Compatible TensorRT version for DeepStream 6 on Quadro RTX 5000

[srikar]

Hi,
I want to install DeepStream 6 on a Quadro RTX 5000, according to the website, it is mentioned that for DS6.0 we need to install CUDA 11.4.1 and TRT 8.0.1

But in the TensorRT download page TRT 8.0.1 for CUDA 11.4.1 is not available? Am I missing something here? Or any TRT version that is compatible with CUDA 11.4 works?

complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) Quadro RTX 5000
• DeepStream Version 6
• JetPack Version (valid for Jetson only) NA
• TensorRT Version ?
• NVIDIA GPU Driver Version (valid for GPU only) 510.47.03

[Amycao]

Check this, TensorRT 8.0.1 GA based on cuda 11.3

1. Download TensorRT 8.0.1 GA for Ubuntu 18.04 and CUDA 11.3 DEB local repo package from: https://developer.nvidia.com/compute/machine-learning/tensorrt/secure/8.0.1/local_repos/nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626_1-1_amd64.deb

[srikar]

Hi Thanks for the reply.

You mean to say I can use CUDA 11.3 and TensorRT 8.0.1 for DS 6.0?

[Amycao]

Since TensorRT 8.0.1 depends on a few packages of CUDA 11.3, those extra CUDA packages will be automatically installed when TensorRT 8.0.1 is installed.

[srikar]

Hi,
I tried installing the TensorRT 8.0.1 but the required packages weren’t automatically installed.

Should I also install CUDA 11.3 along with 11.4.1?

[Amycao]

No.
Try this,
sudo dpkg --get-selections | grep hold
or
sudo apt-get install -f

[srikar]

Here’s the result from running the commands u suggested.

[Amycao]

sudo apt-get install libnvinfer8=8.0.1-1+cuda11.3 libnvinfer-plugin8=8.0.1-1+cuda11.3 libnvparsers8=8.0.1-1+cuda11.3 libnvonnxparsers8=8.0.1-1+cuda11.3 libnvinfer-bin=8.0.1-1+cuda11.3 libnvinfer-dev=8.0.1-1+cuda11.3 libnvinfer-plugin-dev=8.0.1-1+cuda11.3 libnvparsers-dev=8.0.1-1+cuda11.3 libnvonnxparsers-dev=8.0.1-1+cuda11.3 libnvinfer-samples=8.0.1-1+cuda11.3 libnvinfer-doc=8.0.1-1+cuda11.3

[srikar]

[Amycao]

Please follow the readme:
https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_Quickstart.html#dgpu-setup-for-ubuntu
Part: Install TensorRT 8.0.1