Deepstream 6.0 what TensorRT version to be use

I read here Quickstart Guide — DeepStream 6.1.1 Release documentation that Deepstream 6.0 requires Cuda 11.4 and TensorRT 8.0.1 .
When downloading TensorRT 8.0.1 from here https://developer.nvidia.com/nvidia-tensorrt-8x-download it looks like it requires Cuda 11.3.
Should I use TensorRT 8.2 (which requires Cuda 11.4) or should I use TensorRT 8.0.1 which however requires Cuda 11.3? I also see a version 8.0.3.
Can’t wait to try Deepstream, thanks!

Check this, for dGPU setup:

Note

Since TensorRT 8.0.1 depends on a few packages of CUDA 11.3, those extra CUDA packages will be automatically installed when TensorRT 8.0.1 is installed.

You should install TensorRT 8.0.1 and cuda 11.4

I am encountering the following error:

ubuntu@ip-172-31-19-97:~/pycharm/setup/deepstream-6.0$ sudo apt-get install tensorrt
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 tensorrt : Depends: libnvinfer8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvinfer-plugin8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvparsers8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvonnxparsers8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvinfer-bin (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvinfer-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvinfer-plugin-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvparsers-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvonnxparsers-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvinfer-samples (= 8.0.1-1+cuda11.3) but it is not going to be installed
            Depends: libnvinfer-doc (= 8.0.1-1+cuda11.3) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

I followed the guide here: Installation Guide :: NVIDIA Deep Learning TensorRT Documentation

I have been able to install it with the following procedure, but I am not sure why the previous method would not work.

sudo apt install ./nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626_1-1_amd64.deb
sudo apt-key add /var/nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626/7fa2af80.pub
sudo apt update

sudo apt-get install tensorrt
sudo apt-get install python3-libnvinfer-dev
sudo apt-get install uff-converter-tf
sudo apt-get install onnx-graphsurgeon

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin
sudo mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600
sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/7fa2af80.pub
sudo add-apt-repository "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/ /"
sudo apt-get update

cd /var/nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626
sudo apt install -y ./*8.0.1-1+cuda11.3*.deb

Verify

python3 -c "import tensorrt; print(tensorrt.__version__); assert tensorrt.Builder(tensorrt.Logger())"
dpkg -l | grep TensorRT

I was installing TensorRT using local deb file, probably this can’t be done in this scenario.

Did you completely follow this:

Procedure

  1. Download the TensorRT local repo file that matches the Ubuntu version and CPU architecture that you are using.

  2. Install TensorRT from the Debian local repo package. Replace ubuntuxx04, cudax.x, trt8.x.x.x and yyyymmdd with your specific OS version, CUDA version, TensorRT version and package date.

    os=“ubuntuxx04” tag=“cudax.x-trt8.x.x.x-yyyymmdd”
    sudo dpkg -i nv-tensorrt-repo-${os}-${tag}_1-1_amd64.deb
    sudo apt-key add /var/nv-tensorrt-repo-${os}-${tag}/7fa2af80.pub
    sudo apt-get update
    sudo apt-get install tensorrt

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.