I read here Quickstart Guide — DeepStream 6.1.1 Release documentation that Deepstream 6.0 requires Cuda 11.4 and TensorRT 8.0.1 .
When downloading TensorRT 8.0.1 from here https://developer.nvidia.com/nvidia-tensorrt-8x-download it looks like it requires Cuda 11.3.
Should I use TensorRT 8.2 (which requires Cuda 11.4) or should I use TensorRT 8.0.1 which however requires Cuda 11.3? I also see a version 8.0.3.
Can’t wait to try Deepstream, thanks!
Check this, for dGPU setup:
Note
Since TensorRT 8.0.1 depends on a few packages of CUDA 11.3, those extra CUDA packages will be automatically installed when TensorRT 8.0.1 is installed.
You should install TensorRT 8.0.1 and cuda 11.4
I am encountering the following error:
ubuntu@ip-172-31-19-97:~/pycharm/setup/deepstream-6.0$ sudo apt-get install tensorrt
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
tensorrt : Depends: libnvinfer8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvinfer-plugin8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvparsers8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvonnxparsers8 (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvinfer-bin (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvinfer-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvinfer-plugin-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvparsers-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvonnxparsers-dev (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvinfer-samples (= 8.0.1-1+cuda11.3) but it is not going to be installed
Depends: libnvinfer-doc (= 8.0.1-1+cuda11.3) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
I followed the guide here: Installation Guide :: NVIDIA Deep Learning TensorRT Documentation
I have been able to install it with the following procedure, but I am not sure why the previous method would not work.
sudo apt install ./nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626_1-1_amd64.deb
sudo apt-key add /var/nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626/7fa2af80.pub
sudo apt update
sudo apt-get install tensorrt
sudo apt-get install python3-libnvinfer-dev
sudo apt-get install uff-converter-tf
sudo apt-get install onnx-graphsurgeon
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin
sudo mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600
sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/7fa2af80.pub
sudo add-apt-repository "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/ /"
sudo apt-get update
cd /var/nv-tensorrt-repo-ubuntu1804-cuda11.3-trt8.0.1.6-ga-20210626
sudo apt install -y ./*8.0.1-1+cuda11.3*.deb
Verify
python3 -c "import tensorrt; print(tensorrt.__version__); assert tensorrt.Builder(tensorrt.Logger())"
dpkg -l | grep TensorRT
I was installing TensorRT using local deb file, probably this can’t be done in this scenario.
Did you completely follow this:
Procedure
-
Download the TensorRT local repo file that matches the Ubuntu version and CPU architecture that you are using.
-
Install TensorRT from the Debian local repo package. Replace ubuntuxx04, cudax.x, trt8.x.x.x and yyyymmdd with your specific OS version, CUDA version, TensorRT version and package date.
os=“ubuntuxx04” tag=“cudax.x-trt8.x.x.x-yyyymmdd”
sudo dpkg -i nv-tensorrt-repo-${os}-${tag}_1-1_amd64.deb
sudo apt-key add /var/nv-tensorrt-repo-${os}-${tag}/7fa2af80.pub
sudo apt-get update
sudo apt-get install tensorrt
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.