Deepstream 6.4 TensorRT 8.6.1.6 installation

Accelerated Computing Intelligent Video Analytics DeepStream SDK
,
1

Hi,

Having some issues installing deepstream 6.4… please see below. Hope you can assist. Thanks in advance :)

• Hardware Platform / OS: T4 AWS VM Ubuntu 22.04 dGPU
• DeepStream Version : 6.4
• TensorRT Version : 8.6.1.6
• NVIDIA GPU Driver Version (valid for GPU only): 535.104.12
• Issue Type: BUG

• How to reproduce the issue ? :

Follow installation instruction at : Quickstart Guide — DeepStream documentation 6.4 documentation. At the Install TensorRT 8.6.1.6 Step - the following error is displayed.

Note: I Have tried the installation multiple times and have made sure that “deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/” has been added

> The following packages have unmet dependencies:
>  libnvinfer-dev : Depends: libnvinfer-headers-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed
>  libnvinfer-plugin-dev : Depends: libnvinfer-headers-plugin-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed
>  libnvinfer-samples : Depends: libnvinfer-lean-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
>                                libnvinfer-lean-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
>                       Depends: libnvinfer-dispatch-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
>                                libnvinfer-dispatch-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
>                       Depends: libnvinfer-vc-plugin-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
>                                libnvinfer-vc-plugin-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
> E: Unable to correct problems, you have held broken packages.

NVIDIA
NVIDIA1237×725 23.8 KB

2 Likes
3

could you share the results of these command-line?
nvcc -V
dpkg -l |grep TensorRT
dpkg -l|grep cudnn

4

Hi,

Please see below:

ubuntu@ip-10-0-1-169:~$ nvcc -V

nvcc: NVIDIA (R) Cuda compiler driver

Copyright (c) 2005-2021 NVIDIA Corporation

Built on Thu_Nov_18_09:45:30_PST_2021

Cuda compilation tools, release 11.5, V11.5.119

Build cuda_11.5.r11.5/compiler.30672275_0

ubuntu@ip-10-0-1-169:~$ dpkg -l |grep TensorRT

ubuntu@ip-10-0-1-169:~$ dpkg -l|grep cudnn

The last two don’t bring back anything.

Attached is all packages list.

Thanks!

installed_packages.txt (158 KB)

5

the cuda version should be 12.2. please refer to this link.

6

Hi - I did follow those instructions.
Please see the nvidia-smi output screenshot as it does output Cuda 12.2 ( Attached previously)

7

seems you installed multiple cuda, please add cuda12.2 to system path. please make sure “nvcc -V” outputs 12.2.

8

Hello, i have the same problem here. but my nvcc is the 12.2.
Do you have any other suggestion?

9

I had tried to install the previous versions but error still persistent. the version 10 is overwriting.

10
  1. could you try this method?
  2. if still can’t work, please refer to link to uninstall tensorrt first. then reinstall step by step according to the install doc in issue description.
11

Hi @fanzh , Thanks for your help so far. I will only be able to look at the suggestions by the end of the week. Please keep this ticket open and I will revert asap. Thanks!

12

it doesn’t solve the problem. any other suggestion?

13

Hi @fanzh ,

I added cuda 12.2 to the system path as you suggested. nvcc -V does now output Cuda 12.2 but the problem with installing the TensorRT 8.6.1.6 is still the same

Please see below and advice. Thanks.

ubuntu@ip-10-0-1-135:~$ nvidia-smi
Fri Apr  5 08:16:24 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.104.12             Driver Version: 535.104.12   CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  Tesla T4                       Off | 00000000:00:1E.0 Off |                    0 |
| N/A   42C    P0              27W /  70W |      2MiB / 15360MiB |      6%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+
ubuntu@ip-10-0-1-135:~$ sudo apt-get install libnvinfer8=8.6.1.6-1+cuda12.0 libnvinfer-plugin8=8.6.1.6-1+cuda12.0 libnvparsers8=8.6.1.6-1+cuda12.0 \
libnvonnxparsers8=8.6.1.6-1+cuda12.0 libnvinfer-bin=8.6.1.6-1+cuda12.0 libnvinfer-dev=8.6.1.6-1+cuda12.0 \
libnvinfer-plugin-dev=8.6.1.6-1+cuda12.0 libnvparsers-dev=8.6.1.6-1+cuda12.0 libnvonnxparsers-dev=8.6.1.6-1+cuda12.0 \
libnvinfer-samples=8.6.1.6-1+cuda12.0 libcudnn8=8.9.4.25-1+cuda12.2 libcudnn8-dev=8.9.4.25-1+cuda12.2
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 libnvinfer-dev : Depends: libnvinfer-headers-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed
 libnvinfer-plugin-dev : Depends: libnvinfer-headers-plugin-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed
 libnvinfer-samples : Depends: libnvinfer-lean-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
                               libnvinfer-lean-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
                      Depends: libnvinfer-dispatch-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
                               libnvinfer-dispatch-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
                      Depends: libnvinfer-vc-plugin-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
                               libnvinfer-vc-plugin-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
E: Unable to correct problems, you have held broken packages.
ubuntu@ip-10-0-1-135:~$ nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Tue_Aug_15_22:02:13_PDT_2023
Cuda compilation tools, release 12.2, V12.2.140
Build cuda_12.2.r12.2/compiler.33191640_0
ubuntu@ip-10-0-1-135:~$
14

Sorry - I have not tried this approach yet - let me try this first and then revert.

15

Possible solution?

16

this method works. here is my test log 1og-4.7.txt (82.1 KB). that is “installing the dependent libraries before attempting to install the desired library”.
it still can’t work. please share your installing log.

17

Not sure, will check on next clean install. I found that I had to go way more iterations… Anyway, kind of like this way works

18

Worked for me - Thanks. Below is the order in which I ran installations.

apt-get install libnvinfer8=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-plugin8=8.6.1.6-1+cuda12.0
apt-get install libnvparsers8=8.6.1.6-1+cuda12.0
apt-get install libnvonnxparsers8=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-bin=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-headers-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-headers-plugin-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-lean-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-dispatch-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-vc-plugin-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-plugin-dev=8.6.1.6-1+cuda12.0
apt-get install libnvparsers-dev=8.6.1.6-1+cuda12.0
apt-get install libnvonnxparsers-dev=8.6.1.6-1+cuda12.0
apt-get install libnvinfer-samples=8.6.1.6-1+cuda12.0
apt-get install libcudnn8=8.9.4.25-1+cuda12.2
apt-get install libcudnn8-dev=8.9.4.25-1+cuda12.2

3 Likes
19

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.