• Hardware Platform: RTX 4060 (Laptop) • OS: Windows 11 • DeepStream Version: I couldn’t install yet(I want to install 6.0.1) • DeepStream Install Method: N/A • NVIDIA GPU Driver Version: 536.45 • WSL Version: WSL2 • WSL OS: Ubuntu 20.04.6 LTS • TensorRT Version: Not installed yet. • Requirement details: I want to use deepstream-heartrate-app from deepstream-tao-apps repository in github
Hello,
First of all, this topic is continuation of this topic.
I am trying to compile and run the deepstream-heartrate-app code discussed back in the previous topic on WSL2 with Ubuntu 20.04.6 LTS inside Windows 11. I am currently using a laptop with CUDA 12.2 driver installed. Since, i have written the app for “release/ds6.0.1_tao3.0” branch of the repository, i want to install 6.0.1 version of Deepstream SDK. But, since, CUDA 12.2 installed on my system i couldn’t find anything on if 6.0.1 would work with CUDA 12.2, TensorRT 8.6.1, cuDNN 8.9.5 or if CUDA driver 12.2 and gpu driver 536.45 would work with 6.0.1, TensorRT 8.0.1 and cuDNN 8.2.1. So, could you offer your guidance on how to install which version of tensorRT, cuDNN, CUDA Toolkit and CUBLAS in order to beable to compile and run the deepstream-heartrate-app discussed in the previous topic please?
In the compatibilty matrix i couldn’t see that it mentions 12.2. The latest version the matrix i could see mentioned was 12.1. So, may i ask, is 12.2 also compatible with, what were compatible for 12.1 please?
May i ask you, if in order to make deepstream and deepstream-tao-apps work do i need to strictly conform the cuDNN, CUDA, TensorRT, OS and Deepstream versions in compatibilty matrix please?
If you don’t mind may i ask, if i don’t have to conform the compatibilty matrix, does CUDA 12.2 works with Deepstream 6.0.1 and corresponding OS, cuDNN, gcc and TRT versions please?
Finally, if i have to conform exact versions corresponding to my CUDA version, if you don’t mind may i ask your guidance and assistance on how can i make the heartrate app code i have written for DS6.0.1/TAO3.0 branch of deepstream_tao_apps (which was discussed in this topic) compile and work without any problems for DS6.3/TAO4.0 branch please?
DeepStream 6.0.1 is based on CUDA 10.2. Never support CUDA 12.2
Sure. it is MUST
Never.
If you do not use any DeepStream 6.3 specific APIs, it may work. If there is any specific deprecated or changed API used, please port the code according to the new API
May i ask if installation steps for TensorRT, OpenCV and cuDNN does differ from their respective guides for WSL2 please?
It has come to my attention that, I can’t find the exact versions listed in the compatibilty matrix . For example, let’s look at cuDNN, i can find the 8.8.1 version. But not the exact 8.8.1.3-1 as listed in the matrix. Same goes for TRT 8.5.3.1 version, The version i could find was 8.5.3. Could you clarify if for cuDNN 8.8.1 in fact, corresponds to 8.8.1.3-1 and if for TRT 8.5.3 actually corresponds to 8.5.3.1 version please?
For TRT 8.5.3.1, it has caught my attention that, while in the documentation of TRT only CUDA versions through 10.2 to 11.8 are listed as supported versions of CUDA. But, in the compatibilty matrix TRT 8.5.3.1 listed together with CUDA12.1 for DS 6.3. Could you offer your advice and guidance on which version of TRT i should install please?
In cuDNN 8.8.1 for CUDA 12.x, runtime fusion engines will only work with NVRTC from CUDA Toolkit 12.0 and 12.1. It is not forward compatible with future CUDA 12.x Toolkits.
May i ask you if it would pose me a problem and if it does, may i ask you to clarify, if versions of cuDNN like 8.9.5 would work with DS 6.3 without any issue please?
I have installed 8.8.1 version of cuDNN in accordance with the compatibility table. Then I tried to install TRT 8.5.3 using debian package method explained at Quickstart Guide. But, when i enter the command:
sudo apt-get install tensorrt
I got the following output:
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
tensorrt : Depends: libnvinfer8 (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvinfer-plugin8 (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvparsers8 (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvonnxparsers8 (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvinfer-bin (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvinfer-dev (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvinfer-plugin-dev (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvparsers-dev (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvonnxparsers-dev (= 8.5.3-1+cuda11.8) but it is not going to be installed
Depends: libnvinfer-samples (= 8.5.3-1+cuda11.8) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
Thank you so much for all the help you have offered.
I have installed DS 6.3. But, i have an issue on running the deepstream-app. For which i am going to open another topic and will appreciate your guidance. But, for this issue if you don’t mind i am mark your advice on i should conform the compatibility matrix. You can close this topic if you would like to.