Please provide the following info (tick the boxes after creating this topic): Software Version DRIVE OS 6.0.6 DRIVE OS 6.0.5 DRIVE OS 6.0.4 (rev. 1) DRIVE OS 6.0.4 SDK other Target Operating System Linux QNX other Hardware Platform DRIVE AGX Orin Developer Kit (940-63710-0010-30…

[image] servanti: I am not able to find a compatible TensorRT installer , I suppose I can use the debs from Jetpack where I install on Jetson Orin. Will that work? Dear @servanti , No. You can copy required headers/samples from host.

Dear @servanti , Yes. Sdkmanager installs CUDA, cudnn, TRT on target.

Dear SivaRamaKrishnaNV So is it normal that CUDA-X AI is not listed as one of the target components in the sdkmanager? The libs (.so) are installed but no headers are installed on the target. I did a find and it did not find anything. Do we need to copy the headers from the host system? which is …

Dear @servanti , The TRT samples are not part of target file system. We recommend to cross compile the samples on host/docker and run on target. Please check Build and Run Sample Applications for DRIVE OS 6.x Linux | NVIDIA Docs

Dear SivaRamaKrishnaNV It is not just the samples, we build opencv, torch etc cuda , cudnn support since sometimes it is difficult to find pre built packages with the compatible versions of cuda. We do this on Jetson Orin all the time, I suppose I can just install those wheels and debs to avoid c…

Dear SivaRamaKrishnaNV Will it be possible to install cudnn-local-repo-ubuntu2004-8.6.0.163_1.0-1_arm64.deb On the Orin Drive to get full cuDNN development , but still I am not able to find a compatible TensorRT installer , I suppose I can use the debs from Jetpack where I install on Jetson Orin. …

Dear SivaRamaKrishnaNV Thank you for the reply, I managed to get Pytorch and OpenCV directly compiled on the target after copying the appropriate headers/libs from host. Python and tensroRT was a different story. There was no tensorrt.so in the dist package folder of python3.8 and I can not copy …

Dear [image] SivaRamaKrishnaNV I could not find aarch64 tensorrt.so for python so I just figured I’ll try the one on my Jetson Orin. So far it works, if there is an “official” way to get that lib I’d be happy to try it, Now as far as compiling cuDNN and TensorRT code on the target. These are the st…

cuDNN & TensorRT on SDK 6.0.6

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General

SivaRamaKrishnaNV September 6, 2023, 12:59pm 11

Dear @servanti,
Thank you sharing your experience.
But you may encounter few issues if you use libs from Jetson release.
Could you share the steps you used to compile PyTorch/OpenCV on target to help others in community?

Topic		Replies	Views
Tensorrt and cudnn on drive os 6.0.8 DRIVE AGX Orin General cudnn , driveos-dl	15	558	July 24, 2024
Unable to run tensorRT on DRIVE OS 6.0 DRIVE AGX Orin General driveos-dl	5	306	May 14, 2025
No cudnn.h on DRIVE OS 6.0.5 DRIVE AGX Orin General driveos-dl	2	1121	December 6, 2022
Tensorrt in Drive Orin AGX DRIVE AGX Orin General driveos-dl	4	713	February 22, 2024
CUDA Libraries on Host Device & Drive AGX Orin DRIVE AGX Orin General driveos-dl	1	774	November 13, 2023
Cmake unable to detect tensorrt libraries on Drive AGX Orin DRIVE AGX Orin General driveos-dl	6	627	April 10, 2024
Tensorrt include and lib folder on Drive Orin DRIVE AGX Orin General driveos-dl	2	787	February 9, 2024
Error installing TensorRT Cross-Compile for Linux DRIVE AGX Xavier General drive-platform-setup	25	3346	November 4, 2021
Error in executing TensorRT samples through docker container environment DRIVE AGX Orin General docker , driveos-dl	14	502	October 24, 2024
Running TensorRT inference in docker container on Drive Orin AGX DRIVE AGX Orin General driveos-dl	17	2454	August 10, 2023

cuDNN & TensorRT on SDK 6.0.6

Related topics