Missing CUDA Math Libraries (cuBLAS/cuDNN/TensorRT) for DRIVE OS 7.0.3 on ORIN — Only Thor Packages Available

Autonomous Vehicles DRIVE AGX Orin DRIVE AGX Orin General
1

We are working with DRIVE OS 7.0.3 on DRIVE AGX ORIN hardware.
The documentation indicates that DRIVE OS 7.0.3 supports both Thor and Orin platforms.

Our issue:

✓ We flashed Drive AGX Orin with Drive Os 7.0.3

✓ The CUDA headers and tools for DRIVE OS 7.0.3 are present under:

/usr/local/cuda-12.8/targets/aarch64-linux/

(no /thor/ folder)

✗ But the CUDA math libraries (cuBLAS, cuDNN, TensorRT) are not present for Orin.

However, when installing additional packages described in:

“Downloading and Copying Additional DriveOS Packages”

…the only CUDA/CuDNN/TensorRT .deb packages available are Thor-only, for example:

driveos-cuda-thor-nsr-tegra-repo-ubuntu2404-12-8-local_12.8.11-1_arm64.deb

Installing the .deb files on ORIN provides Thor’s CUDA 12.8 libraries, including cuBLAS and cuDNN, under:

/usr/local/cuda-12.8/thor/targets/aarch64-linux/lib/

and they will not work on Orin (as i suppose it should be)

Questions :

  1. Where can we obtain the correct cuBLAS/cuDNN/TensorRT libraries for ORIN under DRIVE OS 7.0.3?
    Are they available separately (similar to Thor packages), or are they expected to be provided through the flashing image or are we missing something?

  2. Does DRIVE OS 7.0.3 officially include a CUDA toolkit for ORIN with math libraries, or is CUDA 12.8 supported on ORIN only through the Thor packages?

  3. If CUDA math libs for Orin are not available under 7.0.3, what is the correct supported configuration for CUDA/TensorRT inference on Orin with DOS 7.0.3?

  4. Is there a recommended way to integrate the CUDA/cuDNN/TensorRT math libraries into DriveOS 7.0.3 rootfs for Orin targets?
    The documentation mentions Yocto recipes for Thor, but it is unclear how this applies to Orin.

Thank you!

3

Dear @silvia.truica1 ,
The DRIVE OS 7.0.3 DevZone release is for DRIVE AGX Thor platform.

4

So there is another Drive OS 7.0.3 release non_DevZone, target specific that supports also Orin platforms?
Because the documentation states that both Orin and Thor are supported in https://developer.nvidia.com/docs/drive/drive-os/7.0.3/public/NVIDIA_DriveOS_7.0.3_Migration_Guide.pdf

For that release we need to contact the Nvidia representative?

Thanks!

5

Dear @silvia.truica1 ,
Please reach out to your Nvidia representative to evaluate request for DRIVE OS 7.x release for orin. DRIVE OS 6.0.10 is the last orin release on Devzone.