Problem :
- I am unable to get CUDA 12 running successfully on Jetson AGX Orin.
- Device Query :
./deviceQuery Starting...
CUDA Device Query (Runtime API) version (CUDART static linking)
cudaGetDeviceCount returned 35
-> CUDA driver version is insufficient for CUDA runtime version
Result = FAIL
Steps to Reproduce
1. Fresh OS Flash from SDK Manager
2. Verify System Requirements
> lspci | grep -i nvidia
0001:00:00.0 PCI bridge: NVIDIA Corporation Device 229e (rev a1)
> uname -m && cat /etc/*release
aarch64
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=20.04
DISTRIB_CODENAME=focal
DISTRIB_DESCRIPTION="Ubuntu 20.04.5 LTS"
# R35 (release), REVISION: 2.1, GCID: 32413640, BOARD: t186ref, EABI: aarch64, DATE: Tue Jan 24 23:38:33 UTC 2023
NAME="Ubuntu"
VERSION="20.04.5 LTS (Focal Fossa)"
> gcc --version
gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
> sudo apt-get install linux-headers-$(uname -r)
E: Unable to locate package linux-headers-5.10.104-tegra
E: Couldn't find any package by glob 'linux-headers-5.10.104-tegra'
E: Couldn't find any package by regex 'linux-headers-5.10.104-tegra'
> sudo apt install nvidia-l4t-kernel-headers
nvidia-l4t-kernel-headers is already the newest version (5.10.104-tegra-35.2.1-20230124153320).
0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
3. Prepare Ubuntu
> sudo apt-key del 7fa2af80
OK
> wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/arm64/cuda-keyring_1.0-1_all.deb
> sudo dpkg -i cuda-keyring_1.0-1_all.deb
4. Update and Install
> sudo apt-get update
> sudo apt-get install cuda
> sudo reboot
5. Post Install Actions
# .bashrc File
# ------ CUDA -------------
export PATH=/usr/local/cuda-12/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-12/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}
# --- Links each point to cuda-12.0
6. Build Samples
> cd cuda-samples
make
> cd Samples/1.../deviceQuery/
> ./deviceQuery
./deviceQuery Starting...
CUDA Device Query (Runtime API) version (CUDART static linking)
cudaGetDeviceCount returned 35
-> CUDA driver version is insufficient for CUDA runtime version
Result = FAIL
If I point my path and LD_LIBRARY_PATH variables to cuda 11.4 instead of 12.0, everything works fine. If either one, or both, is pointing to cuda 12 I get this error.
Cuda toolkit is installed for both 11.4 and 12.0. Jetpack is installed from apt as of today; version 5.1-b147.