CUDA 12.2 error with Jetpack 5.1.3

Good morning,
following the documentation here

I tried to install CUDA 12.2 on Jetson Orin Nano NX 8Gb with previously installed Jetpack 5.1.3

The steps are the following:

  1. first I removed TensorRT, CUDA, CudNN, DLA packages included in Jetpack 5.1.3 using apt-get remove … After this step I don’t have any cuda reference in /usr/local
  2. Next I install CUDA 12.2 following the instructions here
    CUDA Toolkit 12.2 Update 2 Downloads | NVIDIA Developer
  3. I cloned the repo GitHub - NVIDIA/cuda-samples: Samples for CUDA Developers which demonstrates features in CUDA Toolkit using tag v12.2
    git clone --branch v12.2 GitHub - NVIDIA/cuda-samples: Samples for CUDA Developers which demonstrates features in CUDA Toolkit
  4. I tried to compile the deviceQuery example under Samples/1_Utilities
  5. The application is succesfully compiled ut when I try to run I have the following error.
    ./deviceQuery Starting…

CUDA Device Query (Runtime API) version (CUDART static linking)

cudaGetDeviceCount returned 999
→ unknown error
Result = FAIL

I have the same behaviour also using the example deviceQueryDrv

Any suggestion to understand what is going wrong?

Regards

Hi,

CUDA 12.2 is included in the JetPack 6.0 GA.
You can just upgrade your device with it since it also contains cuDNN and TensorRT support.

For your issue, please run the below command before testing:

$ export LD_LIBRARY_PATH=/usr/local/cuda-12.2/compat

Thanks.

Hi @AastaLLL ,
in Jetpack 6.0 webpage there is the following note
NOTE: APT upgrade from JetPack 5 to JetPack 6 is not supported .

so seems that the only way to upgrade from Jetpack 5.x to 6.0 is reflash the board.

I can’t do this since the hardware is installed to my customer and I can only perform software updates.

Is this correct?

Regards