How to enable cuda in Jetson Orin NX 16GB Module using docker

I understand there are cuda cores in the module, so cuda would be capable. However I cannot enable cuda using --gpus all option.
The error message says
docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as ‘csv’
invoking the NVIDIA Container Runtime Hook directly (e.g. specifying the docker --gpus flag) is not supported

Always thanks for your support

Hi,

Please launch container with --runtime nvidia instead.
For example:

sudo docker run -it --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/l4t-cuda:11.4.19-runtime

Thanks.

Thank you.
CUDA was not capable because I did not installed that
I thought nvidia-l4t-cuda is enough but it seems not.
Could you tell me which cuda ver is supported by Jetson orin nx?
I’ve seen a thread about Jetson Orin AGX but I think Jetson Orin NX is different one.
Thanks again.

Hi,

JetPack 5 includes CUDA 11.4 and you can install it with apt command directly:

$ sudo apt-get install nvidia-cuda-dev

We also have some newer CUDA libraries that can run on the r35 GPU driver.
These packages can be found in the official CUDA download.
For example:

Thanks.

1 Like

I got unmet dependency error while installing the CUDA packages.
cuda : Depends: cuda-12-2 (>= 12.2.2) but it is not going to be installed
and for cuda-dev
nvidia-cuda-dev : Depends: cuda-11-4 (= 11.4.19-1) but it is not going to be installed

should I try lower version of cuda to install?

Hi,

Could you share the command you use for installation?

It looks like you want to use CUDA 12.
Do you run the command on the website download page?

Thanks.

Yes I followed the instruction of CUDA website download page

Hi,

The default CUDA version in the container is 11.4.
Does it work correctly?

Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.