Unable to use nvidia-docker on Jetson TX2

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
1

Hello,

I’m facing trouble using nvidia-docker on Jetson TX2. In particular, when I run the example I receive the following output:

dp@nvidia-jetson-tx2:~$ sudo docker run --runtime nvidia --network host -it -e DISPLAY=$DISPLAY -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/l4t-base:r32.3.1
Unable to find image 'nvcr.io/nvidia/l4t-base:r32.3.1' locally
r32.3.1: Pulling from nvidia/l4t-base
8aaa03d29a6e: Pull complete 
e73d3a974854: Pull complete 
2c14cdba18f5: Pull complete 
23dd63c7659b: Pull complete 
3bd414bd9504: Pull complete 
cafd526eb263: Pull complete 
483b0873e636: Pull complete 
2568c5428ff2: Pull complete 
6bcd9356d42f: Pull complete 
c7f6d0180a4e: Pull complete 
beddc9b83fb0: Pull complete 
656f2307c79e: Pull complete 
fe2e73a571b7: Pull complete 
f5decba41c07: Pull complete 
f0b6e413c48c: Pull complete 
Digest: sha256:e8987d52ddb9496948e02656fc62d46561abce25bfe83203f4bc24c67e094578
Status: Downloaded newer image for nvcr.io/nvidia/l4t-base:r32.3.1
docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"process_linux.go:432: running prestart hook 0 caused \\\"error running hook: exit status 1, stdout: , stderr: exec command: [/usr/bin/nvidia-container-cli --load-kmods configure --ldconfig=@/sbin/ldconfig.real --device=all --compute --compat32 --graphics --utility --video --display --pid=19059 /var/lib/docker/overlay2/91ff2e1868519c3034feacf27a61ca96c93f7c0356273040febfad9c3c69c284/merged]\\\\nnvidia-container-cli: initialization error: cuda error: unknown error\\\\n\\\"\"": unknown.
ERRO[0083] error waiting for container: context canceled

I have checked the Troubleshooting section, but I seem to have all the necessary libraries installed.

As a side note, the device query example from CUDA also seems to not be working:

dp@nvidia-jetson-tx2:~$ ./deviceQuery 
./deviceQuery Starting...

 CUDA Device Query (Runtime API) version (CUDART static linking)

cudaGetDeviceCount returned 30
-> unknown error
Result = FAIL
3

Hi,

Which JetPack version do you use?
Please use JetPack4.3 for nvcr.io/nvidia/l4t-base:r32.3.1 to ensure compatibility.

Thanks.

4

How do I check which JetPack version I’m running?

5

clone this repository: GitHub - jetsonhacks/jetsonUtilities: Get information about the NVIDIA Jetson OS environment. Lists L4T and JetPack versions, along with major libraries. and run the script for the info.

6

Returns this:

 NVIDIA Jetson TX2
 L4T 32.3.1 [ JetPack 4.3 ]
 Ubuntu 18.04.4 LTS
 Kernel Version: 4.9.140-tegra
 CUDA NOT_INSTALLED

Although it says that CUDA is not installed, sudo dpkg --get-selections | grep nvidia, yeilds:

libnvidia-compute-435:arm64			install
libnvidia-container-tools			install
libnvidia-container0:arm64			install
nvidia-container-csv-cuda			install
nvidia-container-csv-cudnn			deinstall
nvidia-container-csv-tensorrt			deinstall
nvidia-container-csv-visionworks		install
nvidia-container-runtime			install
nvidia-container-toolkit			install
nvidia-docker2					install
nvidia-l4t-3d-core				install
nvidia-l4t-apt-source				install
nvidia-l4t-bootloader				install
nvidia-l4t-camera				install
nvidia-l4t-ccp-t186ref				install
nvidia-l4t-configs				install
nvidia-l4t-core					install
nvidia-l4t-cuda					install
nvidia-l4t-firmware				install
nvidia-l4t-graphics-demos			install
nvidia-l4t-gstreamer				install
nvidia-l4t-init					install
nvidia-l4t-initrd				install
nvidia-l4t-jetson-io				install
nvidia-l4t-kernel				install
nvidia-l4t-kernel-dtbs				install
nvidia-l4t-kernel-headers			install
nvidia-l4t-multimedia				install
nvidia-l4t-multimedia-utils			install
nvidia-l4t-oem-config				install
nvidia-l4t-tools				install
nvidia-l4t-wayland				install
nvidia-l4t-weston				install
nvidia-l4t-x11					install
nvidia-l4t-xusb-firmware			install
7

In particular, I’ve read the code and it looks like it’s referencing folder /usr/local/cuda/, while my CUDA installation appears to be in /usr/local/cuda-10.0/.

8

Hi,

Thanks for the environment information.
We will try to reproduce this and update more information with you later.

Thanks.

9

Hi,

Sorry for keeping you waiting.
Since we have released a newer package, would you mind to try our JetPack4.4 first?

Thanks.

10

Hello,

I’m having issues upgrading, I think everything is fine until I get this:

dpkg: error processing archive /var/cache/apt/archives/nvidia-l4t-cuda_32.4.2-20200408182620_arm64.deb (--unpack):
 trying to overwrite '/usr/lib/aarch64-linux-gnu/libcuda.so', which is also in package libnvidia-compute-435:arm64 435.17.01-0ubuntu1
11

Hi,

You will need to reflash and install the packages all from the JetPack4.4.
Please reflashed the system first.

Thanks.