L4t-base:r35.1.0 cannot find /usr/local/cuda directory

I just installed jetpack 5.0.2 - L4T 35.1.0 for my AGX Orin. And I make sure that I install Nvidia container runtime when flashing OS to AGX.
I also add config to /etc/docker/daemon.json as below:

{
    "runtimes": {
        "nvidia": {
            "path": "/usr/bin/nvidia-container-runtime",
            "runtimeArgs": []
         } 
    },
    "default-runtime": "nvidia",
    "storage-driver": "overlay2"
}
  • But now I am encountering an issue with Nvidia’s docker images. When I run nvcr.io/nvidia/l4t-base:r35.1.0 image, there is no /usr/local/cuda directory existing. But I run with nvcr.io/nvidia/l4t-base:r32.6.1 image, there is cuda-10.2 version exists. l4t-base:r35.1.0 seem quite new so I have encountered that, there is any solution for this issue, or there is any stable image with Cuda 11 exist?
AGX Orin:Software ➜ docker run -it --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/l4t-base:r35.1.0
root@agxorin:/# ll /usr/local/
total 44
drwxr-xr-x 1 root root 4096 May 31 15:55 ./
drwxr-xr-x 1 root root 4096 Jul 20 11:03 ../
drwxr-xr-x 2 root root 4096 May 31 15:55 bin/
drwxr-xr-x 2 root root 4096 May 31 15:55 etc/
drwxr-xr-x 2 root root 4096 May 31 15:55 games/
drwxr-xr-x 2 root root 4096 May 31 15:55 include/
drwxr-xr-x 1 root root 4096 Jul 20 11:01 lib/
lrwxrwxrwx 1 root root    9 May 31 15:55 man -> share/man/
drwxr-xr-x 2 root root 4096 May 31 16:12 sbin/
drwxr-xr-x 1 root root 4096 Jul 20 11:15 share/
drwxr-xr-x 2 root root 4096 May 31 15:55 src/
AGX Orin:Software ➜ docker run -it --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/l4t-base:r32.6.1
root@agxorin:/# ll /usr/local/
total 48
drwxr-xr-x 1 root root 4096 Jul 23  2021 ./
drwxr-xr-x 1 root root 4096 Jul  2  2021 ../
drwxr-xr-x 2 root root 4096 Jul  2  2021 bin/
lrwxrwxrwx 1 root root   20 Jul 23  2021 cuda -> /usr/local/cuda-10.2/
drwxr-xr-x 1 root root 4096 Jul 23  2021 cuda-10.2/
drwxr-xr-x 2 root root 4096 Jul  2  2021 etc/
drwxr-xr-x 2 root root 4096 Jul  2  2021 games/
drwxr-xr-x 2 root root 4096 Jul  2  2021 include/
drwxr-xr-x 1 root root 4096 Jul 23  2021 lib/
lrwxrwxrwx 1 root root    9 Jul  2  2021 man -> share/man/
drwxr-xr-x 2 root root 4096 Jul  2  2021 sbin/
drwxr-xr-x 1 root root 4096 Jul 23  2021 share/
drwxr-xr-x 2 root root 4096 Jul  2  2021 src/

I believe the jetpack is 5.0.2 (not 5.0.1)

1 Like

@kayccc @Trumany any thoughts on this issue?

Hi,

Please use our l4t-cuda container instead:

For r32, our container mounts libraries from the Jetson.
But from r35, we include the libraries directly into the container.

l4t-base is a pure BSP container. There are other containers with CUDA/TensorRT/PyTorch/… preinstalled.
Please find one based on your use case:

Thanks.

1 Like

Out of curiosity, was this changed to improve performance or convenience (or other )?

Hi,

It allows users to use these containers more containerized.

Thanks.