Hi, I am trying to use CUDA and TensorRT inside the docker container with my Jetson Xavier with base image is nvcr.io/nvidia/l4t-tensorrt:r8.4.1-runtime . But it failed to mount Cuda and TensorRT to the container. I figured it out that it is missing files: cuda.csv, cudnn.csv, tensorrt.csv in /etc/nv…

Yep that is correct @magnusm , on JetPack 5 those libraries are installed inside the containers themselves. If you want the CUDA and TensorRT development files/headers too, you can also try the l4t-jetpack container.

I have the exact same issue. I’ve just flashed my Xavier Dev Kit with Jetpack 5.1, and can only see l4t.csv. I’m missing all the nvidia-container-csv-* packages: user@host:~$ dpkg --list | grep nvidia-container- ii libnvidia-container-tools 1.10.0-1 a…

I found the explanation to my problem in this thread: Host libraries for nvidia-container-runtime - #2 by dusty_nv JetPack 5.x, only l4t.csv gets used (because CUDA/cuDNN/TensorRT/ect are installed inside the containers on JetPack 5 for portability). Does that answer your question? This means yo…

Fyi, the l4t-jetpack container has not been released for JP 5.1

Sorry about that, we’re currently working on it - I did try running l4t-jetpack:r35.1.0 on JetPack 5.1 though, and it seemed to work (just some quick/basic checks I did)

No problem, thanks for the info 👍

Missing cuda.csv, cudnn.csv, tensorrt.csv in /etc/nvidia-container-runtime/host-files-for-container.d/

Accelerated Computing NGC GPU Cloud Docker and NVIDIA Docker

longvuonghathe February 3, 2023, 5:18pm 8

Thank you @magnusm and @dusty_nv for your information. I solved my issue by using l4t-jetpack:r35.1.0

Topic		Replies	Views
Nvcr.io/nvidia/l4t-ml:r32.4.3-py3 images NOT have some tensorrt's files Jetson AGX Xavier tensorrt	1	414	November 29, 2022
Nvidia container not mounting tensorRT Jetson TX2 tensorrt , docker	5	1213	December 8, 2022
Cuda directory inside container doesn't contain enough libraries to import torch Jetson AGX Xavier tensorrt , cuda , pytorch	3	859	June 16, 2023
Cuda library is not found in jetson-containers docker Jetson Xavier NX cuda , docker	7	2520	January 11, 2023
Running nvidia/tensorrt on Jetson Jetson TX2 tensorrt	4	1497	February 23, 2022
CUDA - CUDNN - TENSORRT images Jetson TX2 cuda , docker	2	996	October 5, 2021
Deepstream container not mounting necessary packages for tensorrt, cuda, and cudnn DeepStream SDK	11	1253	August 11, 2022
Docker image with python support for OpenCV, TensorRT and PyCuda Jetson TX2	19	9685	March 4, 2021
TensorRT with nvcr.io/nvidia/l4t-base:r32.3.1 docker image Jetson Nano	7	2284	February 28, 2020
Missing libnvdla_compiler.so for trtexec in nvcr.io/nvidia/l4t-tensorrt:r8.4.1-runtime Jetson AGX Orin tensorrt	3	1122	October 18, 2022

Missing cuda.csv, cudnn.csv, tensorrt.csv in /etc/nvidia-container-runtime/host-files-for-container.d/

Related topics