error on nvidia jetson container

Hi, I downloaded from NVIDIA L4T TensorRT | NVIDIA NGC. I am running it on AGX Xavier.

I can verify CUDA and CUDNN with “nvcc --version” and “dpkg -l | grep cudnn”. However, when I type “python3” and try “import tensorrt”, I have this error:

Traceback (most recent call last):
File “”, line 1, in
File “/usr/local/lib/python3.8/dist-packages/tensorrt/”, line 67, in
from .tensorrt import *
ImportError: cannot open shared object file: No such file or directory

Could you advise? I made no changes to the container at all, shouldn’t it just work? I looked at this, but it doesn’t work for me. because this library does not exist:

Hi @realimposter, is a lower-level driver that gets mounted from the host device. When you started the container, did you run it with --runtime nvidia?

Do you have the file /usr/lib/aarch64-linux-gnu/tegra/ on your system?

Also, which version of JetPack-L4T are you running? If it’s JetPack 5, please try one of the newer l4t-tensorrt container tags.

Hi @dusty_nv

I am using Jetpack 4.6 V1, but do note that I am using a custom AGX Xavier provided by a vendor: MIC-730AI - AI Inference System based on NVIDIA® Jetson AGX Xavier™ - Advantech.

I have checked /usr/lib/aarch64-linux-gnu/tegra/ and I indeed have seen it on my device (outside of the container, in the exact path you have described).

When I run with --runtime nvidia, I see docker: Error response from daemon: Unknown runtime specified nvidia. Any suggestions?

Also, I am not sure if I have the nvidia drivers installed. Is there a way to verify? Like does having mean I have a driver? Or do I have to install from something like Linux-aarch64 (ARM64) Display Driver | 525.53 | Linux aarch64 | NVIDIA

Hi @realimposter, sorry for the delay - you shouldn’t have to manually install other GPU drivers, they come with JetPack-L4T when you flash the device.

It sounds like the nvidia-container-runtime wasn’t installed when you flashed JetPack. Normally this gets installed by SDK Manager tool. You can try installing these packages from apt:

apt-cache search nvidia-container*
libnvidia-container-tools - NVIDIA container runtime library (command-line tools)
libnvidia-container0 - NVIDIA container runtime library
libnvidia-container1 - NVIDIA container runtime library
nvidia-container-csv-cuda - Jetpack CUDA CSV file
nvidia-container-csv-cudnn - Jetpack CUDNN CSV file
nvidia-container-csv-tensorrt - Jetpack TensorRT CSV file
nvidia-container-csv-visionworks - Jetpack VisionWorks CSV file
nvidia-container-runtime - NVIDIA container runtime
nvidia-container-toolkit - NVIDIA container runtime hook
nvidia-container - NVIDIA Container Meta Package