What Jetpack version?
head -n 1 /etc/nv_tegra_release
Is nvidia-container-toolkit installed?
sudo apt search nvidia-container-toolkit |grep install
cat /etc/docker/daemon.json
#Does yours have this contents? Format is lost so here’s file.
daemon.json.txt (150 Bytes)
{
“default-runtime”: “nvidia”,
“runtimes”: {
“nvidia”: {
“path”: “nvidia-container-runtime”,
“runtimeArgs”:
}
}
}
What is your command line to start the docker container? You could try this or variations of it.
docker run --rm -it \
–gpus all \
–runtime nvidia \
–ipc=host \
–shm-size=2g \ #or 3g, 4g
–ulimit memlock=-1 --ulimit stack=67108864 \
–env NVIDIA_VISIBLE_DEVICES=all \
–env NVIDIA_DRIVER_CAPABILITIES=compute,utility,video,graphics \
–env TRITONSERVER_LOG_VERBOSE=1 \
nvcr.io/nvidia/deepstream:7.1-triton-multiarch
Following from dusty-nv/jetson-containers/docs/setup.md
"
If you’re building containers or working with large models, it’s advisable to mount SWAP (typically correlated with the amount of memory in the board). Run these commands to disable ZRAM and create a swap file:
sudo systemctl disable nvzramconfig
sudo fallocate -l 16G /mnt/16GB.swap
sudo mkswap /mnt/16GB.swap
sudo swapon /mnt/16GB.swap
Then add the following line to the end of /etc/fstab to make the change persistent:
/mnt/16GB.swap none swap sw 0 0
If you have NVME storage available, it’s preferred to allocate the swap file on NVME.
#Disabling the Desktop GUI
If you’re running low on memory, you may want to try disabling the Ubuntu desktop GUI. This will free up extra memory that the window manager and desktop uses (around ~800MB for Unity/GNOME or ~250MB for LXDE)
You can disable the desktop temporarily, run commands in the console, and then re-start the desktop when desired:
$ sudo init 3 # stop the desktop
# log your user back into the console (Ctrl+Alt+F1, F2, ect)
$ sudo init 5 # restart the desktop
If you wish to make this persistent across reboots, you can use the follow commands to change the boot-up behavior:
sudo systemctl set-default multi-user.target # disable desktop on boot
sudo systemctl set-default graphical.target # enable desktop on boot
"