Hello We want to use Rootless Docker from a security perspective. However, when trying to access the GPU from Rootless Docker, it fails due to an error. [Steps We tried] First, stop the original Docker service sudo systemctl stop docker.socket sudo systemctl stop docker sudo systemctl disable d…

Hi, We follow the steps you shared at the top of the topic. But the nvidia runtime cannot be mounted successfully through this setup. $ docker info Client: Docker Engine - Community Version: 26.1.3 Context: rootless ... Runtimes: io.containerd.runc.v2 runc Default Runtime: runc $ dock…

Hi, Sorry for the late update. Please find below for more info: [image] NvRmMemInitNvmap failed with Permission denied Jetson AGX Orin Hi, Thanks for your patience. Please add below link to enable the authority: usermod -aG sudo,video,i2c "$USER" Thanks. Thanks.

Hello, Thanks for the reply. I added below link and tried again, but same error occurred. usermod -aG sudo,video,i2c “$USER”

Hi, Could you try to build it like below? FROM nvcr.io/nvidia/l4t-jetpack:r35.4.1 ARG USER=customuser RUN useradd --create-home --user-group --groups sudo --shell /bin/bash "$USER" RUN usermod -aG sudo,video,i2c "$USER" Thanks.

Hello, Thanks for the reply. I built docker image from the Dockerfile you told me, but same error occurred.

Hi, We have tested it and it can work correctly. Please try it again. $ curl -fsSL https://get.docker.com/rootless | sh $ sudo usermod -aG docker $USER $ docker run -it --user customuser --rm --net=host --runtime nvidia -e DISPLAY=$DISPLAY -v /tmp/.X11-unix/:/tmp/.X11-unix test $ cd $ /usr/local…

Hello, Thanks for the reply. I’m trying the method you suggested, but it’s not working. Our jetson already has rootless docker installed, so maybe something is configured differently. When you check with the command below, does docker become rootless? $docker info

Is this still an issue to support? Any result can be shared?

Hello, We haven’t been able to solve the problem yet. According to AastaLLL’s answer, it was worked, but it didn’t work when we tried it. I want to use GPU from rootless docker. When AstaLLL’s tried it, could you please confirm whether it was really rootless docker?

Hi, Thanks for your update. We will double-check it again and update it. Thanks.

Use Jetson AGX Orin’s GPU from Rootless Docker

Robotics & Edge Computing Jetson Systems Jetson AGX Orin

AastaLLL April 8, 2024, 5:49am 3

Hi,

Sorry for the late update. Please find below for more info:

Thanks.

Topic		Replies	Views
Accessing the GPU in rootless docker in docker on Jetson Orin Nano Jetson Orin Nano docker	11	696	July 28, 2025
Normal user cannot use cuda device in L4T-36.2 docker Jetson AGX Orin cuda , jetson-inference	10	430	December 12, 2024
"NvRmMemInitNvmap failed with Permission denied" error when running nvidia-docker in rootless mode on Jetson Orin Nano Jetson Orin Nano jetson-inference	31	1183	June 17, 2025
Nvidia runtime fails on Jetpack 6 GA Jetson Orin NX cuda , docker	5	910	July 2, 2024
GPU Access Issue: CUDA Only Runs via Sudo inside Docker Dev Container (Orin NX / JP 6.1) Docker and NVIDIA Docker cuda , custom-robot	0	60	February 19, 2026
L4t-jetpack:r36.3.0 docker image Unable to access GPU Jetson AGX Orin docker , gpu	4	187	January 14, 2025
nvidia-docker seems unable to use GPU as non-root user Jetson TX2	8	9501	October 18, 2021
NVIDIA docker issue with privileged Jetson AGX Orin docker	5	2297	April 29, 2022
JetPack 6.3 containerd and kubernetes Jetson AGX Orin nvbugs , containers	12	1601	August 22, 2024
Failed to run docker container in privileged mode on Jetson AGX Orin Jetson AGX Orin ros , docker	3	1248	July 8, 2022

Use Jetson AGX Orin’s GPU from Rootless Docker

Related topics