# EGX - \`nvidia\` docker runtime on Nano **URL:** \ **Category:** Jetson Nano\ **Created:** [May 28, 2019, 5:45pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512 "2019-05-28T17:45:55Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![mdegans](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mdegans/32/13104_2.png) [@mdegans](https://forums.developer.nvidia.com/u/mdegans)\ **Post date:** [May 28, 2019, 5:45pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/1 "2019-05-28T17:45:55Z")
> **[The EGX Platform](https://www.nvidia.com/en-us/data-center/products/egx/)** > > The power of accelerated computing from data center to the edge. > [@marketing droid](#): > > EGX starts with the tiny NVIDIA® Jetson Nano™ > > … > > NVIDIA Edge Stack is an optimized software stack that includes NVIDIA drivers, a CUDA® Kubernetes plug-in, a **CUDA Docker container runtime** This was announced yesterday. Bolded is the particular pony I have been wishing for. Is there a beta image or apt package available for the nvidia docker runtime on Nano? ---
**Author:** ![kayccc](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/kayccc/32/14043_2.png) [@kayccc](https://forums.developer.nvidia.com/u/kayccc)\ **Post date:** [May 29, 2019, 1:30am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/2 "2019-05-29T01:30:27Z")
Hi mdegans, it’s coming, and stay tuned to our announcements in the coming month. In the meantime, there are existing recipes for running GPU-accelerated workloads within standard Docker containers—it is a bit of additional work, but you can get started today using one of the community-supplied recipes such as this one: [url][https://blog.hypriot.com/post/nvidia-jetson-nano-intro/[/url]](https://blog.hypriot.com/post/nvidia-jetson-nano-intro/%5B/url%5D) Thanks ---
**Author:** ![mdegans](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mdegans/32/13104_2.png) [@mdegans](https://forums.developer.nvidia.com/u/mdegans)\ **Post date:** [May 29, 2019, 3:03am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/3 "2019-05-29T03:03:52Z")
Thanks for the timeline! I will wait for EGX and prototype any containers on x86 while I wait. ---
**Author:** ![prlawrence](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/prlawrence/32/14043_2.png) [@prlawrence](https://forums.developer.nvidia.com/u/prlawrence)\ **Post date:** [May 29, 2019, 9:41pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/4 "2019-05-29T21:41:09Z")
mdegans, nvidia-docker will be included with JetPack 4.2.1, to be released first week of July. :- ) ---
**Author:** ![mdegans](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mdegans/32/13104_2.png) [@mdegans](https://forums.developer.nvidia.com/u/mdegans)\ **Post date:** [May 29, 2019, 10:05pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/5 "2019-05-29T22:05:25Z")
> [@prlawrence](#): > > mdegans, > nvidia-docker will be included with JetPack 4.2.1, to be released first week of July. :- ) Thank you for the update! I appreciate it. ---
**Author:** ![tibo.durand](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/tibo.durand/32/15577_2.png) [@tibo.durand](https://forums.developer.nvidia.com/u/tibo.durand)\ **Post date:** [June 6, 2019, 5:46pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/6 "2019-06-06T17:46:37Z")
Awesome ! If you want some beta test for JetPack 4.2.1 , I’m available ;-) ---
**Author:** ![HelmutHofferVonAnkershoff](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@HelmutHofferVonAnkershoff](https://forums.developer.nvidia.com/u/HelmutHofferVonAnkershoff)\ **Post date:** [July 5, 2019, 11:19am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/7 "2019-07-05T11:19:49Z")
> [@](#): > > > [@prlawrence](#): > > > > mdegans, > > nvidia-docker will be included with JetPack 4.2.1, to be released first week of July. :- ) > > Thank you for the update! I appreciate it. Will Jetpack 4.2.1 arrive today as planned? ---
**Author:** ![snarky](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/snarky/32/10446_2.png) [@snarky](https://forums.developer.nvidia.com/u/snarky)\ **Post date:** [July 5, 2019, 5:25pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/8 "2019-07-05T17:25:30Z")
Earlier this week I saw them say “next week” in another post. Note that yesterday was a major holiday in the US, and today a lot of people are taking the day off to make it a four-day holiday. ---
**Author:** ![mdegans](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mdegans/32/13104_2.png) [@mdegans](https://forums.developer.nvidia.com/u/mdegans)\ **Post date:** [July 5, 2019, 5:32pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/9 "2019-07-05T17:32:10Z")
Guessing last minute commits break everything. It happened to my spouse right before the 4th. He was stuck on his laptop half the day as a result. I’m fine with the delay for 4.2.1 personally. Stuff happens, and I would rather it be stable. ---
**Author:** ![Rusli](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rusli/32/17247_2.png) [@Rusli](https://forums.developer.nvidia.com/u/Rusli)\ **Post date:** [July 11, 2019, 2:21pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/10 "2019-07-11T14:21:41Z")
I also want JetPack 4.2.1. Please :) ---
**Author:** ![HelmutHofferVonAnkershoff](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@HelmutHofferVonAnkershoff](https://forums.developer.nvidia.com/u/HelmutHofferVonAnkershoff)\ **Post date:** [July 11, 2019, 9:09pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/11 "2019-07-11T21:09:59Z")
@prlawrence: Any update on the release date? P.S.: While waiting for the Nvidia Docker runtime I automated provisioning Jetson devices to join Kubernetes clusters including automatically building a fitting kernel for weave networking and using the mount /dev/nv\* approach to support cuda - see [https://github.com/helmuthva/jetson](https://github.com/helmuthva/jetson) ---
**Author:** ![prlawrence](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/prlawrence/32/14043_2.png) [@prlawrence](https://forums.developer.nvidia.com/u/prlawrence)\ **Post date:** [July 12, 2019, 8:19pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/12 "2019-07-12T20:19:38Z")
> [@mdegans](#): > > …I’m fine with the delay for 4.2.1 personally. Stuff happens, and I would rather it be stable. > [@zaripov.r.z](#): > > I also want JetPack 4.2.1. Please :) > [@helmuthva](#): > > @prlawrence: Any update on the release date? We are fixing a couple last bugs, so as you can tell the schedule has unfortunately slipped. We’ll update again when the release is finalized – JetPack 4.2.1 has lots of great updates and we look forward to sharing it. [https://devtalk.nvidia.com/default/topic/1055628/jetson-nano/new-jetson-software-modules-and-pricing/post/5360588/#5360588](https://devtalk.nvidia.com/default/topic/1055628/jetson-nano/new-jetson-software-modules-and-pricing/post/5360588/#5360588) > [@helmuthva](#): > > P.S.: While waiting for the Nvidia Docker runtime I automated provisioning Jetson devices to join Kubernetes clusters including automatically building a fitting kernel for weave networking and using the mount /dev/nv\* approach to support cuda - see [GitHub - helmut-hoffer-von-ankershoffen/jetson: Helmut Hoffer von Ankershoffen experimenting with arm64 based NVIDIA Jetson (Nano and AGX Xavier) edge devices running Kubernetes (K8s) for machine learning (ML) including Jupyter Notebooks, TensorFlow Training and TensorFlow Serving using CUDA for smart IoT. · GitHub](https://github.com/helmuthva/jetson) Nice! I’m sure many others will want to try something like this, thanks for taking the time to document your work. :- ) ---
**Author:** ![HelmutHofferVonAnkershoff](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@HelmutHofferVonAnkershoff](https://forums.developer.nvidia.com/u/HelmutHofferVonAnkershoff)\ **Post date:** [July 14, 2019, 7:43am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/13 "2019-07-14T07:43:40Z")
@prlawrence: By now [https://github.com/helmuthva/jetson](https://github.com/helmuthva/jetson) contains a kubernetes deployment of a Jupyter server supporting CUDA accelerated Tensorflow running on Jetson nodes (such as Nanos and Xaviers). To achieve this the container has to mount closed source libraries such as cudnn from the Jetson host, see [https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/kustomize/base/deployments.yaml](https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/kustomize/base/deployments.yaml) and [https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/src/Dockerfile](https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/src/Dockerfile) Question: Is this the assumed way or will base images containing the cuda and cudnn libraries be provided as part of the Nvidia Docker runtime in Jetpack 4.2.1? P.S.: For the ones interested in getting Anaconda running on Jetson - it’s part of the deployment, see the Dockerfile. ---
**Author:** ![prlawrence](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/prlawrence/32/14043_2.png) [@prlawrence](https://forums.developer.nvidia.com/u/prlawrence)\ **Post date:** [July 17, 2019, 12:46am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/14 "2019-07-17T00:46:04Z")
> [@HelmutHofferVonAnkershoffen](#): > > … > To achieve this the container has to mount closed source libraries such as cudnn from the Jetson host, see [https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/kustomize/base/deployments.yaml](https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/kustomize/base/deployments.yaml) and [https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/src/Dockerfile](https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/src/Dockerfile) > > Question: Is this the assumed way or will base images containing the cuda and cudnn libraries be provided as part of the Nvidia Docker runtime in Jetpack 4.2.1? The “l4t-base” image will be very slim – libraries will be mounted from the host to the container. See: [https://github.com/NVIDIA/nvidia-docker/wiki/NVIDIA-Container-Runtime-on-Jetson#mount-plugins](https://github.com/NVIDIA/nvidia-docker/wiki/NVIDIA-Container-Runtime-on-Jetson#mount-plugins) ---
**Author:** ![mdegans](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mdegans/32/13104_2.png) [@mdegans](https://forums.developer.nvidia.com/u/mdegans)\ **Post date:** [July 17, 2019, 1:30am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/15 "2019-07-17T01:30:47Z")
> [@prlawrence](#): > > > [@HelmutHofferVonAnkershoffen](#): > > > > … > > To achieve this the container has to mount closed source libraries such as cudnn from the Jetson host, see [https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/kustomize/base/deployments.yaml](https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/kustomize/base/deployments.yaml) and [https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/src/Dockerfile](https://github.com/helmuthva/jetson/blob/master/workflow/deploy/jupyter/src/Dockerfile) > > > > Question: Is this the assumed way or will base images containing the cuda and cudnn libraries be provided as part of the Nvidia Docker runtime in Jetpack 4.2.1? > > The “l4t-base” image will be very slim – libraries will be mounted from the host to the container. See: > [https://github.com/NVIDIA/nvidia-docker/wiki/NVIDIA-Container-Runtime-on-Jetson#mount-plugins](https://github.com/NVIDIA/nvidia-docker/wiki/NVIDIA-Container-Runtime-on-Jetson#mount-plugins) ```auto -v /usr/local/cuda:/usr/local/cuda ``` ~~Is there a reason~~ this isn’t this included in the image? I really don’t like to bind mount, in part because of container escapes, and in part becuase i’ve had issues using it with swarm. Edit: Apparently there is a reason given in the link: image size, and the problem is being worked on Edit, also: > [@](#): > > The NVIDIA software stack, so that it can ultimately run GPU code, talks to the NVIDIA driver through a number of userland libraries (e.g: libcuda.so). Because the driver API is not stable, these libraries are shipped and installed by the NVIDIA driver. > > In effect, what that means is that having a container which contains these libraries, ties it to the driver version it was built and ran against. Therefore moving that container to another machine becomes impossible. The approach we decided to take is to mount, at runtime, these libraries from your host filesystem into your container. Other than that, thank you for the beta. Very cool! ---
**Author:** ![HelmutHofferVonAnkershoff](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@HelmutHofferVonAnkershoff](https://forums.developer.nvidia.com/u/HelmutHofferVonAnkershoff)\ **Post date:** [July 18, 2019, 7:27am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/16 "2019-07-18T07:27:14Z")
@prlawrence, @mdegans - sounds promising, thx for the input. Btw: The page referenced by you contains typos/inconsistencies and i guess the “l4t-base” image is not yet published, see [NVIDIA Container Runtime on Jetson / Typos · Issue #1013 · NVIDIA/nvidia-docker · GitHub](https://github.com/NVIDIA/nvidia-docker/issues/1013) ? ---
**Author:** ![ralf\_s](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@ralf\_s](https://forums.developer.nvidia.com/u/ralf_s)\ **Post date:** [July 22, 2019, 11:52am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/17 "2019-07-22T11:52:15Z")
I’m happy to report that GPU accelerated Docker works fine on my Nano running Jetpack 4.2.1. As Helmut mentioned, there’s an issue with pulling the image from the Nvidia cloud, so I created my own images. If you’re interested, see here: [https://github.com/jetsistant/docker-cuda-jetpack](https://github.com/jetsistant/docker-cuda-jetpack). I tried almost all CUDA samples in the devel container, they are all running flawlessly. Thanks for this great release! ---
**Author:** ![HelmutHofferVonAnkershoff](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@HelmutHofferVonAnkershoff](https://forums.developer.nvidia.com/u/HelmutHofferVonAnkershoff)\ **Post date:** [July 23, 2019, 10:13am UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/18 "2019-07-23T10:13:47Z")
The [nvcr.io/nvidia/l4t-base:r32.1](http://nvcr.io/nvidia/l4t-base:r32.1) image was published, see [NVIDIA L4T Base | NVIDIA NGC](https://ngc.nvidia.com/catalog/containers/nvidia:l4t-base) :-) ---
**Author:** ![HelmutHofferVonAnkershoff](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@HelmutHofferVonAnkershoff](https://forums.developer.nvidia.com/u/HelmutHofferVonAnkershoff)\ **Post date:** [July 23, 2019, 12:08pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/19 "2019-07-23T12:08:39Z")
For the ones interested in running Jetson edge devices as part of a larger multi-platform Kubernetes cluster: I’m happy to report that JetPack 4.2.1 works with Kubernetes + Weave Networking just fine after minor tweaks. Thank you NVIDIA for this wonderful release :-) Have a look at [jetson/.config at master · helmut-hoffer-von-ankershoffen/jetson · GitHub](https://github.com/helmuthva/jetson/blob/master/workflow/provision/roles/kernel/files/.config) for the necessary kernel configuration - or [https://github.com/helmuthva/jetson](https://github.com/helmuthva/jetson) for the bigger picture. ---
**Author:** ![nadeemm](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/nadeemm/32/367020_2.png) [@nadeemm](https://forums.developer.nvidia.com/u/nadeemm)\ **Post date:** [October 18, 2021, 5:44pm UTC](https://forums.developer.nvidia.com/t/egx-nvidia-docker-runtime-on-nano/75512/20 "2021-10-18T17:44:45Z")
Closed on October 18, 2021, 5:44pm UTC