Jetson with Docker

Robotics & Edge Computing Jetson & Embedded Systems Jetson Nano
,
1

Hi,

I would like to know how to use docker with Jetson devices. I have two jetson which are nano and xavier nx. I normally use Anaconda software and install python packages in virtual env. But I think it is better to use docker image.

Normally, Jetson come with Cuda package install only, if my remember is correct. So need to find suitable CuDnn and other Nvidia and Python package then install those into Jetson. So It need to find suitable compatibility version. So, I think, using Docker image better option.

I have basic questions regrading this,

  1. Can I use docker image directly when have Jetson OS image and Docker installed environment? Or Do I need to install some other packages like CuDnn or something?
  2. When use Docker, Can I access both GPU and CPU because some python package use CPU and other use GPU?
  3. is Nvidia have single Docker image with all python packages like Pytouch, Tensorflow, Keras, OpenCV, Panda and so on?
  4. Other than adding volume and GPU CLI parameters, what other parameters need to add when run Docker image?

Thank you for supporting me.

3

Hi,

1.
Jetson Nano need JetPack 4 and Xavier NX can use JetPack 4 & 5.
The behavior of JetPack 4 and JetPack 5 are different.

In JetPack 4, the libraries are mounted from the Jetson device.
So you need to install libraries on Jetson itself.

But in JetPack 5, we include the libraries into the container directly.

2. Yes, GPU access requires nvidia-container-toolkit.

3. Yes, for example l4t-ml:r35.3.1-py3 for JetPack 5.1.1 contains:

  • TensorFlow 2.11.0
  • PyTorch v2.0.0
  • torchvision v0.15.1
  • torchaudio v2.0.1
  • onnx 1.13.1
  • onnxruntime 1.16.0
  • optimum 1.8.8
  • CuPy 13.0.0
  • numpy 1.23.5
  • numba 0.56.4
  • PyCUDA 2022.2
  • OpenCV 4.5.0 (with CUDA)
  • pandas 2.0.1
  • scipy 1.10.0
  • scikit-learn 1.2.2
  • diffusers 0.17.1
  • transformers 4.30.2
  • xformers 0.0.20
  • JupyterLab 3.6.3

More containers can be found in Data Science, Machine Learning, AI, HPC Containers | NVIDIA NGC

4. Please find the readme file of each container for the details.

Thanks.

4

To clarify that container directly means Docker container or directory come with JetPack 5?

Thank you for the information.

6

Hi,

It means the docker container.

Jetson’s container can be found in our NGC page below:

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.