Can i use GPU resources in the docker container?

[JaeJ]

Please provide the following info (check/uncheck the boxes after creating this topic):
Software Version
[O] DRIVE OS Linux 5.2.6
DRIVE OS Linux 5.2.6 and DriveWorks 4.0
DRIVE OS Linux 5.2.0
DRIVE OS Linux 5.2.0 and DriveWorks 3.5
NVIDIA DRIVE™ Software 10.0 (Linux)
NVIDIA DRIVE™ Software 9.0 (Linux)
other DRIVE OS version
other

Target Operating System
[O] Linux
QNX
other

Hardware Platform
NVIDIA DRIVE™ AGX Xavier DevKit (E3550)
[O] NVIDIA DRIVE™ AGX Pegasus DevKit (E3550)
other

SDK Manager Version
1.9.1.10844
[O] other

Host Machine Version
[O] native Ubuntu 18.04
other

I wanna use GPU resources directly in the docker container.

docker run -it --rm -runtime nvidia -gpus all repo:tag

However, NVIDIA DRIVE AGX system cannot use GPU resources in the docker container.
(I’ve already installed docker for Ubuntu 18.04 version)

Also, Installing docker container toolkits i cannot install docker-container-toolkits on the target system.

I’ve recently found Running Docker Containers Directly on NVIDIA DRIVE AGX Orin
NVIDIA DRIVE ORIN can use GPU resources directly in the docker container like above command.

Does anyone knows how to use GPU resources in the docker container on NVIDIA DRIVE AGX Pegasus system?

Best regards!

[VickNV]

As discussed in DRIVE OS and support for the Nvidia Container Toolkit, it is not supported on Xavier.

[JaeJ]

Then how do i use GPU resources directly at the docker container?

[VickNV]

It’s only supported on DRIVE AGX Orin.

[JaeJ]

I have a YOLO PyTorch model.
Basically, it was written as Python script.
To implement this YOLO on the DRIVE Xavier, Should i convert it to CUDA C++ and compile to use GPU computation?

[VickNV]

It would be best to create a new topic to discuss this separate query and help us keep track of each issue more effectively

[JaeJ]

I see Thanks!