Virtualization on the Jetson Thor

Robotics & Edge Computing Jetson Systems Jetson Thor
, ,
1

Hello,

We are currently developing a thor based system for a payload data processing computer. Our goal is to deploy multiple workloads (small models for inference, compression algorithms, …) from different entities at the same time in a virtualized environment.

One of the major concerns we have is how we forward the MIG instances to our hypervisor given that we don’t have the classical PCIe forward mechanisme as the thor GPU is not an external peripheral.

I would like to gather your experience on using virtualization on the thor:

  1. Did somebody successfully deploy a hypervisor with multiple VMs on the thor?
  2. How can we forward the GPU to VMs given that we don’t use PCIe?
  3. NVIDA seems to offer the NVIDIA AI Enterprise software to configure vGPUs. Does this solve our problem here and is it possible to get this for the thor?

Thank you in advance for your inputs.

3

Hi,
By default we don’t support virtual machines on AGX Thor. For running AI models on Jetson platforms, you may refer to the examples:
https://www.jetson-ai-lab.com/

to develop your use-cases.

4

Thank you. Does this mean we have to use the IGX thor if we need virtualization?

5

Hi,
We are evaluating to support VMs on IGX Thor but as of now it is not ready. Would suggest use native system or docker images.