MiG support on Orin AGX

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

Hey everyone

I was searching around if the Orin Ampere GPU supports Multi-instance GPU (MiG) technology, an eventually found in a presentation on the Hot Chips 34 conference in August 2022, that it is actually implemented in hardware to split into multiple instances:

Screenshot 2023-02-21 at 09.11.43
Screenshot 2023-02-21 at 09.11.431432×1056 84.5 KB

This is all the information I could find surrounding the topic. Could someone provide some more information on this topic? Is it really supported, how many times can it be partitioned, can Triton utilise this… ?

If you want to check the presentation yourself:

3

Sorry to tell that MIG won’t be supported on Jetson.

5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.