MPS for Jetson AGX Orin

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

Hello,

Is MPS (Multi Process Server) not supported for Jetson as of now?
In the latest post I could find it is said no,
AGX Orin support MPS? - Jetson & Embedded Systems / Jetson Orin NX - NVIDIA Developer Forums

however in CUDA for Tegra, instruction for using MPS is described.
1. CUDA for Tegra — CUDA for Tegra 12.8 documentation

{2D68BE68-5A58-4C76-8ADF-9B37BBE427E5}
{2D68BE68-5A58-4C76-8ADF-9B37BBE427E5}1244×264 40.6 KB

Could someone confirm the latest status?

3

Hi,
Here are some suggestions for the common issues:

1. Performance

Please run the below command before benchmarking deep learning use case:

$ sudo nvpmodel -m 0
$ sudo jetson_clocks

2. Installation

Installation guide of deep learning frameworks on Jetson:

3. Tutorial

Startup deep learning tutorial:

4. Report issue

If these suggestions don’t help and you want to report an issue to us, please attach the model, command/step, and the customized app (if any) with us to reproduce locally.

Thanks!

5

Hi @carolyuu ,

I’m also interested in if MPS can be used in Jetson.
In short is it supported now?

Thank you.

7

Hi,

Yes, MPS has started to support Jetson from CUDA 12.5.
More information can be found in the below link:

Thanks.