TritonServer supported metrics on Jetson Orin Nano

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
1

Hi!

I’m exploring the metrics report capability of Triton Server on a Jetson Orin Nano.
I used the latest container (tritonserver-25.01-py3-igpu) available for this device.

Following the instruction here, I was able to enable the metrics reporting and I read them using curl. However, I cannot read all types of metrics.

Are the CPU, GPU and Latencies - Histogram metrics available on the Orin Nano? If I run Triton server in native way (no container), all the metrics will be available?

Thanks.

5

Hi,

Sorry for the late update.

Based on the below doc, GPU metrics are not supported on the Jetson:

We also expect native and container will have the same behavior.
Thanks.

6

Hi @AastaLLL,

thanks for the reply. Indeed, the GPU are not supported on the Orin.
But are the CPU and Latencies-Histogram available?

Using the provided container, I got all the metrics exept those ones.

7

Hi,

We need to double-check for the CPU and Latencies-Histogram metrics.
Will provide more info to you later.

Thanks.

8

Hi,

Both CPU and GPU metrics are not enabled for the Jetson build.

Thanks.

9

Thanks for the reply.

11

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.