How to check performance of TensorRT/ONNX model running on Jetson NX

Autonomous Machines Jetson & Embedded Systems Jetson Xavier NX
1

My question is about the performance in terms of TOPs/Power consumption/GPU-CPU usage etc.
How can we check the performance of TensorRT(FP16)/ONNX models in terms of its GPU usage,TOPs,Power consumption?

Documentation says - 21TOPS of INT8 model on NX, How can I get like these numbers for my models

3

Hi,

You can find the GPU usage with tegrastats.

$ sudo tegrastats

To get the maximal performance, you can check our benchmark sample below:

Thanks.

4

For other metrics,like power consumption and TOPs etc , How to check ?

5

Please check NVIDIA Jetson Linux Developer Guide : Clock Frequency and Power Management | NVIDIA Docs

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.