How to prove GPU performance 32 TOPS INT8, 11 TFLOPS FP16 or better

Hi,

Our customer are asking to prove the GPU performace of 32 TOPS INT8 and 11 TFLOPS FP16 or better
using some sample programs.

Want to know, are there any specific sample programs we need to execute and show the graphs of GPU usage ( also RAM usage) in the jtop tool?

Pls let us know. Thanks.

Hi,

You can maximize the device with the below commands:

$ sudo nvpmodel -m 0
$ sudo jetson_clocks

Thanks.

Thanks for this info.

But how to demonstrate and visualise this in Jtop or some.other tool through 📈📉 graphs or plots by executing some programs.

Any idea of some programs which we can run and show the TOPS FTOPS data?

Hi,

Please use our profiler to get this kind of info.
For example, nsight compute :

Thanks.

1 Like