How to measure 200 TOPS of AI Performance of Orin 32GB?

TOPS depends on the model you use.
It can be calculated via the #of operations (ex. add, multiply, …) in the model.

Or you can use our Nsight Compute profiler to get the info:

1 Like