How is TOPS metric calculated with any AI model.?

[MJ_SW]

Hello ,

As per the https://developer.nvidia.com/embedded/jetson-modules,the Jetson Xavier NX supports 21 TOPS in AI Performance

For example if the use case is people detection, tracking and counting, how many TOPS will be utilized?

Is the calculation based on any AI model Architecture? if so , please share the calculation steps.

Thanks,

[AastaLLL]

Hi,

TOPS depends on the model you use.
It can be calculated via the #of operations (ex. add, multiply, …) in the model.

Or you can use our Nsight Compute profiler to get the info:

Nsight Compute :: Nsight Compute Documentation

Thanks.