How to calculate TOPS (INT8) or TFLOPS (FP16) of each layer of a CNN using TensorRT

[AastaLLL]

Hi,

Nsight compute need to be launched on a desktop environment.
But you don’t need a dGPU if just profiling the Xavier.

Currently, the compatible version is 2019.05.
Please install it with the host CUDA package from the JetPack installer.

Xavier NX - Nsight Compute "Failing to prepare kernel for profiling"

Hi, Thanks for your patience. After checking internally, please install the Nsight Compute via SDKmanager (within CUDA toolkit). You can find it under the /opt/nvidia/nsight-compute/2019.5.0 folder. The tool shared in our webpage is for other system, not for Jetson. Thanks.

Thanks.