Discrepancy Between Claimed and Actual Sparse INT8 Performance of Tensor Cores on Jetson AGX Orin

[AastaLLL]

Hi,

We usually expect 60-70% SOL of theoretical peak performance.

The above 98.7 TOPs peak is around 58%SOL.
Maybe tweaking some parameters (ex. m, n, k) can improve further to reach 60% but it’s already close enough.

Thanks.