Tensorcore identification while running inference

[AastaLLL]

Hi,

Tensor Core supports IMMA and HMMA operations.
Please find Nsight Compute to get the utilization of these operations:

Nsight Compute CLI :: Nsight Compute Documentation

tensor_precision_fu_utilization (HMMA)
tensor_precision_int_utilization (IMMA)

Thanks.