Hi, @cuic3

Sorry for the late response.

There are too many variants of the MMA instruction and the answer differs per variant and per architecture.

There are metrics for calculating the FLOPs.

ncu --query-metrics | grep sm__ops_

sm__ops_path_tensor_src_bf16_dst_fp32 Counter # of math ops executed in Tensor path with source BF16 and

sm__ops_path_tensor_src_bf16_dst_fp32_sparsity_off Counter # of math ops executed in Tensor path with source BF16 and

sm__ops_path_tensor_src_bf16_dst_fp32_sparsity_on Counter # of math ops executed in Tensor path with source BF16 and

sm__ops_path_tensor_src_fp16_dst_fp16 Counter # of math ops executed in Tensor path with source FP16 and

sm__ops_path_tensor_src_fp16_dst_fp16_sparsity_off Counter # of math ops executed in Tensor path with source FP16 and

sm__ops_path_tensor_src_fp16_dst_fp16_sparsity_on Counter # of math ops executed in Tensor path with source FP16 and

sm__ops_path_tensor_src_fp16_dst_fp32 Counter # of math ops executed in Tensor path with source FP16 and

sm__ops_path_tensor_src_fp16_dst_fp32_sparsity_off Counter # of math ops executed in Tensor path with source FP16 and

sm__ops_path_tensor_src_fp16_dst_fp32_sparsity_on Counter # of math ops executed in Tensor path with source FP16 and

sm__ops_path_tensor_src_fp64 Counter # of math ops executed in Tensor path with source FP64

sm__ops_path_tensor_src_int1 Counter # of math ops executed in Tensor path with source INT1

sm__ops_path_tensor_src_int4 Counter # of math ops executed in Tensor path with source INT4

sm__ops_path_tensor_src_int4_sparsity_off Counter # of math ops executed in Tensor path with source INT4 with sparsity

sm__ops_path_tensor_src_int4_sparsity_on Counter # of math ops executed in Tensor path with source INT4 with sparsity

sm__ops_path_tensor_src_int8 Counter # of math ops executed in Tensor path with source INT8

sm__ops_path_tensor_src_int8_sparsity_off Counter # of math ops executed in Tensor path with source INT8 with sparsity

sm__ops_path_tensor_src_int8_sparsity_on Counter # of math ops executed in Tensor path with source INT8 with sparsity

sm__ops_path_tensor_src_tf32_dst_fp32 Counter # of math ops executed in Tensor path with source TF32 and

sm__ops_path_tensor_src_tf32_dst_fp32_sparsity_off Counter # of math ops executed in Tensor path with source TF32 and

sm__ops_path_tensor_src_tf32_dst_fp32_sparsity_on Counter # of math ops executed in Tensor path with source TF32 and