Hi, @cuic3
Sorry for the late response.
There are too many variants of the MMA instruction and the answer differs per variant and per architecture.
There are metrics for calculating the FLOPs.
ncu --query-metrics | grep sm__ops_
sm__ops_path_tensor_src_bf16_dst_fp32 Counter # of math ops executed in Tensor path with source BF16 and
sm__ops_path_tensor_src_bf16_dst_fp32_sparsity_off Counter # of math ops executed in Tensor path with source BF16 and
sm__ops_path_tensor_src_bf16_dst_fp32_sparsity_on Counter # of math ops executed in Tensor path with source BF16 and
sm__ops_path_tensor_src_fp16_dst_fp16 Counter # of math ops executed in Tensor path with source FP16 and
sm__ops_path_tensor_src_fp16_dst_fp16_sparsity_off Counter # of math ops executed in Tensor path with source FP16 and
sm__ops_path_tensor_src_fp16_dst_fp16_sparsity_on Counter # of math ops executed in Tensor path with source FP16 and
sm__ops_path_tensor_src_fp16_dst_fp32 Counter # of math ops executed in Tensor path with source FP16 and
sm__ops_path_tensor_src_fp16_dst_fp32_sparsity_off Counter # of math ops executed in Tensor path with source FP16 and
sm__ops_path_tensor_src_fp16_dst_fp32_sparsity_on Counter # of math ops executed in Tensor path with source FP16 and
sm__ops_path_tensor_src_fp64 Counter # of math ops executed in Tensor path with source FP64
sm__ops_path_tensor_src_int1 Counter # of math ops executed in Tensor path with source INT1
sm__ops_path_tensor_src_int4 Counter # of math ops executed in Tensor path with source INT4
sm__ops_path_tensor_src_int4_sparsity_off Counter # of math ops executed in Tensor path with source INT4 with sparsity
sm__ops_path_tensor_src_int4_sparsity_on Counter # of math ops executed in Tensor path with source INT4 with sparsity
sm__ops_path_tensor_src_int8 Counter # of math ops executed in Tensor path with source INT8
sm__ops_path_tensor_src_int8_sparsity_off Counter # of math ops executed in Tensor path with source INT8 with sparsity
sm__ops_path_tensor_src_int8_sparsity_on Counter # of math ops executed in Tensor path with source INT8 with sparsity
sm__ops_path_tensor_src_tf32_dst_fp32 Counter # of math ops executed in Tensor path with source TF32 and
sm__ops_path_tensor_src_tf32_dst_fp32_sparsity_off Counter # of math ops executed in Tensor path with source TF32 and
sm__ops_path_tensor_src_tf32_dst_fp32_sparsity_on Counter # of math ops executed in Tensor path with source TF32 and