IMMA roofline analysis in NSight Compute

[m_ali102]

I came across this

Why the Compute Throughput's value is different from the actual Performance / Peak Performance

Thank you for pointing to the Roofline Model on NVIDIA GPUs lab. That was very helpful. But I am curious about the “512” number in the 512 x sm__inst_executed_pipe_tensor.sum FLOP calculation. I think this is specific to V100? since the h884 instruction is doing 512 FLOPs per instruction. And for A100, it should be 4096 for h16816, is this correct? Another issue I have is when I collect information for one kernel in cutlass_profiler as the following, I am getting DRAM read that is less than the…

So, I guess 512 isn’t the right factor for a100 for both fp16 and in8. Please let us know what to use for a100 for different precisions.
My estimation is 4096 and apparently the user in the mentioned post suggests the same as well.