L2 hit rate always at 100%

You may want to check this either

https://forums.developer.nvidia.com/t/l2-cache-in-a100-provides-179-hit-rate