Tesla T4 has significantly higher GPU utilization than RTX 2080 Ti

I have a questions regarding gpu utilization. I am running the same deep learning inferencing on both Tesla T4 and RTX 2080 Ti cards. However, the gpu utilization is significantly higher on Tesla T4 (90-100%) versus RTX 2080 Ti (20-30%). What’s the potential reason behind it?

1 Like