8X A5000 GPU high power consumption and fan speed without any load/utilization on Ubuntu 22.04

Hi everyone,

We have a very strange issue on our server which has 8 A5000 GPUs. They appear to be at full mode without any load on them, a screenshot and log were attached. The Linux version is Ubuntu 22.04. Any ideas/suggestions would be very appreciated. Thank you very much for your help!
nvidia-bug-report.log.gz (2.6 MB)