Nvidia-smi GPU Fan ERR!

[eaglepeng1108]

Hi,

I have a ubuntu 18.04.2 system with 2 RTX2080Ti, while I was running some python programs using GPU, the program just stopped and the nvidia-smi shows that one of the two GPUs has an error of GPU Fan. I will attach the screenshot and nvidia-bug-report.

I do need some help, could someone help me figure it out?
nvidia-bug-report.log.gz (940 KB)

[generix]

Please enable the nvidia-persistenced to start on boot. If that doesn’t resolve the issue, use gpu-burn to check for hw failure or thermal problems.