GPU is lost on Ubuntu 14.04.4 LTS with driver 384.130

Hi,

I am getting an error of “GPU is lost” on trying to use one of my GPUs. nvidia-smi output before running the process on GPU is the following. Note the fan and pwr is shown as ERR! for the 4th GPU. I am also attaching nvidia-bug-report.log.gz

Thu Aug 9 19:03:55 2018
±----------------------------------------------------------------------------+
| NVIDIA-SMI 384.130 Driver Version: 384.130 |
|-------------------------------±---------------------±---------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
|===============================+======================+======================|
| 0 GeForce GTX TIT… Off | 00000000:05:00.0 On | N/A |
| 22% 53C P8 16W / 250W | 46MiB / 12204MiB | 0% Default |
±------------------------------±---------------------±---------------------+
| 1 GeForce GTX TIT… Off | 00000000:06:00.0 Off | N/A |
| 22% 52C P8 15W / 250W | 1MiB / 12207MiB | 0% Default |
±------------------------------±---------------------±---------------------+
| 2 GeForce GTX TIT… Off | 00000000:09:00.0 Off | N/A |
| 22% 50C P8 15W / 250W | 1MiB / 12207MiB | 0% Default |
±------------------------------±---------------------±---------------------+
| 3 GeForce GTX TIT… Off | 00000000:0A:00.0 Off | N/A |
|ERR! 63C P0 ERR! / 250W | 1MiB / 12207MiB | 0% Default |
±------------------------------±---------------------±---------------------+

±----------------------------------------------------------------------------+
| Processes: GPU Memory |
| GPU PID Type Process name Usage |
|=============================================================================|
| 0 1572 G /usr/bin/X 44MiB |
±----------------------------------------------------------------------------+
nvidia-bug-report.log (2.66 MB)

nvidia-bug-report2.log (3.18 MB)