Unable to determine the device handle for GPU unknown error


I got a problem when I ran my PyTorch program. The program suddenly shut down during running. Following this, I run nvidia-smi and got this output:

After that, I restarted my system. nvidia-smi output looks normal this time. However, I still can not run my program and it throws out the error information attached below.

Thanks advance for your help. I also attach the nvidia log below.

nvidia-bug-report.log.gz (168 KB)