You’ll need to have the persistence daemon (nvidia-persistenced) started on boot and have it continuously running. Otherwise, the driver gets unloaded and the Teslas deinit so when nvidia-smi is run it needs a full reinit. Failing to have the persistenced running may also lead to more serious issue like gpus crashing, depending on workloads.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| nvidia-smi is slow on Ubuntu 16.04 | 4 | 15398 | August 23, 2017 | |
| nvidia-smi slow process listing(not persistance related) | 2 | 1733 | August 11, 2024 | |
| nvidia-smi with CUDA dev environment | 2 | 8806 | April 16, 2012 | |
| watch -n 1 nvidia-smi cause 100% cpu on irq/127-nvidia | 4 | 16464 | October 14, 2021 | |
| nvidia-smi is slow and hangs after sometime with 1080Ti | 4 | 6801 | June 20, 2018 | |
| nvidia-smi freeze | 2 | 3093 | May 10, 2018 | |
| nvidia-smi hangs. cannot be killed even by SIGKILL | 1 | 10403 | April 5, 2016 | |
| Ubuntu nvidia-persistenced and nvidia-smi | 0 | 907 | January 12, 2018 | |
| How to get nvidia-smi working! | 10 | 18990 | March 30, 2014 | |
| nvidia-smi hangs when run during bootup to create /dev/nvidia* files with 346.46 and Fermi Tesla GPU | 2 | 3846 | June 11, 2015 |