Hello,
I am experiencing an issue on occasion with locking the GPU clock frequency on my NVIDIA 3080 GPU using nvidia-smi in Ubuntu 20.04 startup script (systemd service to auto run the commands). The commands I used are:
nvidia-smi --query-gpu=clocks.gr,power.limit --format=csv
sudo nvidia-smi -i 0 -lgc 1600
nvidia-smi --query-gpu=clocks.gr,power.limit --format=csv
The output I receive is as follows:
clocks.current.graphics [MHz], power.limit [W]
1710 MHz, 320.00 W
GPU clocks set to "(gpuClkMin 1600, gpuClkMax 1600)" for GPU 00000000:86:00.0
Warning: persistence mode is disabled on device 00000000:86:00.0. See the Known Issues section of the nvidia-smi(1) man page for more information. Run with [--help | -h] switch to get more information on how to enable persistence mode.
clocks.current.graphics [MHz], power.limit [W]
1710 MHz, 320.00 W
Despite the command showing success, the clock frequency remains unchanged at 1710 MHz.
I have retried the steps after issues happen, it did work. Can someone please help me understand why the GPU clock frequency is not changing as expected and how to resolve this issue?
Thank you.
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 520.56.06 Driver Version: 520.56.06 CUDA Version: 11.8 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 NVIDIA GeForce ... Off | 00000000:86:00.0 On | N/A |
| 0% 48C P2 90W / 320W | 2346MiB / 10240MiB | 1% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 1 NVIDIA GeForce ... Off | 00000000:AF:00.0 Off | N/A |
| 0% 47C P2 40W / 320W | 44MiB / 10240MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 68367 G /usr/lib/xorg/Xorg 48MiB |
| 0 N/A N/A 70472 G /usr/bin/gnome-shell 95MiB |
| 0 N/A N/A 75422 C nvidia-cuda-mps-server 26MiB |
| 0 N/A N/A 75810 G ...bexec/gnome-initial-setup 3MiB |
| 1 N/A N/A 68367 G /usr/lib/xorg/Xorg 4MiB |
| 1 N/A N/A 75422 C nvidia-cuda-mps-server 26MiB |
+-----------------------------------------------------------------------------+