I have a machine with 4 NVIDIA RTX A5000 GPUs. By checking the logs of previous users, this machine was able to train the same models 4x faster about a year ago. When I train models now, I see that the power consumption stays always below 75W. By checking logs from previous users that trained about…

Low performance when training NN and power consumption bounded

Robert_Crovella October 25, 2024, 11:37pm 3

Topic		Replies	Views
Power consumption of GPUs does not go above 100W - nvidia-smi CUDA Programming and Performance hw	2	2412	June 15, 2023
Quadro RTX 8000 Multi-GPU Performance Issue CUDA Programming and Performance	13	1173	March 8, 2025
GPU performance suddenly drops down twice during learning CUDA Programming and Performance	11	3505	November 10, 2018
A100-SXM-80GB A100 Enforced Power Limit different from server to server General Discussion	4	3136	July 23, 2021
Force GTX1080 performance level to reduce power consumption under Linux Linux	20	35313	March 17, 2025
1080GTX Ti GPU clock and power drawn is throttled all of a sudden! CUDA Programming and Performance	12	1727	July 31, 2018
HW Power Brake Slowdown CUDA Programming and Performance	7	4926	February 27, 2021
GPUs are stuck when using multiple GPUs to train CUDA Programming and Performance	4	1921	November 13, 2020
why gpu0 is much slower than gpu1 (v100, ubuntu 16.04)? CUDA Programming and Performance	7	2146	October 15, 2018
Frequent catastrophic crashes on a multiple GPU machine CUDA Setup and Installation	8	4692	October 22, 2017