DGX Spark appears to be maxing out at only 100 watts power draw, less than half of the rated 240 watts, and it only seems to be delivering about half the quoted performance (assuming 1 PF sparse FP4 = 125 TF dense BF16) . It gets quite hot even at this level, and I saw a report of spontaneous rebooting on a long run, so was it de-rated before launch?
Does anyone from NVidia want to address this? I have been running nvidia-smi in a loop during high demand tasks and I’ve never seen it go above 100W usage and even at 85W it gets quite hot at 83C which is nearing the 85C throttling threshold.
Hi, this is a misunderstanding. Spark GPU can draw a max of 120W and the rest of the system including CPU, CX7 and peripherals can draw 100W. The power supply is rated for 240 Watt of peak draw.
We’re updating our product documentation with these additional details and will follow up here once published.
If you are finetuning LLMs, you are probably mostly engaging the Tensor Cores. Those have been relatively the same stats I see when engaging mostly TC, 65W @ 80C range.