Not-a-Star-Wars-solution: raise the box + buy a desk fan
If you are here looking for a not-a-Star Wars solution:
Put your DGX above the surface. I used a metal plate with holes to raise it off the ground, hoping for some thermal exchange. In a 2-hour run, I was at 77 degrees, and for longer runs I reached 75 for the GPU and CPU. So this free metal gives you: minus 6 degrees on a <2-hour run, and minus 4 degrees on a >2-hour run.
If the room temperature is good and stable, it can be enough. Make sure the back of your device has enough space to avoid sucking the hot air back into the device.
If you want to take another step (and if your PI is paying), go for a fan. But not every fan.
Understanding Ventilation and Selecting a Fan
You should consider putting a fan with low turbulence and in the right direction (blowing air to the front of the device so that it would be blowing front to back) and at the right distance (there are two important things to consider for yourself: help the wind get into the device, and help the hot air go out). The device ventilation is sucking from the front and below, and then it blows hot air from behind. The NVIDIA DGX and ASUS DGX are a bit different, but I couldn’t find out how.
I think the best thing you can go with (low sound, good ventilation, and low budget) is the Noctua NF-F12 5V (30 bucks + extra for adapter + good availability), which is under the PC fan category. If you are going for the easiest buy, go with the Noctua NV-FS1 (120 bucks), a modified version in the desktop fan category. I will update the temps after getting it. The good thing about Noctua is that they are experts in PC fans, with a focus on PC ventilation (rather than cooling rooms). They considered the problems of turbulence, I assume:
P.S. I am still thinking about which direction I should put the fan. If I didn’t have a 2-year-old son, I would have time to set it on different axes and distances and benchmark it for fun, but I don’t. I would put it in front (and a little bit lower) so it blows wind from front to back, without blocking the device to suck air from the bottom. Will hopefully update you guys on the temp.
Just a follow-up:
Device: DDGX on top of metal mesh (DGX 10 cm up and flat) + Noctua NF-F12 Fan (20 cm distance, blowing from top to back and slightly from down to up (~10 percent incline)
Running Qwen-3.5-9b via vLLM Docker
GPU util: 95%
Power watag: 35-40
In 10 min run:
- without fan: CPU 81, GPU 69
- with fan: CPU 73, GPU 66
In a 2-hour run: