(I realise this would be totally unsupported and likely painful). Just wondering if anyone has considered this?

Just be aware, that stock Fedora kernel is significantly slower in GPU workloads. I haven’t tried 6.17.7 yet, but I don’t think any NVIDIA-specific changes made it there. However, Fedora 43 Server with custom built kernel performs better than stock DGX OS :)

Thanks for the heads up on the kernel differences. I wish I could spend more time on this. It definitely feels like it is a memory access problem. I do have two devices, one I have left using DGX OS. That does make it easier to figure out the differences. I would be interested to know what they chan…

Got some more cycles to play with the dgx devices. Still haven’t built a custom kernel, but hope to do that soon. Thought, I might test the ConnectX-7 setup. With a vanilla Fedora kernel on one end and a DGX OS on the other end. I am getting around 100Gb/sec. Is 100 Gb/sec what I should be getting? …

It would be good to get some clarity from NVidia on this. For instance, is 200 Gb/s achievable only by using both ports in aggregate, or we should be able to get it from a single port?

I’ve asked for clarification, but according to this post it looks like you have to aggregate p1 and P2 ports to achieve max bandwidth even if they are mapped to the same physical interface, which kinda makes sense, because they could only provide x4 PCie per interface. I may get another Spark later…

Well, someone bought all available stacking cables at our local Microcenter, just as I was ready to checkout my cart! I guess, that’s the sign that I shouldn’t spend another $4K+ for a second Spark…

It is a bit expensive for a bit of a play. However, I found the following cable works for me (for one port, haven’t tested with both ports active): 0.5m (2ft) NVIDIA/Mellanox MCP1650-V00AE30 Compatible 200G QSFP56 Ethernet Passive Direct Attach Copper Twinax Cable Got it from fs dot com. I …

What’s interesting, local Microcenter had 6 cables in stock, at least since Monday. I put one to cart, along with a Spark, then got distracted for a few minutes and when I came back to finish the checkout process, all six cables were gone, and the page now says that the item is not carried in this s…

Try to check Dell or other OEM partners options. Since they send me 4 cable instead one for two device, I guess they have plenty of them :-)

Has anyone tried an alternative Linux distro?

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10

eugr November 10, 2025, 10:35pm 41

Yep, just confirmed. You do need to aggregate to make it work: ConnectX-7 NIC in DGX Spark - #10 by isdias

Topic		Replies	Views
595.58.03 Certified Linux-aarch64 (ARM64) Display Driver and CUDA 13.2 - when for DGX Spark GB10 DGX Spark / GB10 cuda , driver	26	2420	September 22, 2026
New DGX OS 7.4.0 DGX Spark / GB10	39	4063	March 28, 2026
DGX Spark - Need resize root partition for headless DGX OS and/or other Linux distros DGX Spark / GB10	23	2107	October 27, 2025
I am EXTREMely disappointed with the current state of DGX Spark DGX Spark / GB10	91	30719	June 24, 2026
What I've learned so far as a "non-tech" Day 1 DGX Spark adopter DGX Spark / GB10	25	5259	October 30, 2025
DGX Spark (SM121) Software Support is Severely Lacking - Official Roadmap Needed DGX Spark / GB10	43	7581	August 2, 2026
Can DGX Spark work with non-DGX OS? DGX Spark / GB10	7	1362	August 5, 2026
What happened with CUDA 13.2 on DGX Spark? DGX Spark / GB10	9	1201	October 2, 2026
One of Four DGX Sparks Shows ~35% Lower NCCL Bandwidth — Can't Figure Out Why DGX Spark / GB10	49	2640	March 17, 2026
NVFP4 on DGX Spark / GB10 is broken. I bought 9 of these for this feature. Requesting NVIDIA's official roadmap and response DGX Spark / GB10 jetson , llama , agentic-ai , nemotron , nemoclaw	46	8911	July 17, 2026

Has anyone tried an alternative Linux distro?

Related topics