I have 4x clustered currently. Anything anyone is curious to try or see? I’ll be expanding it by 2 more tomorrow.

Thanks for the deep performance posts. Big help, especially to us newbies. Very impressive clustering. I’m helping my son set up a 4-node DGX Spark cluster for his college study group. Hitting a wall trying to cluster GPT-OSS-20B across two nodes (as FP8 or MXFP4). Tried SGLang’s node head/worker op…

@ericlewis777 Huge thanks! This is so much fun, very helpful and informative! Do you have any further plan to experiment similar to what the exo-lab’s post(link) combining Mac and the spark? Or I mean putting the heavy computation on a saparate server/PC or Mac and the rest on the Spark clusters?

Any reason not to cluster via VPI (IB) for stability? All implementation are over Roc/Ethernet? Unlike most, I have an 8790, but no 100Gbe Switch. Is it a simple config change: mlxconfig -d set LINK_TYPE_P1=IB LINK_TYPE_P2=IB I would think I am allowing the hardware to communicate as designed, …

they have the https://mikrotik.com/product/crs804_ddq now, it would simplify your 8 spark deployment

Oh man… I just bought and setup my CRS 812 DDQ this past weekend. Not that I would’ve wanted to wait for stock, but it would’ve been better to get CRS 804 DDQ since they’re the same price and I only bought the CRS 812 DDQ for stacking sparks.

No chance of returning/replacing it with Mikrotik?

They only sell through distributors, but there is no inventory of the new model yet… and I only have 4x sparks at this point, so I’m just going to accept it since I’m already using them together–don’t want to do ship back, wait for inventory, shipping, exercise. …and if I’m willing to spend another …

The MikroTik CSR804-DDQ would work fine for a four or less Sparks cluster. The 400Gbps ports can be split but the max speed would be 50Gbps only. From Mikrotik: QSFP-DD ports also support break-out modes to 1G/2.5G/5G/10G/25G/50G

6x Spark setup

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10

FlossingEnthusiast January 14, 2026, 2:40pm 40

See Connecting DGX Spark to Mellanox Infiniband SB7800

IB is apparently not supported at all.

Topic		Replies	Views
Install and Use vLLM for Inference on two Sparks does not work DGX Spark / GB10	159	4723	December 9, 2025
Should we as a community gofundme one Spark for Eugr's nightly builds? DGX Spark / GB10	51	1307	April 1, 2026
Two-Spark cluster with vLLM using tensor-parallel-size 2 causes one node to drop while the other's GPU goes 100% forever DGX Spark / GB10	36	1060	February 13, 2026
DGX Spark performance DGX Spark / GB10	50	3668	February 27, 2026
DGX Spark + Qwen3-Next-80B: Proven Performance, But Missing Clear Path to NIM, TensorRT-LLM & Web UIs DGX Spark / GB10 cuda , nim , llama	16	3633	March 6, 2026
Help: Running NVFP4 model on 2x DGX Spark with vLLM + Ray (multi-node) DGX Spark / GB10 mistral-large	18	2179	December 25, 2025
Qwen3.5-397B-A17B-int4-AutoRound - 4 x db10 node - updated results 37 - 94 tok/s DGX Spark / GB10 clustering , spark	14	739	March 9, 2026
Day 1 with DGX Spark (Asus version) DGX Spark / GB10	29	1867	February 7, 2026
Why 273 GB/s? Less Is More, Until It Isn’t DGX Spark / GB10	67	2054	March 27, 2026
DGX Spark Multi-Node LLM Inference Report for Qwen3-235B model DGX Spark / GB10 nim , llama	33	1827	January 2, 2026

6x Spark setup

Related topics