I’ve added a convenience script to start cluster on all nodes with autodiscovery option to the repo. Nothing too fancy, wanted to keep it barebones, but useful enough.
I’ll merge the pull requests after we resolve some questions there.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| vLLM container out of date for new models | 9 | 2049 | October 31, 2025 | |
| vLLM containers | 45 | 2867 | July 22, 2026 | |
| Install and Use vLLM for Inference on two Sparks does not work | 159 | 6208 | December 9, 2025 | |
| vLLM on GB10: gpt-oss-120b MXFP4 slower than SGLang/llama.cpp... what’s missing? | 143 | 8409 | February 24, 2026 | |
| I'd like to learn how to use the latest vLLM on DGX Spark | 9 | 2556 | November 29, 2025 | |
| GLM-4.7-Flash-NVFP4 was just released, but for Transformers 5.0 + vLLM 0.14...? | 89 | 4950 | February 13, 2026 | |
| New pre-built vLLM Docker Images for NVIDIA DGX Spark | 73 | 10219 | March 27, 2026 | |
| VLLM -- the $150M train wreck? | 24 | 1685 | February 27, 2026 | |
| HOW-TO: Run Qwen3-Coder-Next on Spark | 92 | 11365 | March 24, 2026 | |
| Running Mistral Small 4 119B NVFP4 on NVIDIA DGX Spark (GB10) | 66 | 5809 | July 22, 2026 |