First - credits where credits due to post by @tonyd615 and @11_p who pointed me to a right direction: DeepSeek-V4-Flash (official FP8) running across 2x DGX Spark — TP=2, MTP, 200K ctx, recipe + numbers - #174 by 11_p as more so to original creator of recipe @aidendle94 and reddit post Reddit - Plea…

Qwen 3.5 .8 MLX is like 1-2gb I think it does great captioning of photos

It was not about the speed but cache management. V2 is definitely better but looks like it’s not about cache size but number of concurrents and time. It just gets worse with time up. I used it heavy today and it bottled up in half day and was crawling pretty slow. Lot worse than before. I guess befo…

Please note that spark-vllm-docker build now includes a merged PR with support for DSV4F and GLM 5.x via DeepGEMM route which may conflict with any other solutions not based on that PR.

@eugr_nv we built it today - many issues, explained below, it got working in the end, 30 t/s max. Not tested for cache pollution but initially looked like it was filling very slow. # nvidia-cutlass-dsl==4.5.2 breaks DeepSeek-V4-Flash on DGX Spark (CUDA 13.0) ## Symptom After a `git pull && ./buil…

What recipe/model are you using? The recipe that is included in spark-vllm-docker should not use CuTeDSL path. Also, NVFP4 quant is not supported in the merged PR, only the original mixed FP8/MXFP4 one (deepseek-ai/DeepSeek-V4-Flash).

Basically a script from your library with small changes. We built a container and pinned it to avoid sporadic rebuilds. Now I am realizing that i haven’t pruned the cache, maybe a culprit.. Originally just launched a basic existing recipe #!/bin/bash # DS4F — EUGR recipe base with our overrides #…

Sorry for the delay External Media GitHub - aidendle94/vllm: A high-throughput and memory-efficient inference... A high-throughput and memory-efficient inference and serving engine for LLMs Code was pushed to the DSV4 branch. Need to bring the code up…

I was also running into similar issues with the production-v2 image and I couldn’t make it work despite my best efforts. Settled with @aidendle94 ’s Production-ready + vLLM PR #44237 combo and so far it has been pretty smooth running continuously. [Screenshot 2026-06-23 at 10.14.42 PM]

Thank you! I confirm it does work - cache still hits ceiling pretty fast (some garbage is likely stored) but eviction works without bottleneck, just requires re-processing some of older parts of the prompt. No decode penalty but some pp slows down. Which it does in every case but not way my claimed …

I need to revise my earlier statement about production-v2 hanging; I’ve been hammering it since yesterday and it’s behaving itself. KV cache sits right around full and then evicts and re-allocates as expected. This is making me wish vllm’s kv cache wasn’t just dumb LRU but also supported some kind o…

Is anyone having issues with this model just making things up? Seems that when using it with Hermes and doing things like a morning briefing it make the entire thing up.. It just will not seem to verify anything. It will only use it internal training.

DeepSeek v4 Flash (Aiden Recipe from Reddit) - 1M token session operational, Cuda 12.1 tailored for DGX Spark GB10

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10

aidendle94 June 24, 2026, 1:56am 161

Sorry for the delay

Code was pushed to the DSV4 branch. Need to bring the code up to date with some recent changes on b12x and their version

Topic		Replies	Views
DeepSeek-V4-Flash (official FP8) running across 2x DGX Spark — TP=2, MTP, 200K ctx, recipe + numbers DGX Spark / GB10 deepseek	260	24614	July 15, 2026
Deepseek v4 Flash on 2 Nodes DGX Spark / GB10 Projects deepseek	71	7471	June 15, 2026
DeepSeek-V4-Flash on 4× DGX Spark via vLLM (jasl fork, TP=4, RDMA, MTP) — 49–54 tok/s single-stream, full recipe + the traps DGX Spark / GB10 Projects deepseek	3	960	June 19, 2026
DeepSeekV4-Flash hybrid quant, 1x DGX Spark: antirez's optimized 128 GB MLX recipe ported to vLLM for GB10 DGX Spark / GB10 Projects deepseek	18	2305	May 11, 2026
Instructions for running Deepseek-v4-flash with DSpark using Eugr's repo DGX Spark / GB10 Projects deepseek	27	2474	August 3, 2026
Deepseek V4 released DGX Spark / GB10 deepseek	143	18115	May 18, 2026
Official NVidia optimized DeepSeek-V4-Flash models? DGX Spark / GB10 deepseek	28	2587	July 11, 2026
DeepSeek V4 Flash (1,048,576 Context) on 2x DGX Spark – Custom Sparkrun Recipe DGX Spark / GB10 jetson , deepseek	11	1325	June 14, 2026
1x Spark tuned DSpark for DeepSeek-V4-Flash: 35 tok/s, 800+ prefill, and fast multi-agent serving DGX Spark / GB10 Projects deepseek	127	8541	August 3, 2026
DeepSeek-V4-Flash-DSpark on 2× DGX Spark (GB10) — big single-stream speed boost (~60-67 tok/s) + 1M context, now with concurrency DGX Spark / GB10 deepseek	101	8591	July 19, 2026

DeepSeek v4 Flash (Aiden Recipe from Reddit) - 1M token session operational, Cuda 12.1 tailored for DGX Spark GB10

Related topics