# DeepSeek v4.1 Flash **URL:** \ **Category:** DGX Spark / GB10\ **Tags:** deepseek\ **Created:** [September 8, 2026, 5:15pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725 "2026-09-08T17:15:40Z")\ **Posts on this page:** 20\ **Page:** 11
**Author:** ![stu.miller](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/stu.miller/32/515845_2.png) [@stu.miller](https://forums.developer.nvidia.com/u/stu.miller)\ **Post date:** [October 3, 2026, 9:12am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/214 "2026-10-03T09:12:29Z")
Server default is 75 on the Mia recipe so you’ll be on the same settings as me - which I’ve mapped to xhigh for Hermes, and can set to 100 via /reasoning max. I’m currently testing my Hermes core patch for the looping, if it ever happens to you shout and I’ll share it (if I manage to get it stable). @meanaverage - some more detail on the reasoning budget dial from my 4.1 itself: > 4.1’s reasoning effort is a documented 1-100 dial that the encoder writes into the prompt as a literal line (Reasoning Effort: 75 (range 1-100, the higher the value, the more thorough the reasoning)) at index 0 in thinking mode, so it’s learned compliance rather than an enforced ceiling; DeepSeek’s table is low=50, high=75, max=100 with no xhigh (that’s SGLang’s alias), and we run 75 because 100 measured 3x the reasoning tokens for about 3 points of tool-eval score. ---
**Author:** ![helge](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/helge/32/528653_2.png) [@helge](https://forums.developer.nvidia.com/u/helge)\ **Post date:** [October 3, 2026, 9:48am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/215 "2026-10-03T09:48:02Z")
> [@stu.miller](#): > > It’s a degenerate internal reasoning cycle - the model just starts to repeat “Let me go. / Emit. / OK. / Let me write.” that produces no output That’s also the only drawback I currently experience with that model. Apart from that, it is indeed a quantum leap that makes a Spark cluster appear sufficient for many tasks. MiMo 2.6 Flash has achieved a similar leap forward, and has done so with a significantly further reduced number of parameters. However, the drop in speed during long context sessions renders it virtually unusable for larger interactive sessions. ---
**Author:** ![stu.miller](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/stu.miller/32/515845_2.png) [@stu.miller](https://forums.developer.nvidia.com/u/stu.miller)\ **Post date:** [October 3, 2026, 10:07am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/216 "2026-10-03T10:07:26Z")
I’ve spent time working on it with 4.1 this morning. Mia’s TP4 recipe I use has a loop abort in, DSV41\_LOOP\_ABORT. It cuts off output and can break real replies without fixing the build-up - it: - Watches the model while it generates and cuts the reply off when it spots exact repetition. - It cuts anything: reasoning, visible answers, tool calls. It’s chopped off multiple real replies for me - so I turned it off - It only catches exact repeats (4 identical copies, or 8 identical lines of 16+ characters). The loops I’m seeing are short, varied lines (“Let me go.” / “Emit.” / “OK.”), so it most likely wouldn’t have fired. - Even when it does fire, the loop text already generated still gets sent back to the model on every later turn, so the build-up continues. I’ve patched Hermes core today with a fix for the specific loop issue I’m seeing: - Acts after the reply arrives, once, and only on the hidden reasoning that gets sent back to the model. It never touches visible answers or tool calls. - It’s built specifically for the pattern I’m seeing (short, varied, repeated lines) and keeps the genuine reasoning before the loop starts. - It stops the loop feeding itself, which is the thing that causes it to get worse and worse - Tested across our fleet for false positives and doesn’t affect the prompt cache. Will monitor over a few days of hard use and see if it does the trick. ---
**Author:** ![meanaverage](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/meanaverage/32/504326_2.png) [@meanaverage](https://forums.developer.nvidia.com/u/meanaverage)\ **Post date:** [October 3, 2026, 5:13pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/217 "2026-10-03T17:13:47Z")
Running the same here (basically) – it’s a modified Mia’s recipe: ```auto knapcio/DeepSeek-V4.1-Flash-4x-DGX-Spark-TP4 at 58f23215 ``` ```auto DSV41_LOOP_ABORT=1, DSV41_LOOP_NGRAM=32, DSV41_LOOP_REPEATS=4, DSV41_LOOP_LINE_REPEATS=8 in DEEPSEEK_ENV ``` Confirmed again that I haven’t seen any looping, but from my history it looks like I’ve only compacted once. The 25 longest threads so far have been 500-750K, but compaction has been rare. So, very much looks like something that must be affected by compaction (ie. very large cold pre-fill? agressive draft head + the kind of input compaction creates?) Might be interesting to try compaction summary text as cold input and see if looping starts immediately with that same input on a fresh thread. ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 3, 2026, 6:11pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/218 "2026-10-03T18:11:03Z")
Interesting! I haven’t run into the “Let me go / Emit” loop on my vLLM build, though to be fair I only have ran it for a couple days worth of tokens. Since it’s the same native weights on a different engine, it could be a useful cross-check if you hit it regularly: [spark3-vllm-ds41f](https://github.com/christopherowen/spark3-vllm-ds41f). TP3 is the main configuration, and there’s experimental TP4 support for a four-node switchless ring, so it should fit your cluster. Whichever way it goes, it would help show whether the loop follows the model or the stack. If you can share a compaction summary that triggers it, I’m happy to replay it on my side too. ---
**Author:** ![rob01](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rob01/32/542161_2.png) [@rob01](https://forums.developer.nvidia.com/u/rob01)\ **Post date:** [October 3, 2026, 6:57pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/219 "2026-10-03T18:57:24Z")
@christopher_owen I am using your latest update. Was the main change the size of the context? I’ve been using the prior version for a few days straight with no issues. So far I have put over 500M tokens through it with 4 concurrent streams at XHigh … prefix cache at 96% on switchless TP3. I got the new version staged with the larger context parameter and will switch to it later today. ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 3, 2026, 8:03pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/221 "2026-10-03T20:03:32Z")
Great news! I really appreciate the external validation! Have you experienced anything I could improve in it? I hope to have something more to share with you before the end of the weekend! ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 3, 2026, 8:04pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/222 "2026-10-03T20:04:58Z")
This is super fun and inspiring. Which switch are you using? ---
**Author:** ![d.piwowar](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@d.piwowar](https://forums.developer.nvidia.com/u/d.piwowar)\ **Post date:** [October 4, 2026, 6:48pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/224 "2026-10-04T18:48:47Z")
I will just leave it here: [GitHub - bertholomus/deepseek-v4.1-tensorfold-tp2-2xgb10: BertholomusAI recipe: DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark (GB10), our own TensorFold TP2 engine. Weights: Mia-AiLab EXL3 2.9bpw (MIT). · GitHub](https://github.com/bertholomus/deepseek-v4.1-tensorfold-tp2-2xgb10) It looks very promising, fast DeepSeek v4.1 with tensor fold on 2 sparks. As soon as I will test it I will try to share some real life results. ---
**Author:** ![rob01](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rob01/32/542161_2.png) [@rob01](https://forums.developer.nvidia.com/u/rob01)\ **Post date:** [October 5, 2026, 2:47am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/225 "2026-10-05T02:47:18Z")
@christopher_owen how many tokens per second are you getting with 4 sparks using DS4.1F? Here is what I get with 3 of them: ```auto prose c1..c6 code c1..c6 DeepSeek :8000 38/59/80/95/100/117 81/115/149/175/193/213 reasoning c1..c6 structured c1..c6 DeepSeek :8000 67/99/118/144/159/165 81/108/148/177/193/214 ``` I am thinking of adding another spark. Also, with 4 sparks how much memory does it server use and can you get to 1M context? Thank you! ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 5, 2026, 6:15am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/226 "2026-10-05T06:15:46Z")
I’m just about to release a version that’s finally focused on decode performance, by making TileLang work on SM121. If you’ve been following along, I’ve been doing maintenance until now, like removing non-determinism and other things. I’ll put a full write-up in the other thread, but here’s a sneak preview. It’s the same software on 3 and 4 Sparks, each at its own limits. Numbers are aggregate tok/s at temperature 0, 256 output tokens, with reasoning on, so every measured token is reasoning text: ```auto Decode (tok/s) 1 2 4 8 16 streams TP=4 prose 62.4 99.0 153.9 217.6 319.1 TP=4 code 74.3 105.0 171.5 261.7 352.2 TP=3 prose 50.5 78.7 122.5 181.6 - TP=3 code 60.9 88.3 137.6 221.6 - Prefill, real source text (tok/s) TP=4 32K 5,730 256K 5,387 1M 4,312 TP=3 32K 4,243 256K 3,971 500K 3,682 Single-stream step, prose / code TP=4 32.6 / 35.6 ms TP=3 39.6 / 43.9 ms ``` I would love independent verification of these numbers. These are from the tests I use for development in this repo. On your other questions: - **1M context:** yes. On 4 Sparks it runs the model’s full 1,048,576-token context with 16 sequences. The KV cache (10.5 GiB per node) holds about eight full 1M windows at once, and a 1M prompt prefills in about four minutes. On 3 Sparks I cap it at 512K and 8 sequences, because memory is the limit there. - **Memory:** at TP=4, every node kept at least 20 GiB free at its lowest point during the benchmark, so the server takes roughly 100 GiB per node. At TP=3 the low point is about 6 GiB free, with a 3.5 GiB KV cache. I should probably tune it more, right? So the fourth Spark gets you: - about 20–25% more decode at 1–8 streams; - about 35% more prefill; - twice the concurrent sequences and twice the context, with plenty of memory left over. ---
**Author:** ![j0n](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@j0n](https://forums.developer.nvidia.com/u/j0n)\ **Post date:** [October 5, 2026, 9:10am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/227 "2026-10-05T09:10:13Z")
@christopher_owen I am following your [spark-ds41f](https://github.com/christopherowen/spark-ds41f) repo with interest, it’s super-impressive. What agent(s) are you using? I don’t have 3 Sparks myself (yet…) but I would love to see a getting started guide, explaining the steps required to run your recipe. ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 5, 2026, 11:47am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/228 "2026-10-05T11:47:20Z")
Hey j0n and thank you! 👋 I use a mix of paid American and Chinese models (all of the ones you would expect!), plus my local setup. What are you using on your end? I’ve tried to make the docs easy to follow for both humans and agents. I also added `bin/spark doctor` to help with OS tuning and getting everything ready. Maybe I have left too much documentation in the README.md and it would benefit from a Quick Start section at the top? If you give it a go, I’d love to hear how it works with your setup! Feel free to ask questions or point out anything confusing - even a quick “I got stuck here” would help me make it better for everyone. ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 5, 2026, 12:48pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/229 "2026-10-05T12:48:14Z")
@stu.miller I finally got around to tuning instead of just the correctness stuff. I believe you were interested in pre-fill numbers at TP=4? ![image](https://global.discourse-cdn.com/nvidia/original/4X/f/f/e/ffee2dfb74f6b8ec96d45a37fdaffca170b863e5.jpeg) ---
**Author:** ![stu.miller](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/stu.miller/32/515845_2.png) [@stu.miller](https://forums.developer.nvidia.com/u/stu.miller)\ **Post date:** [October 5, 2026, 1:15pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/230 "2026-10-05T13:15:45Z")
Thanks - looks good. Not able to take my models down during the working week when they have a lot of work to do, but I’ll look deeper into your solution this weekend if I get the time. Parting with a working stack isn’t an easy decision when so much work is being done by it - the risks are big. I’m not switchless by the way, mine is a TP4 stack with a 100gb Mikrotik. ---
**Author:** ![j0n](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@j0n](https://forums.developer.nvidia.com/u/j0n)\ **Post date:** [October 5, 2026, 1:20pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/231 "2026-10-05T13:20:37Z")
I’ve been using Qwen Code together with Qwen 3.8 Flash Next and made [this game](https://games.jonathanpage.com/) with the combo! I had to use Claude Fable 5.1 when Qwen got stuck on some of the tricky geometry (quaternions and 3D spatial rotation). A Quick Start at the top of the `README.md` would be fabulous, as otherwise it reads more like a record of the (phenomenal) investigation work that has been done rather than telling a human user what to do. But I don’t want to take away from what you’ve achieved as it’s incredible work. What was less clear was if I had to install your [dgx-spark-memory-saver](https://github.com/christopherowen/dgx-spark-memory-saver) and/or whether I would need to manually configure the kernel to the 64 KiB profile myself or if your repo would do that. And I suppose also what I had to do (regarding @stu.miller’s comment) if I don’t have a switch to set up the switchless RoCE routing. Some of these are quite scary steps, so clear instructions for what order they should be done in, and how, and how to revert all the changes would be reassuring. Having said that, I only have two Sparks so I’m afraid I can’t test it out yet! ---
**Author:** ![rob01](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/rob01/32/542161_2.png) [@rob01](https://forums.developer.nvidia.com/u/rob01)\ **Post date:** [October 5, 2026, 3:46pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/232 "2026-10-05T15:46:36Z")
Thanks @christopher_owen those are great numbers and I look forward to seeing the TileLang version! I like that you are doing this switchless. ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 5, 2026, 4:06pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/233 "2026-10-05T16:06:49Z")
Thanks for the kind words, and for taking the time to explain where things were unclear! Thanks for sharing the game, too - interesting to hear where you needed another model’s help with the geometry. It’s pretty fun! That’s fair feedback about the README. It’s grown around the investigation, and it needs a clearer starting point for someone wanting to use it. A Quick Start at the top makes sense. I’ll make sure it explicitly covers: - Whether `dgx-spark-memory-saver` is required or optional for each configuration. - Whether the 64 KiB kernel needs to be installed separately, and what the repo handles automatically. - The switchless RoCE setup, including cabling and routing. - The order of operations, checks after each stage, and how to revert the changes. You should be able to understand what will change on your machines - and how to undo it - before starting. For example, there is a real trade-off when booting without the graphical user interface as the recipe suggests. And no worries about only having two Sparks! This feedback is useful on its own. I’ll also make the hardware requirements and tested configurations clearer so people can tell up front what applies to their setup. … Maybe I should make a 2x recipe as well? ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 5, 2026, 4:08pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/234 "2026-10-05T16:08:20Z")
Thank you for keeping me going! I really appreciate the support. Technically dgx-spark-networking supports switched setups, but I don’t have one to test or tune with :). ---
**Author:** ![christopher\_owen](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/christopher_owen/32/469895_2.png) [@christopher\_owen](https://forums.developer.nvidia.com/u/christopher_owen)\ **Post date:** [October 5, 2026, 4:39pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725/235 "2026-10-05T16:39:35Z")
how is this? > > > Answers the documentation gaps raised on the forum: what each configuration requ…ires, what the repository does and does not change, the order of operations with a check after each stage, and how to revert. > > \- \*\*README Quick Start\*\*: requirements, the three tested profiles (4 KiB TP3, 64 KiB TP3, TP4 ring), and the eight stages with one check each, linking into the guide. > \- \*\*docs/setup.md\*\* (replaces docs/replicate.md): > - tested configurations, and why two Sparks are not supported; > - a table of every host change, marked required, recommended or optional per profile, with its check and revert; > - stages: host baseline (recovery policy, headless trade-off, mode setting, watermark boost, NVMe coalescing, boot order, fan control), 64 KiB kernel and memory saver, fabric cabling and addressing with \`sparknet topology discover\`, site configuration, model, image, first start, verify. > \- \*\*docs/doctor.md\*\*: every configuration, live and launch-preflight check, with its severity, the reason for it and the printed fix. > \- \*\*docs/babysit.md\*\*: upstream issues and PRs we opened or depend on, with what to do when each changes. > \- docs/replicate.md becomes a pointer so existing links keep working; README, docker/README and current-state link to setup.md. > > Every command, path and default was checked against \`bin/spark\`, \`scripts/\`, \`config/\` and the companion repositories' docs. Unit suite: 237 tests OK (5 skipped); \`bin/spark doctor\` clean; all relative links and anchors resolve. [Previous page](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725.md?page=10) [Next page](https://forums.developer.nvidia.com/t/deepseek-v4-1-flash/382725.md?page=12)