# Deepseek V4 released **URL:** \ **Category:** DGX Spark / GB10\ **Tags:** deepseek\ **Created:** [April 24, 2026, 3:21am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696 "2026-04-24T03:21:32Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![paulsc.liu](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@paulsc.liu](https://forums.developer.nvidia.com/u/paulsc.liu)\ **Post date:** [April 24, 2026, 3:21am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/1 "2026-04-24T03:21:32Z")
I think people with 4 DGX Spark are good to go. Rest of us needs to wait for quantized version. > **[DeepSeek-V4 - a deepseek-ai Collection](https://huggingface.co/collections/deepseek-ai/deepseek-v4)** > > We’re on a journey to advance and democratize artificial intelligence through open source and open science. ---
**Author:** ![azampatti](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/azampatti/32/503643_2.png) [@azampatti](https://forums.developer.nvidia.com/u/azampatti)\ **Post date:** [April 24, 2026, 3:41am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/2 "2026-04-24T03:41:54Z")
deepseek-ai/DeepSeek-V4-Flash This one looks like we might be able to run an FP8 quant in a single node…Maybe? Interesting indeed! ---
**Author:** ![eparin82](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@eparin82](https://forums.developer.nvidia.com/u/eparin82)\ **Post date:** [April 24, 2026, 3:53am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/3 "2026-04-24T03:53:03Z")
Deepseek made a quantized version. > **[deepseek-ai/DeepSeek-V4-Flash · Hugging Face](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash)** > > We’re on a journey to advance and democratize artificial intelligence through open source and open science. ---
**Author:** ![azampatti](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/azampatti/32/503643_2.png) [@azampatti](https://forums.developer.nvidia.com/u/azampatti)\ **Post date:** [April 24, 2026, 3:57am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/4 "2026-04-24T03:57:13Z")
That’s the one I was referring to, Looks like a smaller model rather than a quantization. That one should run in a dual spark, but if all of those are active parameters, it’ll be slow… :) I would definitely love an FP8 version of that one though :) ---
**Author:** ![mclenithan](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mclenithan/32/513702_2.png) [@mclenithan](https://forums.developer.nvidia.com/u/mclenithan)\ **Post date:** [April 24, 2026, 4:01am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/5 "2026-04-24T04:01:22Z")
Looks like the architecture is unique… not something to easily toss into vLLM with the current versions, we’ll have to figure this out. Super excited to see where this goes, my quad gb10 cluster is stoked. ---
**Author:** ![whpthomas](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/whpthomas/32/469595_2.png) [@whpthomas](https://forums.developer.nvidia.com/u/whpthomas)\ **Post date:** [April 24, 2026, 4:23am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/6 "2026-04-24T04:23:55Z")
**DeepSeek-V4-Flash** is **284B** parameters **A13B** activated – So no for single spark `:(` ---
**Author:** ![azampatti](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/azampatti/32/503643_2.png) [@azampatti](https://forums.developer.nvidia.com/u/azampatti)\ **Post date:** [April 24, 2026, 4:25am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/7 "2026-04-24T04:25:47Z")
I was just reading that too ![image](https://global.discourse-cdn.com/nvidia/original/4X/2/e/d/2ed3dbcba4f0a3e48edc57d8f72568effe4dac83.png) And it’s an FP4+FP8 mixed one with over 130GB in size. We will have to have an INT4 or something like that to barely aspire to maybe running it ---
**Author:** ![adg1](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@adg1](https://forums.developer.nvidia.com/u/adg1)\ **Post date:** [April 24, 2026, 4:30am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/8 "2026-04-24T04:30:21Z")
> [@eparin82](#): > > [deepseek-ai/DeepSeek-V4-Flash · Hugging Face](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash) All, this is huge. Make sure to read the technical report at [https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek\_V4.pdf](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) for a glimpse of the innovation behind this series of frontier level open-weight model. From an operational point of view, DeepSeek-V4-Flash is the one in the series we will be tinkering with pretty soon, with 284B parameters (13B activated). ---
**Author:** ![JW2026](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jw2026/32/523471_2.png) [@JW2026](https://forums.developer.nvidia.com/u/JW2026)\ **Post date:** [April 24, 2026, 4:57am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/9 "2026-04-24T04:57:48Z")
Numbers (Total Parameters) looks different from what I see if I click on individual models. ---
**Author:** ![joshua.dale.warner](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@joshua.dale.warner](https://forums.developer.nvidia.com/u/joshua.dale.warner)\ **Post date:** [April 24, 2026, 5:24am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/10 "2026-04-24T05:24:09Z")
Other than the architecture being new, my suspicion is that this should be very amenable to an approach like PrismaQuant set to map the 4 and 8-bit layers in DS-4-Flash to NVFP4 and MXFP8. The weight size of the Flash model is 160GB per HF, so it _should_ fit on 2x Sparks with room for generous context (my bet around 700k, would be awesome to hit 1M though). That’s a very straightforward way to near-transparent quality and performance on 2x GB10s. The reason it is marked different in some places on HF is that it’s directly provided as a mixed precision quant. I think over half of it is 4-bit. It will probably be after the weekend before that becomes practical, though, because there is basically no day-0 support from anyone. Which is really quite notable: _they did not partner with the major backends_. At all. The inference infrastructure is literally HF Transformers and… that’s it. They must be serving this with something custom internally. Maybe they tossed out PRs concurrent with release? I haven’t checked. This probably sets us back around a week as vLLM and SGLang get a handle on the new architecture and PRs come in to support it as well as the chat interface, attention model, and thinking mode selection. But all of that will come, because it looks to be a solid model and - after all that commotion regarding MiniMax M2.7 - **still MIT licensed!** ---
**Author:** ![serapis](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/serapis/32/482452_2.png) [@serapis](https://forums.developer.nvidia.com/u/serapis)\ **Post date:** [April 24, 2026, 5:57am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/11 "2026-04-24T05:57:54Z")
We might be lucky: [DeepSeek-V4-Flash | vLLM Recipes](https://recipes.vllm.ai/deepseek-ai/DeepSeek-V4-Flash) I’ll give this a go tomorrow once the model downloaded. ---
**Author:** ![DannyTup](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dannytup/32/450509_2.png) [@DannyTup](https://forums.developer.nvidia.com/u/DannyTup)\ **Post date:** [April 24, 2026, 6:11am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/12 "2026-04-24T06:11:47Z")
> [@mclenithan](#): > > not something to easily toss into vLLM with the current versions vllm published Docker containers specifically for this model which I assume includes whatever is needed even if it’s not merged yet: > **[Image Layer Details - vllm/vllm-openai:deepseekv4-cu130](https://hub.docker.com/layers/vllm/vllm-openai/deepseekv4-cu130)** ---
**Author:** ![mclenithan](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/mclenithan/32/513702_2.png) [@mclenithan](https://forums.developer.nvidia.com/u/mclenithan)\ **Post date:** [April 24, 2026, 6:40am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/13 "2026-04-24T06:40:10Z")
Totally missed that, thanks!! ---
**Author:** ![JW2026](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/jw2026/32/523471_2.png) [@JW2026](https://forums.developer.nvidia.com/u/JW2026)\ **Post date:** [April 24, 2026, 7:22am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/14 "2026-04-24T07:22:49Z")
> [@joshua.dale.warner](#): > > this should be very amenable to an approach like PrismaQuant set to map the 4 and 8-bit layers in DS-4-Flash to NVFP4 and MXFP8. Waiting for kernel update to support 2 and 3 bits. ;-) ---
**Author:** ![djordjestojanovic1992](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@djordjestojanovic1992](https://forums.developer.nvidia.com/u/djordjestojanovic1992)\ **Post date:** [April 24, 2026, 7:24am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/15 "2026-04-24T07:24:13Z")
Sadly too large for a single DGX Spark, and I don’t wanna get a second one, I just got the first one :( ---
**Author:** ![paulsc.liu](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@paulsc.liu](https://forums.developer.nvidia.com/u/paulsc.liu)\ **Post date:** [April 24, 2026, 10:51am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/16 "2026-04-24T10:51:24Z")
When you get 2, you want 4. When you get 4, 8 seem tempting. It is a never ending cycle. Even when you get B200 unit, you will want more. LLM is like drug, you can never get enough hardware. All those Chinese LLM companies are starved for GPU too. Maybe it is time to setup LLM anonymous. We can do zoom call. ---
**Author:** ![alexander.korolev.germany](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/alexander.korolev.germany/32/345413_2.png) [@alexander.korolev.germany](https://forums.developer.nvidia.com/u/alexander.korolev.germany)\ **Post date:** [April 24, 2026, 11:28am UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/17 "2026-04-24T11:28:35Z")
so true ---
**Author:** ![colejneo](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@colejneo](https://forums.developer.nvidia.com/u/colejneo)\ **Post date:** [April 24, 2026, 12:51pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/18 "2026-04-24T12:51:07Z")
I JUST picked up the second one. it hurt cuz now the price has gone up, but I have been wanting it for some time. It’s nice cuz now things like these larger models can fit, bit it was also so I could consistently self host a few models. They do feel like testing boxes, and so any time something good comes, it like, time to cloud host, or further invest. ---
**Author:** ![\_cjg](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@\_cjg](https://forums.developer.nvidia.com/u/_cjg)\ **Post date:** [April 24, 2026, 1:26pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/19 "2026-04-24T13:26:22Z")
So, the only real question is: „How long can you actually hold out before you double down and grab a second Spark?“ ---
**Author:** ![Teason2026](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@Teason2026](https://forums.developer.nvidia.com/u/Teason2026)\ **Post date:** [April 24, 2026, 1:53pm UTC](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696/20 "2026-04-24T13:53:33Z")
anyone was able to run it? vllm reference special image build, vllm/vllm-openai:deepseekv4-cu130, which obviously not supported well for sparks. > **[DeepSeek V4 in vLLM: Efficient Long-context Attention](https://vllm.ai/blog/deepseek-v4)** > > A first-principles walkthrough of DeepSeek V4's long-context attention, and how we implemented it in vLLM. [Next page](https://forums.developer.nvidia.com/t/deepseek-v4-released/367696.md?page=2)