New release: Nex-N2-Pro, a 397B parameter MoE model based on Qwen

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10
1

Hey guys,

Check out this new release: Nex-N2-Pro, a 397B parameter MoE model based on Qwen.

https://huggingface.co/nex-agi/Nex-N2-Pro

From what I’m seeing, it looks like it can run on just 2 Spark nodes. Definitely an interesting option for anyone experimenting with large-scale reasoning models without needing a huge cluster.

image
image691×364 45.3 KB

Has anyone tested it yet? Curious how it compares to other recent Qwen-based models.

2

Interesting! Which quantization are you thinking to squeeze this into 2 Sparks?

3

Well, we are in the same territory of Qwen3.5-397B-A17B, in both active and total number of params.

FP8 quants would fit a two Spark cluster, albeit barely. In order to squeeze more context, NVFP4 or Int4 quants might be needed; but something more optimized based on PrismaSCOUT would be definitely nice.

4

What strikes me most is that with its 397B params New-N2-Pro fares better than DeepSeek V4 Pro (1.6T params) on most benchmarks.

Being able to fit this model on just two nodes setup is turning point, because it significantly reduce the need for proprietary API-gated solutions, as well as those open-weight models (a la DeepSeek V4 Pro) that are still demanding to run in home labs.

5

Didn’t flesh out to be as great as the benches suggest: https://www.youtube.com/watch?v=HDaUWU-3NyE

6

I gave this a try, on tool-eval-bench it scored 80, and I get around 90 with qwen 397b, so they may have made some improvements, but I’m not seeing it so far.

Maybe with more refinement it would be better? since there is no real way of knowing what improvements were actually made, its really hard to judge against the original qwen, as all of these scores against other llm’s there is no way to actually know what is being run, so its hard to compare apples to oranges.

7

I see you point, and, indeed, there is a reproducibility crisis here. At the same time, the lower score may result from other moving parts too, such as inadequate chat templates (?). Just wondering.

8

On a related note, Nex-N2-Pro is now available on OpenRouter. I will be playing with it a bit before eventually giving it a try on prem.