Question - as NVIDIA seems to be lagging and is not stepping up to support this community effort by giving @Eugr access to a Spark (at least one for the nightly builds of the spark-vllm-docker project) should we as a community set up a Gofundme and buy one for him?
I’m based in Europe so I don’t really know how to setup such a campaign, but if someone would set it up I’m up to donate the first €100 or so … :)
@eugr should open a sponsorship on GitHub or a Patriot or something similar.
Yes, that would solve the problem even quicker.
Thanks guys!!! I really appreciate it. But please, hold your horses for now, but I’ll think about it after the GTC.
The Spark is so last year. The community is large enough for a DGX Station. Count me in!
Hi eugr, indeed, thanks a lot for your contributions! I have an 8 node with microtik setup working. If you ever want to try stuff, you’re more then welcome…
I don’t know about those crazy euros 😂 but I’ll match your sentiment with $200.
Do you think Spark 2 would come out with Vera/Rubin in October?
Frankly, no chance. For a whole host of reasons, this platform needs probably full optimization plus a full year of operating at that level, and then a successor would be viable to be considered.
Beyond that, Jensen was very clear that only one Vera Rubin CPU was being made.
My crystal ball suggests this device class will be on a 2-3 year cycle with the next architecture seen being Feynman.
I feel like DGX Station won’t need as much community support as Spark :)
An update: thanks to NVIDIA, I now have a third Spark and two more QSFP cables, so I can not only have a dedicated Spark for builds, but I can also now see if I can make any optimizations for a 3-node cluster.
GREAT! … OK, many thanks to NVIDIA for the support. Credit where credit is due. Let’s continue forward :)
As another person with 3 sparks - I’m glad to hear that help is on the way!
Congratulations, great news! I was thinking of getting my third Spark, so this is doubly good news.
Congratulations @eugr !
( about_time && well_deserved )
Hopefully you can pioneer the best path for a 3rd Spark for us! :)
What’s the going rate for a DGX Station?
$100k
For some reason, I thought they were supposed to start at $45k?
Man… I bought this thing and Nvidia releases broken products and having community fix it faster than them… like what?
The $45K is the price for the DGX Station Dev Kit, a SuperMicro only offering.