Aggreed to add inteligence becnhmark
some open source benchmark exists :
I am not sure if this is the right place to bring this up - I attempted to login with Github to spark-arena, but was met with “Access Denied” and “To request access, please contact the maintainers…”
Is there additional action I must take to get authorized to submit benchmarks? I have a 4x DGX Spark cluster and have some results for ‘MiniMaxAI/MiniMax-M2.5’ to submit.
1 Like
Actually, that’s bad UX from my side. Need to fix it.
You need to click on Request access and not sign in :)
So, you need to sign out and go back to the previous screen
Oof, that was on me - I didnt see the request access as I was multitasking and doing the login. Quck question - I was hoping to use my Github account to validate identify; is it a bug that only a Google account can be used for identity verification?
1 Like
Again, I might be missing something with the recipe support in spark-vllm-docker, but how do you declare environment variables for the container like “HF_TOKEN” with the run-recipe command?
-e flag is passed to the vllm docker
Dear colleagues, please add the recipe for the Qwen3.5-122B-A10B-FP8 model to spark-arena for two DGX Spark. Thank you.
Will do, there’s one for Intel/Qwen3.5-122B-A10B-int4-AutoRound already
2 Likes
Hey there, Raphael! I requested access to submit benchmarks to Spark Arena. I’d be happy to contribute a few benchmarks for my dual node rig.
1 Like