Hi Comm ,
I am new with DGX Spark and I am trying vLLM.
I tried loading gpt-oss 20b through latest vllm image , it was success but it took more than hour and half to load.
Now same problem with Qwen/Qwen3-Coder-30B-A3B-Instruct, It’s been 2 hrs and it still is loading.
This seems frustrating as beginner, i am caught up in the loop of trying models and then waiting hours for setup.
max model length 8192 or higher, everything takes more time
Am I doing something wrong?
If you don’t have the model already downloaded, then it will download it during startup. This can take a long time depending on your internet speed. You can also set the huggingface token so hf doesn’t throttle you as much.
another beginner here ;)
I can second azampatti’s recommendation for eugr/spark-vllm-docker.
I assume you use docker? You can also use “docker logs -f your_container_name” to check the logs after starting the container. If you can’t remember the name use “docker stats” . If it is a download, or any other issue it should be in the logs.
That, the vllm image you’re using is far from the optimal for these boxes. Go Eugr’s! :)
Also, Qwen3-Coder isn’t the best for coding anymore (in most situations), try Qwen3.6-35B-A3B for a fast one or Qwen3.8-27B for a slower but higher accuracy one :)