Docker nvidia/vllm issue

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10
1

recently, i refresh the dgx spark due to some issue

i download the docker from nvidai again,

but have below error, but seem driver 590 is not support DGx spark yet? any ideas?

======================

NVIDIA Release 25.12.post1 (build 247811356)
vLLM Version 0.12.0+35a9f223
Container image Copyright (c) 2025, NVIDIA CORPORATION & AFFILIATES. All rights reserved.

Various files include modifications (c) NVIDIA CORPORATION & AFFILIATES. All rights reserved.

GOVERNING TERMS: The software and materials are governed by the NVIDIA Software License Agreement
(found at https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-software-license-agreement/)
and the Product-Specific Terms for NVIDIA AI Products
(found at https://www.nvidia.com/en-us/agreements/enterprise-software/product-specific-terms-for-ai-products/).

ERROR: This container was built for NVIDIA Driver Release 590.44 or later, but
version 580.126.09 was detected and compatibility mode is UNAVAILABLE.

==============

2

That is a very old container version (for LLM time), 3 months out of date. My guess is you had it pinned.

If you want to stick with NGC image, pull nvcr.io/nvidia/vllm:26.02-py3 and try again. Or, better yet, clone https://github.com/eugr/spark-vllm-docker and run ./build-and-copy.sh

4

yes, i pull nvcr.io/nvidia/vllm:26.02-py3 also have this issue, so i try to use old version, not sure why, previous, i can run old version wihtout issue before i factory reset

5

DGX Spark currently supports version 590 drivers. I am using version 590.48.01 drivers.

±----------------------------------------------------------------------------------------+
| NVIDIA-SMI 590.48.01 Driver Version: 590.48.01 CUDA Version: 13.1 |
±----------------------------------------±-----------------------±---------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GB10 On | 0000000F:01:00.0 Off | N/A |
| N/A 73C P0 39W / N/A | Not Supported | 84% Default |
| | | N/A |
±----------------------------------------±-----------------------±---------------------+

±----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 6337 C …RayWorkerWrapper.ray_call 10873… |
±----------------------------------------------------------------------------------------+

6

590 drivers have not been rolled into the official update as far as I am able to tell. I’m not surprised things don’t work. Any particular reason for attempting this?

7

Which version of DGX OS do you have? The newest Version 7.4 (?) doesn’t have 590 Drivers…