Hi everyone, I installed Ollama on my DGX Spark to run a 20B ChatGPT OSS model, and the performance is honestly terrible. From my Mac, I run a small Python script that reads about ten lines from an Excel file and sends each line to Ollama using: http://<DGX_IP>:11434/api/generate Everything run…

No answer from me, but I experienced similarly poor performance using Ollama with oss-got-20b and 120b on the spark. Switching to lm studio was much faster. I also tried sglang but couldn’t beat the performance from lm studio, interested to know if there is an obvious explanation.

I posted another thread performance - much better with llama.cpp [image] Building llama.cpp container images for Spark/GB10 DGX Spark / GB10 Projects answering to my-self ;) docker run -d –name llama-spark-mistral32 –gpus all -p 3010:8080 -v /home/user/…

There is very little reason to use Ollama these days. Llama.cpp is faster, has a decent built-in webui, has very active development, and just introduced first-party model switching on demand: New in llama.cpp: Model Management llama-swap still allows more granular control and can control vllm and …

Ollama is a no-go nowadays for me. Completely pointless.

Just to share my experience, Ollama’s docker image have serious performance issues when running on DGX Spark. After re-installing it locally instead of the docker image the performance becomes normal. So if your Ollama is a docker image I think this is the case. Also somehow even now webUI have wei…

I’m very curious about this. I’m trying to do OpenAI (or Ollama) remote LLM testing. Currently testing /embeddings and the llama.cpp responses are different from an OpenAI response (JSON formatting). So it’s not really “OpenAI compatible” yet. I would try Ollama if it can perform at least close …

Very poor performance with Ollama on DGX Spark – looking for help

Accelerated Computing DGX Spark / GB10 User Forum DGX Spark / GB10 Projects

raphael.amorim December 4, 2025, 4:58am 4

@ibrunton_smith @deeduckme Ollama image is slow, please try this: GDX Spark is extremely slow on a short LLM test - #5 by cosinus

Topic		Replies	Views
GDX Spark is extremely slow on a short LLM test DGX Spark / GB10 deepseek	20	5310	January 25, 2026
Models not using Spark GPU? DGX Spark / GB10 containers	9	1055	December 15, 2025
DGX Spark performance DGX Spark / GB10	49	7730	February 13, 2026
Reviews are coming in DGX Spark / GB10	27	7788	November 24, 2025
When we install an LLM model and start a chat session, the response speed becomes extremely slow DGX Spark / GB10 llama	1	415	December 6, 2025
Why is the GX10 performance so poor? DGX Spark / GB10 dgx-spark-issue	3	849	July 1, 2026
Can someone please just help me set the DGX Spark up for optimal LLM use? DGX Spark / GB10 llama	11	2583	June 20, 2026
Investigating Performance Issue/Bottleneck DGX Spark / GB10 llama , agentic-ai	9	1101	February 1, 2026
Inconsistent Official Guides DGX Spark / GB10	5	446	November 30, 2025
DGX Spark vs AMD Strix Halo DGX Spark / GB10 llama	4	11846	February 18, 2026

Very poor performance with Ollama on DGX Spark – looking for help

Related topics