# Pre-installed Ollama Configuration

**URL:** <https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480>\
**Category:** DGX Spark / GB10\
**Created:** [October 29, 2025, 8:54pm UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480 "2025-10-29T20:54:58Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![scott165](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@scott165](https://forums.developer.nvidia.com/u/scott165)\
**Post date:** [October 29, 2025, 8:54pm UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/1 "2025-10-29T20:54:58Z")

</div>

I would like to add remote access to Ollama. I’m trying to understand how to add environment variables to allow cross origin access. I tried to use sudo systemctl edit ollama, per playbook

I get no files found for ollama.service.

Ollama is located at /snap/bin/ollama

Also where are the models and modelfiles, where is the home directory?

---

<div class="post-metadata">

**Author:** ![eugr](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/eugr/32/449615_2.png) [@eugr](https://forums.developer.nvidia.com/u/eugr)\
**Post date:** [October 29, 2025, 9:56pm UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/2 "2025-10-29T21:56:37Z")

</div>

Do yourself a service and don’t use Ollama. Use llama.cpp or LM Studio (if you prefer GUI) instead. Ollama underperforms on Spark. It introduces unnecessary complexity compared to llama.cpp.

---

<div class="post-metadata">

**Author:** ![ashreaperone](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@ashreaperone](https://forums.developer.nvidia.com/u/ashreaperone)\
**Post date:** [October 30, 2025, 12:03am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/3 "2025-10-30T00:03:29Z")

</div>

@eugr Do you have a good instruction that shows how to use llama.cpp on spark with cu130 ? I haven’t been looking for one, but no luck. Thanks in advance.

---

<div class="post-metadata">

**Author:** ![scott165](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@scott165](https://forums.developer.nvidia.com/u/scott165)\
**Post date:** [October 30, 2025, 12:18am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/4 "2025-10-30T00:18:39Z")

</div>

I solved my issue…use snap set ollama host=“0.0.0.0:11434”

---

<div class="post-metadata">

**Author:** ![eugr](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/eugr/32/449615_2.png) [@eugr](https://forums.developer.nvidia.com/u/eugr)\
**Post date:** [October 30, 2025, 12:43am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/5 "2025-10-30T00:43:54Z")

</div>

Install development tools:

```bash
sudo apt install clang cmake libcurl4-openssl-dev

```

Checkout llama.cpp

```bash
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp

```

Build:

```bash
cmake -B build -DGGML_CUDA=ON -DGGML_CURL=ON
cmake --build build --config Release -j 20

```

Serve gpt-oss-120b

```bash
build/bin/llama-server -hf ggml-org/gpt-oss-120b-GGUF \
-fa on -ngl 999 \
--jinja \
--ctx-size 0 \
-b 2048 -ub 2048 \
--no-mmap \
--temp 1.0 \
--top-p 1.0 \
--top-k 0 \
--reasoning-format auto \
--chat-template-kwargs "{\"reasoning_effort\": \"medium\"}"

```

---

<div class="post-metadata">

**Author:** ![ashreaperone](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@ashreaperone](https://forums.developer.nvidia.com/u/ashreaperone)\
**Post date:** [October 30, 2025, 12:46am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/6 "2025-10-30T00:46:41Z")

</div>

Thank you!

---

<div class="post-metadata">

**Author:** ![dngettler](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dngettler/32/431437_2.png) [@dngettler](https://forums.developer.nvidia.com/u/dngettler)\
**Post date:** [October 30, 2025, 10:29am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/7 "2025-10-30T10:29:51Z")

</div>

If you use Open WebUI with Ollama, you can easily connect that to Tailscale for free and access your Open WebUI/Ollama models from anywhere. It’s really easy to set it up. With the DGX Spark hosting my larger LLMs and my 5090 with the smaller ones, I also combined the two Ollama servers into the same Open WebUI account; again, really easy setup if you ask any of the AI apps.

---

<div class="post-metadata">

**Author:** ![haidij](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/haidij/32/457442_2.png) [@haidij](https://forums.developer.nvidia.com/u/haidij)\
**Post date:** [November 17, 2025, 4:54pm UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/8 "2025-11-17T16:54:02Z")

</div>

Hi - thanks for all your posts, I’ve been reading your updates on different inference engines with interest. I’m trying to decide whether to prioritise llama cpp or vllm so that I can stick with one model format and stack for a bit.

For LLMs I want local chat UI and API access - not a production scenario but wanting to get the best (fastest and highest quality) performance without too many constraints. And to avoid downloading and managing multiple different formats for the same model.

So I know this is a bit of an ‘it depends’ kind of question but would love to hear your current point of view on this one?

---

<div class="post-metadata">

**Author:** ![eugr](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/eugr/32/449615_2.png) [@eugr](https://forums.developer.nvidia.com/u/eugr)\
**Post date:** [November 17, 2025, 5:18pm UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/9 "2025-11-17T17:18:13Z")

</div>

If you are the only user, I’d stick with llama.cpp - it will give you the best single-user performance without too much overhead. It will also give you a bigger variety of quants to choose from (e.g. Q6\_K\_XL). It can support multi-user too in a pinch.

The only downside is that new model support make take some time, especially if it’s a new architecture. Some models get day 1 support, some take months (Qwen3-Next, Qwen3-VL). But you can use VLLM for those if needed.

My current personal setup is llama.cpp with llama-swap as a proxy to load models on demand. What’s great about llama-swap, is that you can also plug vllm or any other inference engine there if needed.

---

<div class="post-metadata">

**Author:** ![tbnilles](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@tbnilles](https://forums.developer.nvidia.com/u/tbnilles)\
**Post date:** [November 24, 2025, 6:08am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/10 "2025-11-24T06:08:49Z")

</div>

Thank you for this, I was able to compile.

---

<div class="post-metadata">

**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\
**Post date:** [December 8, 2025, 6:14am UTC](https://forums.developer.nvidia.com/t/pre-installed-ollama-configuration/349480/12 "2025-12-08T06:14:05Z")

</div>

Closed on December 8, 2025, 6:14am UTC

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.
