# Building llama.cpp container images for Spark/GB10

**URL:** <https://forums.developer.nvidia.com/t/building-llama-cpp-container-images-for-spark-gb10/353664>\
**Category:** DGX Spark / GB10 Projects\
**Tags:** cuda, llama\
**Created:** [December 5, 2025, 10:36am UTC](https://forums.developer.nvidia.com/t/building-llama-cpp-container-images-for-spark-gb10/353664 "2025-12-05T10:36:47Z")\
**Posts on this page:** 1\
**Showing post:** 5

<div class="post-metadata">

**Author:** ![cosinus](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/cosinus/32/454111_2.png) [@cosinus](https://forums.developer.nvidia.com/u/cosinus)\
**Post date:** [December 7, 2025, 9:43am UTC](https://forums.developer.nvidia.com/t/building-llama-cpp-container-images-for-spark-gb10/353664/5 "2025-12-07T09:43:02Z")

</div>

You should see this behavior on every GPU (\>90% utilization). Whenever you fire a request the GPU usage goes up to near 100% as long as your requests is being processed. After it is finished it goes down to zero again - assuming that it is a single user, sending its requests one by one. GPUs in use by multiple user might never go down to zero for a long(er) time. 😅

If you install nvtop (needs a patched version for Spark[1]) you will see something like this:

 ![Screenshot 2025-12-07 at 10.32.31](https://global.discourse-cdn.com/nvidia/original/4X/9/1/9/919950c0447a7c7f6de6d45f41e96417fa348730.png)

while running and when finished:

 ![Screenshot 2025-12-07 at 10.33.22](https://global.discourse-cdn.com/nvidia/original/4X/9/1/e/91e9c0ab346dd6be0bf4955585dfb70905b04188.png)

GPUs are designed for massive parallelism, meaning their thousands of cores are meant to be used all at once. That’s what makes them so fast compared to CPUs. Tasks split into many smaller pieces which can be done in parallel.

[1] [NVTOP with DGX Spark unified memory support](https://forums.developer.nvidia.com/t/nvtop-with-dgx-spark-unified-memory-support/351284)

---

_[View the full topic](https://forums.developer.nvidia.com/t/building-llama-cpp-container-images-for-spark-gb10/353664)._
