After Ubuntu update it said, “Error: 500 Internal Server Error: llama runner process has terminated: error loading model: unable to allocate CUDA0 buffer llama_model_load_from_file_impl: failed to load model” I typically would run ollama from jetson-containers, and up until the recent update it wo…

Hi, The fix is available in JetPack 6.2.2/r36.5: [image] JetPack 6.2.2/Jetson Linux 36.5 is now live Jetson AGX Orin We are pleased to announce the production release of JetPack 6.2.2 . JetPack 6.2.2 packages Jetson Linux 36.5 with Linux Kernel 5.15 and Ubuntu…

What version of Ollama are you using? I had the same issue. After I updated Ollama to 0.12.6, the issue seems to have been resolved.

Not the OP, but experiencing the same issue. I downloaded and ran that and this is what I get. [image]

same problem, worked the day before then some kind of update occured upon booting up and now ollama run llama3.2:3b gives Error: 500 Internal Server Error: llama runner process has terminated: error loading model: unable to allocate CUDA0 buffer llama_model_load_from_file_impl: failed to load mode…

Hi, CUDA compile is located at /usr/local/cuda-12.6/bin. Please try to set up the environment parameter with the comments below and try it again. $ export PATH=/usr/local/cuda-12.6/bin:$PATH $ export LD_LIBRARY_PATH=/usr/local/cuda-12.6/lib64:$LD_LIBRARY_PATH Just want to confirm that the ‘upgra…

Thanks for replying! What happened: Before Oct 18: Ollama with llama3.2:3b worked fine on r36.4.3 Oct 18: You ran Ubuntu software updates → upgraded to r36.4.7 After update: Ollama broke with “unable to allocate CUDA0 buffer” jacques@jacques-desktop:~$ export PATH=/usr/local/cuda-12.6/b…

[image] AastaLLL: export LD_LIBRARY_PATH=/usr/local/cuda-12.6/lib64:$LD_LIBRARY_PATH jay@jetson-ai:~/Downloads/cuda-samples/cuda-samples-12.5/Samples/1_Utilities/deviceQuery $ ./deviceQuery ./deviceQuery Starting… CUDA Device Query (Runtime API) version (CUDART static linking) Detected 1 C…

I’m pretty much just going to reflash my sd card to get back to L4T 36.4.3. Please to get back to me if a fix is found. Thank you everyone.

Hi, both Thanks for the update. It looks like the GPU is functional, but some issues when allocating a buffer with ollama. We will try this internally and provide more info later. Thanks

Hi, We test this in our environment but fail to reproduce. Original environment is r36.4.4 $ cat /etc/nv_tegra_release # R36 (release), REVISION: 4.4, GCID: 41062509, BOARD: generic, EABI: aarch64, DATE: Mon Jun 16 16:07:13 UTC 2025 # KERNEL_VARIANT: oot TARGET_USERSPACE_LIB_DIR=nvidia TARGET_USE…

"unable to allocate CUDA0 buffer" after Updating Ubuntu Packages

Robotics & Edge Computing Jetson Systems Jetson Orin Nano

JSC2718 October 20, 2025, 6:51pm 14

I wonder if rollback the nvidia-l4t-firmware:arm64 package to version 36.4.4-20250616085344 from 36.4.7-20250918154033 would help?

I have not tried, but seems there are some folks that have explored this option.

Of course one runs the risk of an finding the jetson in unrecoverable state.

Topic		Replies	Views
Updating Orin Nano breaks Ollama Jetson Orin Nano cuda , generative_ai	25	1862	November 27, 2025
Ollama errors orin nano Jetson Orin NX nvbugs , generative_ai	42	3570	February 12, 2026
Ollama not supporting jetson? Jetson Orin Nano llama	17	310	October 12, 2026
Llama3.2:3b randomly outputting "GGGGGGGG" when running under ollama on Jetson Orin Nano Super (JP6.2) Jetson Orin Nano generative_ai	42	1556	February 11, 2026
CUDA0 Buffer Error Jetson Orin Nano cuda , jetson , llama	3	836	January 5, 2026
Cuda0 Buffer Error Jetson Orin Nano cuda	11	2288	November 5, 2025
JetPack 7.2 GPU acceleration issue Jetson Orin Nano cuda , gpu	39	2151	July 17, 2026
How to control amount of shared memory available to LLM on Jetson Thor? Jetson Thor generative_ai	20	1777	November 10, 2025
CUDA Device can't be detected on Jetson Orin Nano running JP7 Jetson Orin Nano cuda	13	226	October 18, 2026
Introducing Ollama Support for Jetson Devices Jetson Projects cuda , natural-language-processing-nlp , artificialintelligence , interactive , docker-machine-learning , generative_ai	28	14878	August 13, 2024

"unable to allocate CUDA0 buffer" after Updating Ubuntu Packages

Related topics