*main-r36.4.0: Pulling from dustynv/ollama*
*Digest: sha256:918c92b9040c1e9ee810080e16ffb9133f62ce771a4ab0e979bea8b4bca890aa*
*Status: Image is up to date for dustynv/ollama:main-r36.4.0*
*docker: Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running prestart hook #0: exit status 1, stdout: , stderr: Auto-detected mode as 'csv'*
*invoking the NVIDIA Container Runtime Hook directly (e.g. specifying the docker --gpus flag) is not supported. Please use the NVIDIA Container Runtime (e.g. specify the --runtime=nvidia flag) instead.: unknown*
*Run 'docker run --help' for more information*
Thanks for the solution, my docker was upgraded again to 28.0.2 and it seems to be a problematic version :(
Using your script, I was able to run it now but it keeps getting stuck asking me to upgrade ollama when I have already update it to the latest version :(
docker run -it --rm -e OLLAMA_MODEL=gemma3:4b -e OLLAMA_MODELS=/root/.ollama -e OLLAMA_HOST=0.0.0.0:9000 -e OLLAMA_CONTEXT_LEN=4096 -e OLLAMA_LOGS=/root/.ollama/ollama.log -v /mnt/nvme/cache/ollama:/root/.ollama --gpus all -p 9000:9000 -e DOCKER_PULL=always --pull always -e HF_TOKEN=${HF_TOKEN} -e HF_HUB_CACHE=/root/.cache/huggingface -v /mnt/nvme/cache:/root/.cache dustynv/ollama:main-r36.4.0 main-r36.4.0: Pulling from dustynv/ollama Digest: sha256:918c92b9040c1e9ee810080e16ffb9133f62ce771a4ab0e979bea8b4bca890aa Status: Image is up to date for dustynv/ollama:main-r36.4.0
Thanks again for the reply.
I tried today again with Gemma 3:4B and it finally went through without any issues.
Is it because the docker was upgraded finally? Sorry if I sound weird as I am new to Linux and all this docker terminology 😅
Now I will just need to figure out myself on how to make the following command given by the Nvidia model site too to work on my Jetson Orin Nano: