Hi, both
This issue is related to the r36.4.7 update and has a failure rate.
You might see either ‘cudaMalloc failed: out of memory’ or ’ unable to allocate CUDA0 buffer’.
The underlying error for both cases are (in Ollama log):
NvMapMemAllocInternalTagged: 1075072515 error 12
Our internal team is working on the issue.
Will update more information with you later.
Thanks.