How to control amount of shared memory available to LLM on Jetson Thor?

Robotics & Edge Computing Jetson & Embedded Systems Jetson Thor
4

Hi,

Please try the steps below and restart the ollama container again to see if it helps.
It will enable the cache cleaner in the background:

$ wget https://raw.githubusercontent.com/NVIDIA-AI-Blueprints/video-search-and-summarization/refs/heads/main/deploy/scripts/sys_cache_cleaner.sh
$ sudo sh sys_cache_cleaner.sh &

Thanks