Can Nano super run ollama gemma2:9b with 8GB RAM?

Autonomous Machines Jetson & Embedded Systems Jetson Orin Nano
1

Nano super is very good but has 8GB RAM only.

Does anyone tested to run Ollama gemma2:9b on it?

I want to get nano super but I am worry about if 8GB can run gemma2:9b.
I tested 2b is not good enough for my case.

I hope nano or nano super owner can help to run a quick test to see if Ollama gemma2:9b can run on Nano.

Thank you so much 🙏

3

We haven’t done the testing yet, but will target to get them run well.
Thanks

4

Hi @vtong , apologies for the delay - yes, we were able to get gemma-2-9B running on Orin Nano 8GB.

It is included in the benchmark results and scripts here: Benchmarks - NVIDIA Jetson AI Lab

If it runs out of memory for you, follow these directions mount swap and disable desktop UI: jetson-containers/docs/setup.md at master · dusty-nv/jetson-containers · GitHub