Ollama support for Jetson Nano

Robotics & Edge Computing Jetson & Embedded Systems Jetson Nano
1

I’m referring to this post Introducing Ollama Support for Jetson Devices

The topic is closed, so I can’t ask there. But the question is: Is Ollama support also meant to be available for old Jetson Nano? I suppose not, since I can’t make it run there… :)

2

Disregard. Will not work

4

Hi,

Which Jetson do you use? Is it Jetson Nano or Orin Nano?

We do provide Ollama containers for users to test.
But it requires the environment with JetPack 5 or JetPack 6:

Thanks.

5

The 2020 Jetson Nano, not Orin. I don’t believe in will work

6

Hi,

We don’t have a container for JetPack 4 environment.
But you can try to follow the steps in the below file to see if it can work:

Thanks.

7

If you are utilizing Ollama (which I suppose) I doubt this will work since Ollama only supports JP 5 or >=6

If you’re running on an NVIDIA JetPack system, Ollama can’t automatically discover the correct JetPack version. Pass the environment variable JETSON_JETPACK=5 or JETSON_JETPACK=6 to the container to select version 5 or 6.

also here

8

Basically Ollama works on 18.04/JP4. But just w/o GPU