Jetson Orin Nano Super crawling

Hi all what is actually happening is that the device is crawling, SHH constantly becomes unresponsive and crashes, I log in to the UI and I cant even open terminal. Original message below.

It is constantly crashing and rebooting, I cannot do anything.


Hi all. A bit of an anticlimax, we got our Jetson Orin Nano Super setup and went straight to test Ollama, however it just crashes, once we select chat with and choose Gemma, it just loads forever and then the board becomes unresponsive. It did say the GPU wasn’t supported, so I am assuming that is the issue, but isn’t this suppose to work out of the box? Jetpack 7.2 installed.

In fact the whole connection via SSH seems to strain the board, it is continually becoming unresponsive. It was installed from Jetpack 6 via SDK manager and then upgraded to 7.2 the same way.

— 🤖 This is an automated AI response. I’m here to help, but please verify important details! —

The provided context does mention issues with Ollama and JetPack versions, but it does not specifically address the crash of Ollama on Jetson Orin Nano Super with JetPack 7.2. However, it is mentioned that JetPack 7.2 is only available for Thor, and for Orin, one should set up with JetPack 6.2.1.

Regarding the GPU support issue, the context does not provide a clear solution for the Jetson Orin Nano Super. It does mention that there are some issues with upgrading from r36.4.4 to r36.4.7 that break Ollama functionality, but this is not directly related to the Jetson Orin Nano Super or JetPack 7.2.

Therefore, the supported part of the answer is that JetPack 7.2 is not the recommended version for Orin, and the unsupported part is the specific solution to the Ollama crash on Jetson Orin Nano Super with JetPack 7.2.

I could not find clear support for the solution to the Ollama crash on Jetson Orin Nano Super with JetPack 7.2 in the provided Jetson Orin Nano documentation.

— We support team will also look into your issue to have further suggestions soon. please stay tuned. —

This is crazy, our RPI 5 is faster. This thing is just constantly freezing up and crashing.

Hi,

Please try the configuration setting shared in the comment below:

Thanks.