Orin Nano vs. LLM doable or not

Hello,

among other things I write article for German Linux Magazine. As LLMs are currently the ‘hot thing’ we would be interested to see if and if yes what LLMs are possible on the small board.
If this is a working solution it would be really great if someone could give at least SSH access to an orin nano so we can test and document how this is working.

Kind Regards,

Konstantin

Hi,

LLM can run on Orin Nano.

We have some tutorials and examples below:

You can also join the community meeting to gather more info:

Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.