Before ordering

I am interested in setting up a private AI assistant that supports tool (function) calling.
Can this be done with Jetson Orion Nano?

I have been toying with Llama 3.2 3B Instruct on my computer with transformers in python but the generation is a bit slow so I am interested in this gadget for personal use. I envision making an app that connects to my Jetson, who responds with content messages and tool call requests.

Thanks for your time,
Lasse

Suggest to visit the blog to learn more about the NVIDIA Jetson Orin Super Developer Kit.

Also can refer to those projects sharing at Latest Jetson & Embedded Systems/Jetson Projects topics - NVIDIA Developer Forums to see if able to meet your requirement.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.