I am interested in setting up a private AI assistant that supports tool (function) calling.
Can this be done with Jetson Orion Nano?
I have been toying with Llama 3.2 3B Instruct on my computer with transformers in python but the generation is a bit slow so I am interested in this gadget for personal use. I envision making an app that connects to my Jetson, who responds with content messages and tool call requests.
Thanks for your time,
Lasse