Jetson AI Lab - Agent Controller LLM

Self-Learning Llama-3 Voice Agent with Function Calling and Automatic RAG

Enable the LLM (Meta-Llama-3-8B) to invoke Python functions you give it access to, including the ability to save/retrieve info that it learns about you over time. Run locally on Jetson Orin, using Llama-3-8B-Instruct, Riva ASR, and Piper TTS through NanoLLM.

See the docs for function calling here: Chat — NanoLLM 24.4.2 documentation

2 Likes