Small LLMs and Mini VLMs on Orin Nano

Robotics & Edge Computing Jetson & Embedded Systems Jetson Projects
1

We’ve released new tutorials on Jetson AI Lab for running Small Language Models (SLM) and mini VLMs (Vision Language Models) on Orin Nano 8GB! Included are support for Phi-2, Gemma, StableLM, TinyLlama, in addition to efficient multimodal models like VILA!

Check out all the data and benchmarks here:

2 Likes