Small LLMs and Mini VLMs on Orin Nano

We’ve released new tutorials on Jetson AI Lab for running Small Language Models (SLM) and mini VLMs (Vision Language Models) on Orin Nano 8GB! Included are support for Phi-2, Gemma, StableLM, TinyLlama, in addition to efficient multimodal models like VILA!

Check out all the data and benchmarks here:

1 Like