Hi
Have you maximized the device’s performance?
$ sudo nvpmodel -m 0
$ sudo jetson_clocks
You can find our benchmark table below.
VLM on Orin with VILA 1.5-3B is ~7fps.
Thanks.
Hi
Have you maximized the device’s performance?
$ sudo nvpmodel -m 0
$ sudo jetson_clocks
You can find our benchmark table below.
VLM on Orin with VILA 1.5-3B is ~7fps.
Thanks.
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Benchmarking VLM on Orin | 7 | 310 | March 2, 2026 | |
| Jetson nano 8G Run VLM Benchmark | 4 | 541 | March 5, 2025 | |
| Problem: slow LLM inference speed on Jetson AGX Orin 64GB | 2 | 900 | April 8, 2025 | |
| LLM library recomendations for maximum token speeds | 12 | 577 | March 30, 2026 | |
| Running llama3.3 or llama4 on Jetson AGX Orin Developer Kit (64 GB) | 8 | 1223 | May 12, 2025 | |
| LLaVA Live Demo | 8 | 233 | July 3, 2025 | |
| LLMs token/sec | 2 | 1263 | April 8, 2024 | |
| LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui | 86 | 26413 | May 10, 2024 | |
| VLM on video running on NVIDIA Jetson | 7 | 1496 | November 3, 2023 | |
| The token speed of qwen 2.5 vl 3b model is very lower on Jeston AGX Orin | 3 | 538 | September 22, 2025 |