Yes, we’re trying that, you can refer to LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui - Jetson & Embedded Systems / Jetson Projects - NVIDIA Developer Forums
kayccc
2
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Does TensorRT-LLM Supports on NVIDIA Jetson AGX Orin Edge Device? | 1 | 400 | July 29, 2024 | |
| Running LLMs with TensorRT-LLM on Nvidia Jetson AGX Orin Dev Kit | 1 | 1036 | December 8, 2024 | |
| TensorRT-LLM for Jetson | 10 | 5000 | July 7, 2025 | |
| Running LLM in jetson agx orin | 3 | 685 | March 4, 2026 | |
| NVIDIA NIM - TensorRT TurboXL | 1 | 482 | August 13, 2024 | |
| Tensort-RT LLM Support for Jetson | 1 | 272 | January 22, 2026 | |
| LLM library recomendations for maximum token speeds | 11 | 1172 | March 16, 2026 | |
| Can TensorRT-LLM be used on Jetson Orin NX with JetPack 6.1? | 5 | 522 | November 21, 2024 | |
| TensorRT-LLM for Jetson | 0 | 429 | November 13, 2024 | |
| LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui | 86 | 27108 | May 10, 2024 |