Will this be available for Jetson Orin?
kayccc
2
Yes, we’re trying that, you can refer to LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui - Jetson & Embedded Systems / Jetson Projects - NVIDIA Developer Forums
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Does TensorRT-LLM Supports on NVIDIA Jetson AGX Orin Edge Device? | 2 | 322 | July 29, 2024 | |
| Running LLMs with TensorRT-LLM on Nvidia Jetson AGX Orin Dev Kit | 1 | 893 | December 8, 2024 | |
| TensorRT-LLM for Jetson | 11 | 4369 | July 7, 2025 | |
| Running LLM in jetson agx orin | 4 | 280 | March 4, 2026 | |
| NVIDIA NIM - TensorRT TurboXL | 2 | 436 | September 16, 2024 | |
| Tensort-RT LLM Support for Jetson | 2 | 123 | January 22, 2026 | |
| LLM library recomendations for maximum token speeds | 12 | 491 | March 30, 2026 | |
| Can TensorRT-LLM be used on Jetson Orin NX with JetPack 6.1? | 6 | 449 | December 17, 2024 | |
| TensorRT-LLM for Jetson | 0 | 313 | November 13, 2024 | |
| LLaMa 2 LLMs w/ NVIDIA Jetson and textgeneration-web-ui | 86 | 26337 | May 10, 2024 |