Hi,
Unfortunately, we don’t have a tutorial for running LLMs on DLA.
On Jetson, you can try TensorRT-LLM or MLC for running a LLM model.
Thanks.
Hi,
Unfortunately, we don’t have a tutorial for running LLMs on DLA.
On Jetson, you can try TensorRT-LLM or MLC for running a LLM model.
Thanks.
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| TensorRT-LLM for Jetson | 10 | 4804 | July 7, 2025 | |
| DLA specific classification/detection ml model | 3 | 517 | August 25, 2023 | |
| Does TensorRT-LLM Supports on NVIDIA Jetson AGX Orin Edge Device? | 1 | 376 | July 29, 2024 | |
| Running LLMs with TensorRT-LLM on Nvidia Jetson AGX Orin Dev Kit | 1 | 991 | December 8, 2024 | |
| TensorRT-LLM for Jetson | 0 | 372 | November 13, 2024 | |
| Can TensorRT-LLM be used on Jetson Orin NX with JetPack 6.1? | 5 | 504 | November 21, 2024 | |
| LLM library recomendations for maximum token speeds | 11 | 980 | March 16, 2026 | |
| Inquiry on any updated support for tensorrt-llm support nvidia orin AGX? | 3 | 372 | June 3, 2025 | |
| Running LLM in jetson agx orin | 3 | 607 | March 4, 2026 | |
| TensorRT for Large Language Models | 1 | 694 | September 11, 2023 |