Hi,
Unfortunately, we don’t have a tutorial for running LLMs on DLA.
On Jetson, you can try TensorRT-LLM or MLC for running a LLM model.
Thanks.
Hi,
Unfortunately, we don’t have a tutorial for running LLMs on DLA.
On Jetson, you can try TensorRT-LLM or MLC for running a LLM model.
Thanks.
Topic | Replies | Views | Activity | |
---|---|---|---|---|
TensorRT-LLM for Jetson | 11 | 2343 | July 7, 2025 | |
DLA specific classification/detection ml model | 4 | 422 | August 25, 2023 | |
Does TensorRT-LLM Supports on NVIDIA Jetson AGX Orin Edge Device? | 2 | 179 | July 29, 2024 | |
Running LLMs with TensorRT-LLM on Nvidia Jetson AGX Orin Dev Kit | 1 | 578 | December 8, 2024 | |
TensorRT-LLM for Jetson | 0 | 165 | November 13, 2024 | |
Can TensorRT-LLM be used on Jetson Orin NX with JetPack 6.1? | 6 | 245 | December 17, 2024 | |
Inquiry on any updated support for tensorrt-llm support nvidia orin AGX? | 4 | 41 | June 3, 2025 | |
TensorRT for Large Language Models | 2 | 590 | September 11, 2023 | |
Run AI models completely on Jetson AGX Orin DLAs | 4 | 463 | April 20, 2024 | |
Deploying Triton Server with TensorRT-LLM on Jetson AGX Orin (JetPack 6.2) — Any Working Example? | 10 | 203 | June 17, 2025 |