Does TensorRT-LLM Supports on NVIDIA Jetson AGX Orin Edge Device?

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

I came to know that TensorRT-LLM does not officially support the NVIDIA Jetson AGX Orin device yet.
What if unofficially I want to make an provision to install and setup the inference engine, what settings you will recommend?

2 Likes
4

Hi,

There is some compatibility when installing TensorRT-LLM on Jetson.
We recommended to wait for our official release.

Thanks.

1 Like
6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.