Is onnxruntime-genai supported on Jetson?

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin NX
1

Hi, Guys~

We found the onnx runtime genai information at the link below.

However, I am unable to install & execute the model seamlessly.

Is ONNX runtime-genai officially supported on Jetson devices?

Thanks

3

Hi,

We need to check with the team and provide more info to you later.
Thanks.

5

Hi, Do you have any updates?
Could you please confirm only if it’s official?

6

Hi,

We are still checking this internally.
Will provide more into to you.

Thanks.

7

Hi,

The Dockerfile can be found in the below link:

Just confirmed that it should work on the Jetson.
Thanks.

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.