Onnxruntime link for 1.20

Robotics & Edge Computing Jetson Systems Jetson Orin NX
,
1

Hello, I have the same issue as this post Jepack 6.1 on Jetson ORIN NX not support onnxruntime
I can’t do any inference on GPU with onnxruntime using CuDNN9 on JetPack 6.1.
But the link is not working anymore. The JetsonZoo is not up to date after onnxruntime version 1.19 ( wich is not working for this issue) and the link on Jetson-ai-lab ( in this post Onnx runtime GPU ) seems to be dead.

Could you provide a link for the onnxruntime1.20 wheel please ?

Thanks,

2

*** Please note that this reply is generated by LLM automatically ***

I’d be happy to help you with your question.

It seems like you’re experiencing an issue with ONNX Runtime on your Jetson Orin NX device, specifically with JetPack 6.1. You’re looking for a solution to enable GPU inference with ONNX Runtime using CuDNN 9.

After reviewing the context, I found that there isn’t a direct link to the ONNX Runtime 1.2.0 wheel provided in the text. However, I can guide you through some possible steps to resolve your issue:

  1. Check the NVIDIA Developer Forum: You can try searching for the ONNX Runtime 1.2.0 wheel on the NVIDIA Developer Forum, specifically in the Jetson Orin NX section. It’s possible that someone has shared a working solution or a link to the wheel.
  2. Visit the ONNX Runtime GitHub page: You can check the ONNX Runtime GitHub page for the latest releases and wheels. They might have a pre-built wheel for JetPack 6.1 and CuDNN 9.
  3. Contact NVIDIA Support: If you’re unable to find a solution, you can reach out to NVIDIA Support directly. They might be able to provide you with a working wheel or guide you through the process of building one.
  4. Consider alternative solutions: If you’re unable to get ONNX Runtime working, you might want to explore alternative solutions for GPU inference on your Jetson Orin NX device. For example, you could try using TensorFlow or PyTorch, which have better support for JetPack 6.1.

In comparison to other Jetson devices, the Jetson Orin NX has similar power and performance management features to the Jetson AGX Orin series. However, the Jetson Orin NX has a different architecture and might require specific configurations for ONNX Runtime.

To summarize, I couldn’t find a direct link to the ONNX Runtime 1.2.0 wheel in the provided context. However, I’ve suggested some possible steps to help you resolve your issue. If you have any further questions or need more guidance, feel free to ask!

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

5

Hi,

You can find our latest onnxruntime-gpu package in the link below:

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.