GPU accelerated ONNX wheel from eLinux

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
1

We are looking for an official Jetson compatible ONNX wheel that supports GPU acceleration. In an older post on AGX forum, nvidia moderator @AastaLLL recommended a ONNX wheel from the eLinux website: Jetson Zoo - eLinux.org

Is this an official resource from nvidia which we can use in our products? The links provided there are linking to nvidia.box.com, which seems to be an official nvidia Box account.

If yes, why are these wheels not referenced on the offical developer resources (Index of /compute/redist/jp/v60)?
Are they compatible with Jetson Orin Nano, as the Website simply states “Jetson Zoo”?

3

Hi,

Do you mean ONNXRuntime package?

The ONNXruntime package in eLinux is built by the ONNXruntime team.
From JetPack 6.1, we collect all the ML packages in the link below:

http://jetson.webredirect.org/jp6/cu126

As these are third-party libraries, it doesn’t have a test plan before release.
If you want some libraries that are wildly verified, please switch to our TensorRT library instead.

Thanks.

4

Thank you for your explanation.
Who is this ONNXruntime team? Is this an open source project / initiative or is this a group inside of Nvidia?
I was initially expecting that the components on eLinux are independent of Nvidia, but then i was surprised that the download links link to an official Nvidia webpage. So these packages seem to be build by Nvidia employees?

5

Hi,

ONNXruntime is from Microsoft.
You should be able to find them on GitHub.

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.