Onnxruntime on JetPack 6.1

Robotics & Edge Computing Jetson Systems Jetson AGX Orin
1

Hi, how can I install onnxruntime on my AGX Orin with JetPack 6.1? I saw a previous post that had a link to a .whl file compatible with 6.1 but it appears that link no longer works.

Thanks,

Andrew

2

*** Please note that this reply is generated by LLM automatically ***

Installing ONNX Runtime on Jetson AGX Orin with JetPack 4.6.1 requires some manual steps since the pre-built wheel file is not available. Here’s a step-by-step guide to help you install ONNX Runtime:

Prerequisites

  1. Ensure you have JetPack 4.6.1 installed on your Jetson AGX Orin.
  2. Install the required dependencies:
sudo apt-get update
sudo apt-get install -y libatlas-base-dev libprotobuf-dev libleveldb-dev libsnappy-dev libopencv-dev libhdf5-dev

Build and Install ONNX Runtime

  1. Clone the ONNX Runtime repository:
git clone https://github.com/microsoft/onnxruntime.git
  1. Navigate to the ONNX Runtime directory:
cd onnxruntime
  1. Checkout the branch compatible with JetPack 4.6.1 (in this case, it’s the rel-1.10.0 branch):
git checkout rel-1.10.0
  1. Create a build directory and navigate to it:
mkdir build
cd build
  1. Run the CMake command to generate the build files:
cmake .. -DUSE_CUDA=ON -DUSE_CUDNN=ON -DCUDA_ARCH=80

Note: The CUDA_ARCH flag is set to 80, which is the architecture of the Jetson AGX Orin’s GPU.
6. Build the ONNX Runtime library:

make -j$(nproc)
  1. Install the ONNX Runtime library:
sudo make install

Install the ONNX Runtime Python Package

  1. Navigate to the ONNX Runtime Python package directory:
cd ../python
  1. Install the ONNX Runtime Python package using pip:
pip3 install .

Verify the Installation

  1. Run the following command to verify that ONNX Runtime is installed correctly:
onnxruntime --version

This should print the version of ONNX Runtime installed on your system.

Comparison with Previous Post

The previous post you mentioned likely provided a pre-built wheel file compatible with JetPack 4.6.1. However, since the link is no longer available, we had to build ONNX Runtime from source. The steps outlined above should help you install ONNX Runtime on your Jetson AGX Orin with JetPack 4.6.1.

I hope this helps, Andrew!

*** Please give the thumbs up if you get answers you like. Or provide feedback to help us improve the answer. ***

5

Hi,

You can find a package below:

Thanks.

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.