Onnx runtime gpu on jetson nano in c++

I am trying to install onnx runtime gpu version for jetson nano as the link:
I successfully installed, but i could not fins these files
libonnxruntime.so and libonnxruntime.so.1.12.0 and also onnxruntime_c_api.h, so i couls not run the code and load the model

As onnx does not have any release for aarch64 gou version, i tried merging their onnxruntime-linux-aarch64-1.11.0.tgz and the built gpu of jetson zoo, but did not work. The onnxruntime-linux-aarch64 provied by onnx works on jetson without gpu and very slow

How can i get onnx runtime gpu with c++ in jetson?


The package is for python users.

We are checking the C++based library internally.
Will share more information with you later.



Based on the discussion below, it required some manual steps for the C++ library.
Please build it from the source and copy the required header file as the suggestion in the comment.



I am trying to build ONNX runtime from source now, but got this error

CMake Error at /usr/local/share/cmake-3.23/Modules/CMakeDetermineCUDACompiler.cmake:311 (message):
CMAKE_CUDA_ARCHITECTURES must be valid if set.
Call Stack (most recent call first):
CMakeLists.txt:1697 (enable_language)
as jetpack 4.61 is supposed to have cuda installed, any idea of this problem?

fixed by removing the checking of CMAKE_CUDA_ARCHITECTURES condition in line 311 of file CMakeDetermineCUDACompiler.cmake

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.