Run onnx model on jetson nano

[harsha.tejas2002]

I trained a object detection model using faster-rcnn in pytorch and have converted the model into onnx. How do i run this onnx model on jetson nano?

[AastaLLL]

Hi,

You can use either onnxruntime or TensorRT.

ONNXRuntime: please find below page to install the onnxruntime package for Jetson:
https://elinux.org/Jetson_Zoo#ONNX_Runtime

TensorRT: please check below topic for the example:

Custom ResNet Jetson Xavier

Hi, The error comes from dynamic shape usage. If you don’t need to reshape the model at the runtime, please set EXPLICIT_BATCH to use static shape instead. Here is an example of onnx model for your reference: import cv2 import time import numpy as np import tensorrt as trt import pycuda.autoinit import pycuda.driver as cuda EXPLICIT_BATCH = 1 << (int)(trt.NetworkDefinitionCreationFlag.EXPLICIT_BATCH) TRT_LOGGER = trt.Logger(trt.Logger.INFO) runtime = trt.Runtime(TRT_LOGGER) host_inputs = …

Thanks.