# Inference with jetson nano

**URL:** <https://forums.developer.nvidia.com/t/inference-with-jetson-nano/213726>\
**Category:** Jetson Nano\
**Tags:** jetson-inference\
**Created:** [May 8, 2022, 10:16am UTC](https://forums.developer.nvidia.com/t/inference-with-jetson-nano/213726 "2022-05-08T10:16:58Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![deepak11.iitb](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@deepak11.iitb](https://forums.developer.nvidia.com/u/deepak11.iitb)\
**Post date:** [May 8, 2022, 10:16am UTC](https://forums.developer.nvidia.com/t/inference-with-jetson-nano/213726/1 "2022-05-08T10:16:58Z")

</div>

I have trained the model in local on Tensorflow and converted that model to .onnx format.  
and used these code to inference.  
[jetson-inference/imagenet-example-python-2.md at master · dusty-nv/jetson-inference · GitHub](https://github.com/dusty-nv/jetson-inference/blob/master/docs/imagenet-example-python-2.md) .

import jetson.inference  
import jetson.utils

import argparse

parser = argparse.ArgumentParser()  
parser.add\_argument(“filename”, type=str, help=“filename of the image to process”)

args = parser.parse\_args()

img = jetson.utils.loadImage(args.filename)

net = jetson.inference.imageNet(‘alexnet’,[‘–model=/home/sudhir/Downloads/AJAX/ResNet18.onnx’,‘–input\_blob=input\_0’,‘–output\_blob=output\_0’,‘–labels=/home/sudhir/Downloads/AJAX/label.txt’])

class\_idx, confidence = net.Classify(img)

class\_desc = net.GetClassDesc(class\_idx)

print(“image is recognized as ‘{:s}’ (class #{:d}) with {:f}% confidence”.format(class\_desc, class\_idx, confidence \* 100))

and was getting error like these.

failed to parse ONNX model ‘/home/sudhir/Downloads/AJAX/ResNet18.onnx’  
[0m [0;31m[TRT] device GPU, failed to load /home/sudhir/Downloads/AJAX/ResNet18.onnx  
[0m [0;31m[TRT] failed to load /home/sudhir/Downloads/AJAX/ResNet18.onnx  
[0m [0;31m[TRT] imageNet – failed to initialize.

how can i inference my own .onnx model on jetson nano

---

<div class="post-metadata">

**Author:** ![AastaLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aastalll/32/14043_2.png) [@AastaLLL](https://forums.developer.nvidia.com/u/AastaLLL)\
**Post date:** [May 9, 2022, 3:20am UTC](https://forums.developer.nvidia.com/t/inference-with-jetson-nano/213726/3 "2022-05-09T03:20:39Z")

</div>

Hi,

Since _jetson\_inference_ uses TensorRT as inference engine, could you try your model with TensorRT first?

```auto
$ /usr/src/tensorrt/bin/trtexec --onnx=[your/model]

```

Thanks.

---

<div class="post-metadata">

**Author:** ![deepak11.iitb](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@deepak11.iitb](https://forums.developer.nvidia.com/u/deepak11.iitb)\
**Post date:** [May 17, 2022, 10:08am UTC](https://forums.developer.nvidia.com/t/inference-with-jetson-nano/213726/4 "2022-05-17T10:08:11Z")

</div>

i have executed $ /usr/src/tensorrt/bin/trtexec --onnx=[your/model] this command and it has passed and also saves the .trt model now how can i inference the .trt model

---

<div class="post-metadata">

**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\
**Post date:** [June 14, 2022, 6:48am UTC](https://forums.developer.nvidia.com/t/inference-with-jetson-nano/213726/7 "2022-06-14T06:48:02Z")

</div>

Closed on June 14, 2022, 6:48am UTC

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.
