TRT engine created on Tesla T4, Quadro P1000 but engine creation fails on Jetson AGX Xavier

[AastaLLL]

Hi,

Please update your model into float-type input format with the below comment:

Exporting Tensorflow models to Jetson Nano

Hi, Elviron The root cause is onnx expects input image to be INT8 but TensorRT use Float32. To solve this issue, you can modify the input data format of ONNX with our graphsurgeon API directly. 1. Install ONNX Graphsurgeon API $ sudo apt-get install python3-pip libprotobuf-dev protobuf-compiler $ git clone https://github.com/NVIDIA/TensorRT.git $ cd TensorRT/tools/onnx-graphsurgeon/ $ make install 2. Modify your model import onnx_graphsurgeon as gs import onnx import numpy as np graph = g…

After that, you will meet a reshape issue like below:

[07/27/2021-16:22:53] [E] [TRT] Reshape_78: -1 wildcard has infinite number of solutions or no solution
[07/27/2021-16:22:53] [E] [TRT] Builder failed while analyzing shapes.

The error indicates that the reshape layer use -1 which is supported with TensorRT currently.
Is it possible to replace the dimension with some pre-defined value?

Thanks.