Importing a ONNX model for performing an inference using TensorRT

[AastaLLL]

Hi,

Do you meet an error like " Unsupported ONNX data type: UINT8 ".

This is a known issue since ONNX by default use INT8 as input data type while TensorRT expects FP32.
You can fix this issue by modifying the data format with our ONNX Graphsurgeon API.

Please check below comment for the detailed information:

Exporting Tensorflow models to Jetson Nano

Hi, Elviron The root cause is onnx expects input image to be INT8 but TensorRT use Float32. To solve this issue, you can modify the input data format of ONNX with our graphsurgeon API directly. 1. Install ONNX Graphsurgeon API $ sudo apt-get install python3-pip libprotobuf-dev protobuf-compiler $ git clone https://github.com/NVIDIA/TensorRT.git $ cd TensorRT/tools/onnx-graphsurgeon/ $ make install 2. Modify your model import onnx_graphsurgeon as gs import onnx import numpy as np graph = g…

Thanks.