&&&& FAILED TensorRT.trtexec [TensorRT v8502]

AI & Data Science Deep Learning (Training & Inference) TensorRT
, ,
1

Hi,

I have converted saved model (mask rcnn) to onnx format, but I am facing issue during conversion of onnx model to tensorrt format on Jetson orin (8 GB).

Screenshot (636)
Screenshot (636)947×525 16.3 KB

Versions:

TensorRT Version: 8.5.2
Jetpack version: 5.1.2
CUDA Version: 11.4
TensorFlow Version: 2.12.0 +nv23.6
onnx : 1.14.1
tf2onnx: 1.15.1

Steps To Reproduce

  • I have used this command to convert mask rcnn-saved model (tf) to onnx format:
    tf2onnx.convert --saved-model material/saved_model --output onnx/material/saved_model.onnx
  • And then ONNX → TensorRT using:
    /usr/src/tensorrt/bin/trtexec --onnx=onnx/material/saved_model.onnx --saveEngine=onnx/material/saved_model.trt

Thanks in advance

2

Hi @ShreyaNaik ,
Can you please help us with the onnx model and repro script.

Thanks

4

Hi @AakankshaS ,

To reproduce this issue, you can download the Material type model (V2) from this Model link and try to convert it to onnx format and then tensorrt.