TensorRT incorrect predictions for segmentation

AI & Data Science Deep Learning (Training & Inference) JAX
1

I am trying to do a segmentation model tensorrt inference. It is giving incorrect results.
(tensorrt version: ‘8.4.1.5’)

tensorrt_result
tensorrt_result804×415 13.6 KB

Attached the necessary files to reproduce the issue.
cmap_cityscapes.npy (356 Bytes)
model.onnx (11.5 MB)
model_fp32.engine (12.5 MB)
Nvidia_TensorRT.ipynb (48.3 KB)

sample_input
sample_input1024×512 41.7 KB

2

Hi @dheerajmadda ,
Apologies for the miss,
I am trying to reproduce the issue from my end, Will update you soon.

Thanks

1 Like
3

Any update on this please? The tensorRT is producing zeros as outputs.