Save serialized TF-TRT engine to reuse in Deepstream

AI & Data Science Deep Learning (Training & Inference) TensorRT
6

Thank you for the fast response,

I followed your steps and I got the following error when I tried to build the engine

error
error1878×554 130 KB

I converted uint8 to int32 using the following code:

import onnx_graphsurgeon as gs
import onnx
import numpy as np

graph = gs.import_onnx(onnx.load("deeplabv3.onnx"))
for inp in graph.inputs:
    print(inp)
    inp.dtype = np.int32

onnx.save(gs.export_onnx(graph), "deeplabv3_int32.onnx")