How can I optimize Tensorflow codes using TensorRT?

Hi,

We are using a Github tutorial to implement object tracking on Jetson Nano 2GB, but the performance is not that good. We thought of using TensorRT to increase the performance.

Any help to integrate our existing code to TensorRT engine would be great.

The repository that we are using for our code is - https://github.com/theAIGuysCode/yolov4-deepsort.git

Thanks

Hi,

For TensorFlow user, please convert your model into ONNX format.
And you can deploy it with TensorRT directly.

Thanks.

Hi,

Could you please share any reference or tutorial that we could refer, it would be of great help.

Thanks

Hi,

You can convert the model into ONNX with tf2onnx.
And the ONNX file can be deployed with trtexec directly.

$ /usr/src/tensorrt/bin/trtexec --onnx=[onnx/model]

Thanks.