I tried running Yolov3 on my system, with and without TensorRT. The GPU usage are:
Without Tensorrt - 1500Mb
With Tensorrt - 600Mb
The tensorrt manages to reduce the GPU usage (which might be due to layer fusion, if i am not wrong), but the problem is the time require to process one frame is still same. Both of them are taking 0.9sec to process one frame.
I was expecting a significant improvement in FPS, but that doesn’t happen. Kindly help me to solve this issue. Maybe i am missing something.
I am using-
The code is from Sample Folder