Performance using the integration TensorFlow-TensorRT vs direct TensorRT

hi all,

Are there some benchmarks that show the performance difference using TensorRT with integration TensorFlow-TensorRT versus direct TensorRT?

Hello,

We don’t currently have benchmarks comparing TRT vs. TFTRT.

Hi NVES, I found this plot showing TRT vs. TF-TRT. Is there some technical justification on why TF-TRT performs almost half of TRT’s throughput as shown in this plot?

That’s based on very old TensorRT (version 3).

We are working on an updated TRT vs TFTRT comparison. I cannot share more information about future release here. Stay tuned.

Hi, I wonder @sanchezvr7 where did you find this plot image?. @nves, do you update any comparison results of TRT and TFTRT recently?

hi @masaf494d, I found that plot at https://devblogs.nvidia.com/tensorrt-integration-speeds-tensorflow-inference/. I haven’t be able to get good comparison between TRT and TFTRT, see the issue here https://github.com/NVIDIA/tensorrt-inference-server/issues/239. Please keep me posted with your progress

1 Like

Since almost a year has passed, does NVIDIA has any update on the TFTRT vs TRT benchmark yet?