Print average model inference time using tensorrt executable

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

I have noticed that with the latest tensorrt.exe version which was recently released (8.5), converting an onnx model using the terminal ‘tensorrt’ command, does not show the average/mean inference time at the end like before.

Is there a command line argument which prints them? I have checked everything in ‘tensorrt --help’ but nothing would pring the average inference time…

2

Hi,

Please try trtexec --verbose, which provides the summary along with TensorRT engine building.

Thank you.

5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.