How to set exactly number of runs for profiling engine model?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

I used command to see all option with trtexec but it only contains --avgRuns. It seems that trtexec automatically radomly choose number of runs greater than specific number.

/usr/src/tensorrt/bin/trtexec -h

I want to set exactly number of runs = 100 for profiling my engine models. I need to set same number of runs for fair comparison. I saw that each run to profile, trtexec choose different number of iterations to profile layers. Could you give an advice?

2

Hi,

Please try using the --iterations flag. Refer to the following document for more details:

Thank you.

3

Thanks for quick response. I did it.

6

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.