The default values for builder->setAverageFindIterations and builder->setMinFindIterations are 1 and 2, respectively. When changing these values, the builder seems to choose a different set of cuda kernels for the engine.
Is this expected? I assume that those parameters are used to time the layers during building and the timing is in turn used to select the fastest cuda kernels for the available GPU. So I guess this is expected? Can you confirm?
Are there any recommended values for those parameters? I would assume setting these parameters higher would make the selection of cuda kernels more robust to small variations in timing. But, for example, doing builder->setAverageFindIterations(1) and builder->setMinFindIterations(1) makes the resulting engine run slightly faster than with builder->setMinFindIterations(2) – for ResNet50 on V100.