TensorRT Plan Building Deterministic

Is plan generation though TensorRT deterministic, or should I expect variances in the generated plan file?


Two plan files generated at different time may not be the same.

The GPU compute capability, precision and supported ops are deterministic in the plan file. The only possible way to change them is to prepare several plan files (or alternatively several engines) with different configurations.