Question about TensorRT reproducibility on different architectures

[spolisetty]

Hi @nk_white,

TensorRT engines do not produce the same results on different platforms. Please refer following post to know more details on your query.

Is TensorRT inference deterministic/reproducibile?

Hi @daniel.widmann, If you are using same engine with same input, TensorRT should be deterministic. However I don’t think engine building is supposed to be deterministic as tactics are chosen based on observed runtime. If you’re outputting your log with info level, you should be able to compare tactic selection between the two engines. Since different tactics/kernels could change order of operations, you would expect floating point differences. You can refer to the below link. Thanks!

Thank you.