Thank you for your quick response.
Unfortunately all of these samples use TF-TRT.
I will be ultimately trying to build engines on the Jetson AGX Xavier with this ONNX model, although I am currently building on a laptop. As far as I am aware, there are many disadvantages to using TF-TRT, such as the high runtime memory usage and disk space required for installing TensorFlow.
I also do not believe it is also possible to directly generate .plan files for models generated with TensorFlow 2. This is based on my tests with the Python TF-TRT API, and fact that the parameter is_dynamic_op=True for TensorFlow 2. Please correct me if I am mistaken, as that would be a suitable workaround.
Is it possible to generate a pure TensorRT engine for this ONNX model? I have shared the model and script (single command) so you may try to reproduce the issue.