Dynamic Engine files

kunal.sahoo2003 · May 15, 2025, 3:27am

Is it possible to export an .ONNX file to .engine file with dynamic batch sizes? I want to create one .engine file and use it for different batch sizes.

spolisetty · May 19, 2025, 4:22am

@kunal.sahoo2003,
Yes, it is supported. Please refer to the documentation below.

Using trtexec:

Topic		Replies	Views
How to support dynamic batch size for TensorRT engine? TensorRT	1	1088	March 3, 2023
File extension of output of trtexec TensorRT	4	1190	July 18, 2022
How can I use the dynamic shape of tensorrt ？ TensorRT	3	2192	April 8, 2021
Dynamic batch size TensorRT	3	4324	January 24, 2023
The same onnx file produces engine files with different size under same configurations TensorRT	4	678	May 12, 2022
Can etlt convert a dynamic engine? DeepStream SDK	3	242	March 1, 2024
How to convert .onnx to .trtmodel tensorrt using trtexec with size output optional TensorRT	2	1143	September 11, 2024
File size vs. batch size for TensorRT serialized engine files TensorRT tensorrt	1	556	September 30, 2020
Build engine from onnx model, can not set dynamic shape right TensorRT	5	921	July 24, 2023
Whether dynamic dimensional model transformation is supported？ TensorRT	1	365	November 26, 2020

Dynamic Engine files

Related topics