See dynamic shapes.
TensorRT Developer Guide :: NVIDIA Deep Learning SDK Documentation
Some topics, for example,
trtexec dynamic batch size · Issue #976 · NVIDIA/TensorRT · GitHub
Trtexec and dynamic batch size - #5 by NVES
Morganh
7
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| AGX Xavier dynamic batches | 1 | 474 | December 28, 2020 | |
| How could I change the batchsize during inference when using a tensorRT model converted by onnx? | 7 | 4938 | September 17, 2021 | |
| about working with dynamic shapes | 5 | 1260 | January 9, 2020 | |
| Cannot convert model with dynamic input shape to TRT engine | 8 | 1346 | September 9, 2021 | |
| How can I use the dynamic shape of tensorrt ？ | 3 | 2354 | April 8, 2021 | |
| Tensorrt Error when using dynamic batch: data: kMIN dimensions in profile 0 are [24,3,224,224] but input has static dimensions [48,3,224,224] | 3 | 2566 | February 8, 2022 | |
| TensorRT use dynamic batch or specified batch? | 3 | 2074 | November 8, 2022 | |
| Processing a dynamic input tensor containing different size images (batch size = 2, each batch contains images of a different size) | 4 | 1627 | May 5, 2022 | |
| Trtexec and dynamic batch size | 4 | 5747 | July 22, 2021 | |
| Built engine failed to include optimization profile with dynamic input shapes #2166 | 3 | 610 | July 22, 2022 |