Set the shape of each element in multiple batches


Hello everyone, I am using Tensorrt for multi batch inference. If each shape in the batch is the same, it can be set as fixed. If the shape of each image in my batch is different, how should I set it?

Input case

batch_size =6
batch_0_shape = 3*100*100
batch_1_shape = 3*150*150
batch_2_shape = 3*200*200
batch_3_shape = 3*250*250
batch_4_shape = 3*300*300
batch_5_shape = 3*350*350

In a batch, each shape entered is different ,How to call API ?

Looking forward to your reply

Hi @1342868324 ,
Checking on this with the Engineering team.