Nvstreamux process 1 frame in a batch at a time instead of 32 frames

[junshengy]

Do you mean your model only supports a fixed batch of 32 images as input? Does your model not support dynamic shape input?

nvstreammux doesn’t seem to guarantee this, as I mentioned above the batch-size property of nvstreammux is the maximum number of frames.
The multiple streams are the main scenario for DeepStream.

You can refer to this topic.

Nvinfer batch-size from video file input

For the live stream, you can never get the succeeded frames at the same time, you can only get them one by one according to the framerate or the time stamps. It is a must to wait for the frames to combine a batch. It has nothing to do with the decoding or inferencing speed. To combine frames from different streams are more efficient than frames from a single stream. The multiple streams are the main scenario for DeepStream.