I’m curious why both nvstreammux and nvinfer have ‘batch-size’ parameters. I can understand one or the other, but I wonder if I’m missing something, as I try to understand why one would want them in both places.
More specifically, does batching in nvstreammux even have any point?
Thank you for the reply, but that doesn’t resolve my uncertainty.
If nvinfer batches independently of whatever nvstreammux does, then what’s the point (or benefit) of using batching within nvstreammux?
I’m not trying to be difficult - I just want to make sure I properly understand any interplay between these settings, or maybe I’m missing something about how other elements are affected.
For instance, if I set batch-size=2 on nvstreammux, and then batch-size=4 on nvinfer, does nvinfer repackage the incoming frames into 4-frame-batches, for further downstream elements? Or, does it process in 4-frame-batches, but still output results in the same 2-frame batches as were provided at input?
There are three secondary-gie and you would like these to have ‘batch-size=16’ and then do inferring, making primary-gie(batch-size=4) have higher priority of accessing GPU.
For the case with only primary-gie, you can simply set the batch-size identical to streammux.