Explanation about batch-size


I’m running 1000 cameras in my custom DeepStream code. About nvinfer and nvstreammux, should I set the batch-size = 1000 for both? I’m facing a high GPU memory usage with high values of batch-size. Can you explain about how I need to set the batch-size for this situation (high cameras number) without reaching the GPU memory limit?

I’m using:

Sorry for the late response, will get back to you soon.


Can you have a try with small batch-size?

Gst-nvinfer — DeepStream 5.1 Release documentation (nvidia.com)

Gst-nvstreammux — DeepStream 5.1 Release documentation (nvidia.com)

Yes, I’m testing with lower and higher batch-size for both. But, is there some problem by using, for example, batch-size 1 for both (nvinfer and nvstreammux) with 1000 cameras (besides inferior performance)?

You can set right batch size to balance performance and memory footprint. such as 32.

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.