Does nvstreammux support temporal batching from a single source?

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Hi,

I would like to run inference on a batch of N temporally contiguous frames from a single source, but it seems that nvstreammux is designed to only batch across multiple sources at the current clock time.

Does nvstreammux support this type of batching? If not, can this type of batching be achieved without writing a custom plugin?

Thanks.

2

Hi Jonckq54,

I am sorry to say, currently we don’t have support temporal batch.
And we don’t have plan to support it in next release.

Thanks
wayne zhu

3

Hey @waynezhu and Nvidia team

Just double checking, I think temporal batching is currently happening in DS 5.0.2

Ex: if I have a single source, set streammux batch-size to 2, and run the pipeline with GST_DEBUG=nvstreammux:7 , I see the following in the logs (TRACE statements removed)

0:00:35.027607891 2284994 0x7f5d8c014b20 LOG              nvstreammux gstnvstreammux.c:362:gst_nvstreammux_chain:<nvstreammux0> Got buffer 0x7f5da40037b0 from source 0

0:00:35.028787603 2284994 0x7f5d8c014b20 LOG              nvstreammux gstnvstreammux.c:362:gst_nvstreammux_chain:<nvstreammux0> Got buffer 0x7f5da4003590 from source 0

0:00:35.029564367 2284994 0x7f5d8c012ed0 DEBUG            nvstreammux gstnvstreammux.c:2196:gst_nvstreammux_src_push_loop:<nvstreammux0> Pushing buffer 0x7f5d8c470370, batch size 2, PTS 0:00:19.352666512
0:00:35.029594414 2284994 0x7f5d8c012ed0 DEBUG            nvstreammux gstnvstreammux.c:2218:gst_nvstreammux_src_push_loop:<nvstreammux0> STREAMMUX OUT BUFFER attached timestamp 0:00:19.352666512

Can you clarify?

1 Like
4

Hi rsnk96,

Please help to open a new topic for your issue. Thanks