Trying to understand why Streammux and Nvv4l2decoder has higher latency relative to other elements in my pipeline

[junshengy]

@adityawasnik91

Latency of nvv4l2decoder is not consistent across batche numebrs.
I see that initially it is very low. But for the later batch numbers, it goes very high.

This is not accurate. The following is the content from the log you provided:

Comp name = nvv4l2decoder7 in_system_timestamp = 1752826039350.527100 out_system_timestamp = 1752826039456.232910               component latency= 105.705811

But I think this is normal. I think your rtsp stream contains b frames. When nvv4l2decoder decodes these b frames, it needs to wait for the reference i frames and p frames to be received and decoded. This may result in delayed data accuracy

@adityawasnik91

my MUXER_BATCH_TIMEOUT is 150
and streammux Batch Size is = number of sources.

Please refer to this FAQ.

DeepStream SDK FAQ

26.[Deepstream6.2 Gst-nvstreammux & Gst-nvstreammux New]How to set parameters reasonably to improve the efficiency of nvstreammux in live mode Gst-nvstreammux: Set the batch-size to the number of sources export NVSTREAMMUX_ADAPTIVE_BATCHING=yes If you want to get high fps, set the batched-push-timeout to the (1000000 us/maximum fps among the videos) Gst-nvstreammux New(export USE_NEW_NVSTREAMMUX=yes): Set the batch-size to the number of sources Should not turn off the adaptive-batching par…

If you have multiple RTSP cameras, nvstreammux will be affected by the slowest stream when forming a batch.