RTSP latency does not work with NVSTREAMMUX

Accelerated Computing Intelligent Video Analytics DeepStream SDK
16

@DaneLLL, something I have noticed while testing this again.

If I run the compositor sample above with 8 RTSP streams with different latency values, jtop reports the following:

  • Smaller than 500 (ms) NVDEC is running at 716MHz
  • Between 500 and 1000 (ms), NVDEC is running at 396MHz, and intermittently up to 650MHz
  • Greater than 1000 (ms), NVDEC is consistently running at 396MHz

A latency of 500ms provides super smooth playback for me.

When running your latest provided command:

gst-launch-1.0 \
  rtspsrc location=$RTSP_PATH1 latency=5000 ! decodebin ! mux.sink_0 \
  nvstreammux name=mux batch-size=1 batched-push-timeout=40000 width=1920 height=1080 live-source=true \
  ! nvoverlaysink

jtop reports the following:

  • NVDEC=Off after the first frame is shown and the playback is paused/buffered
  • NVDEC=396MHz when is starts playing and fast-forwards after the 5 seconds pause
  • NVDEC=716MHz after it has catched up (and the lagginess returns)

It might suggest that the hardware decoder is overloaded and becomming a bottleneck due to no “latency buffer”.