network camera capture window sometimes stops. (nvv4l2decoder)

Hi,

network camera capture window sometimes stops for about 200~ 500 ms
when using the following pipeline:
(The application will not stop.)

gst-launch-1.0 rtspsrc location=rtsp://[IP address] user-id=[ID] user-pw=[Password] ! rtph264depay ! h264parse ! nvv4l2decoder ! nvvideoconvert ! nvegltransform ! nveglglessink sync=false

however, it does not occur in the following cases. why?

gst-launch-1.0 rtspsrc location=rtsp://[IP address] user-id=[ID] user-pw=[Password] ! rtph264depay ! h264parse ! avdec_h264 ! nvvideoconvert ! nvegltransform ! nveglglessink sync=false

Depending on the network camera, the phenomenon may or may not occur.
If you need information on the network camera where the phenomenon occurs, we can provide it.

Hi,
Please share your device(Jetson platforms or x86 dGPU) and release version.
If you use Jetson platform, please check if the issue also happens in using nvoverlaysink:

gst-launch-1.0 rtspsrc location=rtsp://[IP address] user-id=[ID] user-pw=[Password] ! rtph264depay ! h264parse ! nvv4l2decoder ! nvoverlaysink sync=false

Thanks for reply.

The phenomenon also occurred in nvoverlaysink.

I’m using Xavier(Jetpack 4.2.2).
DeepstreamSDK is 4.0.1-1.

Hi,
You can use GST_DEBUG=5 environment variable to enable gstreamer debug logs,
gstreamer will likely print the reason for the stream stopping.

Thanks

Hi,
Please check if you can run
https://devtalk.nvidia.com/default/topic/1058086/deepstream-sdk/how-to-run-rtp-camera-in-deepstream-on-nano/post/5366807/#5366807

If it is working, please replace uri with your RTSP source and try again.
If possible, you may share brand and modelID of the camera for reference.

I tried test-launch but no phenomenon happened.

The phenomenon happens with the following IP cameras.

HIKVISION : DS-2CD2722FWD-IZS

However, the phenomenon does not happen in the following models.

HIKVISION : DS-2CD2720F-IZS

I’m sorry, I haven’t tried many models.

I don’t know if it’s useful, but I’ll paste the ffprobe result.

HIKVISION : DS-2CD2722FWD-IZS

Metadata:
    title           : Media Presentation
  Duration: N/A, start: 1.517000, bitrate: N/A
    Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 4 fps, 30 tbr, 90k tbn, 8 tbc

HIKVISION : DS-2CD2720F-IZS

Metadata:
    title           : Media Presentation
  Duration: N/A, start: 1.417000, bitrate: N/A
    Stream #0:0: Video: h264 (Main), yuv420p(progressive), 1280x720, 4 fps, 30 tbr, 90k tbn, 8 tbc

Thanks for reply. I will check it.
However, the stream does not stop. The phenomenon that the frame freezes often occurs.

Hi,
There are some properties in nvv4l2decoder:

num-extra-surfaces  : Additional number of surfaces in addition to min decode surfaces given by the v4l2 driver
                      flags: readable, writable, changeable only in NULL or READY state
                      Unsigned Integer. Range: 0 - 24 Default: 1

disable-dpb         : Set to disable DPB buffer for low latency
                      flags: readable, writable
                      Boolean. Default: false

enable-full-frame   : Whether or not the data is full framed
                      flags: readable, writable
                      Boolean. Default: false

enable-max-performance: Set to enable max performance
                    flags: readable, writable
                    Boolean. Default: false

Please configure these and check again.