network camera capture window sometimes stops. (nvv4l2decoder)

Accelerated Computing Intelligent Video Analytics DeepStream SDK
#1

Hi,

network camera capture window sometimes stops for about 200~ 500 ms
when using the following pipeline:
(The application will not stop.)

gst-launch-1.0 rtspsrc location=rtsp://[IP address] user-id=[ID] user-pw=[Password] ! rtph264depay ! h264parse ! nvv4l2decoder ! nvvideoconvert ! nvegltransform ! nveglglessink sync=false

however, it does not occur in the following cases. why?

gst-launch-1.0 rtspsrc location=rtsp://[IP address] user-id=[ID] user-pw=[Password] ! rtph264depay ! h264parse ! avdec_h264 ! nvvideoconvert ! nvegltransform ! nveglglessink sync=false

Depending on the network camera, the phenomenon may or may not occur.
If you need information on the network camera where the phenomenon occurs, we can provide it.

#2

Hi,
Please share your device(Jetson platforms or x86 dGPU) and release version.
If you use Jetson platform, please check if the issue also happens in using nvoverlaysink:

gst-launch-1.0 rtspsrc location=rtsp://[IP address] user-id=[ID] user-pw=[Password] ! rtph264depay ! h264parse ! nvv4l2decoder ! nvoverlaysink sync=false
#3

Thanks for reply.

The phenomenon also occurred in nvoverlaysink.

I’m using Xavier(Jetpack 4.2.2).
DeepstreamSDK is 4.0.1-1.

#4

Hi,
You can use GST_DEBUG=5 environment variable to enable gstreamer debug logs,
gstreamer will likely print the reason for the stream stopping.

Thanks

#5

Hi,
Please check if you can run
https://devtalk.nvidia.com/default/topic/1058086/deepstream-sdk/how-to-run-rtp-camera-in-deepstream-on-nano/post/5366807/#5366807

If it is working, please replace uri with your RTSP source and try again.
If possible, you may share brand and modelID of the camera for reference.

#6

I tried test-launch but no phenomenon happened.

The phenomenon happens with the following IP cameras.

HIKVISION : DS-2CD2722FWD-IZS

However, the phenomenon does not happen in the following models.

HIKVISION : DS-2CD2720F-IZS

I’m sorry, I haven’t tried many models.

#7

I don’t know if it’s useful, but I’ll paste the ffprobe result.

HIKVISION : DS-2CD2722FWD-IZS

Metadata:
    title           : Media Presentation
  Duration: N/A, start: 1.517000, bitrate: N/A
    Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 1280x720 [SAR 1:1 DAR 16:9], 4 fps, 30 tbr, 90k tbn, 8 tbc

HIKVISION : DS-2CD2720F-IZS

Metadata:
    title           : Media Presentation
  Duration: N/A, start: 1.417000, bitrate: N/A
    Stream #0:0: Video: h264 (Main), yuv420p(progressive), 1280x720, 4 fps, 30 tbr, 90k tbn, 8 tbc
#8

Thanks for reply. I will check it.
However, the stream does not stop. The phenomenon that the frame freezes often occurs.

#9

Hi,
There are some properties in nvv4l2decoder:

num-extra-surfaces  : Additional number of surfaces in addition to min decode surfaces given by the v4l2 driver
                      flags: readable, writable, changeable only in NULL or READY state
                      Unsigned Integer. Range: 0 - 24 Default: 1

disable-dpb         : Set to disable DPB buffer for low latency
                      flags: readable, writable
                      Boolean. Default: false

enable-full-frame   : Whether or not the data is full framed
                      flags: readable, writable
                      Boolean. Default: false

enable-max-performance: Set to enable max performance
                    flags: readable, writable
                    Boolean. Default: false

Please configure these and check again.

#10