Deepstream failed to decode rtsp feed withnvv4l2decoder

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) GPU
• DeepStream Version Running deepstream in the provided container nvcr.io/nvidia/deepstream:5.1-21.02-triton
• NVIDIA GPU Driver Version (valid for GPU only) GPU: GeForce GTX 1070 / NVIDIA-SMI 455.45.01 Driver Version: 455.45.01 CUDA Version: 11.1
• Issue Type BUGS BUGS

I am working on a deepstream pipeline based on the deepstream-test5 example. While everything works when working from a file - I can’t seem to get anywhere when using a RTSP feed for the source.

The pipeline runs but stay stuck at 0. I have narrow the problem down to the decoding of the frame with nvv4l2decoder.

Indeed If I use the avdec_h264 to decode the feed - I can see it properly and everything is fine.

GST_DEBUG=3 gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! avdec_h264 ! nvvideoconvert ! autovideosink

However, if I use nvv4l2decoder,

GST_DEBUG=3 gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! nvv4l2decoder ! nvvideoconvert ! autovideosink

the feed never show off and the logs show

0:00:00.083226125   373 0x7f44780438a0 FIXME                default gstutils.c:3981:gst_pad_create_stream_id_internal:<fakesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
Progress: (request) Sent PLAY request
0:00:02.089330201   373 0x7f4430004230 FIXME               basesink gstbasesink.c:3145:gst_base_sink_default_event:<autovideosink0-actual-sink-xvimage> stream-start event without group-id. Consider implementing group-id handling in the upstream elements
0:00:02.243942602   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.243956884   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.243975137   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.243979806   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.243993896   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.243998011   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244012075   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244015759   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244026461   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244029375   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244039017   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244041906   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244052278   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244056055   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244066637   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244070075   373 0x7f4430004230 ERROR                   v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from http://git.linuxtv.org/v4l-utils.git

0:00:02.244740758   373 0x7f4430004230 WARN            v4l2videodec gstv4l2videodec.c:1673:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:00:02.244757565   373 0x7f4430004230 WARN          v4l2bufferpool gstv4l2bufferpool.c:1066:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold

The RTSP stream is broadcast from a drone via prdraw. I can read the feed properly with VLC as well.

I am not sure where to look for next and I’d appreciate any help.
Thanks in advance

3

Can you run the following command and get the log?
GST_DEBUG=v4l2videodec:5 gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! nvv4l2decoder ! nvvideoconvert ! autovideosink

4

Hi thanks for the quick reply,
Here is the logs from the command

root@angus:/workdir# GST_DEBUG=v4l2videodec:5 gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! nvv4l2decoder ! nvvideoconvert ! autovideosink
0:00:00.022102005 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps image/jpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-h264, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/x-h265, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)4, systemstream=(boolean)false, parsed=(boolean)true; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)[ 1, 2 ], systemstream=(boolean)false, parsed=(boolean)true; video/x-divx, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], divxversion=(int)[ 4, 5 ]; video/x-vp8, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp9, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.022179972 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps image/jpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-h264, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/x-h265, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)4, systemstream=(boolean)false, parsed=(boolean)true; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)[ 1, 2 ], systemstream=(boolean)false, parsed=(boolean)true; video/x-divx, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], divxversion=(int)[ 4, 5 ]; video/x-vp8, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp9, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.022208949 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.022258339 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.022296029 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.022334895 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
Setting pipeline to PAUSED …
0:00:00.075585744 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:555:gst_v4l2_video_dec_open: Opening
0:00:00.076303100 139 0x557004c65930 DEBUG v4l2videodec gstv4l2videodec.c:637:gst_v4l2_video_dec_start: Starting
Pipeline is live and does not need PREROLL …
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://192.168.53.1/live
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING …
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
0:00:02.119525721 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:02.119592862 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:02.119609804 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:694:gst_v4l2_video_dec_set_format: Setting format: video/x-h264, stream-format=(string)byte-stream, alignment=(string)au
0:00:02.119970464 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 0
0:00:02.119976818 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1377:gst_v4l2_video_dec_handle_frame: Sending header
0:00:02.281410196 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1470:gst_v4l2_video_dec_handle_frame: Acquired caps: video/x-raw, format=(string)NV12, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)bt709, framerate=(fraction)0/1
0:00:02.281524483 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1477:gst_v4l2_video_dec_handle_frame: Available caps: image/jpeg, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-raw, format=(string)NV12, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string){ progressive, interleaved }, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/mpeg, mpegversion=(int)4, systemstream=(boolean)false, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/mpeg, mpegversion=(int)2, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-vp9, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-vp8, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }
0:00:02.281546017 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1485:gst_v4l2_video_dec_handle_frame: Filtered caps: video/x-raw, format=(string)NV12, framerate=(fraction)0/1, width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2
0:00:02.281601136 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1502:gst_v4l2_video_dec_handle_frame: Possible decoded caps: video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], format=(string){ I420, NV12, P010_10LE, BGRx, RGBA, GRAY8, GBR }
0:00:02.281609007 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1511:gst_v4l2_video_dec_handle_frame: Chosen decoded caps: video/x-raw(memory:NVMM), width=(int)1, height=(int)1, framerate=(fraction)0/1, format=(string)I420
0:00:02.282281667 139 0x7f9bdc0041e0 WARN v4l2videodec gstv4l2videodec.c:1673:gst_v4l2_video_dec_decide_allocation: Duration invalid, not setting latency
0:00:02.282336978 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1564:gst_v4l2_video_dec_handle_frame: Starting decoding thread
0:00:02.282386728 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 1
0:00:02.282413381 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 2
0:00:02.282433515 139 0x7f9bdc0041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 3

5

Can you set “num-extra-surfaces” property of nvv4l2decoder to 10 and try again?

6

Still no feed

root@angus:/workdir# GST_DEBUG=v4l2videodec:5 gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! nvv4l2decoder num-extra-surfaces=10 ! nvvideoconvert ! autovideosink
0:00:00.024853078 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps image/jpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-h264, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/x-h265, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)4, systemstream=(boolean)false, parsed=(boolean)true; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)[ 1, 2 ], systemstream=(boolean)false, parsed=(boolean)true; video/x-divx, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], divxversion=(int)[ 4, 5 ]; video/x-vp8, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp9, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.024911945 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps image/jpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-h264, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/x-h265, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)4, systemstream=(boolean)false, parsed=(boolean)true; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)[ 1, 2 ], systemstream=(boolean)false, parsed=(boolean)true; video/x-divx, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], divxversion=(int)[ 4, 5 ]; video/x-vp8, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp9, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.024932707 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.024969998 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.025001214 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.025030393 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:1704:gst_v4l2_video_dec_src_query: Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
Setting pipeline to PAUSED …
0:00:00.078399879 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:555:gst_v4l2_video_dec_open: Opening
0:00:00.079073885 140 0x5605ac7ba930 DEBUG v4l2videodec gstv4l2videodec.c:637:gst_v4l2_video_dec_start: Starting
Pipeline is live and does not need PREROLL …
Progress: (open) Opening Stream
Progress: (connect) Connecting to rtsp://192.168.53.1/live
Progress: (open) Retrieving server options
Progress: (open) Retrieving media info
Progress: (request) SETUP stream 0
Progress: (open) Opened Stream
Setting pipeline to PLAYING …
New clock: GstSystemClock
Progress: (request) Sending PLAY request
Progress: (request) Sending PLAY request
Progress: (request) Sent PLAY request
0:00:02.185266220 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:02.185332530 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1728:gst_v4l2_video_dec_sink_getcaps: Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:02.185350932 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:694:gst_v4l2_video_dec_set_format: Setting format: video/x-h264, stream-format=(string)byte-stream, alignment=(string)au
0:00:02.185905690 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 0
0:00:02.185912712 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1377:gst_v4l2_video_dec_handle_frame: Sending header
0:00:02.346721431 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1470:gst_v4l2_video_dec_handle_frame: Acquired caps: video/x-raw, format=(string)NV12, width=(int)1280, height=(int)720, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)mpeg2, colorimetry=(string)bt709, framerate=(fraction)0/1
0:00:02.346896459 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1477:gst_v4l2_video_dec_handle_frame: Available caps: image/jpeg, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-raw, format=(string)NV12, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string){ progressive, interleaved }, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/mpeg, mpegversion=(int)4, systemstream=(boolean)false, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/mpeg, mpegversion=(int)2, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-vp9, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-vp8, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-h265, stream-format=(string)byte-stream, alignment=(string)au, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }; video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string){ bt601, smpte240m, bt709, 2:4:5:2, 2:4:5:3, 1:4:7:1, 2:4:7:1, 2:4:12:8, bt2020, 2:0:0:0 }
0:00:02.346928917 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1485:gst_v4l2_video_dec_handle_frame: Filtered caps: video/x-raw, format=(string)NV12, framerate=(fraction)0/1, width=(int)1280, height=(int)720, pixel-aspect-ratio=(fraction)1/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2
0:00:02.347003430 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1502:gst_v4l2_video_dec_handle_frame: Possible decoded caps: video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], format=(string){ I420, NV12, P010_10LE, BGRx, RGBA, GRAY8, GBR }
0:00:02.347014489 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1511:gst_v4l2_video_dec_handle_frame: Chosen decoded caps: video/x-raw(memory:NVMM), width=(int)1, height=(int)1, framerate=(fraction)0/1, format=(string)I420
0:00:02.347620280 140 0x7f99000035e0 WARN v4l2videodec gstv4l2videodec.c:1673:gst_v4l2_video_dec_decide_allocation: Duration invalid, not setting latency
0:00:02.351485369 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1564:gst_v4l2_video_dec_handle_frame: Starting decoding thread
0:00:02.351550179 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 1
0:00:02.351587806 140 0x7f99000035e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 2

7

How many " Handling frame" log have you got?

8

It does not stop

0:00:32.044690041 94 0x7fda000041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 946
0:00:32.081837085 94 0x7fda000041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 947
0:00:32.114028531 94 0x7fda000041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 948
0:00:32.147574602 94 0x7fda000041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 949
0:00:32.184399231 94 0x7fda000041e0 DEBUG v4l2videodec gstv4l2videodec.c:1337:gst_v4l2_video_dec_handle_frame: Handling frame 950
…

9

So the pipeline is working well. Please use nveglglessink as the display sink as we use in our sample code.

10

The print of “ERROR v4l2 gstv4l2object.c:2077:gst_v4l2_object_get_interlace_mode: Driver bug detected - check driver with v4l2-compliance from v4l-utils.git - media (V4L2, DVB and IR) applications and libraries” is just a warning, please ignore them.

11

Ok but the display is still an blank screen - even when using nveglglessink

gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! nvv4l2decoder num-extra-surfaces=10 ! nvvideoconvert ! nveglglessink
12

And if I tried to run the sample demo directly from the rtsp feed- I get

**PERF:  FPS 0 (Avg)
Fri Apr 16 09:03:56 2021
**PERF:  0.00 (0.00)
Fri Apr 16 09:04:01 2021
**PERF:  0.00 (0.00)
13

The rtsp quality may be bad. Please set “sync=0 async=0” to your sink. When you run deepstream-app, please config “live-source=1” for nvstreammux group and “sync=0” to sink group.

14

Still the same running

GST_DEBUG=v4l2videodec:5 gst-launch-1.0 rtspsrc location=rtsp://192.168.53.1/live ! rtph264depay ! nvv4l2decoder num-extra-surfaces=10 ! nvvideoconvert ! nveglglessink sync=0 async=0

or running the deepstream-app with “live-source=1” for nvstreammux group and “sync=0” to sink group.

If I use avdec_h264 instead, the quality of the feed is very good so I don’t think it is a rtsp quality issue.