Unable to decode RTP stream with nvv4l2decoder

chowhp71 · October 25, 2023, 11:29am

Please provide complete information as applicable to your setup.
• Hardware Platform GPU RTX3090
**• DeepStream Version ** 6.1
• TensorRT Version 8.5.2-1+cuda11.8
• NVIDIA GPU Driver Version (valid for GPU only) 525.85.12

My RTP stream is a h264 encoded video with resolution 1920x1080

I am able to decide and display an RTP stream using the following command:

gst-launch-1.0 --gst-debug=v4l2videodec:5 udpsrc port=8001 ! application/x-rtp, encoding-name=H264, payload=96 ! rtph264depay ! h264parse ! avdec_h264 ! queue max-size-buffers=1 ! videoconvert ! autovideosink

When I try to use nvv4l2decoder:

gst-launch-1.0 --gst-debug=v4l2videodec:5 udpsrc port=8001 ! application/x-rtp,encoding-name=H264,payload=96 ! rtph264depay ! h264parse ! nvv4l2decoder ! queue max-size-buffers=1 ! nvvideoconvert ! 'video/x-raw(memory:NVMM),format=RGBA' ! nveglglessink

it throw the following error:

0:00:00.036639490 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1891:gst_v4l2_video_dec_sink_getcaps:<nvv4l2decoder0> Returning sink caps image/jpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-h264, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/x-h265, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)4, systemstream=(boolean)false, parsed=(boolean)true; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)[ 1, 2 ], systemstream=(boolean)false, parsed=(boolean)true; video/x-divx, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], divxversion=(int)[ 4, 5 ]; video/x-av1, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp8, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp9, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036698514 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1891:gst_v4l2_video_dec_sink_getcaps:<nvv4l2decoder0> Returning sink caps image/jpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-h264, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/x-h265, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string){ byte-stream }, alignment=(string){ au }; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)4, systemstream=(boolean)false, parsed=(boolean)true; video/mpeg, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], mpegversion=(int)[ 1, 2 ], systemstream=(boolean)false, parsed=(boolean)true; video/x-divx, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ], divxversion=(int)[ 4, 5 ]; video/x-av1, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp8, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]; video/x-vp9, width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036714449 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036725174 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036735398 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036768248 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036812592 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036840513 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
0:00:00.036874450 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:1867:gst_v4l2_video_dec_src_query:<nvv4l2decoder0> Returning src caps video/x-raw(memory:NVMM), width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ], framerate=(fraction)[ 0/1, 2147483647/1 ]
Setting pipeline to PAUSED ...
0:00:00.043302115 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:593:gst_v4l2_video_dec_open:<nvv4l2decoder0> Opening
0:00:00.044213845 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:670:gst_v4l2_video_dec_start:<nvv4l2decoder0> Starting
Pipeline is live and does not need PREROLL ...
0:00:00.044461185 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1071:gst_v4l2_video_dec_drain:<nvv4l2decoder0> Draining...
0:00:00.044473129 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:924:gst_v4l2_video_dec_flush:<nvv4l2decoder0> Flushed
Got context from element 'eglglessink0': gst.egl.EGLDisplay=context, display=(GstEGLDisplay)NULL;
Setting pipeline to PLAYING ...
New clock: GstSystemClock
0:00:00.062988752 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1891:gst_v4l2_video_dec_sink_getcaps:<nvv4l2decoder0> Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:00.063119570 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1891:gst_v4l2_video_dec_sink_getcaps:<nvv4l2decoder0> Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:00.063226278 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1891:gst_v4l2_video_dec_sink_getcaps:<nvv4l2decoder0> Returning sink caps video/x-h264, width=(int)[ 1, 32768 ], height=(int)[ 1, 32768 ], framerate=(fraction)[ 0/1, 2147483647/1 ], stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:00.063254944 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:730:gst_v4l2_video_dec_set_format:<nvv4l2decoder0> Setting format: video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true
0:00:37.738016826 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1891:gst_v4l2_video_dec_sink_getcaps:<nvv4l2decoder0> Returning sink caps video/x-h264, width=(int)1920, height=(int)1080, framerate=(fraction)10/1, pixel-aspect-ratio=(fraction)1/1, stream-format=(string)byte-stream, alignment=(string)au, parsed=(boolean)true, interlace-mode=(string)progressive, chroma-format=(string)4:2:2, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, profile=(string)high-4:2:2, level=(string)4
0:00:37.738041792 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:730:gst_v4l2_video_dec_set_format:<nvv4l2decoder0> Setting format: video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)10/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:2, bit-depth-luma=(uint)10, bit-depth-chroma=(uint)10, parsed=(boolean)true, profile=(string)high-4:2:2, level=(string)4
0:00:37.738102120 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1393:gst_v4l2_video_dec_handle_frame:<nvv4l2decoder0> Handling frame 0
0:00:37.738107321 12491 0x558df029cde0 DEBUG           v4l2videodec gstv4l2videodec.c:1451:gst_v4l2_video_dec_handle_frame:<nvv4l2decoder0> Sending header
Error String : Feature not supported on this GPUError Code : 801
0:00:37.910098428 12491 0x558df029cde0 WARN            v4l2videodec gstv4l2videodec.c:1804:gst_v4l2_video_dec_handle_frame:<nvv4l2decoder0> error: Failed to process frame.
0:00:37.910112512 12491 0x558df029cde0 WARN            v4l2videodec gstv4l2videodec.c:1804:gst_v4l2_video_dec_handle_frame:<nvv4l2decoder0> error: Maybe be due to not enough memory or failing driver
ERROR: from element /GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0: Failed to process frame.
Additional debug info:
gstv4l2videodec.c(1804): gst_v4l2_video_dec_handle_frame (): /GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0:
Maybe be due to not enough memory or failing driver
Execution ended after 0:00:37.865555901
Setting pipeline to NULL ...
0:00:37.910328317 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:688:gst_v4l2_video_dec_stop:<nvv4l2decoder0> Stopping
0:00:37.911437059 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:717:gst_v4l2_video_dec_stop:<nvv4l2decoder0> Stopped
0:00:37.911638145 12491 0x558df025d990 DEBUG           v4l2videodec gstv4l2videodec.c:655:gst_v4l2_video_dec_close:<nvv4l2decoder0> Closing
Freeing pipeline ...

Any idea how to resolve this issue? Thanks!

Fiona.Chen · October 26, 2023, 1:42am

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

Your dependencies are wrong. Please follow the platform compatbilities
https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_Quickstart.html#id6

system · November 13, 2023, 7:50am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.