GStreamer "CameraCapture-Encode-Decode-Display" Single Pipeline Warning - A lot of buffers are being dropped

janardhan.reddi.g · October 10, 2020, 2:59pm

Hi All,

I want to “capture camera using nvarguscamerasrc, encode it with nvv4l2h264enc, decode it with nvv4l2decoder and display it on HDMI monitor using Single GStreamer Pilepline. I am facing " A lot of buffers are being dropped.” warning with below pipeline. Can you please provide working pipeline OR help to resolve the issue.

Note : The same pipeline works fine if i use videotestsrc instead of nvarguscamerasrc OR if i save the h264 stream and then do video playback as mentioned in Clarification about h264 parsing with nvv4l2h264enc / nvv4l2decoder

GStreamer pipeline
gst-launch-1.0 -v nvarguscamerasrc ! 'video/x-raw(memory:NVMM), width=640, height=480, framerate=30/1, format=NV12' ! nvv4l2h264enc ! nvv4l2decoder ! nvoverlaysink

GStreamer pipeline output with warnings

Setting pipeline to PAUSED …
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
/GstPipeline:pipeline0/GstNvArgusCameraSrc:nvarguscamerasrc0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)480, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)480, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/nvv4l2h264enc:nvv4l2h264enc0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)NULL, level=(string)NULL, width=(int)640, height=(int)480, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt601, chroma-site=(string)jpeg
NvMMLiteOpen : Block : BlockType = 261
NVMEDIA: Reading vendor.tegra.display-size : status: 6
NvMMLiteBlockCreate : Block : BlockType = 261
/GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)NULL, level=(string)NULL, width=(int)640, height=(int)480, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt601, chroma-site=(string)jpeg
Redistribute latency…
NvMMLiteOpen : Block : BlockType = 4
===== NVMEDIA: NVENC =====
NvMMLiteBlockCreate : Block : BlockType = 4
/GstPipeline:pipeline0/nvv4l2h264enc:nvv4l2h264enc0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)480, format=(string)NV12, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw(memory:NVMM), width=(int)640, height=(int)480, format=(string)NV12, framerate=(fraction)30/1
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected…
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 3264 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 3264 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
Camera index = 0
Camera mode = 4
Output Stream W = 1280 H = 720
seconds to Run = 0
Frame Rate = 120.000005
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
H264: Profile = 66, Level = 0
/GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0.GstPad:src: caps = video/x-raw(memory:NVMM), format=(string)NV12, width=(int)640, height=(int)480, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)bt601, framerate=(fraction)30/1
/GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0.GstPad:sink: caps = video/x-raw(memory:NVMM), format=(string)NV12, width=(int)640, height=(int)480, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)bt601, framerate=(fraction)30/1
WARNING: from element /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0: A lot of buffers are being dropped.
> Additional debug info:
> gstbasesink.c(2902): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstNvOverlaySink-nvoverlaysink:nvoverlaysink-nvoverlaysink0:
There may be a timestamping problem, or this computer is too slow.
^Chandling interrupt.
Interrupt: Stopping pipeline …
Execution ended after 0:00:05.071223021
Setting pipeline to PAUSED …
Setting pipeline to READY …
GST_ARGUS: Cleaning up
CONSUMER: Done Success
GST_ARGUS: Done Success
Setting pipeline to NULL …

(gst-launch-1.0:15198): GStreamer-CRITICAL **: 20:22:10.321: gst_mini_object_unref: assertion ‘GST_MINI_OBJECT_REFCOUNT_VALUE (mini_object) > 0’ failed

Honey_Patouceul · October 10, 2020, 4:24pm

I cannot test now, but you may try specifying byte-stream fromat such as:

gst-launch-1.0 -v nvarguscamerasrc ! 'video/x-raw(memory:NVMM), width=640, height=480, framerate=30/1, format=NV12' ! nvv4l2h264enc !  video/x-h264, stream-format=byte-stream ! nvv4l2decoder ! nvoverlaysink

or add nvvidconv:

gst-launch-1.0 -v nvarguscamerasrc ! 'video/x-raw(memory:NVMM), width=640, height=480, framerate=30/1, format=NV12' ! nvv4l2h264enc ! video/x-h264, stream-format=byte-stream ! nvv4l2decoder ! nvvidconv ! nvoverlaysink

janardhan.reddi.g · October 11, 2020, 10:33am

Hi, Thanks for your reply.

I tried the pipelines you suggested. Still the warning(A lot of buffers are being dropped) exists. Let me know if you want me to try any other pipeline.

janardhan.reddi.g · October 11, 2020, 1:06pm

I was able to run below pipeline for H.265, but it stalls when i run the ame pipeline for H.264. Are you aware why it stalls for H.264 ?

gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM), width=1920, height=1080, framerate=30/1, format=NV12’ ! nvv4l2h265enc ! h265parse ! video/x-h265,stream-format=byte-stream ! nvv4l2decoder ! nvoverlaysink

FYI… Stalled H.64 pipeline

gst-launch-1.0 nvarguscamerasrc ! ‘video/x-raw(memory:NVMM), width=1920, height=1080, framerate=30/1, format=NV12’ ! nvv4l2h264enc ! h264parse ! video/x-h264,stream-format=byte-stream ! nvv4l2decoder ! nvoverlaysink

Output of stalled H.264 pipeline. I had to press CTRL+C to come out of the pipeline.

GST_ARGUS: 3264 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000;

GST_ARGUS: Running with following settings:
   Camera index = 0 
   Camera mode  = 2 
   Output Stream W = 1920 H = 1080 
   seconds to Run    = 0 
   Frame Rate = 29.999999 
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
H264: Profile = 66, Level = 0 
/GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)constrained-baseline, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, profile=(string)constrained-baseline, level=(string)4, width=(int)1920, height=(int)1080, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, interlace-mode=(string)progressive, colorimetry=(string)bt709, chroma-site=(string)mpeg2, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true

(gst-launch-1.0:19183): GStreamer-CRITICAL **: 17:34:59.272: gst_mini_object_unref: assertion 'mini_object != NULL' failed
^Chandling interrupt.
Interrupt: Stopping pipeline ...
Execution ended after 0:00:06.885789668
Setting pipeline to PAUSED ...
Setting pipeline to READY ...
^C

Honey_Patouceul · October 11, 2020, 3:00pm

For some reason, with h264 stream in byte-stream format, nvv4l2decoder fails.
The workaround is just to remove h264parse.

Topic		Replies	Views
Jetson nano ,opencv ,Gstreamer ,h265 ,mp4 Jetson Nano gstreamer	5	549	January 23, 2024
Using nvvidconv multiple times in a pipeline Jetson Nano gstreamer	7	1310	October 15, 2021
GStreamer Output with Hardware Decoding/Encoding Sped Up Jetson Nano gstreamer	3	685	October 18, 2021
Deteriorating GStreamer pipeline performance Jetson Nano camera , gstreamer	7	2060	October 15, 2021
Attempting to connect to NVIDIA Nano cameras log error Jetson Nano camera , gstreamer	13	769	October 15, 2021
Gst-launch-1.0 nvarguscamerasrc ! nvoverlaysink not working Jetson Nano gstreamer	12	2388	October 15, 2021
H264 encoding from RGB source Jetson Xavier NX encoder	13	3533	December 22, 2021
Gstreamer pipeline(nvv4l2decoder) for .264 file Jetson Xavier NX gstreamer	9	2093	November 1, 2021
Using nvvidconv in two different pipelines, getting "nvbuf_utils: nvbuffer Payload Type not supported" Jetson Nano	3	1598	October 14, 2021
How to use nvivafilter gstreamer plugin on Xavier ? Jetson AGX Xavier	7	1415	October 18, 2021

GStreamer "CameraCapture-Encode-Decode-Display" Single Pipeline Warning - A lot of buffers are being dropped

Related topics