Receive RTP (Pipeline demo)

ariel27593 · July 18, 2023, 12:02pm

setup:
• Hardware Platform:Jetson Xavier NX
• DeepStream Version: 6.1
• JetPack Version: 5.0.1 DP
• TensorRT Version: 8.4.0.11
• Issue Type( questions)

Hi folks,
I work with deepstream and python bindings I have pipeline that captare UDP H264 stream pass to Yolo object detection and tracking, everything work great.
Now I need to handle with something new so before I integrate my network I try build simple pipeline in command line.
someone Send to me RTP stream is pipeline (Sender):

gst-launch-1.0 v4l2src device="/dev/video” ! jpegdec ! omxh264enc ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.0 port=46002

I build simple receive pipeline:

gst-launch-1.0 udpsrc port=46002 caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)MP2T, payload=(int)33" ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvideoconvert ! autovideosink

Unfortntaly I don’t see video on screen I thing something worng with the element rtpmp2tdepay or maybe I missing out something I will be happy to any help.
I add some graphsView of the pipeline

In addition I add graphs of the pipeline

gst-launch-1.0 udpsrc port=46002 caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)MP2T, payload=(int)33" ! rtpmp2tdepay ! fakesink

Honey_Patouceul · July 18, 2023, 9:10pm

You may try adding rtpjitterbuffer (latency is in ms):

gst-launch-1.0 udpsrc port=46002 ! application/x-rtp, media=video, clock-rate=90000, encoding-name=MP2T, payload=33 ! rtpjitterbuffer latency=1000 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvideoconvert ! autovideosink

Also note that omx plugins are deprecated. For sender you may try instead:

gst-launch-1.0 v4l2src device=/dev/video ! nvjpegdec ! nvvidconv ! nvv4l2h264enc insert-sps-pps=1 idrinterval=15 insert-vui=1 ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.0 port=46002

ariel27593 · July 19, 2023, 8:07am

Hi, thank you for your reply. Unfortunately, I added the element and still I have the same problem I attached an image of the Graph.
Maybe you have another idea?

I add wireshark packet for more details

Fiona.Chen · July 19, 2023, 10:12am

The following two pipelines can work:

gst-launch-1.0 udpsrc uri=udp://localhost:5004 caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)MP2T, payload=(int)33" ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvideoconvert ! nv3dsink

gst-launch-1.0 v4l2src device="/dev/video0" ! 'image/jpeg,width=1920,height=1080,framerate=30/1' ! jpegdec ! nvvideoconvert ! nvv4l2h264enc ! mpegtsmux ! rtpmp2tpay ! udpsink

The key is the receiver pipeline should run first.

ariel27593 · July 19, 2023, 10:44am

Hi,
I try use your pipeline:

gst-launch-1.0 udpsrc uri=udp://234.0.0.0:46002 caps="application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)MP2T, payload=(int)33" ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvideoconvert ! autovideosink

Unfortunately, still have the same problem I don’t see the video on the screen, Pay attention that I can’t change the sender pipeline (maybe I need to mention this before).

ariel27593 · July 19, 2023, 11:02am

I try replace some PCAP file that I transmit and use your pipeline I see some progress but now I get this error :

gstrtpjitterbuffer.c(3286): gst_rtp_jitter_buffer_chain (): /GstPipeline:pipeline0/GstRtpJitterBuffer:rtpjitterbuffer0:
Received invalid RTP payload, dropping

Honey_Patouceul · July 19, 2023, 5:34pm

Just checked now with that sender pipeline for localhost:

gst-launch-1.0 videotestsrc ! jpegenc ! queue ! nvv4l2decoder mjpeg=1 ! nvv4l2h264enc insert-sps-pps=1 idrinterval=15 ! mpegtsmux ! rtpmp2tpay ! udpsink host=127.0.0.1 port=46002

and then on same Jeston, received and displayed with:

gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvidconv ! autovideosink

Can you try this ? (Note that I don’t have DS installed on that Jetson)

Fiona.Chen · July 20, 2023, 1:41am

The pipelines you post can work.

The key is the receiver pipeline should run first.

Honey_Patouceul · July 20, 2023, 8:02pm

Re-reading that now, maybe the issue is that your are tring to decode RTP/H264 as RTP/MP2T.
rtp streaming with jetson-utils would probably use RTP/H264 by default.
For RTP/H264, you would use as receiver:

# Receiving on Jeston (sender sends to 127.0.0.1)
gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,encoding-name=H264 ! rtpjitterbuffer latency=100 ! rtph264depay ! h264parse ! nvv4l2decoder ! nvvidconv ! autovideosink

# Or
gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,encoding-name=H264 ! rtpjitterbuffer latency=100 ! rtph264depay ! h264parse ! video/x-h264,width=<width>,height=<height>,framerate=<fps>/1 ! nvv4l2decoder ! nvvidconv ! autovideosink

For jetson-utils sending RTP/MP2T, which would be convenient for receiving with VLC or FFMPEG without writing a SDP file, there is an undocumented option. See added support for rtpmp2ts protocol · dusty-nv/jetson-utils@9d37024 · GitHub)

ariel27593 · July 23, 2023, 6:40am

I try your pipeline and see nothing, the sender pipeline is mpeg:

gst-launch-1.0 v4l2src device="/dev/video” ! jpegdec ! omxh264enc ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.0 port=46002

Unfortunately I can’t change this but I can tell you that I have some “Blackbox” player that call mpv that sucssed to play the video. but I don’t know what pipeline this player use

ariel27593 · July 23, 2023, 8:15am

I change the udpsink to 234.0.0.0 and your exa,ple work on my jetson

I try run command line with debug flag on my stream and I get:

GST_DEBUG=3 gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder enable-max-performance=1 ! nvvidconv ! autovideosink
Setting pipeline to PAUSED ...
Opening in BLOCKING MODE 
0:00:00.251617216 86324 0xaaaab51d74d0 WARN                    v4l2 gstv4l2object.c:4477:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:00.251738368 86324 0xaaaab51d74d0 WARN                    v4l2 gstv4l2object.c:2394:gst_v4l2_object_add_interlace_mode:0xaaaab5193960 Failed to determine interlace mode
0:00:00.251848160 86324 0xaaaab51d74d0 WARN                    v4l2 gstv4l2object.c:2394:gst_v4l2_object_add_interlace_mode:0xaaaab5193960 Failed to determine interlace mode
0:00:00.251925280 86324 0xaaaab51d74d0 WARN                    v4l2 gstv4l2object.c:2394:gst_v4l2_object_add_interlace_mode:0xaaaab5193960 Failed to determine interlace mode
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock

Honey_Patouceul · July 23, 2023, 6:05pm

So I’d suggest that you try this as sender:

# Note that /dev/video is an old thing where a symbolic link was pointing to default camera video node.
# You may also try direct video node path such as /dev/video0.
gst-launch-1.0 v4l2src device=/dev/video ! jpegparse ! nvv4l2decoder mjpeg=1 ! nvv4l2h264enc insert-sps-pps=1 insert-vui=1 idrinterval=15 ! h264parse ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.0 port=46002

# Or:
gst-launch-1.0 v4l2src device=/dev/video ! jpegparse ! nvjpegdec ! queue ! nvv4l2h264enc insert-sps-pps=1 insert-vui=1 idrinterval=15 ! h264parse ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.0 port=46002

# Or if sender is not a Jetson and has to use omxh264enc, you may try adding h264parse after encoder :
gst-launch-1.0 v4l2src device=/dev/video ! jpegparse ! jpegdec ! omxh264enc insert-sps-pps=1 insert-vui=1 ! h264parse ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.0 port=46002

with that Jetson receiver:

gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvidconv ! autovideosink

# Or simpler:
gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! decodebin ! nvvidconv ! autovideosink

# Or general CPU-based H264 decoding (for remote host try increasing latency):
gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=300 ! rtpmp2tdepay ! tsdemux ! h264parse ! avdec_h264 ! videoconvert ! autovideosink

Also note that you may stream JPEG from sender with RTP/JPEG over UDP with:

gst-launch-1.0 v4l2src device=/dev/video0 ! jpegparse ! identity ! rtpjpegpay ! udpsink host=127.0.0.1 port=46004

So you would receive, decode jpeg and display on receiver with:

gst-launch-1.0 udpsrc port=46004 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=JPEG,payload=26 ! rtpjitterbuffer latency=100 ! rtpjpegdepay ! jpegparse ! jpegdec ! videoconvert ! autovideosink

So you can also H264 encode from receiver.

You may better tell your case for more accurate advice.

ariel27593 · July 24, 2023, 8:35am

Hi thank you for offering this solution, but again I mention that I can’t change the sender side only the receiver side.
What element in receiver side I can add to solve my problem, maybe there is diffrent because the sender side use omx encoder?

I think maybe there is some difference with the UDP protocol, I investigate the wireshark packets and I see only one difference in the UDP field in Wireshark that calls the stream index when I open the video stream index equal to 0 when I play the pcap file I get stream index equal to 2 maybe this is the problem?

Honey_Patouceul · July 24, 2023, 10:50pm

Did you get the warnings with all 3 proposed receiver pipelines ?

Note that these are just warnings in your logs, the receiver pipeline started…maybe it failed to get correct video info because the sender don’t properly send these…you may specify video format in receiver pipeline caps.
If receiver doesn’t start displaying, you may have to wait for sender to send an IDR frame.

ariel27593 · July 26, 2023, 7:36am

When I try your second example :

gst-launch-1.0 udpsrc port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! decodebin ! nvvidconv ! autovideosink

I did not get the warning message but still can’t succeed to see the video on a screen in addition I used JTOP and look at the field of HW engines NVDEC and did not see any response (the Dec field did not become green).

when you write specify video format that did you mean because in general I specify application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33

maybe there is a problem in my experiment I playing a pcap file maybe this influence on udp packets?

ariel27593 · July 30, 2023, 9:07am

Hi folks,
I have a big progress (I think so) and I try to understand what missing.
I succeed to transmit the video src and show the video on the screen I need to mention important things that I did not say before the video that I try receiving is from a Pcap file so I play the Pcap file with Colasoft Packet Player from my windows and try to capture multicast in jetson (I connected with hub).
I make a new experiment I save the videoSrc to a pcap file (the video that I succeed to display on jetson) then I play the video and surprisingly I do not succeed to play the video on Jetson.
I think maybe is a problem with timing or something similar because when I try open rtp from the Pcap file I fail I will be happy to any advice on how to tackle this problem.

Honey_Patouceul · July 30, 2023, 11:23am

Here is what I tried:

On another computer than Jeston on the same LAN, I simulated a camera feed streaming to Unicast-prefix-based multicast. I used address 234.0.0.1 (234.0.0.0 didn’t work for my case):

gst-launch-1.0 videotestsrc ! nvvidconv ! nvv4l2h264enc insert-sps-pps=1 insert-vui=1 idrinterval=15 ! h264parse ! mpegtsmux ! rtpmp2tpay ! udpsink host=234.0.0.1 port=46002

Then I captured (you can do this either on sender or Jeston receiver):

sudo tcpdump -w test.pcap -i eth0

let it run for 30s and stop it with Ctrl-C. At this point I also stopped the sender.

On Jetson play the capture with:

gst-launch-1.0 filesrc location=test.pcap ! pcapparse dst-ip=234.0.0.1 dst-port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvidconv ! autovideosink -v

Or you can restream with:

gst-launch-1.0 filesrc location=test.pcap ! pcapparse dst-ip=234.0.0.1 dst-port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! udpsink host=234.0.0.1 port=46002

And receive with:

gst-launch-1.0 udpsrc address=234.0.0.1 port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=100 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! nvvidconv ! autovideosink -v

Hope this helps. If not working, post the output from:

sudo tcpdump -r test.pcap

ariel27593 · July 30, 2023, 11:43am

I not relly undesrtand what you do diffrent from my expirment I play pcap file from windows computer and try capture the video in jetson xavier all the users connecterd to hub and the video stream from the pcap file is to 234.0.0.0:46002

some additional information

Setting pipeline to PAUSED ...
Opening in BLOCKING MODE 
Pipeline is live and does not need PREROLL ...
/GstPipeline:pipeline0/GstUDPSrc:udpsrc0.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)MP2T, payload=(int)33
/GstPipeline:pipeline0/GstRtpMP2TDepay:rtpmp2tdepay0.GstPad:src: caps = video/mpegts, packetsize=(int)188, systemstream=(boolean)true
/GstPipeline:pipeline0/GstTSDemux:tsdemux0.GstPad:sink: caps = video/mpegts, packetsize=(int)188, systemstream=(boolean)true
/GstPipeline:pipeline0/GstRtpMP2TDepay:rtpmp2tdepay0.GstPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)MP2T, payload=(int)33
Setting pipeline to PLAYING ...
New clock: GstSystemClock
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)nal
/GstPipeline:pipeline0/GstQueue:queue0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)nal
/GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)nal
/GstPipeline:pipeline0/GstH264Parse:h264parse0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, width=(int)320, height=(int)240, framerate=(fraction)0/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true, profile=(string)constrained-baseline, level=(string)2.1
NvMMLiteOpen : Block : BlockType = 261 
NVMEDIA: Reading vendor.tegra.display-size : status: 6 
NvMMLiteBlockCreate : Block : BlockType = 261 
/GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, width=(int)320, height=(int)240, framerate=(fraction)0/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true, profile=(string)constrained-baseline, level=(string)2.1
/GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0.GstPad:src: caps = video/x-raw(memory:NVMM), format=(string)NV12, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)bt601, framerate=(fraction)0/1
/GstPipeline:pipeline0/Gstnvvideoconvert:nvvideoconvert0.GstPad:src: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:src: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage.GstPad:sink: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:sink: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)0/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/Gstnvvideoconvert:nvvideoconvert0.GstPad:sink: caps = video/x-raw(memory:NVMM), format=(string)NV12, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, chroma-site=(string)jpeg, colorimetry=(string)bt601, framerate=(fraction)0/1
/GstPipeline:pipeline0/GstVideoRate:videorate0.GstPad:src: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink.GstProxyPad:proxypad0: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage.GstPad:sink: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, format=(string)YUY2, block-linear=(boolean)false
/GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0.GstGhostPad:sink: caps = video/x-raw, width=(int)320, height=(int)240, interlace-mode=(string)progressive, multiview-mode=(string)mono, multiview-flags=(GstVideoMultiviewFlagsSet)0:ffffffff:/right-view-first/left-flipped/left-flopped/right-flipped/right-flopped/half-aspect/mixed-mono, pixel-aspect-ratio=(fraction)1/1, framerate=(fraction)30/1, format=(string)YUY2, block-linear=(boolean)false
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.
WARNING: from element /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage: A lot of buffers are being dropped.
Additional debug info:
gstbasesink.c(3003): gst_base_sink_is_too_late (): /GstPipeline:pipeline0/GstAutoVideoSink:autovideosink0/GstXvImageSink:autovideosink0-actual-sink-xvimage:
There may be a timestamping problem, or this computer is too slow.

Honey_Patouceul · July 30, 2023, 1:25pm

You may try increasing latency to 1000 ms (default is 2000) and adding a queue after decoder (also adjust your multicast address):

sudo jetson_clocks

gst-launch-1.0 udpsrc address=234.0.0.1 port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=1000 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! queue ! nvvidconv ! autovideosink -v

# Or
gst-launch-1.0 udpsrc address=234.0.0.1 port=46002 ! application/x-rtp,media=video,clock-rate=90000,encoding-name=MP2T,payload=33 ! rtpjitterbuffer latency=1000 ! rtpmp2tdepay ! tsdemux ! h264parse ! nvv4l2decoder ! queue ! nvvidconv ! nv3dsink -v

ariel27593 · July 31, 2023, 6:30am

Why do I need to add so much delay to the pipeline it’s not acceptable in my system to underline my system needs to work in real-time operation, Although I try to add your elements and still, it’s not working.

I will try to describe my problem again I play a PCAP file from Windows the PAP file contains an RTP stream to multicast UDP 234.0.0.0:46002 I do not succeed to see the video on screen when I try to replace autovideosink with fakesink and view Jtop I do not see any response of NVVDEC.
Now I play exactly the same video (Videostc) but not from PCAP from Jetson to Udpsink I succeed to capture and display the video.
During the experience, I connected to Hub with another Windows computer that succeed to capture video PCAP and not PCAP and displayed using an MPV player.

I add GST_DEBUG=5 maybe you will see something wrong

0:01:33.712617856  4265 0xaaaaab34a000 DEBUG                GST_BUS gstbus.c:379:gst_bus_post:<bus1> [msg 0xaaaaab736ca0] dropped
0:01:33.712647136  4265 0xaaaaab34a000 INFO        GST_ELEMENT_PADS gstpad.c:2187:gst_pad_unlink: unlinked udpsrc0:src and rtpmp2tdepay0:sink
0:01:33.712708416  4265 0xaaaaab34a000 DEBUG                GST_BUS gstbus.c:340:gst_bus_post:<bus1> [msg 0xaaaaab6f89c0] posting on bus structure-change message: 0xaaaaab6f89c0, time 99:99:99.999999999, seq-num 107, element 'sink', GstMessageStructureChange, type=(GstStructureChangeType)GST_STRUCTURE_CHANGE_TYPE_PAD_UNLINK, owner=(GstElement)"\(GstUDPSrc\)\ udpsrc0", busy=(boolean)false;

Topic		Replies	Views
How to transcode H264 rtp packet to H265 rtp packet Jetson AGX Xavier gstreamer	16	3261	January 5, 2022
RTSP stream not work "Stream format not found, dropping the frame" DeepStream SDK rtsp , gstreamer , nvbugs	24	1560	January 3, 2024
Python binding send RTP DeepStream SDK	13	389	June 15, 2023
GStreamer - stream video to IP Jetson Nano gstreamer	12	5485	October 15, 2021
Gstreamer TCPserversink 2-3 seconds latency Jetson Xavier NX camera , opencv , gstreamer	12	17611	October 3, 2021
Deepstream 3.0 C API Jetson AGX Xavier	10	2487	May 30, 2019
TX2 H264 RTSP Stream decoding issues Jetson TX2	27	11554	October 18, 2021
Help improving gstreamer pipeline on Xavier AGX Jetson AGX Xavier gstreamer	12	1400	October 18, 2021
How to stream camera by UDP H264 Jetson Nano camera , opencv	25	10893	October 15, 2021
FLIR Lepton Streaming from Pi Zero to Nano Jetson Nano gstreamer	28	3491	October 15, 2021

Receive RTP (Pipeline demo)

Related topics