Streammuxxer issues with RTSP stream (related to jitter buffer and NTP timestamps)

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)
GPU
• DeepStream Version
6.1.1
• TensorRT Version
N/A
• NVIDIA GPU Driver Version (valid for GPU only)
515.65.01
• Issue Type( questions, new requirements, bugs)
Question

I am running a deepstream app written in Python that uses the uridecodebin to generate the source element. I also have a streammuxer, nvof and nvinfer elements in the pipeline. This has been working fine for the last few months with various camerastreams. Lately we seem to have a camera that (through its 4G uplink) tends to produce a somewhat erratic datastream. If left running, after an x-amount of time the rtspsrc seems to “dry out” and stop delivering frames through the buffer probe. There is no exception thrown, the loop keeps running (or at least seems like it) and the connection with the camera stays active. But no data coming out anymore… All I can do is restart the application to reconnect and try again. Sometimes it happens after 5 minutes, sometimes after many hours. It seems to be related to the camera (Axis dome camera) and/or the uplink, but still I’m going to have to make do with it so I’m trying to troubleshoot.

I think I am onto something but I need some expert help.

The first thing I noticed is that OpenCV (also using gstreamer under the hood) is reporting the stream as having 180.000fps or 90.000fps whenever I try to open the stream:

    media = cv2.VideoCapture(uri)
    media_width = media.get(cv2.CAP_PROP_FRAME_WIDTH)
    media_height = media.get(cv2.CAP_PROP_FRAME_HEIGHT)
    media_fps = media.get(cv2.CAP_PROP_FPS)
    media.release()

This is weird, because the camera is set at 10fps. Also, other camera’s report this just fine.

The second thing I noticed is that, when I set GST_DEBUG=2, the streammuxer and rtpjitterbuffer are constantly producing warnings:


0:52:49.875571944     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T10:59:53.578Z. Cur: 2022-10-20T10:59:54.875Z source_id 0
0:52:50.766632025     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T10:59:54.875Z. Cur: 2022-10-20T10:59:55.766Z source_id 0
0:52:52.790694072     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T10:59:55.776Z. Cur: 2022-10-20T10:59:57.790Z source_id 0
0:52:54.483464670     1 0x7fc77c01ede0 WARN         rtpjitterbuffer rtpjitterbuffer.c:587:calculate_skew: delta - skew: 0:00:01.011037278 too big, reset skew
0:52:55.777837285     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T10:59:57.918Z. Cur: 2022-10-20T11:00:00.777Z source_id 0
0:52:55.880704317     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:24.322113659 < 0:52:24.531909291)
0:52:55.890819436     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:23.912872013 < 0:52:24.531909291)
0:52:55.897796791     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:24.030872013 < 0:52:24.531909291)
0:52:55.903794642     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:24.148872013 < 0:52:24.531909291)
0:52:55.914185639     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:24.266872013 < 0:52:24.531909291)
0:52:55.924358579     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:24.385872013 < 0:52:24.531909291)
0:52:55.934476361     1 0x7fc7a00101e0 WARN            videodecoder gstvideodecoder.c:2761:gst_video_decoder_prepare_finish_frame:<nvv4l2decoder0> decreasing timestamp (0:52:24.503872013 < 0:52:24.531909291)
0:52:55.951127867     1 0x7fc7a00101e0 WARN            v4l2videodec gstv4l2videodec.c:1326:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:52:56.330094359     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T11:00:00.940Z. Cur: 2022-10-20T11:00:01.329Z source_id 0
0:52:58.595010693     1 0x7fc77c01ede0 WARN         rtpjitterbuffer rtpjitterbuffer.c:587:calculate_skew: delta - skew: 0:00:01.002439167 too big, reset skew
0:52:58.615918635     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T11:00:01.699Z. Cur: 2022-10-20T11:00:03.615Z source_id 0
0:53:00.598923399     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T11:00:03.641Z. Cur: 2022-10-20T11:00:05.598Z source_id 0
0:53:01.339671906     1 0x7fc77c007920 WARN         nvstreammux_ntp gstnvstreammux_ntp.cpp:301:gst_nvds_ntp_calculator_get_buffer_ntp:<Stream-muxer> Forward jump in NTP. Prev: 2022-10-20T11:00:05.619Z. Cur: 2022-10-20T11:00:06.339Z source_id 0

This goes on and on repeatedly until eventually everything grinds to a halt. These warnings all seem to be timing- and buffering related. Also the fps reported by opencv seems to be a giveaway. But I’m not sure as to what exactly?

Does anyone have a clue what I could change to my deepstream pipeline to make it more robust against this strange RTSP stream?

FYI: ffmpeg is able to play this same RTSP stream with no problems whatsoever. For days on end. So there must be something we can do.

2

Also: when I time the intervals between the buffer probe calls, it seems very erratic as well. Sometimes the interval is many (2 or 3) seconds, sometimes a few milliseconds for several frames. So the frames/buffers are coming through the pipeline in seemingly random bursts. With between 6 and 8 frames per second average.

Readings in seconds:

0.06559014320373535, 0.5547986030578613, 0.020908832550048828, 0.05063009262084961, 0.05127835273742676, 0.025737524032592773, 0.24994802474975586, 1.934495449066162, 0.007565021514892578, 0.006184577941894531, 0.010956287384033203, 0.006505489349365234, 0.006459474563598633, 0.009298563003540039, 0.006631374359130859, 0.012323141098022461, 0.010331392288208008, 0.009909391403198242, 0.007012605667114258, 0.0062220096588134766, 0.009530305862426758, 0.007197380065917969, 0.006430864334106445, 0.00605463981628418, 2.4193131923675537, 0.0069692134857177734, 0.010961771011352539, 0.003641366958618164, 0.006378889083862305, 0.00664067268371582, 0.006275177001953125, 0.006691932678222656, 0.006609678268432617, 0.009517669677734375, 0.009718179702758789, 0.009752035140991211, 0.009899616241455078, 0.009740114212036133, 1.6130549907684326, 0.0034852027893066406, 0.005862236022949219, 0.00984501838684082, 0.006899595260620117, 0.006720066070556641, 0.006564140319824219, 0.007042407989501953, 0.009708166122436523, 0.010348320007324219, 0.010282278060913086, 0.007477283477783203, 0.010041236877441406, 0.006516933441162109, 0.006685733795166016, 1.8417274951934814, 0.012913942337036133, 0.01642751693725586, 0.007431507110595703, 0.007676124572753906, 0.006063222885131836, 0.010007619857788086, 0.009958505630493164, 0.01009225845336914, 0.0066487789154052734, 0.006697416305541992, 0.010408878326416016, 0.010514974594116211, 0.010229349136352539, 0.010078907012939453, 0.006867170333862305, 0.009138107299804688, 2.0199458599090576, 0.004265546798706055, 0.007095813751220703, 0.007144451141357422, 0.010739564895629883, 0.6504929065704346, 0.0070760250091552734, 0.010271310806274414, 0.009678125381469727, 0.008609294891357422, 0.009666919708251953, 0.01510310173034668, 0.009032249450683594, 0.00872349739074707, 0.011621236801147461, 0.006806612014770508, 0.009343147277832031, 0.010333538055419922, 0.010144472122192383, 0.010199308395385742, 0.007485389709472656, 0.0068798065185546875, 0.0066034793853759766, 0.009628057479858398, 0.016866207122802734, 0.01010274887084961, 0.017563343048095703, 0.09994888305664062, 0.738255500793457, 0.04764699935913086, 0.030335187911987305, 0.026894569396972656, 0.01891160011291504, 0.03314805030822754, 0.030602693557739258, 0.04778242111206055, 0.5475709438323975, 0.02584671974182129, 0.006760597229003906, 0.027932167053222656, 0.05577349662780762, 0.09697723388671875, 0.12220573425292969, 0.12771844863891602, 0.7754976749420166, 0.023594141006469727, 0.03343772888183594, 0.03017592430114746, 0.004007577896118164, 0.041699886322021484, 0.01001429557800293, 0.0673513412475586, 0.6629378795623779, 0.025450468063354492, 0.048295021057128906, 0.02991461753845215, 0.04493284225463867, 0.011897563934326172, 0.0693669319152832, 0.1222538948059082, 2.492875099182129, 0.0066449642181396484, 0.009017229080200195, 0.006618022918701172, 0.009342432022094727, 0.006956338882446289, 0.0067729949951171875, 0.007003307342529297, 0.007045745849609375, 0.01036524772644043, 0.007410287857055664, 0.006827116012573242, 0.009620189666748047, 0.009318828582763672, 0.003945589065551758, 0.12367606163024902, 0.03255343437194824, 0.030609846115112305, 0.00798797607421875, 0.03474593162536621, 0.0348513126373291, 0.02347278594970703, 0.09739327430725098, 0.48988866806030273, 0.028223752975463867, 0.01817035675048828, 0.004579782485961914, 0.09616446495056152, 0.11318826675415039, 0.14425897598266602, 0.10933709144592285, 2.4165377616882324, 0.014016389846801758, 0.0032923221588134766, 0.0068395137786865234, 0.01131439208984375, 0.007771492004394531, 0.0075168609619140625, 1.200082540512085, 0.015033960342407227, 0.005296468734741211, 0.01062631607055664, 0.004187822341918945, 0.006268024444580078, 0.007093906402587891, 0.00686192512512207, 0.006652355194091797, 0.0068933963775634766, 0.00997614860534668, 0.010199785232543945, 0.011530876159667969, 0.009293794631958008, 0.007483005523681641, 0.006631374359130859, 0.020615339279174805, 0.06741213798522949, 0.03092217445373535, 0.014036893844604492, 0.045896291732788086, 0.04513287544250488, 2.483233690261841, 0.011204719543457031, 0.008178234100341797, 0.012575626373291016, 0.010436058044433594, 0.006270408630371094, 0.015027284622192383, 0.010347127914428711, 0.007061481475830078, 0.009779691696166992, 0.010304450988769531, 0.006735324859619141, 0.010381937026977539, 0.010567426681518555, 0.10990595817565918, 0.0006206035614013672, 0.015212297439575195, 0.049623727798461914, 0.032938241958618164, 0.03145790100097656, 0.04793834686279297, 0.126251220703125, 0.6934735774993896, 0.01857304573059082, 0.010889291763305664, 0.25961923599243164, 0.013704538345336914, 0.010486125946044922, 0.05037498474121094, 0.07833361625671387, 0.5738022327423096, 0.03245234489440918, 0.04706883430480957, 0.036551713943481445, 0.014936447143554688, 0.08042335510253906, 0.2159714698791504, 0.034390926361083984, 1.9935417175292969, 0.006863832473754883, 0.005953073501586914, 0.010701179504394531, 0.011122941970825195, 0.0067255496978759766, 0.007107973098754883, 0.007212638854980469, 0.006445884704589844, 0.007082939147949219, 0.006711244583129883, 0.006742238998413086, 0.007077932357788086, 0.010073661804199219, 0.010146141052246094, 0.17577576637268066, 0.23523163795471191, 0.013640403747558594, 0.003490924835205078, 0.0074732303619384766, 0.3005506992340088, 0.0068509578704833984, 0.02504253387451172, 0.6820437908172607, 0.05409574508666992, 0.009199857711791992, 0.03763747215270996, 0.04801487922668457, 0.03583502769470215, 0.03592109680175781, 0.04290175437927246, 0.7190835475921631, 0.016171693801879883, 0.04802536964416504, 0.018473386764526367, 0.059279680252075195, 0.012159347534179688, 0.05134081840515137, 0.0787210464477539, 0.8795285224914551, 0.024776697158813477, 0.09579348564147949, 0.046204328536987305, 0.04662322998046875, 0.0598604679107666, 0.0625760555267334, 0.016219615936279297, 1.8433837890625, 0.004136323928833008, 0.012148618698120117, 0.0033597946166992188, 0.006979703903198242, 0.006057262420654297, 0.006727695465087891, 0.010721445083618164, 0.005960702896118164, 0.010943412780761719, 0.01000666618347168, 0.007050514221191406, 0.009526729583740234, 0.01082468032836914, 0.0069959163665771484, 1.9081032276153564, 0.0064411163330078125, 0.003729581832885742, 0.009592056274414062, 0.010018348693847656, 0.0063593387603759766, 0.009879112243652344, 0.04491996765136719, 0.017931222915649414, 0.09260749816894531, 0.048288822174072266, 0.08341503143310547, 0.07506728172302246, 0.08277320861816406, 0.025943994522094727, 0.5401604175567627, 0.29255127906799316, 0.007576942443847656, 0.038599252700805664, 0.04355907440185547, 0.04937601089477539, 0.04757523536682129, 0.06258487701416016, 0.533050537109375, 0.02535104751586914, 0.017900705337524414, 0.06362104415893555, 0.06253194808959961, 0.031191349029541016, 0.028577327728271484, 0.249983549118042, 2.071202516555786

And I noticed something else: when starting the stream there are some more interesting warnings.

0:00:31.128908399     1      0x3e24de0 WARN                  udpsrc gstudpsrc.c:1445:gst_udpsrc_open:<udpsrc0> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?                        
0:00:31.129002833     1      0x3e24de0 WARN                  udpsrc gstudpsrc.c:1455:gst_udpsrc_open:<udpsrc0> have udp buffer of 212992 bytes while 524288 were requested                                                                              
0:00:33.247820265     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.247848907     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MJPG                                          
0:00:33.247859987     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.247870220     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MJPG                                          
0:00:33.247891860     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.247904887     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat AV10                                          
0:00:33.247916369     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.247927574     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat AV10                                          
0:00:33.247945769     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.247958045     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat DVX5                                          
0:00:33.247968365     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.247990404     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat DVX5                                          
0:00:33.248007235     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.248021355     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat DVX4                                          
0:00:33.248031737     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.248043178     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat DVX4                                          
0:00:33.248059917     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                                                                  
0:00:33.248072022     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MPG4                                          
0:00:33.248082382     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248093661     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MPG4
0:00:33.248110579     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248122622     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MPG2
0:00:33.248133635     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248144893     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MPG2
0:00:33.248162997     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248174519     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat H265
0:00:33.248183399     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248195790     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat H265
0:00:33.248212172     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248224077     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat VP90
0:00:33.248234701     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248245730     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat VP90
0:00:33.248261369     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248274121     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat VP80
0:00:33.248284736     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248295867     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat VP80
0:00:33.248312812     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248324967     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat H264
0:00:33.248335293     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1                        
0:00:33.248346956     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat H264
0:00:33.248894713     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1                        
0:00:33.248912599     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2942:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe minimum capture size for pixelformat NM12
0:00:33.248923581     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:3057:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1                        
0:00:33.248935079     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2948:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe maximum capture size for pixelformat NM12
0:00:33.248949143     1 0x7fc2e00184c0 WARN                    v4l2 gstv4l2object.c:2395:gst_v4l2_object_add_interlace_mode:0x7fc2e406d390 Failed to determine interlace mode         
0:00:33.366757626     1 0x7fc2e00184c0 WARN            v4l2videodec gstv4l2videodec.c:1847:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:00:33.366861330     1 0x7fc2e00184c0 WARN          v4l2bufferpool gstv4l2bufferpool.c:1082:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:33.432795886     1 0x7fc2e400fde0 WARN          v4l2bufferpool gstv4l2bufferpool.c:1533:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder0:pool:src> Driver should never set v4l2_buffer.field to ANY

The camera is producing a TCP datastream (I have to set --rtsp_transport tcp when using ffplay) so I don’t understand why it’s giving this UDP warning?

What might be going on?

5

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one.
Thanks

All payloads(video, audio and others) are transferred with UDP but not TCP. RFC 2326: Real Time Streaming Protocol (RTSP) (rfc-editor.org)

Seems the camera can not generate correct timestamps for the frames. You can test the stability by a simple gstreamer pipeline. gst-launch-1.0 rtspsrc location=rtsp:/// ! rtph264depay ! h264parse ! x264dec ! fakesink

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.