Deepstream_parallel_inference_app add rtsp reconnects

**• Hardware Platform (GPU) RTX 3060
**• DeepStream Version 6.3
• TensorRT Version
**• NVIDIA GPU Driver Version (valid for GPU only) CUDA12.0
• Issue Type (questions)

I tried to add RTSP reconnects in deepstream_parallel_inference, but it always gets stuck at reset_source_pipeline (src_bin). The program just freezes. Do you have any solutions for this?
Moreover, I found that in this example, if even one RTSP stream fails to connect or gets disconnected, the entire program stops running.

Could you attach the patch you added and how do you reproduce this issue?

Because I need to pull multiple RTSP streams for recognition, I found that if a stream disconnects, the program will freeze and stop working. If the RTSP cannot connect when the program starts, the entire program will fail to start. Therefore, I plan to add a reconnection feature for RTSP disconnections.

My approach is to directly assign the following values in
static gboolean create_rtsp_src_bin(NvDsSourceConfig *config, NvDsSrcBin *bin):

bin->rtsp_reconnect_interval_sec = 10;
bin->rtsp_reconnect_attempts = -1;
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src

**PERF:  FPS 0 (Avg)    FPS 1 (Avg)     FPS 2 (Avg)     FPS 3 (Avg)
**PERF:  0.00 (0.00)    0.00 (0.00)     0.00 (0.00)     0.00 (0.00)
2024-07-31 13:10:43
**PERF:  0.00 (0.00)    0.00 (0.00)     0.00 (0.00)     0.00 (0.00)
2024-07-31 13:10:48
** WARN: <watch_source_status:758>: No data from source 1 since last 10 sec. Trying reconnection

After the above message appears, the program freezes.

After testing, I found that the program freezes at reset_source_pipeline(gpointer data); during the reconnection process in the following part:

if (gst_element_set_state(src_bin->bin, GST_STATE_NULL) == GST_STATE_CHANGE_FAILURE) {
    GST_ERROR_OBJECT(src_bin->bin, "Can't set source bin to NULL");
    return FALSE;
}

You mean you modify our demo create_multi_source_bin to create_rtsp_src_bin and set the parameter related to the reconnect? How did you simulate the disconnection scenario?

Doesn’t using this example also utilize the create_rtsp_src_bin function in deepstream_source_bin.c? I directly assigned variables in the create_rtsp_src_bin function in deepstream_source_bin.c. After testing, the RTSP reconnection functionality does execute, but the program gets stuck.

For the scenario, I am pulling a real camera RTSP stream and directly turning off the camera to simulate a disconnection. Additionally, I found that after running the RTSP stream for a period of time, the program sometimes shuts down automatically and displays the following error:

Quitting
nvstreammux: Successfully handled EOS for source_id=0
App run failed

When I use deepstream-app, I don’t encounter this error. Is it true that deepstream_parallel_inference_app is less robust in terms of RTSP connection mechanisms compared to deepstream-app?

We’ll try to reproduce that issue with our latest version.

Thank you very much.

I use DeepStream 7.0 to reproduce this issue. There was no stuck problem. And about the EOS issue, you need to port the relevant code from deepstream-app.

sources\apps\sample_apps\deepstream-app\deepstream_app.c
static gboolean
bus_callback (GstBus * bus, GstMessage * message, gpointer data)
{

The processing of this bus_call is less robust than deepstream-app.

I have discovered an issue: when the RTSP reconnects after a disconnection, the model’s recognition disappears. Have you encountered the same problem?
original:

rtsp reconnect:

I modified the sample code to address the issue that caused the program to crash after an RTSP disconnection, achieving a successful reconnection. However, after reconnection, the object detection stops functioning.

Could you attach the config file you are using?

source4_1080p_dec_parallel_infer.txt (8.0 KB)
sources.csv:

enable,type,uri,num-sources,gpu-id,cudadec-memtype,rtsp-reconnect-interval-sec,rtsp-reconnect-attempts
1,4,rtsp://admin:123@10.133.71.150:554/profile1,1,0,0,10,-1
1,4,rtsp://admin:123@10.133.71.151:554/profile1,1,0,0,10,-1
1,4,rtsp://admin:123@10.133.71.152:554/profile1,1,0,0,10,-1

I added rtsp-reconnect-interval-sec and rtsp-reconnect-attempts to sources.csv to achieve the effect of reconnecting after a disconnection.

Could you attach the whole log about the issue below? You can add GST_DEBUG=3 in front of your command.

root@shy-ROG-Strix-G15CE-G15CE:/admin/tritonclient/sample/apps/deepstream-parallel-infer/build# GST_DEBUG=3 ./deepstream-parallel-infer -c /admin/tritonclient/sample/configs/apps/bodypose_yolo_lpr/source4_1080p_dec_parallel_infer.yml

src_ids:0;1;2
Unknown key enable-batch-process for tracker
Unknown key enable-past-frame for tracker
src_ids:0;1
Unknown key enable-batch-process for tracker
Unknown key enable-past-frame for tracker
src_ids:1;2
Unknown key enable-batch-process for tracker
Unknown key enable-past-frame for tracker
NVDSMETAMUX_CFG_PARSER: Group 'user-configs' ignored
** INFO: <create_primary_gie_bin:154>: gpu-id: 0 in primary-gie group is ignored, only accept in nvinferserver's config
i:0, src_id_num:3
link_streamdemux_to_streammux, srid:0, mux:0
link_streamdemux_to_streammux, srid:1, mux:0
link_streamdemux_to_streammux, srid:2, mux:0
** INFO: <create_primary_gie_bin:154>: gpu-id: 0 in primary-gie group is ignored, only accept in nvinferserver's config
i:1, src_id_num:2
link_streamdemux_to_streammux, srid:0, mux:1
link_streamdemux_to_streammux, srid:1, mux:1
gstnvtracker: Loading low-level lib at /opt/nvidia/deepstream/deepstream-6.3/lib/libnvds_nvmultiobjecttracker.so
[NvMultiObjectTracker] Initialized
0:00:00.181765506 2672150 0x560adbd70e40 WARN           nvinferserver gstnvinferserver_impl.cpp:366:validatePluginConfig:<primary_gie> warning: Configuration file unique-id reset to: 888
INFO: infer_trtis_backend.cpp:218 TrtISBackend id:888 initialized model: yolov7_firesmoke
0:00:00.452784419 2672150 0x560adbd70e40 WARN           nvinferserver gstnvinferserver_impl.cpp:366:validatePluginConfig:<primary_gie> warning: Configuration file unique-id reset to: 999
Deserialize yoloLayer plugin: yolo
INFO: infer_trtis_backend.cpp:218 TrtISBackend id:999 initialized model: yolov7
Running...
WARNING from primary_gie: Configuration file unique-id reset to: 888
Debug info: gstnvinferserver_impl.cpp(366): validatePluginConfig (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:parallel_infer_bin/GstBin:primary_gie_1_bin/GstNvInferServer:primary_gie
WARNING from primary_gie: Configuration file unique-id reset to: 999
Debug info: gstnvinferserver_impl.cpp(366): validatePluginConfig (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:parallel_infer_bin/GstBin:primary_gie_0_bin/GstNvInferServer:primary_gie
0:00:00.656004819 2672150 0x7f21f80a1460 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:00.656076502 2672150 0x7f21f80a14c0 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc1:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:00.656100290 2672150 0x7f21f80a1520 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc2:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:01.060738988 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060752314 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MJPG
0:00:01.060755213 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060757748 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MJPG
0:00:01.060765804 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060768170 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat AV10
0:00:01.060770308 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060772586 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat AV10
0:00:01.060777318 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060780416 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat DVX5
0:00:01.060782629 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060784817 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat DVX5
0:00:01.060788825 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060792202 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat DVX4
0:00:01.060794851 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060797824 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat DVX4
0:00:01.060802234 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060805154 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MPG4
0:00:01.060807668 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060810424 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MPG4
0:00:01.060814944 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060817634 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat MPG2
0:00:01.060820008 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060822633 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat MPG2
0:00:01.060827251 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060830986 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat H265
0:00:01.060833528 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060836284 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat H265
0:00:01.060840607 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060843390 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat VP90
0:00:01.060845851 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060848450 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat VP90
0:00:01.060852224 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060854826 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat VP80
0:00:01.060857242 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060859752 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat VP80
0:00:01.060864051 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060866781 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe minimum capture size for pixelformat H264
0:00:01.060869199 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:sink> Unable to try format: Unknown error -1
0:00:01.060871887 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:sink> Could not probe maximum capture size for pixelformat H264
0:00:01.061082165 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061085796 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe minimum capture size for pixelformat Y444
0:00:01.061088543 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061091536 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe maximum capture size for pixelformat Y444
0:00:01.061095654 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc10f900 Failed to determine interlace mode
0:00:01.061100661 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061103550 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe minimum capture size for pixelformat P410
0:00:01.061105928 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061108814 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe maximum capture size for pixelformat P410
0:00:01.061111818 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc10f900 Failed to determine interlace mode
0:00:01.061116153 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061119085 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe minimum capture size for pixelformat PM10
0:00:01.061121494 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061124183 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe maximum capture size for pixelformat PM10
0:00:01.061126985 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc10f900 Failed to determine interlace mode
0:00:01.061131194 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061134197 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe minimum capture size for pixelformat NM12
0:00:01.061136631 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder0:src> Unable to try format: Unknown error -1
0:00:01.061139401 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder0:src> Could not probe maximum capture size for pixelformat NM12
0:00:01.061142124 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc10f900 Failed to determine interlace mode
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
0:00:01.061329823 2672150 0x560adb2d80c0 WARN            videodecoder gstvideodecoder.c:745:gst_video_decoder_setcaps:<nvv4l2decoder0> Subclass refused caps
0:00:01.061334909 2672150 0x560adb2d80c0 WARN               decodebin gstdecodebin2.c:2523:connect_pad:<decodebin_elem0> Couldn't set nvv4l2decoder0 to PAUSED
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:01.065404445 2672150 0x7f21f80a4120 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc5> error: Internal data stream error.
0:00:01.065410907 2672150 0x7f21f80a4120 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc5> error: streaming stopped, reason not-linked (-1)
0:00:01.111712822 2672150 0x560adb2d5760 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.111737883 2672150 0x560adb2d5760 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:01.112295459 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.112303023 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:01.112347268 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.112350169 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:01.112362542 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.112364749 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:01.112397635 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.112402046 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:01.112416338 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.112418537 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:01.112424704 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:01.112426878 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:01.730978962 2672150 0x7f21f80a4000 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc3> error: Internal data stream error.
0:00:01.730992288 2672150 0x7f21f80a4000 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc3> error: streaming stopped, reason not-linked (-1)
0:00:02.260159196 2672150 0x560adb1d2b00 FIXME               basesink gstbasesink.c:3246:gst_base_sink_default_event:<sink_sub_bin_sink1> stream-start event without group-id. Consider implementing group-id handling in the upstream elements
0:00:18.971639178 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:5624:gst_rtspsrc_loop_udp:<src_elem0> warning: The server closed the connection.
WARNING from src_elem0: Could not read from resource.
Debug info: gstrtspsrc.c(5624): gst_rtspsrc_loop_udp (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
The server closed the connection.
0:00:18.984396542 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:5637:gst_rtspsrc_loop_udp:<src_elem0> warning: Unhandled return value -7.
0:00:18.984541198 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:5705:gst_rtspsrc_loop_udp:<src_elem0> error: Could not receive message. (System error)
0:00:18.984612599 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:6057:gst_rtspsrc_loop:<src_elem0> error: Internal data stream error.
0:00:18.984635205 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:6057:gst_rtspsrc_loop:<src_elem0> error: streaming stopped, reason error (-5)
WARNING from src_elem0: Could not read from resource.
Debug info: gstrtspsrc.c(5637): gst_rtspsrc_loop_udp (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Unhandled return value -7.
ERROR from src_elem0: Could not read from resource.
ERROR from src_elem0: Could not read from resource.
Debug info: gstrtspsrc.c(5705): gst_rtspsrc_loop_udp (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not receive message. (System error)
ERROR from src_elem0: Internal data stream error.
ERROR from src_elem0: Internal data stream error.
Debug info: gstrtspsrc.c(6057): gst_rtspsrc_loop (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
streaming stopped, reason error (-5)
nvstreammux: Successfully handled EOS for source_id=0
nvstreammux: Successfully handled EOS for source_id=0
nvstreammux: Successfully handled EOS for source_id=0
0:00:27.555352421 2672150 0x7f21f80a15e0 WARN                 rtspsrc gstrtspsrc.c:3458:on_timeout_common:<src_elem0> source 0455fb32, stream 0455fb32 in session 2 timed out
** WARN: <watch_source_status:758>: No data from source 0 since last 10 sec. Trying reconnection
Attempting to set all elements in src_bin to NULL state
Setting element h264parse_elem0 to NULL state
Element h264parse_elem0 state change return: SUCCESS
Setting element depay_elem0 to NULL state
Element depay_elem0 state change return: SUCCESS
Setting element src_cap_filter_nvvidconv to NULL state
Element src_cap_filter_nvvidconv state change return: SUCCESS
Setting element nvvidconv_elem0 to NULL state
Element nvvidconv_elem0 state change return: SUCCESS
Setting element tee_rtsp_post_decode_elem0 to NULL state
Element tee_rtsp_post_decode_elem0 state change return: SUCCESS
Setting element src_que0 to NULL state
Element src_que0 state change return: SUCCESS
Setting element decodebin_elem0 to NULL state
Element decodebin_elem0 state change return: SUCCESS
Setting element dec_que0 to NULL state
Element dec_que0 state change return: SUCCESS
Setting element tee_rtsp_elem0 to NULL state
Element tee_rtsp_elem0 state change return: SUCCESS
Setting element src_elem0 to NULL state
0:00:28.086290481 2672150 0x560adb2d8180 WARN                 default gstrtspconnection.c:1308:writev_bytes: Error sending message: Broken pipe
0:00:28.086343660 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:6407:gst_rtspsrc_try_send:<src_elem0> error: Could not send message. (Received end-of-file)
0:00:28.086418354 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:8669:gst_rtspsrc_pause:<src_elem0> error: Could not send message. (Received end-of-file)
0:00:28.089707423 2672150 0x560adb2d8180 WARN                 default gstrtspconnection.c:1308:writev_bytes: Error sending message: Broken pipe
0:00:28.089749896 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:6407:gst_rtspsrc_try_send:<src_elem0> error: Could not send message. (Received end-of-file)
0:00:28.089821484 2672150 0x560adb2d8180 WARN                 rtspsrc gstrtspsrc.c:8096:gst_rtspsrc_close:<src_elem0> error: Could not send message. (Received end-of-file)
Element src_elem0 state change return: SUCCESS
Setting src_bin->bin to NULL state
State change return: SUCCESS
** INFO: <reset_source_pipeline:1748>: Resetting source 0
Syncing state with parent
Sending stream reset event to parser
0:00:28.549383921 2672150 0x7f21c801a400 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc6:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:28.549451914 2672150 0x7f21f80a1700 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc7:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:28.549536910 2672150 0x7f21f80a1760 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc8:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:28.918781465 2672150 0x7f21f80a4000 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc15> error: Internal data stream error.
0:00:28.918817189 2672150 0x7f21f80a4000 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc15> error: streaming stopped, reason not-linked (-1)
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:28.932992613 2672150 0x7f21f80a1460 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc21> error: Internal data stream error.
0:00:28.933003616 2672150 0x7f21f80a1460 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc21> error: streaming stopped, reason not-linked (-1)
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:29.620419025 2672150 0x7f21f80a40c0 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc18> error: Internal data stream error.
0:00:29.620463140 2672150 0x7f21f80a40c0 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc18> error: streaming stopped, reason not-linked (-1)
State after setting to NULL: PAUSED
Pending state: PLAYING
State change return: FAILURE
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(6407): gst_rtspsrc_try_send (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(8669): gst_rtspsrc_pause (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(6407): gst_rtspsrc_try_send (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(8096): gst_rtspsrc_close (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from udpsrc18: Internal data stream error.
ERROR from udpsrc18: Internal data stream error.
Debug info: gstbasesrc.c(3072): gst_base_src_loop (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0/GstUDPSrc:udpsrc18:
streaming stopped, reason not-linked (-1)
** WARN: <watch_source_status:758>: No data from source 0 since last 10 sec. Trying reconnection
Attempting to set all elements in src_bin to NULL state
Setting element h264parse_elem0 to NULL state
Element h264parse_elem0 state change return: SUCCESS
Setting element depay_elem0 to NULL state
Element depay_elem0 state change return: SUCCESS
Setting element src_cap_filter_nvvidconv to NULL state
Element src_cap_filter_nvvidconv state change return: SUCCESS
Setting element nvvidconv_elem0 to NULL state
Element nvvidconv_elem0 state change return: SUCCESS
Setting element tee_rtsp_post_decode_elem0 to NULL state
Element tee_rtsp_post_decode_elem0 state change return: SUCCESS
Setting element src_que0 to NULL state
Element src_que0 state change return: SUCCESS
Setting element decodebin_elem0 to NULL state
Element decodebin_elem0 state change return: SUCCESS
Setting element dec_que0 to NULL state
Element dec_que0 state change return: SUCCESS
Setting element tee_rtsp_elem0 to NULL state
Element tee_rtsp_elem0 state change return: SUCCESS
Setting element src_elem0 to NULL state
0:00:37.628904267 2672150 0x7f21b0018860 WARN                 default gstrtspconnection.c:1308:writev_bytes: Operation was cancelled
0:00:37.628945852 2672150 0x7f21b0018860 WARN                 rtspsrc gstrtspsrc.c:6410:gst_rtspsrc_try_send:<src_elem0> send interrupted
0:00:37.628962006 2672150 0x7f21b0018860 WARN                 rtspsrc gstrtspsrc.c:8672:gst_rtspsrc_pause:<src_elem0> PAUSE interrupted
Element src_elem0 state change return: SUCCESS
Setting src_bin->bin to NULL state
State change return: SUCCESS
** INFO: <reset_source_pipeline:1748>: Resetting source 0
Syncing state with parent
Sending stream reset event to parser
0:00:37.695315964 2672150 0x7f21f80a4000 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc9:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:37.695328383 2672150 0x7f21f80a1520 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc10:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:37.695329649 2672150 0x7f21f80a4060 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc11:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:38.073802792 2672150 0x7f21f80a40c0 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc24> error: Internal data stream error.
0:00:38.073839813 2672150 0x7f21f80a40c0 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc24> error: streaming stopped, reason not-linked (-1)
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:38.830339657 2672150 0x7f21f80a4120 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc26> error: Internal data stream error.
0:00:38.830385312 2672150 0x7f21f80a4120 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc26> error: streaming stopped, reason not-linked (-1)
0:00:43.492192989 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:5624:gst_rtspsrc_loop_udp:<src_elem0> warning: The server closed the connection.
0:00:43.497337132 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:5637:gst_rtspsrc_loop_udp:<src_elem0> warning: Unhandled return value -7.
0:00:43.497416650 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:5705:gst_rtspsrc_loop_udp:<src_elem0> error: Could not receive message. (System error)
0:00:43.497466604 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:6057:gst_rtspsrc_loop:<src_elem0> error: Internal data stream error.
0:00:43.497481932 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:6057:gst_rtspsrc_loop:<src_elem0> error: streaming stopped, reason error (-5)
State after setting to NULL: PAUSED
Pending state: PLAYING
State change return: FAILURE
WARNING from src_elem0: Could not read from resource.
Debug info: gstrtspsrc.c(5624): gst_rtspsrc_loop_udp (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
The server closed the connection.
WARNING from src_elem0: Could not read from resource.
Debug info: gstrtspsrc.c(5637): gst_rtspsrc_loop_udp (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Unhandled return value -7.
ERROR from src_elem0: Could not read from resource.
ERROR from src_elem0: Could not read from resource.
Debug info: gstrtspsrc.c(5705): gst_rtspsrc_loop_udp (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not receive message. (System error)
ERROR from src_elem0: Internal data stream error.
ERROR from src_elem0: Internal data stream error.
Debug info: gstrtspsrc.c(6057): gst_rtspsrc_loop (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
streaming stopped, reason error (-5)
** WARN: <watch_source_status:758>: No data from source 0 since last 10 sec. Trying reconnection
Attempting to set all elements in src_bin to NULL state
Setting element h264parse_elem0 to NULL state
Element h264parse_elem0 state change return: SUCCESS
Setting element depay_elem0 to NULL state
Element depay_elem0 state change return: SUCCESS
Setting element src_cap_filter_nvvidconv to NULL state
Element src_cap_filter_nvvidconv state change return: SUCCESS
Setting element nvvidconv_elem0 to NULL state
Element nvvidconv_elem0 state change return: SUCCESS
Setting element tee_rtsp_post_decode_elem0 to NULL state
Element tee_rtsp_post_decode_elem0 state change return: SUCCESS
Setting element src_que0 to NULL state
Element src_que0 state change return: SUCCESS
Setting element decodebin_elem0 to NULL state
Element decodebin_elem0 state change return: SUCCESS
Setting element dec_que0 to NULL state
Element dec_que0 state change return: SUCCESS
Setting element tee_rtsp_elem0 to NULL state
Element tee_rtsp_elem0 state change return: SUCCESS
Setting element src_elem0 to NULL state
0:00:47.504251082 2672150 0x7f21e400ff00 WARN                 default gstrtspconnection.c:1308:writev_bytes: Error sending message: Broken pipe
0:00:47.504295712 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:6407:gst_rtspsrc_try_send:<src_elem0> error: Could not send message. (Received end-of-file)
0:00:47.504351644 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:8669:gst_rtspsrc_pause:<src_elem0> error: Could not send message. (Received end-of-file)
0:00:47.508099162 2672150 0x7f21e400ff00 WARN                 default gstrtspconnection.c:1308:writev_bytes: Error sending message: Broken pipe
0:00:47.508142007 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:6407:gst_rtspsrc_try_send:<src_elem0> error: Could not send message. (Received end-of-file)
0:00:47.508194132 2672150 0x7f21e400ff00 WARN                 rtspsrc gstrtspsrc.c:8096:gst_rtspsrc_close:<src_elem0> error: Could not send message. (Received end-of-file)
Element src_elem0 state change return: SUCCESS
Setting src_bin->bin to NULL state
State change return: SUCCESS
** INFO: <reset_source_pipeline:1748>: Resetting source 0
Syncing state with parent
Sending stream reset event to parser
0:00:47.563906069 2672150 0x7f21f80a1760 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc12:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:47.563958197 2672150 0x7f21f80a40c0 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc14:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:47.563956920 2672150 0x7f21f80a1460 FIXME                default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc13:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:47.959091056 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959102579 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat MJPG
0:00:47.959105510 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959108977 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat MJPG
0:00:47.959116351 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959130723 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat AV10
0:00:47.959133121 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959135854 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat AV10
0:00:47.959141622 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959144382 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat DVX5
0:00:47.959146868 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959149665 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat DVX5
0:00:47.959154228 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959157191 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat DVX4
0:00:47.959159632 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959162384 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat DVX4
0:00:47.959166918 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959169811 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat MPG4
0:00:47.959172187 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959174924 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat MPG4
0:00:47.959179829 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959182621 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat MPG2
0:00:47.959184965 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959187701 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat MPG2
0:00:47.959192802 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959195581 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat H265
0:00:47.959197972 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959200715 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat H265
0:00:47.959204992 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959207962 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat VP90
0:00:47.959210402 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959213189 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat VP90
0:00:47.959217063 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959219839 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat VP80
0:00:47.959222321 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959225477 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat VP80
0:00:47.959234676 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959237577 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe minimum capture size for pixelformat H264
0:00:47.959240057 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:sink> Unable to try format: Unknown error -1
0:00:47.959242788 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:sink> Could not probe maximum capture size for pixelformat H264
0:00:47.959271284 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959274745 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe minimum capture size for pixelformat Y444
0:00:47.959276860 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959279823 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe maximum capture size for pixelformat Y444
0:00:47.959283475 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc19c6c0 Failed to determine interlace mode
0:00:47.959288491 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959291390 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe minimum capture size for pixelformat P410
0:00:47.959300756 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959303306 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe maximum capture size for pixelformat P410
0:00:47.959306228 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc19c6c0 Failed to determine interlace mode
0:00:47.959310541 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959313223 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe minimum capture size for pixelformat PM10
0:00:47.959315598 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959318337 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe maximum capture size for pixelformat PM10
0:00:47.959321077 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc19c6c0 Failed to determine interlace mode
0:00:47.959325511 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959328136 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2967:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe minimum capture size for pixelformat NM12
0:00:47.959330613 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:3082:gst_v4l2_object_get_nearest_size:<nvv4l2decoder1:src> Unable to try format: Unknown error -1
0:00:47.959333112 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2973:gst_v4l2_object_probe_caps_for_format:<nvv4l2decoder1:src> Could not probe maximum capture size for pixelformat NM12
0:00:47.959335978 2672150 0x560adb2d80c0 WARN                    v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0x7f21fc19c6c0 Failed to determine interlace mode
Error while setting IOCTL
Invalid control
S_EXT_CTRLS for CUDA_GPU_ID failed
0:00:47.959473718 2672150 0x560adb2d80c0 WARN            videodecoder gstvideodecoder.c:745:gst_video_decoder_setcaps:<nvv4l2decoder1> Subclass refused caps
0:00:47.959478353 2672150 0x560adb2d80c0 WARN               decodebin gstdecodebin2.c:2523:connect_pad:<decodebin_elem0> Couldn't set nvv4l2decoder1 to PAUSED
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:47.963701625 2672150 0x7f21f80a1700 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc35> error: Internal data stream error.
0:00:47.963709567 2672150 0x7f21f80a1700 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc35> error: streaming stopped, reason not-linked (-1)
State after setting to NULL: PAUSED
Pending state: VOID_PENDING
State change return: SUCCESS
0:00:47.984763258 2672150 0x7f2178017360 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.984776541 2672150 0x7f2178017360 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(6407): gst_rtspsrc_try_send (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(8669): gst_rtspsrc_pause (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(6407): gst_rtspsrc_try_send (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
ERROR from src_elem0: Could not write to resource.
ERROR from src_elem0: Could not write to resource.
Debug info: gstrtspsrc.c(8096): gst_rtspsrc_close (): /GstPipeline:deepstream-tensorrt-openpose-pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRTSPSrc:src_elem0:
Could not send message. (Received end-of-file)
0:00:47.985107880 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.985113951 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:47.985136118 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.985138761 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:47.985159735 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.985161961 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:47.985186778 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.985190313 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:47.985204872 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.985207313 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
0:00:47.985221610 2672150 0x560adb2d80c0 WARN              video-info video-info.c:189:validate_colorimetry: color matrix RGB is only supported with RGB format, I420 is not
0:00:47.985224284 2672150 0x560adb2d80c0 WARN              video-info video-info.c:513:gst_video_info_from_caps: invalid colorimetry, using default
** ERROR: <cb_newpad3:510>: Failed to link depay loader to rtsp src
0:00:48.690836856 2672150 0x7f21c801a400 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc33> error: Internal data stream error.
0:00:48.690874574 2672150 0x7f21c801a400 WARN                 basesrc gstbasesrc.c:3072:gst_base_src_loop:<udpsrc33> error: streaming stopped, reason not-linked (-1)

During the execution process, I disconnected and reconnected the RTSP stream.

There’s nothing valid in the log file. Could you check the source_id, metadata in the probe function after the reconnection?

Okay, I’ll test it out again. Do you experience the same issue on your end?

The test results are as follows: Initially, both source_id and obj_meta->object_id print out normally. However, after reconnecting, while “Processing frame from source_id” still prints out the source_id correctly, the obj_meta->object_id does not print at all.

static GstPadProbeReturn
body_pose_gie_src_pad_buffer_probe(GstPad *pad, GstPadProbeInfo *info, gpointer u_data)
{
  gchar *msg = NULL;
  GstBuffer *buf = (GstBuffer *)info->data;
  NvDsMetaList *l_frame = NULL;
  NvDsMetaList *l_obj = NULL;
  NvDsMetaList *l_user = NULL;
  NvDsBatchMeta *batch_meta = gst_buffer_get_nvds_batch_meta(buf);

  for (l_frame = batch_meta->frame_meta_list; l_frame != NULL; l_frame = l_frame->next)
  {
    NvDsFrameMeta *frame_meta = (NvDsFrameMeta *)(l_frame->data);

    // 檢查 source_id
    guint source_id = frame_meta->source_id;
    g_print("Processing frame from source_id = %d\n", source_id);

    for (l_user = frame_meta->frame_user_meta_list; l_user != NULL; l_user = l_user->next)
    {
      NvDsUserMeta *user_meta = (NvDsUserMeta *)l_user->data;
      if (user_meta->base_meta.meta_type == NVDSINFER_TENSOR_OUTPUT_META)
      {
        NvDsInferTensorMeta *tensor_meta = (NvDsInferTensorMeta *)user_meta->user_meta_data;
        Vec2D<int> objects;
        Vec3D<float> normalized_peaks;
        tie(objects, normalized_peaks) = parse_objects_from_tensor_meta(tensor_meta);
        create_display_meta(objects, normalized_peaks, frame_meta, frame_meta->source_frame_width, frame_meta->source_frame_height);
      }
    }

    for (l_obj = frame_meta->obj_meta_list; l_obj != NULL; l_obj = l_obj->next)
    {
      NvDsObjectMeta *obj_meta = (NvDsObjectMeta *)l_obj->data;
      g_print("Processing frame from obj_meta->object_id = %d\n", obj_meta->object_id);
      for (l_user = obj_meta->obj_user_meta_list; l_user != NULL; l_user = l_user->next)
      {
        NvDsUserMeta *user_meta = (NvDsUserMeta *)l_user->data;
        if (user_meta->base_meta.meta_type == NVDSINFER_TENSOR_OUTPUT_META)
        {
          NvDsInferTensorMeta *tensor_meta = (NvDsInferTensorMeta *)user_meta->user_meta_data;
          Vec2D<int> objects;
          Vec3D<float> normalized_peaks;
          tie(objects, normalized_peaks) = parse_objects_from_tensor_meta(tensor_meta);
          create_display_meta(objects, normalized_peaks, frame_meta, frame_meta->source_frame_width, frame_meta->source_frame_height);
        }
      }
    }
  }
  return GST_PAD_PROBE_OK;
}

No. I cannot reproduce that on my side. Could you attach your changes for our demo? So I can try to reproduce that on my side. Thanks

I was able to use the RTSP reconnect function simply by adding rtsp-reconnect-interval-sec and rtsp-reconnect-attempts in the sources.csv file. When you say you can’t reproduce the issue, do you mean that you’re unable to trigger the reconnection, or that the object detection fails after reconnection?

I just set the rtsp-reconnect-interval-sec to 10 and rtsp-reconnect-attempts to -1 in the create_rtsp_src_bin function.
Since we don’t have an actual camera at crossroads, so we just use ffmpeg to create an virtual rtsp stream. But when I broke the virtual stream and re-created the stream, the demo couldn’t reconnect properly.
So we need your detailed operation steps and changes in our code to reproduce that on our side.

I was able to use the RTSP reconnect function by simply porting the bus_callback (GstBus * bus, GstMessage * message, gpointer data) from deepstream-app and adding rtsp-reconnect-interval-sec and rtsp-reconnect-attempts in the sources.csv file. I didn’t make any other significant changes.

I have tried that with 2 sources. After the reconnection, it works well. Below is the config file I used.
source4_1080p_dec_parallel_infer.yml (8.4 KB)
sources_4_rtsp.csv (140 Bytes)
I use the mothod below to create the 2 rtsp source.
Build rtsp server.