Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
GPU
• DeepStream Version
6.2
• NVIDIA GPU Driver Version (valid for GPU only)
525.105.17
• Issue Type( questions, new requirements, bugs)
bugs
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
I ran myapp with a bad rtsp stream, which produced errors like these:
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
ERROR from depay_elem0: The stream is in the wrong format.
Debug info: gstrtph264depay.c(1298): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
NAL unit type 27 not supported yet
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
[Thread 0x7f270b36d000 (LWP 64) exited]
[Thread 0x7f270ab6c000 (LWP 65) exited]
** INFO: <reset_source_pipeline:1707>: Resetting source 0
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
ERROR from depay_elem0: The stream is in the wrong format.
Debug info: gstrtph264depay.c(1298): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
NAL unit type 27 not supported yet
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
ERROR from depay_elem0: The stream is in the wrong format.
Debug info: gstrtph264depay.c(1298): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
NAL unit type 27 not supported yet
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
[New Thread 0x7f270b36d000 (LWP 67)]
[New Thread 0x7f270ab6c000 (LWP 68)]
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
ERROR from depay_elem0: The stream is in the wrong format.
Debug info: gstrtph264depay.c(1298): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
NAL unit type 27 not supported yet
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
ERROR from depay_elem0: The stream is in the wrong format.
Debug info: gstrtph264depay.c(1298): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
NAL unit type 27 not supported yet
WARNING from depay_elem0: Could not decode stream.
Debug info: gstrtph264depay.c(1287): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
Undefined packet type
ERROR from depay_elem0: The stream is in the wrong format.
Debug info: gstrtph264depay.c(1298): gst_rtp_h264_depay_process (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin0/GstRtpH264Depay:depay_elem0:
NAL unit type 27 not supported yet
but when I tried to stop it by calling gst_element_set_state (bin->bin, GST_STATE_NULL);, it stucked. I used gdb to debug, backtrace like this:
#0 0x00007fffd97fa170 in __lll_lock_wait () at /usr/lib/x86_64-linux-gnu/libpthread.so.0
#1 0x00007fffd97f2131 in pthread_mutex_lock () at /usr/lib/x86_64-linux-gnu/libpthread.so.0
#2 0x00007fffd98f28ea in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#3 0x00007fffd98f3035 in gst_pad_set_active () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#4 0x00007fffd98cfd25 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#5 0x00007fffd98e2d3c in gst_iterator_fold () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#6 0x00007fffd98d0546 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#7 0x00007fffd98d255e in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#8 0x00007fffd98d2791 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#9 0x00007fffcc33553d in () at /usr/lib/x86_64-linux-gnu/libgstvideo-1.0.so.0
#10 0x00007fffd98d49d2 in gst_element_change_state () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#11 0x00007fffd98d5119 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#12 0x00007fffd98b11b8 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#13 0x00007fff10be59ba in () at /usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstplayback.so
#14 0x00007fffd98d49d2 in gst_element_change_state () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#15 0x00007fffd98d5119 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#16 0x00007fffd98b11b8 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#17 0x00007fffd98d49d2 in gst_element_change_state () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
there’s a lock waiting, I traced the lock’s oewer thread, which is this one:
#0 0x00007fffd93a123f in clock_nanosleep () at /usr/lib/x86_64-linux-gnu/libc.so.6
#1 0x00007fffd93a6ec7 in nanosleep () at /usr/lib/x86_64-linux-gnu/libc.so.6
#2 0x00007fffd93d985f in usleep () at /usr/lib/x86_64-linux-gnu/libc.so.6
#3 0x00007fff10a31c21 in () at /usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libgstnvvideo4linux2.so
#4 0x00007fffcc32fdab in () at /usr/lib/x86_64-linux-gnu/libgstvideo-1.0.so.0
#5 0x00007fffcc332af8 in () at /usr/lib/x86_64-linux-gnu/libgstvideo-1.0.so.0
#6 0x00007fffcc3331ea in () at /usr/lib/x86_64-linux-gnu/libgstvideo-1.0.so.0
#7 0x00007fffd98ecfef in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#8 0x00007fffd98ef051 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#9 0x00007fffd98f5e63 in gst_pad_push () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#10 0x00007fffd926f550 in () at /usr/lib/x86_64-linux-gnu/libgstbase-1.0.so.0
#11 0x00007fffd98ecfef in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#12 0x00007fffd98ef051 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#13 0x00007fffd98f5e63 in gst_pad_push () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#14 0x00007fffd92532c7 in gst_base_parse_push_frame () at /usr/lib/x86_64-linux-gnu/libgstbase-1.0.so.0
#15 0x00007fffd925603b in gst_base_parse_finish_frame () at /usr/lib/x86_64-linux-gnu/libgstbase-1.0.so.0
#16 0x00007fff10b13fff in () at /usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstvideoparsersbad.so
#17 0x00007fffd924dde6 in () at /usr/lib/x86_64-linux-gnu/libgstbase-1.0.so.0
#18 0x00007fffd9253f2e in () at /usr/lib/x86_64-linux-gnu/libgstbase-1.0.so.0
#19 0x00007fffd98ecfef in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#20 0x00007fffd98ef051 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#21 0x00007fffd98f5e63 in gst_pad_push () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#22 0x00007fffd98ecfef in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#23 0x00007fffd98ef051 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#24 0x00007fffd98f5e63 in gst_pad_push () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#25 0x00007fffd98dbd8b in gst_proxy_pad_chain_default () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#26 0x00007fffd98ecfef in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#27 0x00007fffd98ef051 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#28 0x00007fffd98f5e63 in gst_pad_push () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#29 0x00007fffcc16a774 in () at /usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstcoreelements.so
#30 0x00007fffd99241e7 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#31 0x00007fffd9a35374 in () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#32 0x00007fffd9a34ad1 in () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#33 0x00007fffd97ef609 in start_thread () at /usr/lib/x86_64-linux-gnu/libpthread.so.0
#34 0x00007fffd93e3133 in clone () at /usr/lib/x86_64-linux-gnu/libc.so.6
seemed like it stucked in usleep(), I tried continue and break several times, each time it stopped exactly the same position.
I tried deepstream-app in the nvcr.io/nvidia/deepstream:devel-6.2 with no code changing, it also stucked when I tried to stop the application, and from the gdb backtrace, it occured when calling gst_element_set_state () just like my own app:
#0 0x00007f1eb3968170 in __lll_lock_wait () at /usr/lib/x86_64-linux-gnu/libpthread.so.0
#1 0x00007f1eb3960131 in pthread_mutex_lock () at /usr/lib/x86_64-linux-gnu/libpthread.so.0
#2 0x00007f1eb422f8ea in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#3 0x00007f1eb4230035 in gst_pad_set_active () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#4 0x00007f1eb420cd25 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#5 0x00007f1eb421fd3c in gst_iterator_fold () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#6 0x00007f1eb420d546 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#7 0x00007f1eb420f55e in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#8 0x00007f1eb420f791 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#9 0x00007f1eb434c53d in () at /usr/lib/x86_64-linux-gnu/libgstvideo-1.0.so.0
#10 0x00007f1eb42119d2 in gst_element_change_state () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#11 0x00007f1eb4212119 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#12 0x00007f1eb41ee1b8 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#13 0x00007f1e6cc2d9ba in () at /usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstplayback.so
#14 0x00007f1eb42119d2 in gst_element_change_state () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#15 0x00007f1eb4212119 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#16 0x00007f1eb41ee1b8 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#17 0x00007f1eb42119d2 in gst_element_change_state () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#18 0x00007f1eb4212119 in () at /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0
#19 0x0000556138f7a5a9 in reset_source_pipeline (data=0x7f1e7a448088) at ../../apps-common/src/deepstream_source_bin.
#20 0x0000556138f75939 in watch_source_status (data=0x7f1e7a448088) at ../../apps-common/src/deepstream_source_bin.c:
#21 0x00007f1eb3f10be8 in () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#22 0x00007f1eb3f1004e in g_main_context_dispatch () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#23 0x00007f1eb3f10400 in () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#24 0x00007f1eb3f106f3 in g_main_loop_run () at /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0
#25 0x0000556138f64195 in main (argc=1, argv=0x7ffcac7ea978) at deepstream_app_main.c:824