My set up is: T4 GPU, Deepstream 6.1, Tensorrt 8.2.5.1, Cuda 11.6, cuDnn 8.4, Driver 510.47.03
I have successfully installed Deepstream 6.1 and can run commands like deepstream-app --version-all. I cloned the Deepstream python apps repository from deepstream_python_apps/apps/deepstream-rtsp-in-rtsp-out at master · NVIDIA-AI-IOT/deepstream_python_apps · GitHub, and I installed the Deepstream 6.1 python bindings with the .whl file. I tried to run the sample rtsp in rtsp out program, but I keep getting an error where the pipeline freezes indefinitely near hitting the nvv412decoder0.
The command I am using to run the python sample app is python3 deepstream_test1_rtsp_in_rtsp_out.py -i rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mp4 -g nvinfer
The rtsp link is a public rtsp from RTSP Stream Test | Wowza
The only changes I made were to the dstest1_pgie_config.txt file where I changed all the …/…/…/…/ paths to /opt/nvidia/deepstream/deepstream/.
Theoretically, because this is a sample app, it should work, so I’m thinking that the problem should be in the way I set up deepstream. However, I think I have the right version of all the dependencies installed, so I don’t know where to proceed from here.
Here is the output with GST_DEBUG=2:
Creating Pipeline
Creating streamux
Creating source_bin 0
Creating source bin
source-bin-00
Creating Pgie
Creating tiler
Creating nvvidconv
Creating nvosd
Creating H264 Encoder
Creating H264 rtppay
Adding elements to Pipeline
0:00:00.128797229 1899 0x20d7aa0 ERROR rtspserver rtsp-server.c:928:gst_rtsp_server_create_socket:GstRTSPServer@0x1fd3910 failed to create socket
0:00:00.128818198 1899 0x20d7aa0 ERROR rtspserver rtsp-server.c:1295:gst_rtsp_server_create_source:GstRTSPServer@0x1fd3910 failed to create socket
0:00:00.128832172 1899 0x20d7aa0 ERROR rtspserver rtsp-server.c:1341:gst_rtsp_server_attach:GstRTSPServer@0x1fd3910 failed to create watch: Error binding to address 0.0.0.0:8554: Address already in use
*** DeepStream: Launched RTSP Streaming at rtsp://localhost:8554/ds-test ***
Starting pipeline
0:00:00.130345833 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:encoder:sink Unable to try format: Unknown error -1
0:00:00.130365325 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:encoder:sink Could not probe minimum capture size for pixelformat YM12
0:00:00.130374794 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:encoder:sink Unable to try format: Unknown error -1
0:00:00.130383443 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:encoder:sink Could not probe maximum capture size for pixelformat YM12
0:00:00.130392677 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2394:gst_v4l2_object_add_interlace_mode:0x20c0110 Failed to determine interlace mode
0:00:00.130407982 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:encoder:sink Unable to try format: Unknown error -1
0:00:00.130417959 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:encoder:sink Could not probe minimum capture size for pixelformat NM12
0:00:00.130427450 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:encoder:sink Unable to try format: Unknown error -1
0:00:00.130439017 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:encoder:sink Could not probe maximum capture size for pixelformat NM12
0:00:00.130447767 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2394:gst_v4l2_object_add_interlace_mode:0x20c0110 Failed to determine interlace mode
0:00:00.130484832 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:encoder:src Unable to try format: Unknown error -1
0:00:00.130498192 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:encoder:src Could not probe minimum capture size for pixelformat H264
0:00:00.130508672 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:encoder:src Unable to try format: Unknown error -1
0:00:00.130517159 1899 0x20d7aa0 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:encoder:src Could not probe maximum capture size for pixelformat H264
0:00:00.361178099 1899 0x20d7aa0 WARN nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::initialize() <nvdsinfer_context_impl.cpp:1161> [UID = 1]: Warning, OpenCV has been deprecated. Using NMS for clustering instead of cv::groupRectangles with topK = 20 and NMS Threshold = 0.5
WARNING: …/nvdsinfer/nvdsinfer_model_builder.cpp:1482 Deserialize engine failed because file path: /opt/nvidia/deepstream/deepstream-6.1/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine open error
0:00:01.343722545 1899 0x20d7aa0 WARN nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:1888> [UID = 1]: deserialize engine from file :/opt/nvidia/deepstream/deepstream-6.1/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine failed
0:00:01.366692892 1899 0x20d7aa0 WARN nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:1993> [UID = 1]: deserialize backend context from engine from file :/opt/nvidia/deepstream/deepstream-6.1/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine failed, try rebuild
0:00:01.366726355 1899 0x20d7aa0 INFO nvinfer gstnvinfer.cpp:646:gst_nvinfer_logger: NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1914> [UID = 1]: Trying to create engine from model files
WARNING: …/nvdsinfer/nvdsinfer_model_builder.cpp:1454 Serialize engine failed because of file path: /opt/nvidia/deepstream/deepstream-6.1/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine opened error
0:00:19.450606893 1899 0x20d7aa0 WARN nvinfer gstnvinfer.cpp:643:gst_nvinfer_logger: NvDsInferContext[UID 1]: Warning from NvDsInferContextImpl::buildModel() <nvdsinfer_context_impl.cpp:1941> [UID = 1]: failed to serialize cude engine to file: /opt/nvidia/deepstream/deepstream-6.1/samples/models/Primary_Detector/resnet10.caffemodel_b1_gpu0_int8.engine
INFO: …/nvdsinfer/nvdsinfer_model_builder.cpp:610 [Implicit Engine Info]: layers num: 3
0 INPUT kFLOAT input_1 3x368x640
1 OUTPUT kFLOAT conv2d_bbox 16x23x40
2 OUTPUT kFLOAT conv2d_cov/Sigmoid 4x23x40
0:00:19.483611845 1899 0x20d7aa0 INFO nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus: [UID 1]: Load new model:dstest1_pgie_config.txt sucessfully
Decodebin child added: source
0:00:19.509220400 1899 0x147e760 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open: warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:19.509250623 1899 0x147e760 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open: have udp buffer of 212992 bytes while 524288 were requested
0:00:19.509446425 1899 0x147e760 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open: warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:19.509491020 1899 0x147e760 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open: have udp buffer of 212992 bytes while 524288 were requested
0:00:19.516310363 1899 0x147e760 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open: warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:19.516338643 1899 0x147e760 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open: have udp buffer of 212992 bytes while 524288 were requested
0:00:19.516490186 1899 0x147e760 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open: warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:19.516512861 1899 0x147e760 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open: have udp buffer of 212992 bytes while 524288 were requested
Decodebin child added: decodebin0
Decodebin child added: decodebin1
Decodebin child added: rtph264depay0
Decodebin child added: rtpmp4gdepay0
Decodebin child added: h264parse0
Decodebin child added: aacparse0
Decodebin child added: capsfilter0
Decodebin child added: nvv4l2decoder0
0:00:19.762444663 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762465188 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat MJPG
0:00:19.762477917 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762488959 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat MJPG
0:00:19.762507260 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762516825 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat DVX5
0:00:19.762525711 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762535286 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat DVX5
0:00:19.762551347 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762560656 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat DVX4
0:00:19.762569436 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762578952 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat DVX4
0:00:19.762594808 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762603952 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat MPG4
0:00:19.762612690 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762622160 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat MPG4
0:00:19.762635460 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762644842 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat MPG2
0:00:19.762653556 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762663029 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat MPG2
0:00:19.762678440 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762690557 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat H265
0:00:19.762700316 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762709753 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat H265
0:00:19.762722909 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762731920 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat VP90
0:00:19.762741992 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762751937 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat VP90
0:00:19.762765063 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762774078 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat VP80
0:00:19.762784637 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762793933 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat VP80
0:00:19.762807532 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762816465 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe minimum capture size for pixelformat H264
0:00:19.762826325 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:sink Unable to try format: Unknown error -1
0:00:19.762836049 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:sink Could not probe maximum capture size for pixelformat H264
0:00:19.762873495 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:src Unable to try format: Unknown error -1
0:00:19.762883443 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2941:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:src Could not probe minimum capture size for pixelformat NM12
0:00:19.762893958 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:3056:gst_v4l2_object_get_nearest_size:nvv4l2decoder0:src Unable to try format: Unknown error -1
0:00:19.762903482 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2947:gst_v4l2_object_probe_caps_for_format:nvv4l2decoder0:src Could not probe maximum capture size for pixelformat NM12
0:00:19.762917946 1899 0x7f623801e120 WARN v4l2 gstv4l2object.c:2394:gst_v4l2_object_add_interlace_mode:0x7f62280b81c0 Failed to determine interlace mode
Decodebin child added: avdec_aac0
In cb_newpad
gstname= audio/x-raw
In cb_newpad
gstname= video/x-raw
features= <Gst.CapsFeatures object at 0x7f6341fe5e80 (GstCapsFeatures at 0x7f62280b8c40)>
0:00:19.915305890 1899 0x7f623801e120 WARN v4l2bufferpool gstv4l2bufferpool.c:1049:gst_v4l2_buffer_pool_start:encoder:pool:src Uncertain or not enough buffers, enabling copy threshold
0:00:19.916174687 1899 0x7f623801e120 WARN v4l2videodec gstv4l2videodec.c:1779:gst_v4l2_video_dec_decide_allocation: Duration invalid, not setting latency
0:00:19.916206206 1899 0x7f623801e120 WARN v4l2bufferpool gstv4l2bufferpool.c:1049:gst_v4l2_buffer_pool_start:nvv4l2decoder0:pool:src Uncertain or not enough buffers, enabling copy threshold
0:00:19.916923742 1899 0x7f6228019920 WARN v4l2bufferpool gstv4l2bufferpool.c:1499:gst_v4l2_buffer_pool_dqbuf:nvv4l2decoder0:pool:src Driver should never set v4l2_buffer.field to ANY
0:00:19.931039933 1899 0x7f62700188c0 WARN v4l2bufferpool gstv4l2bufferpool.c:1499:gst_v4l2_buffer_pool_dqbuf:encoder:pool:src Driver should never set v4l2_buffer.field to ANY
Whenever I run the deep stream python sample rtsp in rtsp out app from the repo deepstream_python_apps/apps/deepstream-rtsp-in-rtsp-out at master · NVIDIA-AI-IOT/deepstream_python_apps · GitHub, I get an error in the pipeline where it freezes near the nvv4l2decoder0 element