Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) Jetson Orin NX
• DeepStream Version 6.3
• JetPack Version (valid for Jetson only) 5.1.3
• TensorRT Version 8.5.2-1+cuda11.4
• Issue Type( questions, new requirements, bugs) bugs
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
I’m encountering an issue while trying to use the “Multi Source Input with Dewarper” plugin for multiple rtsp sources on a Jetson device. The pipeline works fine on x86 with the same DeepStream version, but it fails on Jetson. If I switch to the standard “Multi Source Input” plugin, the pipeline runs on Jetson, but I really need the dewarping functionality.
To replicate the problem:
- Set up an rtsp stream using the following pipeline from the Pylon camera (details in the link).
T1.txt (3.7 KB) - Run the pipeline using the graph composer tool (details in the link).
T2.txt (4.7 KB)
The error message is:
admin@ubuntu:~/nvgraph/troubleshoot$ GST_DEBUG=3 /opt/nvidia/graph-composer/execute_graph.sh T2.yaml -d ../common/target_aarch64.yaml
Graphs: T2.yaml
Target: ../common/target_aarch64.yaml
===================================================================
Running T2.yaml
===================================================================
[INFO] Writing manifest to /tmp/ds.T2/manifest.yaml
2024-04-29 13:59:56.301 INFO gxf/gxe/gxe.cpp@182: Creating context
2024-04-29 13:59:56.397 INFO gxf/gxe/gxe.cpp@107: Loading app: '/home/admin/nvgraph/troubleshoot/T2.yaml'
2024-04-29 13:59:56.397 INFO gxf/std/yaml_file_loader.cpp@170: Loading GXF entities from YAML file '/home/admin/nvgraph/troubleshoot/T2.yaml'...
2024-04-29 13:59:56.401 INFO gxf/gxe/gxe.cpp@259: Initializing...
2024-04-29 13:59:56.419 INFO extensions/nvdsbase/nvds_scheduler.cpp@270: This program is linked against GStreamer 1.16.3
2024-04-29 13:59:56.421 INFO extensions/nvdsmuxdemux/nvstreammux.hpp@27: initialize: nvstreammux Stream Muxer0
2024-04-29 13:59:56.421 INFO extensions/nvdsvisualization/nvtilerbin.hpp@37: initialize: nvtilerbin Video Tiler0
2024-04-29 13:59:56.421 INFO extensions/nvdsoutputsink/nvvideorenderersinkbin.hpp@24: initialize: nvvideorenderersinkbin NVidia Video Renderer4
2024-04-29 13:59:56.422 INFO gxf/gxe/gxe.cpp@266: Running...
2024-04-29 13:59:56.422 INFO extensions/nvdsbase/nvds_scheduler.cpp@121: Scheduling 4 elements and 4 components
2024-04-29 13:59:56.422 INFO extensions/nvdsmuxdemux/nvstreammux.hpp@37: create_element: nvstreammux Stream Muxer0
2024-04-29 13:59:56.449 INFO extensions/nvdsmuxdemux/nvstreammux.hpp@61: bin_add: nvstreammux Stream Muxer0
2024-04-29 13:59:56.449 INFO extensions/nvdssource/multi_uri_src_bin.cpp@343: create_element: NvDsMultiSrcInput Multi Source Input with Dewarper11
2024-04-29 13:59:56.449 INFO extensions/nvdssource/multi_uri_src_bin.cpp@389: bin_add: bin Multi Source Input with Dewarper11
2024-04-29 13:59:56.449 INFO extensions/nvdsvisualization/nvtilerbin.hpp@45: create_element: nvtilerbin Video Tiler0
2024-04-29 13:59:56.500 INFO extensions/nvdsvisualization/nvtilerbin.hpp@69: bin_add: nvtilerbin Video Tiler0
2024-04-29 13:59:56.500 INFO extensions/nvdsoutputsink/nvvideorenderersinkbin.hpp@32: create_element: nvvideorenderersinkbin NVidia Video Renderer4
2024-04-29 13:59:56.500 INFO extensions/nvdsoutputsink/nvvideorenderersinkbin.hpp@54: bin_add: nvvideorenderersinkbin NVidia Video Renderer4
Using winsys: x11
Running...
****** NvDsScheduler Runtime Keyboard controls:
p: Pause pipeline
r: Resume pipeline
q: Quit pipeline
2024-04-29 13:59:56.569 INFO extensions/nvdsbase/nvds_scheduler.cpp@398: NvDsScheduler Pipeline ready
2024-04-29 13:59:56.570 INFO extensions/nvdsbase/nvds_scheduler.cpp@383: NvDsScheduler Pipeline running
0:00:00.250924000 112539 0xffff3c001760 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open:<udpsrc0> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:00.251009280 112539 0xffff3c001760 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open:<udpsrc0> have udp buffer of 212992 bytes while 524288 were requested
0:00:00.349796224 112539 0xffff3c0014c0 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open:<udpsrc2> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:00.349884992 112539 0xffff3c0014c0 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open:<udpsrc2> have udp buffer of 212992 bytes while 524288 were requested
0:00:00.350326272 112539 0xffff3c0014c0 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open:<udpsrc3> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:00.350365632 112539 0xffff3c0014c0 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open:<udpsrc3> have udp buffer of 212992 bytes while 524288 were requested
0:00:00.354590592 112539 0xffff04014060 FIXME default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc0:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:00.450260960 112539 0xffff40002c00 WARN udpsrc gstudpsrc.c:1445:gst_udpsrc_open:<udpsrc5> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:00.450333920 112539 0xffff40002c00 WARN udpsrc gstudpsrc.c:1455:gst_udpsrc_open:<udpsrc5> have udp buffer of 212992 bytes while 524288 were requested
0:00:00.453549632 112539 0xffff04014180 FIXME rtpjitterbuffer gstrtpjitterbuffer.c:1553:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer0> Unsupported timestamp reference clock
0:00:00.453582720 112539 0xffff04014180 FIXME rtpjitterbuffer gstrtpjitterbuffer.c:1561:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer0> Unsupported media clock
0:00:00.455102080 112539 0xffff08006120 FIXME default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc1:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:00.458544832 112539 0xffff08006240 FIXME rtpjitterbuffer gstrtpjitterbuffer.c:1553:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer1> Unsupported timestamp reference clock
0:00:00.458572576 112539 0xffff08006240 FIXME rtpjitterbuffer gstrtpjitterbuffer.c:1561:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer1> Unsupported media clock
0:00:00.461081472 112539 0xfffed401c060 ERROR nvstreammux gstnvstreammux.cpp:1542:gst_nvstreammux_request_new_pad:<Stream Muxer/Stream Muxer0> Pad should be named 'sink_%u' when requesting a pad
0:00:00.462758432 112539 0xfffef0003180 FIXME default gstutils.c:3980:gst_pad_create_stream_id_internal:<fakesrc2:src> Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:00.465031296 112539 0xfffec00195e0 ERROR nvstreammux gstnvstreammux.cpp:1542:gst_nvstreammux_request_new_pad:<Stream Muxer/Stream Muxer0> Pad should be named 'sink_%u' when requesting a pad
0:00:00.466120704 112539 0xfffef00032a0 FIXME rtpjitterbuffer gstrtpjitterbuffer.c:1553:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer2> Unsupported timestamp reference clock
0:00:00.466146496 112539 0xfffef00032a0 FIXME rtpjitterbuffer gstrtpjitterbuffer.c:1561:gst_jitter_buffer_sink_parse_caps:<rtpjitterbuffer2> Unsupported media clock
0:00:00.552877472 112539 0xfffe98013760 ERROR nvstreammux gstnvstreammux.cpp:1542:gst_nvstreammux_request_new_pad:<Stream Muxer/Stream Muxer0> Pad should be named 'sink_%u' when requesting a pad
Opening in BLOCKING MODE
Opening in BLOCKING MODE
Opening in BLOCKING MODE
0:00:05.431254432 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:4561:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:05.431271968 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:4561:gst_v4l2_object_probe_caps:<nvv4l2decoder1:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:05.431271872 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:4561:gst_v4l2_object_probe_caps:<nvv4l2decoder2:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:05.431368224 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.431322080 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.431400800 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.431414848 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.431441184 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.431455552 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.431464544 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.431493280 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.431477888 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.431524576 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.431513408 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.431545088 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
0:00:05.537199424 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:4561:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:05.537278976 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.537331360 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.537364576 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.537392704 112539 0xfffe9800c580 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe9c097390 Failed to determine interlace mode
0:00:05.538733568 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:4561:gst_v4l2_object_probe_caps:<nvv4l2decoder2:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:05.538803200 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.538855040 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.538888256 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.538941088 112539 0xfffec0018c60 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffea80810c0 Failed to determine interlace mode
0:00:05.539992224 112539 0xffff4c003de0 FIXME basesink gstbasesink.c:3246:gst_base_sink_default_event:<NVidia Video Renderer/NVidia Video Renderer4-sink> stream-start event without group-id. Consider implementing group-id handling in the upstream elements
0:00:05.540293152 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:4561:gst_v4l2_object_probe_caps:<nvv4l2decoder1:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:05.540321888 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.540321888 112539 0xffff4c003de0 FIXME basesink gstbasesink.c:3246:gst_base_sink_default_event:<NVidia Video Renderer/NVidia Video Renderer4-sink> stream-start event without group-id. Consider implementing group-id handling in the upstream elements
0:00:05.540347744 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.540398944 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.540416832 112539 0xfffe7801af00 WARN v4l2 gstv4l2object.c:2420:gst_v4l2_object_add_interlace_mode:0xfffe940998c0 Failed to determine interlace mode
0:00:05.541347008 112539 0xffff4c003de0 FIXME basesink gstbasesink.c:3246:gst_base_sink_default_event:<NVidia Video Renderer/NVidia Video Renderer4-sink> stream-start event without group-id. Consider implementing group-id handling in the upstream elements
0:00:05.553720608 112539 0xfffe7801af00 WARN v4l2videodec gstv4l2videodec.c:2305:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder1> Duration invalid, not setting latency
0:00:05.553724896 112539 0xfffe9800c580 WARN v4l2videodec gstv4l2videodec.c:2305:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:00:05.553981600 112539 0xfffec0018c60 WARN v4l2videodec gstv4l2videodec.c:2305:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder2> Duration invalid, not setting latency
0:00:05.554036928 112539 0xfffe9800c580 WARN v4l2bufferpool gstv4l2bufferpool.c:1114:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:05.554261984 112539 0xfffec0018c60 WARN v4l2bufferpool gstv4l2bufferpool.c:1114:gst_v4l2_buffer_pool_start:<nvv4l2decoder2:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:05.555442496 112539 0xfffe7801af00 WARN v4l2bufferpool gstv4l2bufferpool.c:1114:gst_v4l2_buffer_pool_start:<nvv4l2decoder1:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:06.150765952 112539 0xffff40002460 WARN v4l2bufferpool gstv4l2bufferpool.c:1565:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder0:pool:src> Driver should never set v4l2_buffer.field to ANY
0:00:06.152541248 112539 0xfffe9403e4c0 WARN v4l2bufferpool gstv4l2bufferpool.c:1565:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder1:pool:src> Driver should never set v4l2_buffer.field to ANY
0:00:06.152824736 112539 0xfffe9403ef60 WARN v4l2bufferpool gstv4l2bufferpool.c:1565:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder2:pool:src> Driver should never set v4l2_buffer.field to ANY
/dvs/git/dirty/git-master_linux/nvutils/nvbufsurftransform/nvbufsurftransform.cpp:4339: => Surface type not supported for transformation NVBUF_MEM_CUDA_DEVICE
0:00:06.158850368 112539 0xfffe98013520 ERROR nvvideoconvert gstnvvideoconvert.c:4095:gst_nvvideoconvert_transform: buffer transform failed
/dvs/git/dirty/git-master_linux/nvutils/nvbufsurftransform/nvbufsurftransform.cpp:4339: => Surface type not supported for transformation NVBUF_MEM_CUDA_DEVICE
0:00:06.159372864 112539 0xfffec0018ea0 ERROR nvvideoconvert gstnvvideoconvert.c:4095:gst_nvvideoconvert_transform: buffer transform failed
/dvs/git/dirty/git-master_linux/nvutils/nvbufsurftransform/nvbufsurftransform.cpp:4339: => Surface type not supported for transformation NVBUF_MEM_CUDA_DEVICE
0:00:06.159439456 112539 0xfffe880126a0 ERROR nvvideoconvert gstnvvideoconvert.c:4095:gst_nvvideoconvert_transform: buffer transform failed
qReturned, stopping playback
Deleting pipeline
2024-04-29 14:00:05.404 INFO gxf/gxe/gxe.cpp@288: Deinitializing...
2024-04-29 14:00:05.404 INFO gxf/gxe/gxe.cpp@296: Destroying context
2024-04-29 14:00:05.405 INFO gxf/gxe/gxe.cpp@302: Context destroyed.
*******************************************************************
End T2.yaml
*******************************************************************
[INFO] Graph installation directory /tmp/ds.T2 and manifest /tmp/ds.T2/manifest.yaml retained
I’ve come across a similar post saying " This error means that the memory is applied by malloc , and the GPU cannot access it" (reference: Deepstream-test5 for usb camera fail - #8 by junshengy) but the solution doesn’t seem to apply in my case.
I strongly believe the issue lies with the “Multi Source Input with Dewarper” plugin because:
- Switching to the standard “Multi Source Input” plugin allows the pipeline to work on Jetson.
- The problem persists even when creating the rtsp stream using the following command:
cvlc --loop ./sample_720p.mp4 ":sout=#gather:rtp{sdp=rtsp://:8550/ds-test}" :network-caching=1500 :sout-all :sout-keep
Any insights or suggestions on how to resolve this issue would be greatly appreciated.