UCX Graph Installation Error

Accelerated Computing Intelligent Video Analytics DeepStream SDK
, , ,
1

•Hardware Platform (Jetson / GPU): Nvidia RTX A5500
•DeepStream Image: 7.1-gc-triton-devel
•NVIDIA GPU Driver Version (valid for GPU only): 580.95.05
•Issue Type( questions, new requirements, bugs): bugs

I have tried to communicate two pipelines via UCX. My main motivation is to run server pipeline on the Graph Composer and client on the terminal.

For the first pipeline server of deepstream-ucx-test2 is deployed.

image
image1562×274 35.5 KB

and following parameters provided for the nvdsucxserversrc element.

port: 13337
addr: 127.0.0.1

Second pipeline is created via terminal by using following command.

gst-launch-1.0 videotestsrc ! "video/x-raw,width=1920,height=1080,framerate=30/1" ! nvvideoconvert ! "video/x-raw(memory:NVMM),format=NV12" ! nvdsucxclientsink addr=127.0.0.1 port=13337

But following error is popping up in the GXF Server terminal.

(gxe:540): GStreamer-CRITICAL **: 12:03:24.768: gst_buffer_pool_set_active: assertion 'GST_IS_BUFFER_POOL (pool)' failed

(gxe:540): GStreamer-CRITICAL **: 12:03:24.768: gst_object_unref: assertion 'object != NULL' failed

(gxe:540): GStreamer-WARNING **: 12:03:24.977: ../gst/gstpad.c:5337:store_sticky_event:<ucx_server_source/ucx_server_source:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<gstreamer_caps_filter/gstreamer_caps_filter:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<meta_deserialize/meta_deserialize:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<video_convert/video_convert:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<sink:proxypad1> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_queue:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<onscreen_display/onscreen_display:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<video_convert/video_convert:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<meta_deserialize/meta_deserialize:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:24.978: ../gst/gstpad.c:5337:store_sticky_event:<gstreamer_caps_filter/gstreamer_caps_filter:sink> Sticky event misordering, got 'caps' before 'stream-start'
Running...
****** NvDsScheduler Runtime Keyboard controls:
p: Pause pipeline
r: Resume pipeline
q: Quit pipeline
2025-11-04 12:03:25.068 INFO  extensions/nvdsbase/nvds_scheduler.cpp@396: NvDsScheduler Pipeline ready

2025-11-04 12:03:25.069 INFO  extensions/nvdsbase/nvds_scheduler.cpp@381: NvDsScheduler Pipeline running


(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_queue:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_nvvidconv:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_conv_queue:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_nvvidconv:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_conv_queue:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_nvosd:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<onscreen_display/onscreen_display:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<sink:proxypad2> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-queue:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<src:proxypad0> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-queue:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<nvosd_bin_nvosd:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-transform:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-capfiler:src> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-sink:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-capfiler:sink> Sticky event misordering, got 'caps' before 'stream-start'

(gxe:540): GStreamer-WARNING **: 12:03:25.069: ../gst/gstpad.c:5337:store_sticky_event:<video_renderer/video_renderer-transform:sink> Sticky event misordering, got 'caps' before 'stream-start'
[openzeka:540  :0:551] Caught signal 11 (Segmentation fault: address not mapped to object at address 0x60)
==== backtrace (tid:    551) ====
 0 0x0000000000042520 __sigaction()  ???:0
 1 0x000000000000b94e gst_ds_nvosd_bin_get_type()  ???:0
 2 0x000000000008d4a6 gst_pad_template_pad_created()  ???:0
 3 0x0000000000049bc6 g_hook_list_marshal()  /opt/tritonserver/librdkafka/hiredis/mosquitto-2.0.15/glib/build/../glib/ghook.c:674
 4 0x000000000008da55 gst_pad_template_pad_created()  ???:0
 5 0x000000000008f959 gst_pad_query()  ???:0
 6 0x0000000000092d69 gst_pad_get_allowed_caps()  ???:0
 7 0x000000000009318e gst_pad_push()  ???:0
 8 0x0000000000046875 gst_plugin_coreelements_register()  ???:0
 9 0x00000000000ba127 gst_tag_get_nick()  ???:0
10 0x000000000008a384 g_thread_pool_thread_proxy()  /opt/tritonserver/librdkafka/hiredis/mosquitto-2.0.15/glib/build/../glib/gthreadpool.c:350
11 0x0000000000089ac1 g_thread_proxy()  /opt/tritonserver/librdkafka/hiredis/mosquitto-2.0.15/glib/build/../glib/gthread.c:831
12 0x0000000000094ac3 pthread_condattr_setpshared()  ???:0
13 0x0000000000126850 __xmknodat()  ???:0
=================================
====================================================================================================
|                            GXF terminated unexpectedly                                           |
====================================================================================================
#01 gxe(+0x92fa) [0x5d26bcc8d2fa]
#02 gxe(+0x244da) [0x5d26bcca84da]
#03 gxe(+0x247bc) [0x5d26bcca87bc]
#04 /usr/lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x765a91398520]
#05 /usr/lib/x86_64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_deepstream_bins.so(+0xb94e) [0x765a8742f94e]
#06 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0(+0x8d4a6) [0x765a901ce4a6]
#07 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0(g_hook_list_marshal+0x66) [0x765a90042bc6]
#08 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0(+0x8da55) [0x765a901cea55]
#09 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0(+0x8f959) [0x765a901d0959]
#10 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0(+0x92d69) [0x765a901d3d69]
#11 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0(gst_pad_push+0xde) [0x765a901d418e]
#12 /usr/lib/x86_64-linux-gnu/gstreamer-1.0/libgstcoreelements.so(+0x46875) [0x765a6eeaa875]
#13 /usr/lib/x86_64-linux-gnu/libgstreamer-1.0.so.0(+0xba127) [0x765a901fb127]
#14 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0(+0x8a384) [0x765a90083384]
#15 /usr/lib/x86_64-linux-gnu/libglib-2.0.so.0(+0x89ac1) [0x765a90082ac1]
#16 /usr/lib/x86_64-linux-gnu/libc.so.6(+0x94ac3) [0x765a913eaac3]
#17 /usr/lib/x86_64-linux-gnu/libc.so.6(+0x126850) [0x765a9147c850]
====================================================================================================
Minidump written to: /tmp/271c2d81-9ee7-4b71-18d300a2-84f639ec.dmp

I am able to obtain nvdsucxclientsink and nvdsucxserversrc elements via gst-inspect-1.0 command.

3

DS UCX plugins are based on the GPUDirect RDMA, have you prepared your platform with Gst-NvDsUcx — DeepStream documentation? How many GPUs do you have?

4

As far as I have researched, issue is related to deserialization component. Because designed pipeline in the Graph Composer GUI does not receive frames with the NvDsBatchMeta data structure. Although raw frames are provided to the Composer pipeline, the deserialization component accepts the NvDsBatchMeta format.

@Fiona.Chen Can you say NvDsMetaDeserialize component is related to which deepstream plugin or extension in the Deepstream 8.0 Documentation.

image
image736×362 17.7 KB

5

Please refer to Gst-nvdsmetautils — DeepStream documentation. It is nvdsmetaextract who works inside NvDsMetaDeserialize.

6

Can the sample /opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-ucx-test work in your environment?

7

Yes, it is working properly. As I said before problem is caused by Meta Deserializer component which only accept NvDsBatchMeta data structure but raw video is provided. Pipeline has worked properly after removing the component.
Thanks for your support @Fiona.Chen