Problem with two parallel branches

[SimonBirrell]

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) Jetson AGX Orin
• DeepStream Version 6.4 (using Python bindings)
• JetPack Version (valid for Jetson only) 6.0-b52
• TensorRT Version 8.6.2
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs) Bug/question

Hi,

I’m trying to set up a structure where:

• an initial part of the pipeline handles Mask-RCNN inference, segmentation annotation and tracking
• two separate, parallel branches then annotate two video streams with different information A and B

Initially I found that A and B are added to both streams and switch at random. Having read the following issue it appears that both threads are both accessing the same NV memory:

Draw different graphics with nvdsosd on two parallel streams

Hello, thanks for the reply. I use the Jetson only with one monitor, the windows of the two glessink positioned next to each other. Let’s say on one branch I set the first RectParams of the display buffer to a black rectangle covering the whole video. On the other stream I “draw” a red rectangle. So I expect to see nothing but a black video continuously on the first stream and a red screen on the second one. In this case I can clearly see that sometimes the red video stream flashes also on the …

This situation is shown on the left of my diagram.

Following the recommendation in the above issue, I’ve tried moving the nvvideoconvert stage to the parallel branches. With this, the pipeline fails to start.
This situation is shown on the right of my diagram.

The full error message in this case is:

Error: gst-stream-error-quark: Internal data stream error. (1): ../libs/gst/base/gstbasesrc.c(3127): gst_base_src_loop (): /GstPipeline:webcam-display/GstV4l2Src:v4l2src:
streaming stopped, reason not-negotiated (-4)
nvstreammux: Successfully handled EOS for source_id=0

I basically want

• inference to happen ONCE, so before the split into two branches
• have separate annotations on both branches

How can I fix this?

Thanks!

Simon

[yuweiw]

Could you try to set disable-passthrough=1 to the nvvideoconvert after tee for your second pipeline?

[SimonBirrell]

I’m not sure if you meant for both branches in Pipeline 2 or just for the second branch. In any case, the error (streaming stopped, reason not-negotiated (-4)) is the same in both cases.

[yuweiw]

@SimonBirrell

I’m not sure if you meant for both branches in Pipeline 2 or just for the second branch.

both branches in Pipeline 2.

Could you attach the log with GST_DEBUG=3 in the front of your command?

[yingliu]

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks