Attach_tensor_output_meta not synchronization before OSD plugin

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (GPU)
• DeepStream Version: 5.1
• TensorRT Version : 7.2
• NVIDIA GPU Driver Version 460.56
• Issue Type( questions)
• How to reproduce the issue? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

Hello, I setup pose estimation as the secondary engine after the primary engine detection. The application I use is deepstream-app.

Pose estimation I add configure inference on person object and enable output-tensor-meta. However, the probe I add before OSD (function process_meta in deepstream_app.c does not have the user meta-type NVDSINFER_TENSOR_OUTPUT_META . Although I debug and see the attach_tensor_output_meta incase not process_full_frame attach give the output that means it has done attach the tensor to object successfully.
Seem like wait_queue_buf_probe in the secondary bin do not wait for the right thing until all secondary done processing here. which was described

Wait for all secondary inferences to complete the processing and then send the processed buffer to downstream. This is way of synchronization between all secondary infers and sending buffer once meta data from all secondary infer components got attached. This is needed because all secondary infers process same buffer in parallel.

Please check it out. Thank you

3

Hey, could you share your sgie config file with us?

4

Yes

[secondary-gie0]
enable=1
gpu-id=0
gie-unique-id=2
operate-on-gie-id=1
operate-on-class-ids=0;
nvbuf-memory-type=0
config-file=engine_configs/config_infer_pose_estimation.txt

Engine config

[property]
gpu-id=0
net-scale-factor=0.0174292
offsets=123.675;116.28;103.53
onnx-file=pose_estimation.onnx
model-engine-file=pose_estimation.onnx_b4_gpu0_fp32.engine
#labelfile-path=labels.txt
batch-size=4
#1 full frame | 2 objects
process-mode=2
model-color-format=0
## 0=FP32, 1=INT8, 2=FP16 mode
network-mode=0
interval=0
gie-unique-id=1
#NvDsInferNetworkType_Other
network-type=100
workspace-size=3000
output-tensor-meta=1
5

Thanks, so you didn’t set the ‘classifier-async-mode’, right?

6

yes.

following the condition nvinfer->output_tensor_meta && !nvinfer->classifier_async_mode

the function attach_tensor_output_meta() was call and did attach tensor to object

7

Yeah, I got, may I know currently where did you install the probe ?

8

Exactly the gie_processing_done_buf_prob. the sink of osd bin

9

Ok, seems a bug in DS SDK, currently, I think you can try to add the probe just on the src pad of the sgie and I guess it will work, it’s just a workaround.
For debugging the issue, would you mind to create a simple demo for us, so we can easily repro and root cause it.

1 Like
10

Okay, I will tried your suggest first. The simple demo will provide later. But you could start investigate the bug as the pipeline was described.

11

Sure, thanks. I prefer to use your demo since it will let us on the same alignment.

1 Like
12

Hi @bcao , I did try to add the probe just on the src pad of the sgie. This way shows the user meta data type NVDSINFER_TENSOR_OUTPUT_META was got in the probe was added. But the osd bin still doesn’t actually get the display was added in that probe. I could see the pose display one second and then disappear just a moment. So this is probably the processing of the secondary gie bin does not synchronize with osd incase using tee seperate branch in deepstream-app example.

13

Hey, I think it should be 2 problems here, one certain issue is that NVDSINFER_TENSOR_OUTPUT_META meta data is missing if the probe not on the src pad of nvinfer. We will use this topic to track this issue.

For 2nd one, I would like you to create a new topic to discuss the OSD related issue, but I need to confirm if it’s really a issue.

14

Okay, maybe you right when said that NVDSINFER_TENSOR_OUTPUT_META meta data is missing if the probe not on the src pad of nvinfer. Hope good news about this.

15

Hey customer, not sure if you just think adding the probe on src pad of nvinfer can be a WAR or you think we need to root cause the issue. If you choose the latter one, it’s better if you can share me a simple demo to repro the issue.

16

Hi, I confirm my point is that the issues NVDSINFER_TENSOR_OUTPUT_META metadata is missing if the probe not on the src pad of nvinfer is right.

and the OSD no issues anymore.

17

Hey customer, do we still need to support this topic, would you mind to share a simple sample with us to repro the issue if yes.

1 Like
18

thank you @bcao. I do not need to support this topic anymore. We could close this topic

19

Got, Thanks .