Running segmenter as secondary to a primary detector

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) GPU
• DeepStream Version 6.3
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

Hi,

To overcome accuracy issues I’m trying to run a segmenter (peopleSegNet) on the output of a detector (resnet10.caffemodel), I used a detector and segmenter from the python-apps deepstream-segmask and deepstream-test2.
In my pgie I defined process-mode=1 and gie-unique-id = 1 while in the segmenter I set process-mode= 2 and gie-unique-id = 2, also in the segmenter I set operate-on-gie-id=1, it doesn’t work, all I see is bounding boxes around cars and an occasional error message:

[nvds_mask_utils_resize_to_binary_argb32:109]failure: status=-23
libnvosd (63):(ERROR) : ERROR: [nvll_osd_resize_segment_masks_bg]

Attached the code and config files.

thanks

dstest_segmask_config.txt (2.3 KB)

dstest2_pgie_config.txt (3.0 KB)

deepstream_segmask.py.txt (16.6 KB)

2

to get bboxes around people too I set the num-detected-classes to 4 in the detector’s config

4

The PGIE is our sample model, the person class id is 2.

The SGIE should work on person class only.

Please set “network-type=3” and “operate-on-class-ids=2” in the SGIE’s configuration file.
You must set “display-mask” property of nvdsosd as TRUE to display the instance masks.

5

I set the parameters as you specified, it didn’t solve the issue

6

The same problem with deepstream 7.0:

deepstream_segmask.py.txt (16.2 KB)
dstest_segmask_config.txt (2.3 KB)
dstest2_pgie_config.txt (3.1 KB)

7

@md44 :

The instance segmentation model can’t be used as SGIE, it can output segmentation masks for objects with classes. The instance segmentation model should be used as PGIE.

8

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.