Deepstream Custom App: Region of interest tracking

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) GPU
• DeepStream Version 6.0.1
• JetPack Version (valid for Jetson only)
• TensorRT Version 8.2.5.1
• NVIDIA GPU Driver Version (valid for GPU only) V100
• Issue Type( questions, new requirements, bugs) I’ve built a OpenCV project where I am drawing bounding box around the person and track him in subsequent frames and when person moves to other RTSP feed system tracks him automatically. I am currently using Yolo v5 and opencv CSRT tracker, I wish to migrate the project to deepstream. May I know how to do that and does it have necessary plugins for this task?

3

Deepstream has the tracker. You can refer the samples: C/C++ Sample Apps Source Details — DeepStream 6.1.1 Release documentation

If you want to integrate you own tracker into Deepstream. You can refer: Gst-nvtracker — DeepStream 6.1.1 Release documentation

4

Thank you for your response,

Yes, I’ve read about NvDCF tracker, but I am not interested in multi object tracking.

What I want is to draw a bounding box around the person and then initialize the tracker on it. I’ve done it in open_cv, but I am not entirely sure how can I achieve this in Deepstream.

5

Any updated?

6

Seems you need multi-camera tracker. DS does not support it. But you can check here: Metropolis Microservices | NVIDIA Developer

Do you want to manually specify the bbox or a detector to detect the person to track? If you use PGIE to detect the person, you can get the ID of the person and track the person. nvtracker will track all person, you can select the person who you want to track.

7

Do you want to manually specify the bbox or a detector to detect the person to track? If you use PGIE to detect the person, you can get the ID of the person and track the person. nvtracker will track all person, you can select the person who you want to track.

Yes I want to manually specify the bbox and then track the person. I.e draw bounding box around the person and track him in subsequent frames.

8

Then DS don’t have the feature. But seems it is application level functions. DS will report all tracked person. You can develop your application to analysis the output of DS.

9

Thanks for your quick response, I will git it a try if you’re saying this.
I’ve looked at the sample apps and did not find any example in which we can select a particular stream and draw a bounding box around the person/object.

Could you suggest which plugin can do this job or what should i explore for this?
Is there anyway I can pause a particular stream and then draw bounding box around the object?