Question about DeepStream + Track Anything

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

hello
I read about the technology blog that came out yesterday.

I am interested in sam + track. Is it possible to run it after segmentation pgie in DeepStream?

3

Thanks for your suggestion. I will check internally and feedback.

1 Like
4

It would be good to have tracking during the pgie interval, and it would also be good to have feedback (correction) as suggested in the paper.

5

It is in our roadmap. Can you share more on why it is important to your project?

6

Iā€™m working on camera-based semantic segmentation using deepstream-pipeline.
I found tracking with kalman+dcf at pgie-interval in nvdcf very interesting and powerful in object detection.

So in semantic segmentation, assuming that masking of a certain terrain(like bridge) is inferred, it would be really good to track that mask with a track-anything model during the pgie-interval. Then I think it will work more efficiently on the pipeline side.

Assume apply interval

image -> pgie (like deeplabv3) -> track-anything -> sink (frame 0)
image -> track-anything -> sink (frame 1)
image -> track-anything -> sink (frame 2)
image -> pgie (like deeplabv3) -> track-anything (FeedBack loop) -> sink (frame 3)
7

Thanks for your sharing.

1 Like
8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.