Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU) GPU 3060 Ti
• DeepStream Version 6.2
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)
I extended the sample deepstream application for pose estimation (GitHub - NVIDIA-AI-IOT/deepstream_pose_estimation: This is a sample DeepStream application to demonstrate a human pose estimation pipeline.) to work for multiple streams of input and added nvtracker plugin after nvinfer element (pgie) by creating objects for each poses and attaching bounding box information (from estimated pose) to corresponding object and finally attaching these objects to corresponding frame. Then I attach the pose information as user metadata on corresponding object to use it after tracking element. Now, I can get tracker id and pose information after nvtracker.
Now I want to implement an action classifier in deepstream as sgie, which takes an input sequence of these poses with same tracker id and outputs the action class. The input is of size 48x34, where 34 represents (x,y) coordinate of 17 skeleton joints concatenated along the length to become 34 (17x2). 48 is sequence size, 48 poses of certain track id.
How can I do this task? Is it achievable? It would be great if has sample example related/similar to this task. I tried to understand preprocess sample example and deepstream-3d-action-recognition example to do this task. But still couldn’t understand it yet. I need to implement this for my masters thesis, and deadline is near. I would really appreciate if you give at least some ideas.
Thank you.