How to run human_pose_estimation by deepstream-app?

1210586191 · May 25, 2021, 2:33am

• Hardware Platform (Jetson / GPU) NX
• DeepStream Version 5.0.1
**• JetPack Version (valid for Jetson only)**4.4
• TensorRT Version7.1.3.1

Hello，I want to use the deepstream-app method to run human-post-estimation.

GitHub - NVIDIA-AI-IOT/deepstream_pose_estimation: This is a sample DeepStream application to demonstrate a human pose estimation pipeline.

This is my configuration file.
ds_config.txt (3.6 KB)
deepstream_pose_estimation_config.txt (2.0 KB)

How should I add the parsing function to the deepstream_pose_estimation_config.txt file, and what else needs to be modified to make it work?

AastaLLL · May 25, 2021, 6:00am

Hi,

You can find the parser in deepstream_pose_estimation_app.cpp directly:

github.com

NVIDIA-AI-IOT/deepstream_pose_estimation/blob/master/deepstream_pose_estimation_app.cpp#L45


      
          using Vec1D = std::vector<T>;
          
          
template <class T>
          using Vec2D = std::vector<Vec1D<T>>;
          
          
template <class T>
          using Vec3D = std::vector<Vec2D<T>>;
          
          
gint frame_number = 0;
          
          
/*Method to parse information returned from the model*/
          std::tuple<Vec2D<int>, Vec3D<float>>
          parse_objects_from_tensor_meta(NvDsInferTensorMeta *tensor_meta)
          {
            Vec1D<int> counts;
            Vec3D<int> peaks;
          
          
  float threshold = 0.1;
            int window_size = 5;
            int max_num_parts = 20;
            int num_integral_samples = 7;

Thanks.

1210586191 · May 25, 2021, 10:03am

I want to use this method deepstream-app -c ds_config.txt .
Do I need to modify the original parsing function to generate a .so file? Do other modules, such as osd, metadata, etc., also need to be modified? Can you give me some detailed suggestions?

Thanks evry much !

AastaLLL · May 27, 2021, 6:27am

Hi,

The parser doesn’t include into the deepstream-app by default.
You can wrapping it into a library like libnvdsinfer_custom_impl_ssd.so in objectDetector_SSD example.

Thanks.

1210586191 · May 28, 2021, 3:43am

Thanks for your reply. I’ll try it.