KeyPoint

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

At present, I need to be able to connect to the human key point model of deepstreeam5.0, but I am not familiar with it. Are there any recommended open models that have been connected?

• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)

3

@RayZhang

I am so sorry that we currently do not have similar samples as human face landmarks.
And further more, we do not have direct support of post-processing of landmark data types.

However, NvDsInfer is now opensource. You can find source code of NvDsInfer in .../sources/gst-plugins/gst-nvinfer (high level) and ../sources/libs/nvdsinfer (low level).

So, you can develop your own NvDsInfer by:

  1. customizing NvDsBatchMeta or any sub types inside NvDsBatchMeta like NvDsFrameMeta or NvDsObjectMeta
  2. creating a new landmark type (You can have a look at NvDsInferObjectDetectionInfo or NvDsInferAttribute as reference) to implement parsing for landmark tensor outputs.

Documents as references:

NvDsInfer Plugin introduction

https://docs.nvidia.com/metropolis/deepstream/plugin-manual/index.html#page/DeepStream%20Plugins%20Development%20Guide/deepstream_plugin_details.html#wwpID0E0YFB0HA

NvDsInfer API (NvDsObjectMeta)

https://docs.nvidia.com/metropolis/deepstream/4.0/dev-guide/DeepStream_Development_Guide/baggage/struct__NvDsObjectMeta.html