Hand Posenet From NVIDIA-AI-IOT / trt_pose_hand Demo

Is there a way to get the a trainable Tao model of the hand pose model (
hand_pose_resnet18_att_244_244.pth) used in GitHub - NVIDIA-AI-IOT/trt_pose_hand: Real-time hand pose estimation and gesture classification using TensorRT ?
I would like to do some transfer learning.

Actually it is similar to gesturenet in TAO. Please download notebook from
https://docs.nvidia.com/tao/tao-toolkit/text/tao_toolkit_quick_start_guide.html#download-jupyter-notebook
or GPU-optimized AI, Machine Learning, & HPC Software | NVIDIA NGC

The pretrained model is mentioned in Gesture Recognition — TAO Toolkit 3.21.11 documentation
NVIDIA NGC
https://catalog.ngc.nvidia.com/orgs/nvidia/teams/tao/models/gesturenet/files?version=trainable_v1.0

Then run gesture training in TAO.

1 Like

gesturenet seems to be a classification model. Is it possible to just get the 2d hand pose model?

Sorry, currently TAO does not have a hand pose model. It has body pose model instead. Body Pose Estimation — TAO Toolkit 3.21.11 documentation
I will sync with internal team for it.

1 Like

If I use the body pose model, is there any way to get the exact data and parameters that were used when training hand_pose_resnet18_att_244_244.pth internally?

The hand_pose_resnet18_att_244_244.pth is not compatible with TAO.
For TAO bodypose model, please refer to its trainable model BodyPoseNet | NVIDIA NGC
End users can use it to train.
Or use the deployable model directly to run inference.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.