# Recognising hand gestures to control a robot dog

**URL:** <https://forums.developer.nvidia.com/t/recognising-hand-gestures-to-control-a-robot-dog/160953>\
**Category:** Jetson Projects\
**Created:** [December 2, 2020, 3:46pm UTC](https://forums.developer.nvidia.com/t/recognising-hand-gestures-to-control-a-robot-dog/160953 "2020-12-02T15:46:03Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![xrobots](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/xrobots/32/30672_2.png) [@xrobots](https://forums.developer.nvidia.com/u/xrobots)\
**Post date:** [December 2, 2020, 3:46pm UTC](https://forums.developer.nvidia.com/t/recognising-hand-gestures-to-control-a-robot-dog/160953/1 "2020-12-02T15:46:03Z")

</div>

I used transfer learning to retrain ssd-mobilenet to recognise my hand gestures so I could drive a large robot dog without the controller. This works pretty well if the confidence rating is set high enough, and there is also some filtering on the output to smooth out the dog’s movement. I’m just using 5 GPIO pins on a Jetson Nano to control the existing dog hardware. This whole project is open source: [GitHub - XRobots/openDogV2](https://github.com/XRobots/openDogV2)

YT playlist for the whole build: [openDog V2 - YouTube](https://www.youtube.com/playlist?list=PLpwJoq86vov9CcmrLGyM2XyyYDAYG0-Iu)

[![](https://global.discourse-cdn.com/nvidia/original/3X/e/3/e3972cd86573aa03974b8019a0b9e8e21da4c7a8.jpeg "openDog V2 #8 Hand Gesture Recognition") ](https://www.youtube.com/watch?v=HXEAfCGzw20)
