My Jetson Nano powered robotic project - Mariola

Hi!

I like to share with you a Jetson Nano 3GB powered robotic project I’m working on.
The code name is Mariola and it’s all about the human - robots interactions.


Im using the pose detection ML model from the Jetson playground to detect person pose - and then let Mariola (the robot) mimic this pose.

The mechanics of the robot itself is based on the Arduino Nano as a controllers and some step motors, servos, NeoPixels leds and other stuff.

The basic of the way it work is:
Jestson runs the customized in python script with the resnet18-body giving back the planar coordinates of the detected joints.
Those are recalculated via some IK model to get the servos positions
Results are sent to the Ardiono Master via UART - and the rest is done by the Arduinos.

[edit - added video]
The robot demo video:
https://youtu.be/3NuYDphypm0

The project description video:
https://youtu.be/n5zZ9u3IKxk

The project GitHub page for the jetson “brain”:
https://github.com/tymancjo/jetson_trials

For the moment the project is in active development and is constantly modified.
Hope you find it interesting!

Best
Tom

5 Likes

sir,
Actually I want to operate my servos using Arduino via python through serial connction from Jetson nano. the reason is that when my Jetson inference program detects an object using detectnet this information must pass to arduino uno so that servos start to operates and pick the object.
we are stuck without the python code in jetson program and corresponding needed code for arduino.
Can anyone please help me… Please since it is crucial