Qrio. An AI Bot that speaks and plays YouTubeKids video for my toddler

Hi guys!

Sharing my latest weekend project, Qrio.

An AI bot that can interact and speak to Dexie (our 21 months old toddler), recognises toys he carry and plays YouTubeKids video about the toy. Eg. Airplane, panda, etc.

This idea came from watching his high curiosity, always pointing at things asking us what they are πŸ˜€πŸ˜ŽπŸ€˜

Credit to coronavirus, I managed to complete this project earlier due to staying home for weeks because of a lockdown.

The tech uses a combination of plethora of techs such as an Object Detection (Tensorflow RT), NVIDIA Jetson Nano, Amazon Polly text to speech, Selenium automation framework (yes, you heard it right) and a game engine with Skeleton animation system.

Read the Towards Data Science article below for the full story. Github link is provided in the blog.

Watch the YouTube video demo here

Connect with me at https://www.linkedin.com/in/agustinus-nalwan

5 Likes

Very cool! Thanks for sharing.