Generating Character Animations from Speech with AI

Originally published at: Generating Character Animations from Speech with AI | NVIDIA Technical Blog

Researchers from the Max Planck Institute for Intelligent Systems, a member of NVIDIA’s NVAIL program, developed an end-to-end deep learning algorithm that can take any speech signal as input – and realistically animate it in a wide range of adult faces.  “There is an extensive literature on estimating 3D face shape, facial expressions, and facial…