Generating Expressive 3D Facial Animations From Audio

Originally published at: Generating Expressive 3D Facial Animations From Audio | NVIDIA Technical Blog

Researchers from NVIDIA and the independent game developer Remedy Entertainment developed an automated real-time deep learning technique to create 3D facial animations from audio with low latency. Using a TITAN Xp GPU and the cuDNN-accelerated Theano deep learning framework, the researchers trained their neural network on nearly ten minutes of high-quality audio and expression data…