AI Learns to Lip-Sync From Audio Clips

Originally published at: https://developer.nvidia.com/blog/ai-learns-to-lip-sync-from-audio-clips/

University of Washington researchers developed a deep learning-based system that converts audio files into realistic mouth shapes, which are then grafted onto and blended with the head of that person from another existing video. “These type of results have never been shown before,” said Ira Kemelmacher-Shlizerman, an assistant professor at the UW’s Paul G. Allen…