Adjusting mouth shape to better match phonemes (Blendshape solve options?)

Hi @andrew199 thanks for your interest in Audio2Face.

Making good M, P, B shapes are sometimes difficult depending on the emotion states. We’re working towards providing a better deep learning network in future releases.
In the meantime, the general tips would be like this

  • As in the video, use some symmetry constraints if the lip shape is not symmetric.
  • If lip is not closing properly, try using lipOpenOffset in the post-process to close the lips. (attached image)
  • Neutral emotion tends to give good MBP poses, so use strong neutral emotion and a bit of other emotions.

image