A2F doesn't work with A2F sample model Alison

AI & Data Science Digital Humans (closed) Audio2Face (closed)
1

I am following “Character Transfer Part 1: Overview in Omniverse Audio2Face”

there is something wrong with post wrap step.
following is the warning message from console
022-05-16 23:41:33 [492,952ms] [Info] [omni.kit.app.impl] [py stdout]: No closest points for 51 samples

2022-05-16 23:44:05 [645,454ms] [Info] [omni.kit.app.impl] [py stdout]: No closest points for 200 samples

2022-05-16 23:44:25 [664,731ms] [Info] [omni.graph.core.plugin] Compute node /World/allison_v001/allison_models_grp/m_head_mid_fitted was removed.

2022-05-16 23:44:40 [680,287ms] [Warning] [omni.anim.deltaBlend.plugin] DeltaBlend deformer evaluation skipped - invalid point count for compute node
2022-05-16 23:44:40 [680,287ms] [Warning] [omni.anim.deltaMush.plugin] inputs:points empty on mush!
2022-05-16 23:44:40 [680,287ms] [Warning] [omni.anim.deltaMush.plugin] inputs:points (0) and inputs:bindPoints (48005) have different sizes on mush!
2022-05-16 23:44:40 [680,287ms] [Warning] [omni.anim.deltaMush.plugin] inputs:faceVertexIndices empty on mush!
2022-05-16 23:44:40 [680,287ms] [Warning] [omni.anim.deltaMush.plugin] inputs:faceVertexCounts empty on mush!
2022-05-16 23:44:40 [680,288ms] [Warning] [omni.anim.deltaMush.plugin] Filling outputs:points on mush!
2022-05-16 23:44:40 [680,529ms] [Warning] [omni.anim.deltaMush.plugin] inputs:points empty on mush!
2022-05-16 23:44:40 [680,529ms] [Warning] [omni.anim.deltaMush.plugin] inputs:points (0) and inputs:bindPoints (48005) have different sizes on mush!
2022-05-16 23:44:40 [680,529ms] [Warning] [omni.anim.deltaMush.plugin] inputs:faceVertexIndices empty on mush!

2

here is the log file
kit_20220517_073320.log (5.2 MB)

3

Hi @tisu, which sample file did you when you start this? something’s wrong in the deformer chain, but not sure why until we know your steps. can you reproduce it?

4

I am using Allison_v001.usd from omniverse ://localhost/NVIDIA/Assets/Audio2Face/Samples/char_transfer
and following the tutorial for mesh fitting and post wrap.

5

HI @tisu ,
Can you record your steps in a video and share your final scene?
In particular, I want to see if the mesh fitting is producing a mesh that looks like Mark on Allison’s skin texture or not.

Thanks

6

thanks for the suggestion.
I figure out when I drag the USD file to viewport, the wrap deformale doesn’t work correctly.
If i open the USD file in orginal file, and it will work correctly.

7

Hi @tisu ,

Can you share your Omnigraph Settings screen shot, please? It’s under Omnigraph >> Settings menu
Also want to see if the problem goes away if you save and reopen the scene.

Thank you