Blendshape conversion error

AI & Data Science Digital Humans (closed) Audio2Face (closed)
1

Hello, I’m trying to do a blendshape conversion from the template “Mark” to my custom character, but it’s not working.

Under the Blendshape conversion pannel, I have “mark” as the imput anim mesh, and my character as the “blendshape Mesh”, after I clicked “set up blendshape solve” Nothing happened beside this error code.

2023-02-06 23:46:24 [Error] [omni.graph.core.plugin] /World/audio2face/BlendshapeSolve: Assertion raised in compute - operands could not be broadcast together with shapes (184560,1) (11382,1)
2023-02-06 23:46:24 [Error] [omni.graph.core.plugin] File “c:\users\iamlo\appdata\local\ov\pkg\audio2face-2022.2.0\exts\omni.audio2face.exporter\omni\audio2face\exporter\ogn\python\nodes\OgnBsSolveNode.py”, line 174, in compute
2023-02-06 23:46:24 [Error] [omni.graph.core.plugin] out_weight = db.internal_state.solver.computeFacsWeights(points.reshape(-1, 1))
2023-02-06 23:46:24 [Error] [omni.graph.core.plugin] File “c:\users\iamlo\appdata\local\ov\pkg\audio2face-2022.2.0\exts\omni.audio2face.exporter\omni\audio2face\exporter\scripts\facsSolver.py”, line 162, in computeFacsWeights
2023-02-06 23:46:24 [Error] [omni.graph.core.plugin] target_delta_mat = point_mat - self.neutral_mat
2023-02-06 23:46:24 [Error] [omni.graph.core.plugin]

I followed this tutorial BlendShape Generation in Omniverse Audio2Face - YouTube

Screenshot_20230206_234706
Screenshot_20230206_2347062555×1440 429 KB

2

Hi there, could you please send your file so we can investigate?

3

Audio2face.usd (17.4 MB)

Here is the file, thanks for your reply.

4

Thanks for sharing the file. But it seems that your model is being referenced from this path “file:/C:/Users/iamlo/Desktop/export.usdc” which we don’t have access to.

To save your scene fully, you can use “File → Save Flattened As…”.

5

I did "Save flattened as"for this file.

halo.usd (17.6 MB)

6

Hi there,

I was able to generate blendShapes and create a blendShape solve using your last scene.

Have you generated BlendShapes before creating a solve using Character Transfer -> BlendShape Generation -> Export? This should export 2 files, you’d need to import back the Skel version, then you can create blendShape keyframes/weights using BlendShape Conversion.

7

ah, yes!!! it’s working, I was missing this step. Thank you so much!

1 Like
8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.