Is there a Blendshape test tool for USD Composer? (feature request if not)

You can use audio2face to generate blendshapes, and it will also generate a sample mesh of every blendshape, but I would like to be able to test the blendshapes by being able to adjust the weights.

For example, on Skeleton you can adjust bone rotations to move legs etc, but for blendshapes it looks like you can have the Skeletal Animation panel reference a SkelAnimation prim, but I could not see how to look at and adjust the blenshape weights for SkelAnimation prims. So I had to edit the USD file and look at the array of blendshapes by hand to work out which number to adjust. Rather tedious and error prone. Is there a better way?

Step 1: You can select the Skeleton prim and it will identify a SkelAnimaton prim that it previews.

Step 2: You can click on the referenced SkelAnimation prim. Looking at the raw properties, you can see there is blendshape data, but its not visible and you cannot edit it.

Step 3: You can edit the USD file and look for the SkelAnimation node. If you change the weights and save the file, then you can see the impact of the weight changes.


The left eye at 50%.

Has there been found the solution ? I imported meshes with several blendshapes to render still frames, and I would like to manually select them, or even better import the weights I have set in Blender.

Let me ask about blendshapes and get back to you. Where is this source material coming from ? What application ?

USDComposer doesn’t come with any blendshape tool unfortunately.
We have a few basic blendshapes tools available in A2F that you might find useful. For example, Toolbox > BUILT-IN > Mesh > BlendShape to Geometry which allows you to turn the selected blendshape prim into a mesh. There’s also a new proximity based Transfer added to the BUILT-IN>USDSkel menu in A2F 2023.2.0 released yesterday.

For your question about how to play with shape coefficcient, we don’t have a dedicated tool for it, but you can do this with OmniGraph. This is doable in Composer, but A2F comes with Float Array Tuner node that I think best for this task. This node is also upgraded to be more flexible on A2F 2023.2.0

In this video I showed the two option of either using Float Array Tuner node in A2F, or use the more native Make Array node which should be available by default in Composer.

3 Likes

This was very helpful, thank you. I hope that more direct way to do this will come with an upcoming release. It would really help to import the weights that are set in Blender before exporting.

Yes, that is very helpful. Sure, a little extension would be nice, but creating a little graph like that is almost as good (and available now).

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.