I want to export 52 arkit blendshapes(not mark 46 blendshapes) weights as json file.
what should I do?
Hello @user119975! Welcome to the community! I informed the dev team of your question. I will post here when I hear back!
Hi @user119975 ,
Our blendshape solve is based on the number of blendshapes available on the target.
In your case, if you need 52 arkit blendshape animated weights on the json, if you have a mesh with those blendshapes that matches the topology of your target head, then the json would contain those 52 animated values.
Steps:
- first do Character Transfer from Mark to your target head.
- next, set the Input Anim Mesh on the BLENDSHAPE CONVERTION panel to the result of the character transfer, and set the Blendshape Mesh to your mesh with those 52 shapes,
- then run the Setup Blendshape Solve.
Hope it helps.
-Edy
Hello!
So if we wanted a 52 arkit outcome in terms of exporting blendshapes. ?
We would do a Character Transfer - not from Mark - but from an Arkit compatible USD?
And then do a Blendshape Generation from the result?
Pete
Hi, we need to make clear distinction between blendshape solve and the blendshape generation.
If you want to get 52 arkit shapes on your custom mesh using blendshape generation, that’s not supported at the moment - you can only generate 46 blendshapes from our template.
If you want 52 blendshape weights of an a2f animation using blendshape solve, you can do it by following the instruction of Edy above.
Does it help your question?
Thanks so much for the quick reply. However the problem I have is a bit of a loop :-) Though you may have a suggestion.
The reason I need Audio2face is so that I can apply the correct blendshapes to the UnrealLiveLink Face App streaming into Houdini. And so my custom mesh of a modelled head which has no Blendshapes, is hoping to inheret the Arkit ones in A2F. The only online example I found was this nasty thing which seems to fail in A2F for a variety of reasons. Dropbox - FaceCap_from_IPhoneX_POLYWINK.fbx - Simplify your life
Do you know of an intermediate Arkit USD I could use to at least get the data passed through Mark?
Kind regards,
Pete
I’m a bit confused, so what you need is
- 52 blendshape poses on your custom mesh that will be driven by live link face app?
or - blendshape weights? you want to get the blendshape weights from Audio2Face? or from the LiveLink face app?
The Arkit poses (and so applied / solved blendshapes) from A2F.
Inputs: - Head A with no existing blendshapes
- Mark + MarkMouthOpen
- An Arkit Head B (which has been solved (mesh fitted?) to have the same overall shape as Mark?
Output: Head A with Arkit blenshapes applied (and no weight animation needed),
Hi again, yeah that is not supported with current A2F.
Like I mentioned, you can only transfer 46 shapes on your custom face from the Mark template.
Transferring 3rd-party blendshape poses on your custom face is not supported.
No worries - I’ll try to do a conversion in Houdini from the 52 animated weights into the 42 scheme.
I imagine you’ll get some real interest when you do apply the [ARKit Mark] template options though. Pretty popular!
You’ll be pulling alot of people away from FaceWare Studio and Polywink
Thank you for the suggestion! We will discuss this internally.
Hello Audio2Face team!
In a2f 2022.2 release notes I found “Adds BlendShape Generation Support for ARKit Blendshapes”, could you help to configure it? I can see BlendShapes generation tab in UI, but it is inactive.
To generate ARKit blendShapes, you need to setup your character transfer first, then from Character Transfer tab, in BlendShape Generation section, choose Male 52 ARKit Poses and click Export.
This will export 2 files, one with blendShape target and the other with USDSkel. You can use any of these based on your preference.
Exporting BlendShape weights is explained above and in video tutorials.
Thank you! Also found videos about new version of a2f on Audio2Face with Blender | Part 2: Loading AI-Generated Lip Sync Clips - YouTube.
1 Like
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.