Originally published at: https://developer.nvidia.com/blog/simplify-and-scale-ai-powered-metahuman-deployment-with-nvidia-ace-and-unreal-engine-5/
At Unreal Fest 2024, NVIDIA released new Unreal Engine 5 on-device plugins for NVIDIA ACE, making it easier to build and deploy AI-powered MetaHuman characters on Windows PCs. ACE is a suite of digital human technologies that provide speech, intelligence, and animation powered by generative AI. Developers can also now access a new Audio2Face-3D plugin…
Really nice. We use it with ue5 and open ai realtime api. so my question is: is it possible to plug in an audio stream to a2f?
another question or more a request was:
would it be possible to provide an event for when “animate character from wav file” or also from wave object was finished?
another topic: i build one for android and after launching the app it immediatly closes and i get this error:
LogProperty: Error: Struct type unknown for property 'StructProperty /Game/MetaHumans/Common/Face/Face_AnimBP.Face_AnimBP_C:AnimGraphNode_ApplyACEAnimation'; perhaps the USTRUCT() was renamed or deleted?
If I look in the anim bp the node is called ApplyACEFaceAnimation. Don’t know why it’s looking for ApplyACEAnimation.
Unreal Engine 5.4.4 and ACE for 5.4
hi, i noticed in the demo (https://youtu.be/KCp70qzmGgY?t=1398) that the eyes are blinking even in idle mode. since i’ve been using the kairos workflow since last year, this has become one of our main concerns.
here’s my recent test, but the blink animation doesn’t seem to be showing: https://youtu.be/eXhQ2IZMbkQ
could you please guide me on how to achieve these types of blinking animations? thank you in advance!