Audio2Gesture Livelink with Unreal Engine 5 Character

Omniverse Connections & Data Exchange Omniverse Connectors
1

Hi,

Is there a way to obtain audio2gesture output just like with Audio2Face headless server? I am trying to livestream audio2gesture with UE5 character. OmniLive seems to only works with adjusting the assets rather than syncing character animation.

Thanks

3 Likes
2

Hi, same question, let’s search for the answer together. I can share how I built graphs on A2F, but I don’t know how to connect this blog to streaming. Maybe you can guess, but from the looks of it this is the only option. Although I’m thinking of making an OSC server plugin and streaming the movements through it.

Check: I can't connect Audio2Gesture to stream Livelink in generic graph

3

We’ve Moved NVIDIA A2F Support! We have new places to better help you get the support you need.

  1. Developers can submit tickets through the NVIDIA AI Enterprise program NVIDIA Enterprise Customer Support
  2. Developers can discuss ACE through our NVIDIA Developer Discord Server NVIDIA Developer
4

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.