Does Audio2Face has any SDK or Kit?

AI & Data Science Digital Humans (closed) Audio2Face (closed)
1

Does Audio2Face has any SDK or Kit? We can use it to built another app.

2

Hello @lizhigang19831024! Welcome to the Community! I have let the dev team know about your question. You should have a reply shortly!

3

Hi @lizhigang19831024 ,
Thank you for your interest in Audio2Face and welcome to the community.
Audio2Face is built of several components that are meant to be modular depends on the need of each app. We are exploring different scenarios on how to get Audio2Face into different usecases in Omniverse, and our development priority currently is to focus on Audio2Face integration throughout Omniverse apps.

4

OK, thank you so much.

5

Hi, any news? - Interest in what Omniverse apps can now use the functionality Audio2face?
Is there an extension for Audio2face that allows you to play animation on a character (animation is created in another editor)?

6

Hi @Polzovatel6038 ,
Currently there’s no other publicly available app that has Audio2Face included.
Internally we have a few apps being developed that uses Audio2Face. One of it is used for the Tokkio robot kiosk demo shown in the last GTC keynote GTC November 2021 Keynote with NVIDIA CEO Jensen Huang - YouTube
Similar one is used for the TJ character in the earlier section of the Keynote.

Audio2face supports playing USDSkel animation in the app but there’s not much control available. So, if you can export the animation our in USD format, then that usd should be playable in Audio2Face. But as a note, Audio2Face app is not really designed for such purpose.

7

Thank you very much for your detailed answer

1 Like
8

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.