Is There Real-Time Animation Support in USD Composer?

Hello! I was wondering if it’s possible to animate a character in real-time in USD Composer. I know that Machinima had an extension that allowed real-time pose tracking and retargeting. Since Machinima is no longer available, there are suggestions to use MOVE AI instead. However, I haven’t been able to find any real-time pose estimation and retargeting features. Is there a way to achieve this in USD Composer, or is there another recommended solution? Thanks in advance.

As far as I know it’s just Move.ai. Does that not work for you? There is our new ACE workflow. When you say real time, you’re not talking about just real time rendering… you mean real time changes in animation, correct?

Thanks for your reply. Correct, I want to use a webcam to record myself while the character is animated right before my eyes. As far as I was able to find out Move.ai can only create animations and play them after creation.

In machinima you were able to select video sources such as video files or even the webcam. It was also able to retarget right there.

Well if you still have access to Machinima I guess you could use that, but we no longer support it or offer it. I would just use Move.ai or any other motion capture software to capture you performance and then export it into Composer. We don’t want to be a live capture system for characters. We want to be a simulation and digital twin platform. If you really want to do characters, we now offer NVIDIA ACE ACE | NVIDIA Developer

1 Like