How to use new 2022.1 with CC4 on full body?

I need information on how to use new 2022.1 with CC4 on full body?

Simple, step by step video tutorial would be the best.

As you can see, I have really spent a lot of time with the old version, trying to do this:

I succeeded in some degree but I really do not want to go again a 3 week research project with this :)

I also now write a support topic to cc4 about this need, if they answer I update the info here.

2 Likes

Hello @pekka.varis! I’ve asked the dev team for some help answering your question. I will post back here when I have more information!

2 Likes

Hi @pekka.varis ,
I’ve recorded these tutorials for CC4 character full body connection with A2F.
https://drive.google.com/drive/folders/1Fzvp_2sCkkhVF8JBZ4tdjrrr6e6u1tKX?usp=sharing

  1. Overview - Inspect what CC4 character export provided, what’s missing, and challenges 09:19
  2. Extra Mesh - Prepare missing extra meshes 16:14
  3. CharSetup - Gathering all the meshes and add them to charSetup 10:20
  4. CharTransfer - Running charTransfer with CC3Plus Preset and attach A2F Fullface pipeline 13:20
  5. Technical fix to workaround transform update trigger. 09:01
  6. Connecting to the usdSkel animation 05:58

Some of the steps are still quite involved and we are working to streamline that.

1 Like

Thanks for the information. I assume it is a much simpler process to export the Blendshape JSONs back into iClone. Can you please provide us any update on how that should be done? Nothing works. Even when I try to export a USD Facial Animation to Unreal, I get a message that says “Cannot find curve timesamples.” Everything seems to be exporting null for me. Any guidance is very appreciated.

Hi @rbt730, can you give us more information, so we can take a look closer?

  • if you export .json from the blendshape solve, are you getting all “NULL” ?

  • For unreal import part, are you using UE4 or UE5?

  • If possible, can you share the .json and .usd file that didn’t work for you?

@esusantolim thanks this is so important information!!

I get on with this and share my results here :)

From my test today, all .json export + .usd export for UE4 and UE5 all work.
@rbt730 If you show some video or any clue, I think we can find out what went wrong or is missed.

Hi there @yseol ,

It works now, after lots of difficulty. I eventually got it half-working late last night when I used my A2F result mesh as the Input Anim Mesh and my A2F mesh head export from iClone (without eyes or dentures) as the Blendshape Mesh. This way I exported multiple JSON files back to iClone and was able to successfully import them and play them in iClone’s Timeline.

At some point today I unchecked some of the Blendshapes that were being exported in the JSON files via the CC4 Extended preset. I am finding that my Reallusion characters either look completely flat or their brows and upper lip lift too much in the middle, producing a “worried chipmunk” effect. (I had hoped to clean this up in iClone, but the program understandably freezes when I try to edit any Blendshape keyframes-- it’s too much for it to handle, since I’m working with long audio files.) However, in unchecking some of the Blendshapes that were being exported from Audio2Face, this led to me back to all-“NULL” JSON files. I don’t know why it produced this error since I was simply toggling checkmarks on a Pose profile.

Unfortunately I had already saved over my file, so I had to start fresh, but in starting fresh I kept running into an issue where the A2F CC_Base_Body mesh (the head) would simply not follow along with the Input Anim after a Blendshape Solve. This lasted for hours, until literally just now, when it simply worked after I reloaded the file. This isn’t the first time reloading has solved my problems in this program, oddly. But I can confirm that I’m able to export JSONs again.

I can send you my USD file via a private message if you’d like-- Reallusion wouldn’t appreciate me sharing a CC4 character here. Otherwise, I’d really appreciate a formal YouTube tutorial on how to get all the relevant Blendshape Conversion data in JSON format-- for face and, in particular, the saccade data of the eyes-- back into iClone so that I have something to refer to step-by-step. If such a tutorial is in the works, that’s fantastic. Thanks.

Hi @rbt730, thanks for trying many tests.

We also tested many cases internally, for exmple exporting to iClone8, UE4, and UE5. We found all working well and couldn’t reproduce any error you mentioned.
Do you have any screenshot of this case? so we can try to reproduce the error on our side?

However, in unchecking some of the Blendshapes that were being exported from Audio2Face, this led to me back to all-“NULL” JSON files. I don’t know why it produced this error since I was simply toggling checkmarks on a Pose profile.

At the moment, we are investigating how to transfer all the facial motion (teeth, saccade, tongue) to other apps, once we figure that out, we will share the tutorial. Thanks for your input.