Made sim in Isaac Sim 5, baked and exported to Kit Full App with OVD.
Please see here:
Main Issue:
The sim looks great on Isaac Sim. But when the OVD baked sim is imported to Kit Full App, I have multiple issues:
- Scaling to 100 larger and axis to Y at Isaac Sim ( from Scene & Physics preferences ), no problem I do on the next round.
- Why is it kinda “jittenig” on Kit when I play it back? The scene is 60 frm per sec at both Isaac Sim and in Omnvierse, but the motion is smooth only at Isaac Sim. Are there some settings to raise for the baking?
Do I have some workaround half automated solution for the missing materials or do I have to manually assign each one in Kit? I know I can import the same forklift with same materials to Kit, and with that on the scene there might be some clever way to add the missing materials.
Most important question is:
Can I make “falling boxes from warehouse rack shelter” kind of simple simulations straight inside Kit 108 and BAKE the simulation? My only reason for starting this baking challenge was to be able to animate my camera to follow the falling boxes simulation, but without baked sim it was really hard to guess where all the boxes fall to frame them looking good in OV. btw here is the final shot with that, it came out just fine: https://youtu.be/6wNqyUI7iRU?si=I3KnPIrgTyJN_kdR
@pekka3 below are a few of my observations based on what you wrote:
regarding the stage up-axis and scaling discrepancy, i would suggest paying attention to the up-axis and MPU of both apps to see if they match. iirc, one uses meter and Z-up while the other uses centermeter and Y-up by default.
not sure if you noticed, but your timeline playback in kit 108 sequencer is set to 24 fps, so is that the stuttering/jittering you are referring to? you can try changing the playback rate to 60 again and see if you get a smoother animation.
the video segment where you showed kit 108 is the actual raw OVD file/data for prim transforms, where only the collision meshes (i believe) are shown. in other words, no material information will be recorded/applied, hence only a standard green material is visible. prims also won’t have the same level of detail as the actual asset. you can only get this visualization if you used Load OVD section of the extension. the purpose is more for troubleshooting the sim and not meant to be used for final render.
instead, you should be able to use Overlay OVD on an Active Edit Layer section of the OmniPVD extension. click on Bake PhysX transforms into the active edit layer and specify the recorded OVD to load the simulation data into the stage with high resolution prims (in this case the forklift and the sphere) with appropriate materials are already applied.
you can refer to your other thread on baking simulation where video clips were provided with direction - How to bake simulations?
regarding your question on whether you can sim and bake directly inside of 108, i presume you can given you have all the necessary extensions (like the Physx bundle) needed to do the sim; that said, i’ve mostly done my simulation in Isaac Sim as a personal preference. as long as you have the baked information from OVD and can load it back onto the prim(s), you should be able to animate your cameras accordingly once OVD transforms are applied to your pre-existing scene.
Hi @pekka3
This post, is like many of your other posts, where you are trying to flip between Isaac Sim and USD Composer and back again. It makes the workflow solution complex. Isaac Sim is its own separate product. It is “based”on Omniverse, but it is not actually Omniverse.
So having said this, let’s stick with one or the other. If you are using Isaac Sim, there must be a reason. Issac Sim is designed specifically for Robotics, SDG, and RL. If you are not doing any of that, you should be using USD Composer.
I know you have also posted about using OmniPVD before and we looked at that workflow.
Finally, as in another post please do not use “Omni kit app full”. Use USD Composer.
Hurray!
It worked great, thank you @Simplychenable
You have helped me soooo much bro.
@Richard3D all good here, finally I got this running as I planned. Keeping the materials and positions the same, all inside Kit108.
As you can see from the video, I can also now add more objects and simulate them as the baked earlier sim is playing in timeline, how cool.
Is there any tools for me now to move this baked sim later in timeline, for example with usign sequencer or some other tool?
I will now stay inside Kit108 and do these simulations here, not bounce between Isaac Sim & Kit108. However if I need some day to do collaboration with Muammer Bay with autonomous forklift etc but that is a different story then with a budget!
