Human Simulation + Bounding Boxes in Synthetic Data Recorder

Omniverse Isaac Sim
1

Hi Omniverse Team,

I’ve successfully generated synthetic data and 2D bounding boxes for a warehouse scene using the Synthetic Data Recorder.

Now I want to:

  • Simulate a moving human in the scene

  • Capture 2D bounding boxes for the human during motion

  • Save the frames along with bounding box annotations

My questions:

  1. What’s the best way to add and animate a human in the scene?

  2. Will bounding box annotators work automatically for the moving human?

  3. Can I save the simulation along with annotations, or only frames + labels?

Thanks!

3

Hi @karmik.barodia

Below is the answer to your questions

  1. Action and Event Data Generation — Isaac Sim Documentation and Actor Simulation and Synthetic Data Generation — Isaac Sim Documentation might be something that you are looking for. Please take a look.

  2. You will need to set object_info_bounding_box_2d_tight and/or object_info_bounding_box_2d_loose to true to enable it. See Actor Simulation and Synthetic Data Generation — Isaac Sim Documentation

  3. Yes, frames and annotations are saved together simultaneously.

4

Closing this thread since there is no update for more than two weeks. Feel free to re-open or open a new one if you still need any support.