How to generate "photoreal synthetic data" from Omniverse environments with Cosmos?

Omniverse Synthetic Data Generation (SDG)
, , , , ,
1

From the press release:

Physics-based photoreal synthetic data generation, using Cosmos models to generate photoreal videos from controlled 3D scenarios developed in the NVIDIA Omniverse™ platform.

Which model should be used for this? Probably i’m missing something, but the models i currently see in the catalog are all seem to be for generating new frames, and none of them are for enhancing existing ones.

3 Likes
2

Also, in the Isaac Sim 4.5 release post:

Cosmos can ingest images and videos and output photoreal video clips to then retrain policy models.

Is there any example for that?

3

Seems like the feature is not available (yet?): How to generate “photoreal synthetic data” from Omniverse environments with Cosmos? · Issue #89 · NVIDIA/Cosmos · GitHub