How to save InstanceSegmentation Image?

Isaac Sim Version

4.2.0
4.1.0
4.0.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Isaac Lab Version (if applicable)

1.2
1.1
1.0
Other (please specify):

Operating System

Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model:
  • Driver Version:

Topic Description

Detailed Description

I’m collecting data to train a robot, specifically storing semantic, RGB, and depth images from three cameras. However, there’s an issue with the semantic data: the colors for the semantic segmentation change each time I save the images, even though I’ve set the semantic data in the editor. What I want is for the semantic colors of each object to remain consistent.

The solutions I’m considering are:

  1. Saving the segmentation information in advance as a YAML file, then reading it during runtime to assign segmentation information to each object based on that file.
  2. Capturing the Instance Segmentation Display directly from the viewport.

However, the first method doesn’t map properly to the semantic colors, even if I assign the IDs and store the information in a dictionary. For the second method, capturing the viewport directly still results in changing colors.

Screenshots or Videos

(If applicable, add screenshots or links to videos that demonstrate the issue)

Thank you for trying this. Our apologies for the delayed response. The tool for working with this type of ground-truth data is Replicator. Please let us know if you need further help.