Please provide all relevant details below before submitting your post. This will help the community provide more accurate and timely assistance. After submitting, you can check the appropriate boxes. Remember, you can always edit your post later to include additional information if needed.
Isaac Sim Version
4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):
Operating System
Ubuntu 24.04
Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):
GPU Information
- Model: RTX 4090
- Driver Version: 550.120
Topic Description
Detailed Description
(Describe the issue in detail, including what you were trying to do, what you expected to happen, and what actually happened)
Steps to Reproduce
GOAL: Use the semantic segmentation to extract just the arm and lemon from the rgb image.
- Created a simple world in isaac sim with a robot arm and lemon on a table, and some walls and floor around it.
- Used replicator to record the scene when I start the simulation. I recorded rgb, semantic segmentation, and depth from image plane
- In post-processing, I used the semantic segmentation output to create a mask, that I used to overlay the robot and lemon from the rgb footage onto the semantic segmentation output. The overlaying was mainly a gut-check on if the segmentation is working correctly.
I saw all this noise around the lemon and robot and I don’t know where its coming from. In this simulated world, I would expect perfect segmentation, and so I expect I should be able to perfectly mask out the arm from the rgb image.
Screenshots or Videos
(If applicable, add screenshots or links to videos that demonstrate the issue)
I’ve included the semantic segmentation output, the rgb output, and the eventual overlayed output with the rgb arm and lemon overlayed into the sem-seg video.