Semantic Segmentation skipping some objects - severe issue

Isaac Sim Version

4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Operating System

Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model: NVIDIA GeForce RTX 4070 Ti SUPER
  • Driver Version: 550.144.03

Hi, I created a post on the SGD forum but it’s not getting any attention

I create this grid of tiles using the same .usd file. They’re all copies yet some of them don’t appear in the segmentation mask.
This makes the semantic segmentation data generation basically useless.
How can i circumvent this? Is it a bug in isaac sim?