I have successfully imported a Gaussian Splatting object into Isaac Sim. However, when I try to add a semantic label to this object using the Semantic Schema Editor, it doesn’t seem to work as expected. Specifically, I cannot see anything when I switch the RenderVar to SemanticSegmentation mode.
Could you please help me figure out this issue? I would greatly appreciate your assistance. Thank you!
To help us diagnose the issue, could you please provide the following details:
Original file format: For example, is your Gaussian Splatting object in USD/USDZ, PLY, or another format?
Exact reproduction steps: Please outline how you imported the object and the steps you took to add semantic labels (e.g., drag-and-drop, Python script, specific Isaac Sim features used).
Relevant log files: Attach or paste any error messages or console logs that appeared during the import and labeling process.
These details will help us pinpoint whether the issue is related to file compatibility, import workflow, or how semantic schemas are applied. Thank you!
To clarify the workflow: how did you obtain or convert the Gaussian Splatting object? For example, was it exported directly as a USDZ file from another tool, or converted from a different format (such as PLY, OBJ, or another)?
The current semantic labeling workflow does not support applying labels directly to the Gaussian splats. This means labels assigned to the proxy mesh do not transfer to the Gaussian representation: segmentation and semantic labels will only work for the proxy mesh, not for the visualized Gaussian object itself.