Hi, I am using the Semantic Schema Editor in Isaac Sim to set the semantics for my scene. For the 3D Bounding Box everything looks fine. But for some reason the 2D bounding boxes, tight and loose, do not fit the object correct. Its as if the transparent glass part of the bottle is ignored in the 2D view.
If the material of the bottle is not some glas but in this example the bricks it works, but this is no solution for me:
@Byte97 just a passerby without tons of experience with the semantic schema editor and happens to have a question - does the amount of transparency on the material/shader factor into this? given glass could have varying degree of opaqueness, i am curious to know whether the amount matters to how meshes are perceived by 2D. in other words, have you tried it with other type of glass material (or simply adjusting the existing material) to see whether there’s a threshold it before it gets picked up?
Yes I have tried with different glass. It happens with every glass I tried so far.
But you are correct it has something to do with the opaqueness. When I take a Plastic and set the opacity to 1.0 I still get the bounding box. But as soon as I go to 0.99 it disappears:
Maybe this post regarding “transparency” acting as occlusion might be the solution. Can someone explain how to do that?
Okay I found the solution at least for glass. You need to enable “Cast Shadows” under the Mesh that has the glass material.
Now it works. @2024a This is something that should be mentioned somewhere…
good to know, @Byte97 ! thanks for reporting back 👍
sadly I just found out it works for glass…but not for plastics. Since the glass materials do not have the opacity set. Once I add that to plastic, the box is gone again. Shadow or not :/
Any update on this? I am having the exact problem, semantic labels on translucent plastic material are ignored in the 2D view
Could you kindly create a new topic linked to this one? In the new topic, please let us know if you are still encountering this issue with the latest release of Isaac Sim, version 4.1.0.
Can you check if Cast Shadows fixes the issue:
