How to know that UV Map variables such as some noise coordinates of an mesh material?

Omniverse Isaac Sim
1

I am doing UV mapping on an object in Blender and drawing white scratches directly on the surface using texture painting.
I extracted the coordinates of these scratches in UV map space and saved them as JSON.
Then I exported the object as a USD/USDC file.

When I import this USDC asset into the Omniverse Isaac Sim environment, how can I obtain the coordinates of these scratches inside Isaac Sim?

Specifically:

  • How can I map the scratch UV coordinates to the object’s surface in Isaac Sim?

  • Is there a way to convert these UV coordinates to world or local coordinates in Isaac Sim?

  • My goal is to draw bounding boxes around these scratches inside Isaac Sim.

Any guidance on accessing UV data, materials, or texture-space to world-space conversion in Isaac Sim / Omniverse would be appreciated.

2

Hi @mertogzhn55,

Interesting use case, thanks for the detailed description.​

This question goes quite deep into accessing mesh UV primvars and converting from texture/UV space back to 3D positions on the surface, which is handled by the underlying Omniverse / USD geometry and material APIs that Isaac Sim is built on. Because of that, you may get more targeted help from the Omniverse Platform → OpenUSD category, where folks focused on UsdGeomMesh, UV primvars (st), and coordinate conversions (object ↔ world space) are more active:​