USDs of some custom assets import with incorrect normals into Isaac sim

Isaac Sim Version

4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Operating System

Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model: RTX 4080 Super
  • Driver Version: 566.36

Hi everyone!
I exported a few assets from Unreal Engine 5.5 to USD for use with Isaac Sim. However, upon importing i notice that some of the geometries have incorrect surface normals (the reflections look skewed and stretched to one side or another). This happens while opening the usd directly in both Isaac and USD Composer. However, the same usd in blender does not show incorrect normals (both render or in openGL viewport).
What could be the reason for this odd behavior? How may I debug this further?
Any help would be appreciated. Thanks!!

Steps to Reproduce

Export any large scene from Unreal Engine. In my case, its these:
Storage House Set | Fab
Archviz Interior vol.3 | Fab

Error Messages

None, the scene opens without any errors or warnings.

Screenshots

What I’ve Tried

I have tried importing the same usd in blender 3d and that works correctly. I have also tried changing export settings in UE (to not export a normal map or tangents altogether) but to no avail.

1 Like

I did further debugging, with simpler objects and have found that the issue was not with geometries but with the normal maps and how they render inside of Isaac.

On a much simpler object, just a cube that’s been unwrapped, this is how it looks like:

However, upon disconnecting the normal map:

The normal map being used is:

In the mdl node graph, it is set to raw colorspace. Other applications interpret this normal map correctly, so I am not entirely sure what the difference is here. Does Isaac expect world space normal maps as opposed to tangent space?

@ankit.pruthi i don’t have Isaac Sim in front of me, but could flipping the green channel of the normal map yield anything different? i can see if i can repo this when i get back to my machine. in the meantime, could you share a screenshot of your shader graph?

Hi,
Here’s how the shader graph looks like. I am unable to edit this graph though.
I tried using the normal map above in a completely new shader inside Isaac as well rather than the one created from UE export but that doesn’t fix it either. Nor does flipping V.

So it is just a problem with normal maps? Normally we do the same thing. Read the normal maps with RAW Color Space.

Also we do not support Unreal Engine past 5.3. How are you exporting your scene? Through their native USD, or through FBX etc?

Hello!

We noticed that this topic hasn’t received any recent responses, so we are closing it for now to help keep the forum organized.

If you’re still experiencing this issue or have additional questions, please feel free to create a new topic with updated details. When doing so, we recommend mentioning or linking to this original topic in your new post—this helps provide context and makes it easier for others to assist you.

Thank you for being part of the NVIDIA Isaac Sim community.

Best regards,
The NVIDIA Isaac Sim Forum Team