Influence of materials on LIDAR and (depth-)cameras


I just noticed that the depth camera image and lidar scans treat objects with a transparent material just like any opaque material (eg. omniverse://localhost/NVIDIA/Materials/Base/Glass/Clear_Glass.mdl).
In reality glass would usually not be recognized by lidars or depth cameras.

This sparked the question if the material properties (esp. reflection) of objects in Isaac Sim are somehow taken into account when calculating the result of a lidar scan or depth images. I have the impression that this is currently not the case, if that would be possible in the future it would be really great!

Kind regards,

We are planning to have RTX based sensor support in the future that will allow the materials applied to geometry to influence the lidar simulation.
Currently the lidar sensor uses PhysX raycasts so it interacts with the collision geometry instead of the visual geometry which limits how materials influence the lidar simulation

Thanks for clarifying that!

What is the approximate timeframe? Possibly Version 2022.1 or later?

2022.2 (march-ish) is when some of this stuff will initially land.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.