Is there anyway to render voxels from depth cameras in Isaac Sim?
I’m trying to do something like this with Octomap: ur3 ompl rrt octomap - YouTube
I need the voxels in Isaac Sim to leverage the RMPflow local motion planner. Seems like there is no support for something like this in Isaac Sim.
One option is to convert a depth image to points using this API call:
https://docs.omniverse.nvidia.com/py/isaacsim/source/extensions/omni.isaac.core/docs/index.html?highlight=depth#omni.isaac.core.utils.viewports.project_depth_to_worldspace
and then use one of the methods here to visualize the data in your scene.
https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/tutorial_advanced_live_data.html
