RTX Lidar - Example Rotary: APIs/endpoints to collect data?

Important: Isaac Sim support

Note: For Isaac Sim support, the community is gradually transitioning from this forum to the Isaac Sim GitHub repository so that questions and issues can be tracked, searched, and resolved more efficiently in one place. Whenever possible, please create a GitHub Discussion or Issue there instead of starting a new forum topic.

Note: For any Isaac Lab topics, please submit your topic to its GitHub repo ( GitHub - isaac-sim/IsaacLab: Unified framework for robot learning built on NVIDIA Isaac Sim · GitHub ) following the instructions provided on Isaac Lab’s Contributing Guidelines ( Contribution Guidelines — Isaac Lab Documentation ).

Please provide all relevant details below before submitting your post. This will help the community provide more accurate and timely assistance. After submitting, you can check the appropriate boxes. Remember, you can always edit your post later to include additional information if needed.

6.0.0
5.1.0
5.0.0
4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Operating System

Ubuntu 24.04
Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model: NVIDIA RTX Pro 4500 Blackwell
  • Driver Version: 580.126.09

Topic Description

Trying to configure the RTX Lidar → Nvidia → Example Rotary sensor to query data from a scene set up. Can’t figure out what

Detailed Description

I’m trying to log data from the RTX Lidar (Example Rotary) in Isaac Sim. I’m using the IsaacCreateRTXLidarScanBuffer with RtxLidarDebugDrawPointCloudBufferas per the official documentation, but I keep getting the return array as this:

distance: (0,) intensity: (0,)

So it essentially returns nothing. I have a scene that is set up as a room (so 4 walls as well as a ceiling on top and a ground plane). There is no attached light in the room, but a stage light that lights up a franka arm. I have placed RTX Lidar on the hand and the goal is just to collect some stationary data as a .npz file, but I keep getting empty distance, intensity.

If someone has successfully collected data with the RTX Lidar through a script, can you point me to the correct APIs to do this?

Steps to Reproduce

(Add more steps as needed)

Error Messages

AnnotatorRegistryError: No annotator of name RtxSensorCpuIsaacCreateRTXLidarScanBuffer registered. Available annotators: [‘camera_params’, ‘rgb’, ‘normals’, ‘motion_vectors’, ‘cross_correspondence’, ‘occlusion’, ‘distance_to_image_plane’, ‘distance_to_camera’, ‘LdrColor’, ‘HdrColor’, ‘RtxSensorCpu’, ‘RtxSensorGpu’, ‘RtxSensorMetadata’, ‘IsaacComputeRTXLidarFlatScan’, ‘IsaacCreateRTXLidarScanBuffer’, ‘IsaacExtractRTXSensorPointCloudNoAccumulator’…]

Screenshots or Videos

Additional Information

What I’ve Tried

(Describe any troubleshooting steps you’ve already taken)

Related Issues

(If you’re aware of any related issues or forum posts, please link them here)

Additional Context

(Add any other context about the problem here)

@rsonawane2002 We have several example script for RTX Lidar. Have you tried them out?