Isaac Sim Crashing When Using RTX Sensors

Omniverse Isaac Sim
1

Important: Isaac Sim support

Note: For Isaac Sim support, the community is gradually transitioning from this forum to the Isaac Sim GitHub repository so that questions and issues can be tracked, searched, and resolved more efficiently in one place. Whenever possible, please create a GitHub Discussion or Issue there instead of starting a new forum topic.

Note: For any Isaac Lab topics, please submit your topic to its GitHub repo ( GitHub - isaac-sim/IsaacLab: Unified framework for robot learning built on NVIDIA Isaac Sim · GitHub ) following the instructions provided on Isaac Lab’s Contributing Guidelines ( Contribution Guidelines — Isaac Lab Documentation ).

Please provide all relevant details below before submitting your post. This will help the community provide more accurate and timely assistance. After submitting, you can check the appropriate boxes. Remember, you can always edit your post later to include additional information if needed.

6.0.0
5.1.0
5.0.0
4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Operating System

Ubuntu 24.04
Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model: Nvidia RTX A5000
  • Driver Version: 580.142

IsaacSim Crashing When Running RTX Sensors

Using Docker Environment

Environment

I am running a simulation that consists of boxton dynamics spot in an closed heavy dense environmet having so much materials and shaders. I also have a rtx lidar attached to the body of spot. For publishing lidar data i have a action graph setup and the spot is navigating with the help of flatterrain policy. I am launching the usd via python scripting where the physics dt is 500 and rendering dt 10/500 as needed for rl trained spot policy. So in the action graph i have a simulation gate node that will publish lidar data only at 20 hz.

Issue

When i run the python scirpt that loads the usd and run the simulation isaacsim is crashing after some time saying CUDA error 700, cudaErrorIllegalAdress-an illegal memory adress was encountered

Screenshots or Videos

cuda_700_error
cuda_700_error1276×429 95.6 KB

3

Hi, CUDA error 700 (illegal address) is often related to GPU memory exhaustion or memory corruption under heavy load. Try to simplify your scene or running at lower dt to see if that helps. Otherwise you may need to upgrade to a GPU with more RAM.

4

I can’t run at lower physics dt because it will effect boxton dynamics spot movment. The rl policy is trained on physics dt 500, rendering dt 10/500. Also When i tested in a simple environment with spot and some objects same error i am getting

5

Did you check the GPU memory usage via nvidia-smi while running your test? That might give you some clue.

6

I am closely monitoring the gpu utilisation, but nothing there, One finding is that, if i use the workstation installed isaacsim rather than isaacsim in container the issue is not happening at all, the issue is only coming when i use isaacsim inside the container setup.

7

What do you mean nothing there? Did you see GPU memory usage when running nvidia-smi?
Since this only happens with the docker build, did you map your GPUs to the docker when launching it?

8

Yeah i have mapped docker when building it.

What should i focus on nvidia-smi, when running the environment i have 15gb free vram and utilisation is 5-6gb.

9

Did you build your docker from source? Also, can you share the commands you used to launch the docker?

10

Hi, we haven’t heard back since our last question about your Docker setup (whether it was built from source and the launch commands used). Since it’s been a while, we’ll go ahead and close this thread. If you’re still experiencing this issue, please open a new topic on the forum or on the Isaac Sim GitHub repository and link back to this one: Isaac Sim Crashing When Using RTX Sensors. Thanks for your patience!