Issue with Isaac Sim crashing in AWS DCV (Ubuntu 24.04, g6e.4xlarge)

Omniverse Isaac Sim
1

Important: Isaac Sim support

Dear NVIDIA Team,

I hope this email finds you well. I attended the NVIDIA Tech Day for Robotics and Autonomy last August and found it incredibly insightful!

I am reaching out regarding a persistent issue I am experiencing with Isaac Sim crashing. I am working on the SO-101 arm robot training using an AWS `g6e.4xlarge` instance running Ubuntu 24.04.

When I execute the following command:
`lerobot_agent --task Lerobot-So101-Teleop-Vials-To-Rack-DR`

Isaac Sim opens, loads all the assets, and then continuously crashes. However, if I run a new, empty Isaac Sim instance, it does not crash at all.

With the help of the AWS support team (Joshua), we have tried multiple troubleshooting steps to resolve the driver and display manager configuration, including:

  1. Checking the current driver (`nvidia-smi`).
  2. Completely removing existing drivers (`sudo apt-get purge -y ‘nvidia-*’` and `sudo apt-get autoremove -y`).
  3. Installing the tested driver version 570 (`sudo apt-get install -y nvidia-driver-570`) and rebooting.
  4. Restarting the `gdm.service`, running `sudo nvidia-xconfig`, and installing `nvidia-utils-570`.
  5. Installing and reinstalling `nvidia-modprobe` and `nvidia-settings`.
  6. Finally, purging everything again, installing `nvidia-driver-595`, and rebooting.

We also checked the logs (via `journalctl -u gdm.service`, `lsmod`, and `Xorg.0.log`), but the issue persists when the assets load. You can see a similar issue referenced on GitHub here: https://github.com/isaac-sim/IsaacSim/issues/586

Could you please advise on what might be causing this crash specifically when the task assets are loaded, and how I might be able to resolve it?

Best regards,

3

Can you please anyone can help me? In this issue

4

@jc130 could you attach the logs for debugging?

5

HI Lhuang-- Thank you for reply please se below logs -

Issac sim Error logs

root@ip-172-31-7-67:/workspace/Sim-to-Real-SO-101-Workshop# lerobot_agent --task Lerobot-So101-Teleop-Vials-To-Rack-DR
[INFO][AppLauncher]: Using device: cuda:0
[INFO][AppLauncher]: Loading experience file: /workspace/isaaclab/apps/isaaclab.python.rendering.kit
[Info] [carb] Logging to file: /isaac-sim/kit/logs/Kit/Isaac-Sim/5.1/kit_20260520_220711.log

|---------------------------------------------------------------------------------------------|
| Driver Version: 595.58.03 | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
| | | | | | Device-ID | UUID |
| | | | | | Bus-ID | |
|---------------------------------------------------------------------------------------------|
| 0 | NVIDIA L40S | Yes: 0 | | 46068 MB | 10de | 0 |
| | | | | | 26b9 | 8b39e995.. |
| | | | | | 34 | |
|=============================================================================================|
| OS: 24.04.2 LTS (Noble Numbat) ubuntu, Version: 24.04.2, Kernel: 6.8.0-1008-aws
| XServer Vendor: The X.Org Foundation, XServer Version: 12101011 (1.21.1.11)
| Processor: AMD EPYC 7R13 Processor
| Cores: 8 | Logical Cores: 16
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 127096 | Free Memory: 123831
| Total Page/Swap (MB): 0 | Free Page/Swap: 0
|---------------------------------------------------------------------------------------------|
cat: ‘/sys/devices/system/cpu/cpu*/cpufreq/scaling_governor’: No such file or directory
2026-05-20T22:07:18Z [7,180ms] [Warning] [gpu.foundation.plugin] ECC is enabled on physical device 0
2026-05-20T22:07:18Z [7,182ms] [Warning] [gpu.foundation.plugin] PCIe link width current (8) and maximum (16) for device 0 don’t match.
2026-05-20T22:07:24Z [12,932ms] [Warning] [omni.log] Source: omni.hydra was already registered.
2026-05-20T22:07:28Z [16,916ms] [Warning] [carb] Acquiring non optional plugin interface which is not listed as dependency: [omni::physx::IPhysxBenchmarks v1.0] (plugin: ), by client: omni.physics.physx.plugin. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client.
2026-05-20T22:07:29Z [17,564ms] [Warning] [omni.isaac.dynamic_control] omni.isaac.dynamic_control is deprecated as of Isaac Sim 4.5. No action is needed from end-users.
2026-05-20T22:07:36Z [25,457ms] [Warning] [pxr.Semantics] pxr.Semantics is deprecated - please use Semantics instead
2026-05-20T22:07:38Z [27,121ms] [Warning] [omni.graph.core.plugin] Found duplicate of category ‘Replicator’ - was ‘Annotators’, adding ‘Fabric Reader’
2026-05-20T22:07:38Z [27,121ms] [Warning] [omni.graph.core.plugin] Category ‘Replicator’ not accepted on node type ‘omni.replicator.core.FabricReader’ in extension ‘omni.replicator.core’
2026-05-20T22:07:38Z [27,129ms] [Warning] [omni.replicator.core.scripts.extension] No material configuration file, adding configuration to material settings directly.
2026-05-20T22:07:47Z [35,754ms] [Warning] [omni.fabric.plugin] Warning: attribute viewPickingId not found for bucket id 9

2026-05-20T22:07:47Z [35,804ms] [Warning] [omni.kit.window.filepicker.collections.collection_item] Failed to add ‘/root/Documents’: ‘/root/Documents/’ as dupliated path in ‘Documents’
2026-05-20T22:07:48Z [0ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] A crash has occurred. If a debugger should be attached, please set the ‘/crashreporter/debuggerAttachTimeoutMs’ setting to a timeout in milliseconds. This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2026-05-20T22:07:48Z [102ms] [Error] [carb.crashreporter-breakpad.plugin] ‘crashreport.gui’ exited with code 2
2026-05-20T22:07:48Z [106ms] [Error] [carb.crashreporter-breakpad.plugin] [crash] Wrote dump file ‘/isaac-sim/kit/data/Kit/Isaac-Sim/5.1/011825be-e929-45c6-fa1a08a8-0ade0d25.dmp’
2026-05-20T22:07:48Z [107ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] preventing upload of minidump due to user opt-out: ‘/isaac-sim/kit/data/Kit/Isaac-Sim/5.1/011825be-e929-45c6-fa1a08a8-0ade0d25.dmp’
2026-05-20T22:07:48Z [108ms] [Error] [carb.crashreporter-breakpad.plugin] [crash] dump file size is 3679704 bytes, file is readable.
2026-05-20T22:07:48Z [112ms] [Fatal] [carb.crashreporter-breakpad.plugin] [crash] Crash detected in pid 32 thread 37
2026-05-20T22:07:48Z [113ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] Crash metadata:
2026-05-20T22:07:48Z [113ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] BuildGitlabJobID = ‘209507876’
2026-05-20T22:07:48Z [114ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] CarbSdkVersion = ‘206.6+release.9587.07f17b1b.gl’
2026-05-20T22:07:48Z [115ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] CrashTime = ‘Wed May 20 22:07:48 2026 GMT’
2026-05-20T22:07:48Z [116ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] DriverShaderCacheWrapper = ‘disabled’
2026-05-20T22:07:48Z [118ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] DumpId = ‘011825be-e929-45c6-fa1a08a8-0ade0d25’
2026-05-20T22:07:48Z [119ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] LastUploadStatus = ‘0’
2026-05-20T22:07:48Z [121ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] ProductName = ‘OmniverseKit’
2026-05-20T22:07:48Z [122ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] PythonTracebackStatus = ‘‘py-spy’ successfully wrote info to ‘/isaac-sim/kit/data/Kit/Isaac-Sim/5.1/011825be-e929-45c6-fa1a08a8-0ade0d25.py.txt’’
2026-05-20T22:07:48Z [124ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] RetryCount = ‘0’
2026-05-20T22:07:48Z [127ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] StartupTime = ‘1779314831’
2026-05-20T22:07:48Z [129ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] UploadSuccessful = ‘0’
2026-05-20T22:07:48Z [131ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] UptimeSeconds = ‘37’
2026-05-20T22:07:48Z [133ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] UserStory = ‘’
2026-05-20T22:07:48Z [136ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] UserStoryStatus = ‘‘crashreport.gui’ exited with code 2’
2026-05-20T22:07:48Z [138ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] Version = ‘107.3.3+production.229672.69cbf6ad.gl’
2026-05-20T22:07:48Z [141ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] aftermath_enabled = ‘1’
2026-05-20T22:07:48Z [143ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] aftermath_flags = ‘3’
2026-05-20T22:07:48Z [146ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] aftermath_status = ‘auto-enabled’
2026-05-20T22:07:48Z [149ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] aftermath_version = ‘2024.1’
2026-05-20T22:07:48Z [151ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] appName = ‘Isaac-Sim’
2026-05-20T22:07:48Z [154ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] appState = ‘started’
2026-05-20T22:07:48Z [156ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] appVersion = ‘5.1.0’
2026-05-20T22:07:48Z [159ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] autoloadExts = ‘’
2026-05-20T22:07:48Z [162ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildBranch = ‘production’
2026-05-20T22:07:48Z [165ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildCi = ‘gl’
2026-05-20T22:07:48Z [167ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildConfig = ‘release’
2026-05-20T22:07:49Z [170ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildGitlabJobName = ‘kit-build-release-linux-x86_64’
2026-05-20T22:07:49Z [173ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildGitlabJobStage = ‘kit-build’
2026-05-20T22:07:49Z [176ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildGitlabPipelineID = ‘34875094’
2026-05-20T22:07:49Z [179ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildHash = ‘69cbf6ad’
2026-05-20T22:07:49Z [181ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildMajor = ‘107’
2026-05-20T22:07:49Z [184ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildMinor = ‘3’
2026-05-20T22:07:49Z [187ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildNumber = ‘229672’
2026-05-20T22:07:49Z [190ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildPatch = ‘3’
2026-05-20T22:07:49Z [192ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] buildVersion = ‘107.3.3’
2026-05-20T22:07:49Z [195ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] carboniteFrameworkVersion = ‘206.6+release.9587.07f17b1b.gl’
2026-05-20T22:07:49Z [198ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] carboniteSdkVersion = ‘206.6+release.9587.07f17b1b.gl’
2026-05-20T22:07:49Z [201ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] commandLine = ‘/workspace/isaaclab/_isaac_sim/kit/python/bin/python3 /workspace/isaaclab/_isaac_sim/kit/python/bin/lerobot_agent --task Lerobot-So101-Teleop-Vials-To-Rack-DR’
2026-05-20T22:07:49Z [203ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuCoreLimited = ‘16’
2026-05-20T22:07:49Z [206ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuId = ‘Intel64 Family 25 Model 1 Stepping 1’
2026-05-20T22:07:49Z [209ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuLogicalCoresBareMetal = ‘16’
2026-05-20T22:07:49Z [212ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuName = ‘AMD EPYC 7R13 Processor’
2026-05-20T22:07:49Z [215ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuPhysicalCoresBareMetal = ‘8’
2026-05-20T22:07:49Z [218ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuUsageQuota = ‘-1.000000’
2026-05-20T22:07:49Z [220ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] cpuVendor = ‘AuthenticAMD’
2026-05-20T22:07:49Z [223ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] desktopOrigin = ‘(0, 0)’
2026-05-20T22:07:49Z [226ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] desktopSize = ‘1536x688’
2026-05-20T22:07:49Z [229ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] displayCount = ‘1’
2026-05-20T22:07:49Z [232ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] displayRes_0 = ‘1536x688x32bit@60Hz’
2026-05-20T22:07:49Z [235ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] environmentName = ‘Individual’
2026-05-20T22:07:49Z [237ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] externalBuild = ‘1’
2026-05-20T22:07:49Z [240ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] gpuDriver_0 = ‘595.58’
2026-05-20T22:07:49Z [243ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] gpuVRAM_0 = ‘48305799168’
2026-05-20T22:07:49Z [246ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] gpu_0 = ‘NVIDIA L40S’
2026-05-20T22:07:49Z [249ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] kitRendererDriverVersion = ‘595.58’
2026-05-20T22:07:49Z [251ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lastCommand = ‘ChangeSetting(path=/persistent/exts/omni.kit.viewport.menubar.camera/expand,value=False,prev=True)’
2026-05-20T22:07:49Z [254ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lastCommands = ‘SetLightingMenuModeCommand(lighting_mode=stage,usd_context_name=),ChangeSetting(path=/persistent/exts/omni.kit.viewport.menubar.camera/expand,value=False,prev=True)’
2026-05-20T22:07:49Z [257ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_isaacSim_buildBranch = ‘release’
2026-05-20T22:07:49Z [260ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_isaacSim_buildDate = ‘Fri Oct 17 03:55:10 2025 +0000’
2026-05-20T22:07:49Z [263ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_isaacSim_buildHash = ‘9c81211’
2026-05-20T22:07:49Z [266ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_isaacSim_buildRepo = ‘https://gitlab-master.nvidia.com/omniverse/isaac/omni_isaac_sim.git’
2026-05-20T22:07:49Z [268ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_isaacSim_buildVersion = ‘5.1.0-rc.19’
2026-05-20T22:07:49Z [271ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_physx_buildBranch = ‘HEAD’
2026-05-20T22:07:49Z [274ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_physx_buildDate = ‘Oct-03-2025’
2026-05-20T22:07:49Z [277ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_physx_buildHash = ‘3a61992’
2026-05-20T22:07:49Z [280ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_physx_buildRepo = ‘gitlab-master.nvidia.com/omniverse/physics’
2026-05-20T22:07:49Z [282ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] lib_physx_buildVersion = ‘107.3.26’
2026-05-20T22:07:49Z [285ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] memoryStats = ‘(avail/total) RAM: 119.072/124.117GB, Swap: 0/0GB, VM: 1.71799e+10/1.71799e+10GB’
2026-05-20T22:07:49Z [288ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] nvidia-smi = ’
==============NVSMI LOG==============

Timestamp : Wed May 20 22:07:18 2026
Driver Version : 595.58.03
CUDA Version : 13.2

Attached GPUs : 1
GPU 00000000:34:00.0
Product Name : NVIDIA L40S
Product Brand : NVIDIA
Product Architecture : Ada Lovelace
Display Mode : Requested functionality has been deprecated
Display Attached : Yes
Display Active : Disabled
Persistence Mode : Disabled
Addressing Mode : None
MIG Mode
Current : N/A
Pending : N/A
Accounting Mode : Disabled
Accounting Mode Buffer Size : 4000
Driver Model
Current : N/A
Pending : N/A
Serial Number : 1652224094594
GPU UUID : GPU-8b39e995-519d-1039-01fc-72e46dd8ef56
GPU PDI : 0xe8e3dd4426fe56ee
Minor Number : 0
VBIOS Version : 95.02.66.00.15
MultiGPU Board : No
Board ID : 0x3400
Board Part Number : 900-2G133-A880-000
GPU Part Number : 26B9-896-A1
FRU Part Number : N/A
Platform Info
Chassis Serial Number : N/A
Slot Number : N/A
Tray Index : N/A
Host ID : N/A
Peer Type : N/A
Module Id : 1
GPU Fabric GUID : N/A
Inforom Version
Image Version : G133.0242.00.03
OEM Object : 2.1
ECC Object : 6.16
Power Management Object : N/A
Inforom BBX Object Flush
Latest Timestamp : N/A
Latest Duration : N/A
GPU Operation Mode
Current : N/A
Pending : N/A
GPU C2C Mode : N/A
GPU Virtualization Mode
Virtualization Mode : Pass-Through
Host VGPU Mode : N/A
vGPU Heterogeneous Mode : N/A
GPU Recovery Action : None
GSP Firmware Version : 595.58.03
IBMNPU
Relaxed Ordering Mode : N/A
PCI
Bus : 0x34
Device : 0x00
Domain : 0x0000
Base Classcode : 0x3
Sub Classcode : 0x2
Device Id : 0x26B910DE
Bus Id : 00000000:34:00.0
Sub System Id : 0x185110DE
GPU Link Info
PCIe Generation
Max : 4
Current : 4
Device Current : 4
Device Max : 4
Host Max : N/A
Link Width
Max : 16x
Current : 8x
Bridge Chip
Type : N/A
Firmware : N/A
Replays Since Reset : 0
Replay Number Rollovers : 0
Tx Throughput : 439 KB/s
Rx Throughput : 20019 KB/s
Atomic Caps Outbound : N/A
Atomic Caps Inbound : N/A
Fan Speed : N/A
Performance State : P0
Clocks Event Reasons
Idle : Not Active
Applications Clocks Setting : Not Active
SW Power Cap : Not Active
HW Slowdown : Not Active
HW Thermal Slowdown : Not Active
HW Power Brake Slowdown : Not Active
Sync Boost : Not Active
SW Thermal Slowdown : Not Active
Display Clock Setting : Not Active
Clocks Event Reasons Counters
SW Power Capping : 0 us
Sync Boost : 0 us
SW Thermal Slowdown : 0 us
HW Thermal Slowdown : 0 us
HW Power Braking : 0 us
Sparse Operation Mode : N/A
FB Memory Usage
Total : 46068 MiB
Reserved : 609 MiB
Used : 1706 MiB
Free : 43755 MiB
BAR1 Memory Usage
Total : 65536 MiB
Used : 1719 MiB
Free : 63817 MiB
Conf Compute Protected Memory Usage
Total : 0 MiB
Used : 0 MiB
Free : 0 MiB
Compute Mode : Default
Utilization
GPU : 0 %
Memory : 0 %
Encoder : 0 %
Decoder : 0 %
JPEG : 0 %
OFA : 0 %
Encoder Stats
Active Sessions : 1
Average FPS : 0
Average Latency : 0
FBC Stats
Active Sessions : 0
Average FPS : 0
Average Latency : 0
DRAM Encryption Mode
Current : N/A
Pending : N/A
ECC Mode
Current : Enabled
Pending : Enabled
ECC Errors
Volatile
SRAM Correctable : 0
SRAM Uncorrectable Parity : 0
SRAM Uncorrectable SEC-DED : 0
DRAM Correctable : 0
DRAM Uncorrectable : 0
Aggregate
SRAM Correctable : 0
SRAM Uncorrectable Parity : 0
SRAM Uncorrectable SEC-DED : 0
DRAM Correctable : 0
DRAM Uncorrectable : 0
SRAM Threshold Exceeded : No
Aggregate Uncorrectable SRAM Sources
SRAM L2 : 0
SRAM SM : 0
SRAM Microcontroller : 0
SRAM PCIE : 0
SRAM Other : 0
Channel Repair Pending : No
TPC Repair Pending : No
Unrepairable Memory : N/A
Retired Pages
Single Bit ECC : N/A
Double Bit ECC : N/A
Pending Page Blacklist : N/A
Remapped Rows
Correctable Error : 0
Uncorrectable Error : 0
Pending : No
Remapping Failure Occurred : No
Bank Remap Availability Histogram
Max : 192 bank(s)
High : 0 bank(s)
Partial : 0 bank(s)
Low : 0 bank(s)
None : 0 bank(s)
Temperature
GPU Current Temp : 40 C
GPU T.Limit Temp : 48 C
GPU Shutdown T.Limit Temp : -5 C
GPU Slowdown T.Limit Temp : -2 C
GPU Max Operating T.Limit Temp : 0 C
GPU Target Temperature : N/A
Memory Current Temp : N/A
Memory Max Operating T.Limit Temp : N/A
GPU Power Readings
Average Power Draw : 83.83 W
Instantaneous Power Draw : 83.12 W
Current Power Limit : 350.00 W
Requested Power Limit : 350.00 W
Default Power Limit : 350.00 W
Min Power Limit : 100.00 W
Max Power Limit : 350.00 W
GPU Memory Power Readings
Average Power Draw : N/A
Instantaneous Power Draw : N/A
Module Power Readings
Average Power Draw : N/A
Instantaneous Power Draw : N/A
Current Power Limit : N/A
Requested Power Limit : N/A
Default Power Limit : N/A
Min Power Limit : N/A
Max Power Limit : N/A
Power Smoothing : N/A
Workload Power Profiles
Requested Profiles : N/A
Enforced Profiles : N/A
EDPp Multiplier : N/A
Clocks
Graphics : 2520 MHz
SM : 2520 MHz
Memory : 9001 MHz
Video : 1965 MHz
Applications Clocks
Graphics : Requested functionality has been deprecated
Memory : Requested functionality has been deprecated
Default Applications Clocks
Graphics : Requested functionality has been deprecated
Memory : Requested functionality has been deprecated
Deferred Clocks
Memory : N/A
Max Clocks
Graphics : 2520 MHz
SM : 2520 MHz
Memory : 9001 MHz
Video : 1965 MHz
Max Customer Boost Clocks
Graphics : 2520 MHz
Clock Policy
Auto Boost : N/A
Auto Boost Default : N/A
Fabric
State : N/A
Status : N/A
CliqueId : N/A
ClusterUUID : N/A
Health
Summary : N/A
Bandwidth : N/A
Route Recovery in progress : N/A
Route Unhealthy : N/A
Access Timeout Recovery : N/A
Incorrect Configuration : N/A
Partition Assigned : N/A
Processes
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 2769
Type : G
Name :
Used GPU Memory : 69 MiB
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 2955
Type : G
Name :
Used GPU Memory : 57 MiB
GPU instance ID : N/A
Compute instance ID : N/A
Process ID : 3202
Type : C+G
Name :
Used GPU Memory : 1365 MiB
Capabilities
EGM : disabled

’
2026-05-20T22:07:49Z [291ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] osDistro = ‘ubuntu’
2026-05-20T22:07:49Z [294ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] osName = ‘24.04.2 LTS (Noble Numbat)’
2026-05-20T22:07:49Z [297ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] osVersion = ‘24.04.2’
2026-05-20T22:07:49Z [300ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] portableMode = ‘1’
2026-05-20T22:07:49Z [302ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] primaryDisplayRes = ‘1536x688x32bit@60Hz’
2026-05-20T22:07:49Z [305ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] runEnvironment = ‘Individual’
2026-05-20T22:07:49Z [308ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] runningInContainer = ‘1’
2026-05-20T22:07:49Z [311ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_debugSymbols = ‘0’
2026-05-20T22:07:49Z [314ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_dumpIncludeOverrides = ‘0’
2026-05-20T22:07:49Z [317ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_dumpIntermediates = ‘0’
2026-05-20T22:07:49Z [320ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_obfuscateCode = ‘1’
2026-05-20T22:07:49Z [323ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_optimizationLevel = ‘1’
2026-05-20T22:07:49Z [325ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] systemInfo = ’
|---------------------------------------------------------------------------------------------|
| Driver Version: 595.58.03 | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
| | | | | | Device-ID | UUID |
| | | | | | Bus-ID | |
|---------------------------------------------------------------------------------------------|
| 0 | NVIDIA L40S | Yes: 0 | | 46068 MB | 10de | 0 |
| | | | | | 26b9 | 8b39e995.. |
| | | | | | 34 | |
|=============================================================================================|
| OS: 24.04.2 LTS (Noble Numbat) ubuntu, Version: 24.04.2, Kernel: 6.8.0-1008-aws
| XServer Vendor: The X.Org Foundation, XServer Version: 12101011 (1.21.1.11)
| Processor: AMD EPYC 7R13 Processor
| Cores: 8 | Logical Cores: 16
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 127096 | Free Memory: 123831
| Total Page/Swap (MB): 0 | Free Page/Swap: 0
|---------------------------------------------------------------------------------------------|
’
2026-05-20T22:07:49Z [328ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] telemetrySessionId = ‘12068389420713931693’
2026-05-20T22:07:49Z [331ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] terminatedByAbort = ‘0’
2026-05-20T22:07:49Z [334ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] totalRamBareMetalMB = ‘127096’
2026-05-20T22:07:49Z [337ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] totalRamLimitedMB = ‘127096’
2026-05-20T22:07:49Z [339ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] totalSwapBareMetalMB = ‘0’
2026-05-20T22:07:49Z [342ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] totalSwapLimitedMB = ‘0’
2026-05-20T22:07:49Z [345ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] userId = ‘default’
2026-05-20T22:07:49Z [348ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] workingDirectory = ‘/workspace/Sim-to-Real-SO-101-Workshop’
2026-05-20T22:07:49Z [350ms] [Fatal] [carb.crashreporter-breakpad.plugin] [crash] Thread 37 backtrace follows:
2026-05-20T22:07:49Z [377ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50 (??:?)
2026-05-20T22:07:49Z [387ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: librtx.scenedb.plugin.so!void std::vector<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>, std::allocator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>*, std::vector<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>, std::allocator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> > > >, std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>&&)+0x123ef (??:?)
2026-05-20T22:07:49Z [396ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: librtx.scenedb.plugin.so!void std::vector<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>, std::allocator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>*, std::vector<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>, std::allocator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> > > >, std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>&&)+0x12766 (??:?)
2026-05-20T22:07:49Z [405ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: librtx.scenedb.plugin.so!void std::vector<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>, std::allocator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>*, std::vector<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>, std::allocator<std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int> > > >, std::tuple<char const*, float, float, unsigned int, unsigned int, unsigned int>&&)+0x14a14 (??:?)
2026-05-20T22:07:49Z [415ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: librtx.scenedb.plugin.so!carbOnPluginStartup+0x3b4de (??:?)
2026-05-20T22:07:49Z [424ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: librtx.scenedb.plugin.so!void std::vector<int, std::allocator >::_M_realloc_insert(__gnu_cxx::__normal_iterator<int*, std::vector<int, std::allocator > >, int&&)+0x7ce1 (??:?)
2026-05-20T22:07:49Z [433ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: libcarb.scenerenderer-rtx.plugin.so!std::unordered_map<unsigned int, unsigned int, std::hash, std::equal_to, std::allocator<std::pair<unsigned int const, unsigned int> > >::~unordered_map()+0x4655f (??:?)
2026-05-20T22:07:49Z [442ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: libcarb.scenerenderer-rtx.plugin.so!std::unordered_map<unsigned int, unsigned int, std::hash, std::equal_to, std::allocator<std::pair<unsigned int const, unsigned int> > >::~unordered_map()+0x64486 (??:?)
2026-05-20T22:07:49Z [451ms] [Fatal] [carb.crashreporter-breakpad.plugin] 008: libcarb.scenerenderer-rtx.plugin.so!carbOnPluginShutdown+0xe4b (??:?)
2026-05-20T22:07:49Z [458ms] [Fatal] [carb.crashreporter-breakpad.plugin] 009: libomni.hydra.rtx.plugin.so!+0x4459
2026-05-20T22:07:49Z [469ms] [Fatal] [carb.crashreporter-breakpad.plugin] 010: libomni.usd.so!void std::vector<unsigned long, std::allocator >::_M_realloc_insert(__gnu_cxx::__normal_iterator<unsigned long*, std::vector<unsigned long, std::allocator > >, unsigned long&&)+0x10da (??:?)
2026-05-20T22:07:49Z [479ms] [Fatal] [carb.crashreporter-breakpad.plugin] 011: libomni.usd.so!void std::vector<unsigned long, std::allocator >::_M_realloc_insert(__gnu_cxx::__normal_iterator<unsigned long*, std::vector<unsigned long, std::allocator > >, unsigned long&&)+0x58ce (??:?)
2026-05-20T22:07:49Z [490ms] [Fatal] [carb.crashreporter-breakpad.plugin] 012: libomni.usd.so!void std::vector<unsigned long, std::allocator >::_M_realloc_insert(__gnu_cxx::__normal_iterator<unsigned long*, std::vector<unsigned long, std::allocator > >, unsigned long&&)+0x5c5a (??:?)
2026-05-20T22:07:49Z [504ms] [Fatal] [carb.crashreporter-breakpad.plugin] 013: libcarb.tasking.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (carb::tasking::Scheduler::*)(carb::tasking::Fiber*, carb::tasking::Scheduler::TrackedThread*), carb::tasking::Scheduler*, carb::tasking::Fiber*, carb::tasking::Scheduler::TrackedThread*> > >::_M_run()+0xa3a7 (??:?)
2026-05-20T22:07:49Z [518ms] [Fatal] [carb.crashreporter-breakpad.plugin] 014: libcarb.tasking.plugin.so!void std::vector<int, std::allocator >::_M_realloc_insert<int const&>(__gnu_cxx::__normal_iterator<int*, std::vector<int, std::allocator > >, int const&)+0xb6dc (??:?)
2026-05-20T22:07:49Z [531ms] [Fatal] [carb.crashreporter-breakpad.plugin] 015: libcarb.tasking.plugin.so!void std::vector<int, std::allocator >::_M_realloc_insert<int const&>(__gnu_cxx::__normal_iterator<int*, std::vector<int, std::allocator > >, int const&)+0xb6ff (??:?)
2026-05-20T22:07:49Z [544ms] [Fatal] [carb.crashreporter-breakpad.plugin] 016: libcarb.tasking.plugin.so!make_fcontext+0x39 (??:?)
Segmentation fault (core dumped)
root@ip-172-31-7-67:/workspace/Sim-to-Real-SO-101-Workshop#

image
image1821×803 46.8 KB

6

@jc130 from the log, the crash is in RTX rendering path (e.g. librtx.scenedb.plugin.so), which suggests that the issue might be related to driver/runtime incompatibility. The log also shows the current driver version is 595.58.03. Could you check whether this issue still reproduces on an 580 branch driver, ideally 580.65.06 as listed on Isaac Sim Requirements — Isaac Sim Documentation ?

7

Closing this thread since there is no update for more than 2 weeks. Feel free to reopen or open a new thread if you still need any support.