Segmentation fault when running Isaac Sim container on HPC

I run into an error when using Apptainer to run Isaac Sim 2023.1.1 on our HPC cluster. After creating the image with SINGULARITY_NOHTTPS=1 apptainer build --sandbox isaacsim.sif docker://nvcr.io/nvidia/isaac-sim:2023.1.1, and running the image with singularity run --nv $TMPDIR/isaacsim.sif, it ends in a segmentation fault with errors related to (1) a read-only file system (OSError: [Errno 30] Read-only file system: '/isaac-sim/kit/exts/omni.gpu_foundation/cache/nv_shadercache') and (2) incompatible drivers, despite using up-to-date ones (vkCreateInstance failed. Vulkan 1.1 is not supported, or your driver requires an update.).

How can I fix these errors? This question says Singularity/Apptainer is not supported yet, but on Isaac Sim Orbit Singularity/Apptainer is given as an option that should work.

The full log is given below.

(base) [ld20d359@gnode14 ~]$ singularity run --nv $TMPDIR/isaacsim.sif
WARNING: DEPRECATED USAGE: Environment variable SINGULARITY_DOCKER_PASSWORD will not be supported in the future, use APPTAINER_DOCKER_PASSWORD instead
WARNING: DEPRECATED USAGE: Environment variable SINGULARITY_DOCKER_USERNAME will not be supported in the future, use APPTAINER_DOCKER_USERNAME instead

The NVIDIA Omniverse License Agreement (EULA) must be accepted before
Omniverse Kit can start. The license terms for this product can be viewed at
https://developer.nvidia.com/omniverse/license

Omniverse Software collects installation and configuration details about your software, hardware, and network
configuration (e.g., version of operating system, applications installed, type of hardware, network speed, IP
address) based on our legitimate interest in improving your experience. To improve performance, troubleshooting
and diagnostic purposes of our software, we also collect session behavior, error and crash logs.

Data Collection in container mode is completely anonymous unless specified. You may opt-out of this collection
anytime by not setting the PRIVACY_CONSENT environment variable.

To opt-in set the PRIVACY_CONSENT environment variable when running the container. Set the 
PRIVACY_USERID environment variable tag the telemetry data with a user ID or email.
[Info] [carb] Logging to file: /storage/homefs/ld20d359/.nvidia-omniverse/logs/Kit/Isaac-Sim/2023.1/kit_20240109_181340.log
2024-01-09 17:13:40 [3ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/b509c0ac-dada-4449-c83ffea9-9c38aab8.dmp.zip'
2024-01-09 17:13:40 [3ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/514a1856-4385-4008-f8973ba8-f5d02f25.dmp.zip'
2024-01-09 17:13:40 [3ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/dbb55ec6-e3cf-407e-ec70cf81-af229cf1.dmp.zip'
2024-01-09 17:13:40 [3ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/42855103-3177-4523-f3167f86-4bdd0fcb.dmp.zip'
2024-01-09 17:13:40 [4ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/04617282-1d7a-41f0-3e2731a8-d2e55ad7.dmp.zip'
2024-01-09 17:13:40 [157ms] [Warning] [omni.ext.plugin] [ext: omni.kit.sequencer.core-103.4.0+105.0] Built using kit version: 105.0. Current version: 105.1. It is considered compatible, but building with a newer version is recommended.
2024-01-09 17:13:40 [157ms] [Warning] [omni.ext.plugin] [ext: omni.kit.sequencer.usd-103.4.0+105.0] Built using kit version: 105.0. Current version: 105.1. It is considered compatible, but building with a newer version is recommended.
2024-01-09 17:13:40 [158ms] [Warning] [omni.ext.plugin] [ext: omni.kit.widget.timeline-105.0.1+105.0] Built using kit version: 105.0. Current version: 105.1. It is considered compatible, but building with a newer version is recommended.
2024-01-09 17:13:40 [162ms] [Warning] [omni.ext.plugin] [ext: omni.kit.window.sequencer-103.4.2-dev.3+105.0] Built using kit version: 105.0. Current version: 105.1. It is considered compatible, but building with a newer version is recommended.
2024-01-09 17:13:40 [164ms] [Warning] [omni.ext.plugin] [ext: omni.paint.brush.attributes-1.3.1+105.0] Built using kit version: 105.0. Current version: 105.1. It is considered compatible, but building with a newer version is recommended.
2024-01-09 17:13:40 [193ms] [Warning] [omni.ext.plugin] [ext: omni.usd.schema.sequence-2.3.0+105.0.lx64.r.cp310] Built using kit version: 105.0. Current version: 105.1. It is considered compatible, but building with a newer version is recommended.
[0.884s] [ext: omni.kit.async_engine-0.0.0] startup
[1.535s] [ext: omni.assets.plugins-0.0.0] startup
[1.536s] [ext: omni.datastore-0.0.0] startup
[1.537s] [ext: omni.client-1.0.1] startup
[1.551s] [ext: omni.taskagent-0.0.0] startup
[1.552s] [ext: omni.stats-0.0.0] startup
[1.553s] [ext: omni.activity.core-1.0.1] startup
[1.557s] [ext: omni.ujitso-0.0.0] startup
[1.558s] [ext: omni.hsscclient-0.0.0] startup
[1.559s] [ext: omni.activity.profiler-1.0.2] startup
[1.561s] [ext: omni.gpu_foundation-0.0.0] startup
[1.579s] [ext: omni.rtx.shadercache.vulkan-1.0.0] startup
2024-01-09 17:13:42 [1,561ms] [Error] [carb.scripting-python.plugin] OSError: [Errno 30] Read-only file system: '/isaac-sim/kit/exts/omni.gpu_foundation/cache/nv_shadercache'

At:
  /isaac-sim/kit/python/lib/python3.10/os.py(230): makedirs
  /isaac-sim/kit/exts/omni.gpu_foundation/omni/gpu_foundation_factory/impl/foundation_extension.py(91): setup_shadercache_locations
  /isaac-sim/kit/exts/omni.gpu_foundation/omni/gpu_foundation_factory/impl/foundation_extension.py(142): on_startup
  /isaac-sim/kit/kernel/py/omni/ext/_impl/_internal.py(164): _startup_ext
  /isaac-sim/kit/kernel/py/carb/profiler/__init__.py(85): wrapper
  /isaac-sim/kit/kernel/py/omni/ext/_impl/_internal.py(224): startup
  /isaac-sim/kit/kernel/py/omni/ext/_impl/_internal.py(328): startup_extension
  PythonExtension.cpp::startup()(2): <module>

2024-01-09 17:13:42 [1,561ms] [Error] [omni.ext.plugin] [ext: omni.gpu_foundation-0.0.0] Failed to startup python extension.
[1.591s] [ext: carb.windowing.plugins-1.0.0] startup
2024-01-09 17:13:42 [1,573ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-01-09 17:13:42 [1,573ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[1.592s] [ext: omni.kit.renderer.init-0.0.0] startup
2024-01-09 17:13:42 [1,590ms] [Warning] [omni.platforminfo.plugin] failed to open the default display.  Can't verify X Server version.
2024-01-09 17:13:42 [1,621ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_INCOMPATIBLE_DRIVER
2024-01-09 17:13:42 [1,621ms] [Error] [carb.graphics-vulkan.plugin] vkCreateInstance failed. Vulkan 1.1 is not supported, or your driver requires an update.
2024-01-09 17:13:42 [1,621ms] [Error] [gpu.foundation.plugin] carb::graphics::createInstance failed.
2024-01-09 17:13:42 [1,635ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_INCOMPATIBLE_DRIVER
2024-01-09 17:13:42 [1,636ms] [Error] [carb.graphics-vulkan.plugin] vkCreateInstance failed. Vulkan 1.1 is not supported, or your driver requires an update.
2024-01-09 17:13:42 [1,636ms] [Error] [gpu.foundation.plugin] carb::graphics::createInstance failed.
2024-01-09 17:13:42 [1,654ms] [Error] [omni.gpu_foundation_factory.plugin] Failed to create any GPU devices, including an attempt with compatibility mode.
sh: 1: zenity: not found
[1.674s] [ext: omni.kit.pipapi-0.0.0] startup
[1.678s] [ext: omni.kit.pip_archive-0.0.0] startup
[1.679s] [ext: omni.kit.loop-default-0.2.0] startup
[1.679s] [ext: omni.kit.test-0.0.0] startup
[1.970s] [ext: omni.services.pip_archive-0.13.1] startup
[1.971s] [ext: omni.kit.telemetry-0.5.0] startup
[1.982s] [ext: omni.pip.compute-1.2.0] startup
[1.982s] [ext: omni.mtlx-0.1.0] startup
[1.983s] [ext: omni.usd.config-1.0.3] startup
[1.988s] [ext: omni.gpucompute.plugins-0.0.0] startup
[1.989s] [ext: omni.usd.libs-1.0.0] startup
[2.065s] [ext: omni.pip.torch-2_0_1-2.0.2] startup
[2.066s] [ext: omni.pip.cloud-1.0.1] startup
[2.097s] [ext: omni.isaac.core_archive-2.2.1] startup
[2.097s] [ext: omni.usd.schema.audio-0.0.0] startup
[2.248s] [ext: omni.usd.schema.semantics-0.0.0] startup
[2.258s] [ext: omni.usd_resolver-1.0.1] startup
[2.262s] [ext: omni.iray.libs-0.0.0] startup
[2.267s] [ext: omni.volume-0.4.0] startup
[2.269s] [ext: omni.usd.core-1.1.8] startup
[2.273s] [ext: omni.mdl.neuraylib-0.2.0] startup
[2.274s] [ext: omni.hydra.rtx-0.1.0] startup
[2.284s] [ext: omni.hydra.iray-0.1.0] startup
[2.288s] [ext: omni.isaac.ml_archive-1.1.3] startup
[2.288s] [ext: omni.appwindow-1.1.5] startup
2024-01-09 17:13:42 [2,270ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-01-09 17:13:42 [2,270ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[2.291s] [ext: omni.kit.renderer.core-0.0.0] startup
2024-01-09 17:13:42 [2,273ms] [Error] [omni.kit.renderer.plugin] GPU Foundation is not initialized!
2024-01-09 17:13:42 [2,275ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-01-09 17:13:42 [2,275ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[2.295s] [ext: omni.kit.renderer.capture-0.0.0] startup
[2.297s] [ext: omni.kit.renderer.imgui-0.0.0] startup
2024-01-09 17:13:42 [2,281ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-01-09 17:13:42 [2,281ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-01-09 17:13:42 [2,282ms] [Error] [omni.kit.imgui_renderer.plugin] _prepareDefaultWindow: invalid device attached to the default window!
[2.303s] [ext: omni.ui-2.18.5] startup
[2.323s] [ext: carb.audio-0.1.0] startup
[2.327s] [ext: omni.uiaudio-1.0.0] startup
[2.328s] [ext: omni.kit.mainwindow-1.0.1] startup
[2.330s] [ext: omni.kit.uiapp-0.0.0] startup
[2.330s] [ext: omni.usd.schema.metrics.assembler-105.1.2] startup
[2.337s] [ext: omni.usd.schema.physics-0.0.0] startup
[2.361s] [ext: omni.usd.schema.scene.visualization-2.0.2] startup
[2.363s] [ext: omni.usd.schema.destruction-0.7.0] startup
[2.367s] [ext: omni.usd.schema.physx-0.0.0] startup
[2.398s] [ext: omni.usd.fileformat.sbsar-105.0.5] startup
[2.407s] [ext: omni.usd.schema.omnigraph-1.0.0] startup
[2.413s] [ext: omni.anim.navigation.schema-105.2.0] startup
[2.417s] [ext: omni.usd.schema.forcefield-0.0.0] startup
[2.423s] [ext: omni.anim.graph.schema-105.2.2] startup
[2.431s] [ext: omni.usd.schema.isaac-2.0.1] startup
[2.438s] [ext: omni.schema.audio.boom-0.4.0] startup
[2.441s] [ext: omni.usd.schema.flow-105.1.18] startup
[2.442s] [ext: omni.usd.schema.anim-0.0.0] startup
[2.459s] [ext: omni.usd.schema.geospatial-0.0.0] startup
[2.462s] [ext: omni.usd.schema.omniscripting-1.0.0] startup
[2.466s] [ext: omni.kit.actions.core-1.0.0] startup
[2.469s] [ext: omni.kit.commands-1.4.6] startup
[2.481s] [ext: omni.kit.window.popup_dialog-2.0.23] startup
[2.492s] [ext: omni.graph.exec-0.3.0] startup
[2.493s] [ext: omni.kit.widget.nucleus_connector-1.1.4] startup
[2.502s] [ext: omni.kit.exec.core-0.5.0] startup
[2.504s] [ext: omni.resourcemonitor-105.0.0] startup
[2.506s] [ext: omni.kit.audiodeviceenum-1.0.1] startup
[2.507s] [ext: omni.hydra.usdrt_delegate-7.2.34] startup
[2.520s] [ext: omni.timeline-1.0.9] startup
[2.522s] [ext: omni.hydra.scene_delegate-0.3.2] startup
[2.529s] [ext: omni.usd-1.10.18] startup
[2.635s] [ext: omni.potree_converter-1.0.3] startup
[2.641s] [ext: omni.usd.fileformat.e57-1.1.4] startup
[2.641s] [ext: omni.usd.schema.sequence-2.3.0] startup
[2.648s] [ext: omni.kit.asset_converter-2.0.18] startup
[2.670s] [ext: omni.kit.collaboration.telemetry-1.0.0] startup
[2.672s] [ext: omni.kit.collaboration.channel_manager-1.0.11] startup
[2.677s] [ext: omni.kit.usd.layers-2.1.27] startup
[2.712s] [ext: omni.kit.menu.utils-1.5.6] startup
[2.740s] [ext: omni.kit.menu.create-1.0.11] startup
[2.744s] [ext: omni.kit.context_menu-1.6.8] startup
[2.758s] [ext: omni.kit.widget.toolbar-1.5.6] startup
[2.780s] [ext: omni.debugdraw-0.1.2] startup
[2.785s] [ext: omni.kit.helper.file_utils-0.1.6] startup
[2.846s] [ext: omni.kit.widget.nucleus_info-1.0.2] startup
[2.848s] [ext: omni.kit.widget.filebrowser-2.3.35] startup
[2.879s] [ext: omni.kit.search_core-1.0.5] startup
[2.881s] [ext: omni.kit.widget.path_field-2.0.8] startup
[2.886s] [ext: omni.kit.widget.search_delegate-1.0.4] startup
[2.890s] [ext: omni.kit.widget.browser_bar-2.0.9] startup
[2.894s] [ext: omni.kit.notification_manager-1.0.6] startup
[2.899s] [ext: omni.ui.scene-1.7.0] startup
[2.906s] [ext: omni.kit.widget.versioning-1.4.6] startup
[2.917s] [ext: omni.kit.clipboard-1.0.3] startup
[2.919s] [ext: omni.kit.widget.searchfield-1.1.3] startup
[2.925s] [ext: omni.kit.window.filepicker-2.10.13] startup
[3.008s] [ext: omni.mdl-0.2.1] startup
[3.200s] [ext: omni.kit.window.file_importer-1.0.22] startup
[3.205s] [ext: omni.hydra.pxr-1.1.6] startup
[3.210s] [ext: omni.kit.viewport.legacy_gizmos-1.0.14] startup
[3.213s] [ext: omni.kit.material.library-1.3.41] startup
[3.240s] [ext: omni.hydra.engine.stats-1.0.1] startup
[3.244s] [ext: omni.kit.hydra_texture-1.1.12] startup
[3.249s] [ext: omni.kit.window.drop_support-1.0.1] startup
[3.250s] [ext: omni.kit.viewport.registry-104.0.5] startup
[3.252s] [ext: omni.kit.widget.viewport-105.1.7] startup
[3.273s] [ext: usdrt.scenegraph-7.2.34] startup
[3.326s] [ext: omni.kit.usd_undo-0.1.2] startup
[3.327s] [ext: omni.kit.viewport.window-105.1.12] startup
[3.387s] [ext: omni.anim.navigation.core-105.1.4] startup
[3.396s] [ext: omni.kit.primitive.mesh-1.0.15] startup
[3.413s] [ext: omni.kit.widget.zoombar-1.0.5] startup
[3.415s] [ext: omni.kit.stage_templates-1.1.20] startup
[3.422s] [ext: omni.kit.browser.core-2.3.10] startup
[3.440s] [ext: omni.inspect-1.0.1] startup
[3.442s] [ext: omni.kit.window.file_exporter-1.0.22] startup
[3.445s] [ext: omni.graph.core-2.139.12] startup
[3.449s] [ext: omni.kit.window.file-1.3.44] startup
[3.464s] [ext: omni.kit.browser.folder.core-1.9.7] startup
[3.493s] [ext: omni.graph.tools-1.41.3] startup
[3.592s] [ext: omni.anim.retarget.core-105.1.7] startup
[3.610s] [ext: omni.graph-1.106.1] startup
[4.003s] [ext: omni.kit.browser.sample-1.4.6] startup
[4.008s] [ext: omni.kit.widget.searchable_combobox-1.0.5] startup
[4.013s] [ext: omni.kit.widget.options_menu-1.0.5] startup
[4.018s] [ext: omni.kit.widget.settings-1.0.6] startup
[4.030s] [ext: omni.kit.widget.prompt-1.0.6] startup
[4.034s] [ext: omni.kit.collaboration.presence_layer-1.0.8] startup
[4.044s] [ext: omni.kit.widget.graph-1.8.4] startup
[4.082s] [ext: omni.kit.widget.filter-1.1.2] startup
[4.085s] [ext: omni.kit.window.preferences-1.3.23] startup
[4.110s] [ext: omni.kit.widget.live_session_management-1.2.22] startup
[4.134s] [ext: omni.kit.window.extensions-1.3.0] startup
[4.174s] [ext: omni.kit.widget.text_editor-1.0.2] startup
[4.177s] [ext: omni.kit.window.content_browser_registry-0.0.1] startup
[4.180s] [ext: omni.kit.widget.highlight_label-1.0.1] startup
[4.182s] [ext: omni.kit.hotkeys.core-1.3.0] startup
[4.198s] [ext: omni.kit.window.content_browser-2.7.17] startup
[4.223s] [ext: omni.kit.window.property-1.9.6] startup
[4.233s] [ext: omni.kit.widget.stage-2.9.6] startup
[4.278s] [ext: omni.kit.viewport.utility-1.0.16] startup
[4.285s] [ext: omni.ui_query-1.1.1] startup
[4.288s] [ext: omni.kit.property.usd-3.21.15] startup
[4.402s] [ext: omni.kit.graph.delegate.modern-1.9.1] startup
[4.417s] [ext: omni.graph.ui-1.48.0] startup
[4.523s] [ext: omni.kvdb-0.0.0] startup
[4.526s] [ext: omni.kit.window.cursor-1.1.2] startup
[4.528s] [ext: omni.physx.foundation-105.1.12-5.1] startup
[4.529s] [ext: omni.localcache-0.0.0] startup
[4.531s] [ext: omni.kit.widget.spinner-1.0.6] startup
[4.535s] [ext: omni.convexdecomposition-105.1.12-5.1] startup
[4.541s] [ext: omni.usdphysics-105.1.12-5.1] startup
[4.544s] [ext: omni.kit.viewport.menubar.core-105.0.19] startup
[4.619s] [ext: omni.kit.viewport.actions-105.1.6] startup
[4.633s] [ext: omni.physx.cooking-105.1.12-5.1] startup
[4.642s] [ext: omni.kit.viewport.menubar.display-105.1.0] startup
[4.647s] [ext: omni.kit.manipulator.selector-1.0.1] startup
[4.651s] [ext: omni.kit.widget.imageview-1.0.3] startup
[4.652s] [ext: omni.curve.creator-105.0.3] startup
[4.655s] [ext: omni.kit.widget.stage_icons-1.0.4] startup
[4.657s] [ext: omni.kit.window.quicksearch-2.4.1] startup
[4.669s] [ext: omni.kit.graph.delegate.default-1.1.1] startup
[4.670s] [ext: omni.kit.window.stage-2.4.4] startup
[4.678s] [ext: omni.kit.raycast.query-1.0.1] startup
[4.688s] [ext: omni.kit.manipulator.transform-104.6.15] startup
[4.692s] [ext: omni.kit.graph.editor.core-1.5.1] startup
[4.707s] [ext: omni.kit.manipulator.viewport-104.0.9] startup
[4.712s] [ext: omni.scene.visualization.core-105.4.10] startup
2024-01-09 17:13:45 [4,696ms] [Warning] [omni.stageupdate.plugin] Deprecated: direct use of IStageUpdate callbacks is deprecated. Use IStageUpdate::getStageUpdate instead.
[4.901s] [ext: omni.kit.manipulator.tool.snap-1.4.2] startup
[4.935s] [ext: omni.kit.graph.widget.variables-2.1.0] startup
[4.942s] [ext: omni.kit.graph.usd.commands-1.3.0] startup
[4.946s] [ext: omni.curve.manipulator-105.1.8] startup
[5.016s] [ext: omni.graph.window.core-1.84.0] startup
[5.091s] [ext: omni.physx-105.1.12-5.1] startup
[5.113s] [ext: omni.anim.navigation.ui-105.1.4] startup
[5.130s] [ext: omni.anim.skelJoint-105.1.16] startup
[5.154s] [ext: omni.graph.window.generic-1.9.3] startup
[5.164s] [ext: omni.importer.mjcf-1.1.0] startup
[5.185s] [ext: omni.anim.navigation.bundle-105.1.0] startup
[5.188s] [ext: omni.anim.retarget.ui-105.1.4] startup
[5.223s] [ext: omni.activity.usd_resolver-1.0.1] startup
[5.225s] [ext: omni.activity.pump-1.0.0] startup
[5.226s] [ext: omni.importer.urdf-1.6.1] startup
[5.308s] [ext: omni.anim.retarget.bundle-105.1.1] startup
[5.311s] [ext: omni.activity.ui-1.0.27] startup
[5.341s] [ext: omni.kit.streamsdk.plugins-2.5.2] startup
[5.341s] [ext: omni.kit.menu.stage-1.2.3] startup
[5.346s] [ext: omni.graph.nodes-1.106.3] startup
[6.015s] [ext: omni.physics.tensors-0.1.0] startup
[6.036s] [ext: omni.kit.numpy.common-0.1.2] startup
[6.039s] [ext: omni.physx.tensors-0.1.0] startup
[6.044s] [ext: omni.isaac.version-1.0.3] startup
[6.046s] [ext: omni.warp.core-1.0.0-beta.2] startup
Warp 1.0.0-beta.2 initialized:
   CUDA Toolkit: 11.5, Driver: 12.3
   Devices:
     "cpu"    | x86_64
     "cuda:0" | NVIDIA GeForce RTX 3090 (sm_86)
   Kernel cache: /storage/homefs/ld20d359/.cache/warp/1.0.0-beta.2
[6.330s] [ext: omni.isaac.dynamic_control-1.2.6] startup
[6.359s] [ext: omni.kit.ui_test-1.2.13] startup
[6.366s] [ext: omni.isaac.core-3.3.2] startup
[10.440s] [ext: omni.graph.visualization.nodes-2.1.1] startup
[10.465s] [ext: omni.graph.action-1.55.1] startup
[10.574s] [ext: omni.kit.usd.collect-2.2.6] startup
[10.587s] [ext: omni.isaac.ui-0.13.5] startup
[10.627s] [ext: omni.kit.tool.collect-2.2.3] startup
[10.638s] [ext: omni.isaac.articulation_inspector-0.1.6] startup
[10.648s] [ext: omni.isaac.asset_browser-0.4.3] startup
[10.655s] [ext: omni.anim.shared.core-105.8.2] startup
[10.681s] [ext: omni.kit.widget.material_preview-1.0.8] startup
[10.689s] [ext: omni.graph.image.core-0.1.0] startup
[10.690s] [ext: omni.kit.window.material_graph-1.8.11] startup
[10.830s] [ext: omni.graph.scriptnode-1.1.6] startup
[10.846s] [ext: omni.warp-1.0.0-beta.2] startup
[10.980s] [ext: omni.syntheticdata-0.4.10] startup
[11.065s] [ext: omni.command.usd-1.0.2] startup
[11.074s] [ext: omni.isaac.debug_draw-0.6.1] startup
2024-01-09 17:13:51 [11,064ms] [Warning] [omni.stageupdate.plugin] Deprecated: direct use of IStageUpdate callbacks is deprecated. Use IStageUpdate::getStageUpdate instead.
2024-01-09 17:13:51 [11,064ms] [Warning] [omni.stageupdate.plugin] Deprecated: direct use of IStageUpdate callbacks is deprecated. Use IStageUpdate::getStageUpdate instead.
[11.097s] [ext: omni.replicator.core-1.10.20] startup
2024-01-09 17:13:51 [11,174ms] [Warning] [omni.replicator.core.scripts.annotators] Annotator PostProcessDispatch is already registered, overwriting annotator template
[12.733s] [ext: omni.sensors.nv.wpm-1000.0.0-isaacsim.2023.1.1] startup
[12.734s] [ext: omni.sensors.nv.materials-1000.0.0-isaacsim.2023.1.1] startup
2024-01-09 17:13:53 [12,715ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.materials-1000.0.0-isaacsim.2023.1.1] Native plugin search dir contains several files: /isaac-sim/extscache/omni.sensors.nv.materials-1000.0.0-isaacsim.2023.1.1+lx64.r/bin . It makes dir walk slow, replace with the exact path to the plugin instead of a wildcard.
[12.735s] [ext: omni.sensors.nv.common-1000.0.0-isaacsim.2023.1.1] startup
[12.744s] [ext: omni.anim.curve-105.23.0] startup
[12.789s] [ext: omni.sensors.nv.radar-1000.0.0-isaacsim.2023.1.1] startup
[12.794s] [ext: omni.sensors.nv.lidar-1000.0.1-isaacsim.2023.1.1] startup
[12.800s] [ext: omni.isaac.range_sensor-2.0.2] startup
[12.917s] [ext: omni.isaac.core_nodes-1.7.1] startup
[13.020s] [ext: omni.anim.timeline-105.0.15] startup
[13.029s] [ext: omni.isaac.sensor-9.11.1] startup
[13.230s] [ext: omni.kit.collaboration.selection_outline-1.0.6] startup
[13.238s] [ext: omni.isaac.camera_inspector-0.2.1] startup
[13.245s] [ext: omni.anim.curve.ui-1.3.1] startup
[13.256s] [ext: omni.kit.renderer.cuda_interop-1.0.1] startup
[13.259s] [ext: omni.anim.curve.bundle-1.2.0] startup
[13.259s] [ext: omni.kit.livestream.core-2.3.0] startup
[13.261s] [ext: omni.isaac.mjcf-1.0.0] startup
2024-01-09 17:13:53 [13,242ms] [Warning] [omni.isaac.mjcf] The extension omni.isaac.mjcf has been deprecated. Please use omni.importer.mjcf instead.
[13.262s] [ext: omni.isaac.lula-2.1.0] startup
[13.271s] [ext: omni.isaac.occupancy_map-0.3.2] startup
[13.300s] [ext: omni.isaac.physics_inspector-0.1.4] startup
[13.317s] [ext: omni.isaac.physics_utilities-0.1.2] startup
[13.329s] [ext: omni.isaac.robot_assembler-1.1.4] startup
[13.341s] [ext: omni.isaac.robot_description_editor-2.1.3] startup
[13.411s] [ext: omni.isaac.scene_blox-0.1.0] startup
[13.414s] [ext: omni.isaac.synthetic_recorder-1.7.0] startup
[13.427s] [ext: omni.isaac.throttling-1.0.0] startup
[13.431s] [ext: omni.isaac.unit_converter-0.1.7] startup
[13.438s] [ext: omni.kit.widget.calendar-1.0.8] startup
[13.442s] [ext: omni.isaac.urdf-1.1.0] startup
2024-01-09 17:13:54 [13,424ms] [Warning] [omni.isaac.urdf] The extension omni.isaac.urdf has been deprecated. Please use omni.importer.urdf instead.
[13.443s] [ext: omni.isaac.utils-0.6.0] startup
[13.462s] [ext: omni.isaac.diff_usd-1.0.1] startup
[13.470s] [ext: omni.isaac.surface_gripper-0.7.0] startup
[13.497s] [ext: omni.kit.ngsearch-0.3.0] startup
[13.501s] [ext: omni.kit.widget.extended_searchfield-1.0.26] startup
[13.539s] [ext: omni.isaac.window.about-1.1.0] startup
[13.544s] [ext: omni.kit.browser.asset-1.3.6] startup
[13.551s] [ext: omni.flowusd-105.1.45] startup
2024-01-09 17:13:54 [13,536ms] [Warning] [omni.stageupdate.plugin] Deprecated: direct use of IStageUpdate callbacks is deprecated. Use IStageUpdate::getStageUpdate instead.
[13.563s] [ext: omni.isaac.manipulators-1.1.0] startup
[13.573s] [ext: omni.isaac.motion_generation-6.1.0] startup
[13.615s] [ext: omni.kit.browser.deepsearch-1.1.8] startup
[13.622s] [ext: omni.kit.window.imageviewer-1.0.7] startup
[13.630s] [ext: omni.kit.collaboration.stage_columns-1.0.4] startup
[13.639s] [ext: omni.flowusd.ui-105.2.2] startup
[13.665s] [ext: omni.kit.viewport.menubar.camera-105.1.9] startup
[13.687s] [ext: omni.isaac.franka-0.4.0] startup
[13.692s] [ext: omni.kit.converter.common-200.1.0-rc.4] startup
[13.696s] [ext: omni.vdb_timesample_editor-0.1.8] startup
[13.702s] [ext: omni.slangnode-105.2.2] startup
[13.727s] [ext: omni.kit.widget.timeline-105.0.1] startup
[13.746s] [ext: omni.kit.collaboration.viewport.camera-2.0.17] startup
[13.760s] [ext: omni.isaac.cortex-0.3.5] startup
[13.763s] [ext: omni.kit.converter.jt_core-200.1.0-rc.14] startup
[13.787s] [ext: omni.kit.converter.cad_core-200.1.0-rc.22] startup
[13.800s] [ext: omni.flowusd.bundle-1.0.2] startup
[13.800s] [ext: omni.anim.curve_editor-105.16.0] startup
^[[C[14.125s] [ext: omni.isaac.dofbot-0.3.1] startup
[14.130s] [ext: omni.isaac.cortex.sample_behaviors-1.0.4] startup
[14.134s] [ext: omni.isaac.universal_robots-0.3.3] startup
[14.139s] [ext: omni.isaac.quadruped-1.4.1] startup
[14.185s] [ext: omni.kit.tool.asset_importer-2.4.28] startup
[14.204s] [ext: omni.kit.mesh.raycast-105.3.1] startup
[14.211s] [ext: omni.isaac.wheeled_robots-0.9.0] startup
[14.279s] [ext: omni.kit.actions.window-1.1.0] startup
[14.289s] [ext: usdrt.gf-1.0.2] startup
[14.289s] [ext: omni.isaac.examples-1.7.13] startup
[14.595s] [ext: omni.kit.converter.cad-200.1.0-rc.18] startup
[14.605s] [ext: omni.ramp-105.1.14] startup
[14.622s] [ext: omni.kit.hotkeys.window-1.4.1] startup
[14.645s] [ext: omni.kit.manipulator.tool.mesh_snap-1.4.4] startup
[14.670s] [ext: omni.rtx.window.settings-0.6.9] startup
[14.685s] [ext: omni.graph.io-1.5.1] startup
2024-01-09 17:13:55 [14,670ms] [Warning] [carb] Acquiring non optional plugin interface which is not listed as dependency: [omni::fabric::IFabricUsd v0.2] (plugin: <default plugin>), by client: omni.graph.io.plugin. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client.
[14.702s] [ext: omni.genproc.core-105.1.5] startup
[14.728s] [ext: omni.kit.widget.layers-1.6.32] startup
[14.807s] [ext: omni.kit.selection-0.1.3] startup
[14.812s] [ext: omni.isaac.examples_nodes-0.1.2] startup
[14.830s] [ext: omni.kit.viewport.rtx-104.0.0] startup
[14.830s] [ext: omni.genproc.ui-105.1.0] startup
[14.845s] [ext: omni.kit.menu.aov-1.1.3] startup
[14.849s] [ext: omni.kit.menu.edit-1.1.14] startup
[14.860s] [ext: omni.isaac.extension_templates-1.5.1] startup
[14.866s] [ext: omni.kit.thumbnails.mdl-1.0.23] startup
[14.873s] [ext: omni.genproc.bundle-105.1.0] startup
[14.874s] [ext: omni.activity.freeze_monitor-1.0.3] startup
[14.882s] [ext: omni.kit.browser.material-1.4.4] startup
[14.893s] [ext: omni.kit.menu.file-1.1.7] startup
[14.898s] [ext: omni.kit.pointclouds-1.1.2] startup
[14.914s] [ext: omni.isaac.gain_tuner-0.1.3] startup
[14.921s] [ext: omni.kit.quicksearch.hdri-0.8.12] startup
[14.925s] [ext: omni.kit.quicksearch.material-0.8.12] startup
[14.930s] [ext: omni.kit.quicksearch.menu-0.8.7] startup
[14.933s] [ext: omni.kit.quicksearch.props-0.8.7] startup
[14.937s] [ext: omni.kit.quicksearch.select-0.8.3] startup
[14.940s] [ext: omni.kit.stagerecorder.core-105.0.4] startup
[14.949s] [ext: omni.mdl.usd_converter-1.0.9] startup
[14.972s] [ext: omni.kit.quicksearch.settings-0.8.6] startup
[14.975s] [ext: omni.kit.scripting-105.1.3] startup
[14.997s] [ext: omni.kit.search.files-1.0.4] startup
[15.000s] [ext: omni.kit.search.service-0.1.11] startup
[15.408s] [ext: omni.kit.stage.copypaste-1.2.2] startup
[15.415s] [ext: omni.kit.stagerecorder.ui-105.0.4] startup
[15.430s] [ext: omni.kit.stage.mdl_converter-1.0.4] startup
[15.433s] [ext: omni.kit.usd_presenter.conn.manager-0.1.4] startup
[15.435s] [ext: omni.kit.widgets.custom-1.0.6] startup
[15.477s] [ext: omni.kit.property.layer-1.1.5] startup
[15.486s] [ext: omni.kit.stage_column.payload-1.0.12] startup
[15.491s] [ext: omni.kit.stage_column.variant-1.0.13] startup
[15.497s] [ext: omni.kit.stagerecorder.bundle-105.0.2] startup
[15.497s] [ext: omni.kit.profiler.window-2.1.2] startup
2024-01-09 17:13:56 [15,501ms] [Warning] [omni.kit.profiler.window] remove _SpanInstance.__lt__ and use insort 'key' arg instead
[15.524s] [ext: omni.kit.thumbnails.usd-1.0.3] startup
[15.670s] [ext: omni.kit.playlist.core-1.3.1] startup
[15.682s] [ext: omni.kit.property.audio-1.0.9] startup
[15.688s] [ext: omni.hydra.scene_api-0.1.2] startup
[15.697s] [ext: omni.kit.property.camera-1.0.5] startup
[15.702s] [ext: omni.kit.property.geometry-1.2.11] startup
[15.714s] [ext: omni.kit.property.light-1.0.8] startup
[15.719s] [ext: omni.kit.property.material-1.8.36] startup
[15.736s] [ext: omni.kit.property.render-1.1.1] startup
[15.740s] [ext: omni.kit.property.skel-1.0.4] startup
[15.748s] [ext: omni.kit.property.transform-1.3.10] startup
[15.776s] [ext: omni.kit.prim.icon-1.0.11] startup
[15.783s] [ext: omni.kit.tool.asset_exporter-1.2.12] startup
[15.795s] [ext: omni.kit.manipulator.camera-105.0.4] startup
[15.817s] [ext: omni.kit.manipulator.prim-105.0.11] startup
[15.843s] [ext: omni.kit.viewport.menubar.render-105.1.1] startup
[15.855s] [ext: omni.kit.tool.remove_unused.core-0.1.1] startup
[15.857s] [ext: omni.kit.property.bundle-1.2.9] startup
[15.862s] [ext: omni.kit.waypoint.core-1.4.45] startup
[15.893s] [ext: omni.kit.window.material-1.4.0] startup
[15.915s] [ext: omni.kit.viewport.menubar.settings-105.0.9] startup
[15.968s] [ext: omni.kit.core.collection-0.1.6] startup
[15.974s] [ext: omni.kit.variant.editor-105.1.7] startup
[16.062s] [ext: omni.kit.manipulator.selection-104.0.8] startup
[16.067s] [ext: omni.kit.tool.measure-105.1.76] startup
2024-01-09 17:13:56 [16,158ms] [Warning] [omni.kit.tool.measure.interface._widgets] Vertex, Edge and Mid Point snap requires `/rtx-transient/scenedb/useUniformsReindexing` setting to be true
[16.197s] [ext: omni.kit.waypoint.playlist-1.0.7] startup
[16.203s] [ext: omni.kit.tool.remove_unused.controller-0.1.3] startup
[16.207s] [ext: omni.hydra.pxr.settings-1.0.5] startup
[16.211s] [ext: omni.kit.usda_edit-1.1.11] startup
[16.237s] [ext: omni.kit.variant.presenter-105.1.1] startup
[16.253s] [ext: omni.kit.viewport.bundle-104.0.1] startup
[16.253s] [ext: omni.kit.viewport.menubar.lighting-105.0.7] startup
[16.268s] [ext: omni.kit.viewport.menubar.waypoint-104.2.16] startup
[16.278s] [ext: omni.services.facilities.base-1.0.4] startup
[16.279s] [ext: omni.kit.viewport.pxr-104.0.1] startup
[16.279s] [ext: omni.kit.widget.live-2.1.6] startup
[16.284s] [ext: omni.kit.widget.collection-0.1.16] startup
[16.300s] [ext: omni.kit.viewport.ready-1.0.5] startup
[16.302s] [ext: omni.kit.viewport_widgets_manager-1.0.8] startup
[16.308s] [ext: omni.kit.waypoint.bundle-1.0.4] startup
[16.308s] [ext: omni.services.core-1.6.4] startup
[16.489s] [ext: omni.services.transport.client.base-1.2.4] startup
[16.491s] [ext: omni.kit.widget.cache_indicator-2.0.8] startup
2024-01-09 17:13:57 [16,476ms] [Warning] [omni.kit.widget.cache_indicator.cache_state_menu] Unable to detect Omniverse Cache Server. File /storage/homefs/ld20d359/.nvidia-omniverse/config/omniverse.toml is not found. Consider installing it for better IO performance.
[16.496s] [ext: omni.kit.window.collection-0.1.17] startup
[16.501s] [ext: omni.isaac.cloner-0.7.2] startup
[16.505s] [ext: omni.kit.window.commands-0.2.4] startup
[16.511s] [ext: omni.kit.window.console-0.2.10] startup
[16.525s] [ext: omni.physx.commands-105.1.12-5.1] startup
[16.547s] [ext: omni.services.client-0.5.3] startup
[16.551s] [ext: omni.iray.settings.core-0.6.4] startup
[16.560s] [ext: omni.kit.property.collection-0.1.15] startup
[16.563s] [ext: omni.isaac.gym-0.10.0] startup
[16.565s] [ext: omni.graph.examples.cpp-1.9.3] startup
[16.595s] [ext: omni.kit.capture.viewport-1.3.7] startup
[16.615s] [ext: omni.rtx.settings.core-0.5.13] startup
[16.638s] [ext: omni.services.transport.client.http_async-1.3.6] startup
[16.642s] [ext: omni.usdphysics.ui-105.1.12-5.1] startup
[16.695s] [ext: omni.kit.sequencer.usd-103.4.0] startup
2024-01-09 17:13:57 [16,681ms] [Warning] [pxr.AudioSchema] pxr.AudioSchema is deprecated - please use pxr.OmniAudioSchema instead
[16.705s] [ext: semantics.schema.property-1.0.2] startup
[16.710s] [ext: omni.kit.preferences.animation-1.1.0] startup
[16.719s] [ext: omni.kit.window.movie_capture-2.3.9] startup
[16.762s] [ext: omni.physx.ui-105.1.12-5.1] startup
[16.851s] [ext: omni.kit.property.sequence-0.3.0] startup
[16.857s] [ext: omni.kit.sequencer.core-103.4.0] startup
[16.869s] [ext: omni.anim.widget.timeline-0.1.8] startup
[16.896s] [ext: omni.kit.window.privacy-0.1.0] startup
[16.898s] [ext: omni.kit.property.physx-0.1.0] startup
[16.962s] [ext: omni.physx.demos-105.1.12-5.1] startup
[16.986s] [ext: omni.kit.window.script_editor-1.7.4] startup
[16.992s] [ext: omni.kit.window.sequencer-103.4.2-dev.3] startup
[17.081s] [ext: omni.kit.compatibility_checker-0.1.1] startup
[17.085s] [ext: omni.kit.window.toolbar-1.5.4] startup
[17.090s] [ext: omni.physx.camera-105.1.12-5.1] startup
[17.103s] [ext: omni.particle.system.core-105.1.6] startup
2024-01-09 17:13:57 [17,090ms] [Warning] [omni.particle.system.core.scripts.extension] 
            ATTENTION!: omni.particle.system.core is currently undergoing extensive (breaking) changes.
            Please be aware that systems built with the existing extension will need to be rebuilt in
            the USD Composer 2023.2 release.
[17.125s] [ext: omni.physx.cct-105.1.12-5.1] startup
[17.176s] [ext: omni.physx.graph-105.1.12-5.1] startup
[17.191s] [ext: omni.physx.supportui-105.1.12-5.1] startup
[17.230s] [ext: omni.physx.vehicle-105.1.12-5.1] startup
[17.284s] [ext: omni.graph.window.particle.system-105.1.18] startup
DYNAMICS_TODO:
  Make sure "omni.particle.system.core2" is a proper dependency.
  For now, it can just be set to autoload.
DYNAMICS_TODO:
  Make sure "omni.particle.system.core2" is a proper dependency.
  For now, it can just be set to autoload.
[17.312s] [ext: omni.graph.ui_nodes-1.5.10] startup
[17.444s] [ext: omni.particle.system.ui-105.1.10] startup
[17.470s] [ext: omni.kit.window.status_bar-0.1.6] startup
[17.476s] [ext: omni.scene.optimizer.core-105.1.8] startup
[17.487s] [ext: omni.physx.bundle-105.1.12-5.1] startup
[17.487s] [ext: omni.kit.window.usd_paths-1.0.5] startup
[17.494s] [ext: omni.graph.bundle.action-2.0.4] startup
[17.494s] [ext: omni.particle.system.bundle-105.1.0] startup
[17.494s] [ext: omni.physx.zerogravity-105.1.12-5.1] startup
2024-01-09 17:13:58 [17,486ms] [Warning] [omni.kit.app._impl] "import omni.kit.window.toolbar.builtin_tools.models.setting_model" is deprecated. Please use "import omni.kit.widget.toolbar.builtin_tools.models.setting_model"
2024-01-09 17:13:58 [17,486ms] [Warning] [omni.kit.app._impl] "import omni.kit.window.toolbar.hotkey" is deprecated. Please use "import omni.kit.widget.toolbar.hotkey"
2024-01-09 17:13:58 [18,146ms] [Warning] [omni.kit.app._impl] Imported from /isaac-sim/extsPhysics/omni.physx.zerogravity-105.1.12-5.1/omni/physxzerogravity/scripts/toolbar_button.py
2024-01-09 17:13:58 [18,147ms] [Warning] [omni.kit.app._impl] "import omni.kit.window.toolbar.widget_group" is deprecated. Please use "import omni.kit.widget.toolbar.widget_group"
2024-01-09 17:13:59 [18,414ms] [Warning] [omni.kit.app._impl] Imported from /isaac-sim/extsPhysics/omni.physx.zerogravity-105.1.12-5.1/omni/physxzerogravity/scripts/toolbar_button.py
[18.458s] [ext: omni.scene.optimizer.ui-105.1.3] startup
[18.485s] [ext: omni.replicator.composer-1.2.17] startup
[18.554s] [ext: omni.scene.visualization.ui-105.1.1] startup
[18.630s] [ext: omni.replicator.isaac-1.11.3] startup
[18.783s] [ext: omni.replicator.replicator_yaml-2.0.4] startup
[18.835s] [ext: omni.services.transport.server.base-1.1.1] startup
[18.837s] [ext: omni.scene.optimizer.bundle-105.1.8] startup
[18.837s] [ext: omni.kit.property.isaac-0.2.2] startup
[18.844s] [ext: omni.scene.visualization.bundle-105.1.0] startup
[18.844s] [ext: omni.kit.property.sbsar-105.0.5] startup
[18.859s] [ext: omni.isaac.kit-1.4.7] startup
[18.863s] [ext: omni.services.starfleet.auth-0.1.5] startup
[18.874s] [ext: omni.services.transport.server.http-1.3.0] startup
[18.959s] [ext: omni.services.usd-1.1.0] startup
[18.963s] [ext: omni.usd.metrics.assembler-105.1.8] startup
[18.973s] [ext: omni.simready.explorer-1.0.26] startup
[19.000s] [ext: omni.tools.array-105.0.4] startup
[19.036s] [ext: omni.tools.distribute-105.0.4] startup
[19.066s] [ext: omni.anim.graph.core-105.1.15] startup
[19.113s] [ext: omni.tools.pivot-105.0.3] startup
[19.146s] [ext: omni.tools.randomizer-105.0.2] startup
[19.184s] [ext: omni.usd.metrics.assembler.ui-105.1.17] startup
[19.198s] [ext: omni.kit.quicksearch.actions-0.8.11] startup
[19.204s] [ext: omni.kit.menu.common-1.1.4] startup
[19.209s] [ext: omni.kit.quicklayout-1.0.5] startup
[19.213s] [ext: omni.anim.graph.ui-105.1.3] startup
[19.287s] [ext: omni.kit.window.title-1.1.3] startup
2024-01-09 17:13:59 [19,270ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-01-09 17:13:59 [19,270ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-01-09 17:13:59 [19,272ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-01-09 17:13:59 [19,272ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[19.293s] [ext: semantics.schema.editor-0.3.4] startup
[19.302s] [ext: omni.isaac.onshape-0.7.0] startup
[21.272s] [ext: omni.kit.quicksearch.commands-1.1.3] startup
[21.276s] [ext: omni.isaac.merge_mesh-0.1.4] startup
[21.288s] [ext: omni.graph.window.action-1.11.2] startup
[21.301s] [ext: omni.anim.graph.bundle-105.1.1] startup
[21.305s] [ext: omni.isaac.app.setup-0.11.2] startup
2024-01-09 17:14:01 [21,291ms] [Warning] [omni.kit.app._impl] carb.imgui is deprecated. Use omni.kit.imgui instead.
[21.311s] Isaac Sim Headless Native Version: 2023.1.1-rc.8
2024-01-09 17:14:02 [0ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash] A crash has occurred.  If a debugger should be attached, please set the '/crashreporter/debuggerAttachTimeoutMs' setting to a timeout in milliseconds.  This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2024-01-09 17:14:02 [113ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash] compressing 3 files into '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/901cffd3-f912-4be2-aa15a6a2-7f4fc263.dmp.zip' for upload.
'crashreport.gui' exited with code 1272024-01-09 17:14:02 [363ms] [Error] [carb.crashreporter-breakpad.plugin] [crash] Wrote dump file '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/901cffd3-f912-4be2-aa15a6a2-7f4fc263.dmp.zip'
2024-01-09 17:14:02 [367ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash] preventing upload of minidump due to user opt-out: '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/901cffd3-f912-4be2-aa15a6a2-7f4fc263.dmp.zip'
2024-01-09 17:14:02 [373ms] [Error] [carb.crashreporter-breakpad.plugin] [crash]     dump file size is 321216 bytes, file is readable.
2024-01-09 17:14:02 [374ms] [Fatal] [carb.crashreporter-breakpad.plugin] [crash] Crash detected in pid 30927 thread 30927
2024-01-09 17:14:02 [378ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash] Crash metadata:
2024-01-09 17:14:02 [388ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  CarbSdkVersion = '158.3+release158.tc9506.b2fcff1c'
2024-01-09 17:14:02 [394ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  CrashTime = 'Tue Jan  9 17:14:02 2024 GMT'
2024-01-09 17:14:02 [401ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  DriverShaderCacheWrapper = 'disabled'
2024-01-09 17:14:02 [405ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  DumpId = '901cffd3-f912-4be2-aa15a6a2-7f4fc263'
2024-01-09 17:14:02 [411ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  ProductName = 'OmniverseKit'
2024-01-09 17:14:02 [415ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  PythonTracebackStatus = ''py-spy' successfully wrote info to '/storage/homefs/ld20d359/.local/share/ov/data/Kit/Isaac-Sim/2023.1/901cffd3-f912-4be2-aa15a6a2-7f4fc263.py.txt''
2024-01-09 17:14:02 [416ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  RetryCount = '0'
2024-01-09 17:14:02 [416ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  StartupTime = '1704820420'
2024-01-09 17:14:02 [417ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  UploadSuccessful = '0'
2024-01-09 17:14:02 [420ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  UptimeSeconds = '22'
2024-01-09 17:14:02 [424ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  UserStory = ''
2024-01-09 17:14:02 [427ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  UserStoryStatus = ''crashreport.gui' exited with code 127'
2024-01-09 17:14:02 [435ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  Version = '105.1.2+release.133510.b82c1e1e.tc'
2024-01-09 17:14:02 [440ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  appName = 'Isaac-Sim'
2024-01-09 17:14:02 [445ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  appState = 'startup'
2024-01-09 17:14:02 [445ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  appVersion = '2023.1.1'
2024-01-09 17:14:02 [446ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  autoloadExts = ''
2024-01-09 17:14:02 [447ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildBranch = 'release'
2024-01-09 17:14:02 [450ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildCi = 'tc'
2024-01-09 17:14:02 [450ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildHash = 'b82c1e1e'
2024-01-09 17:14:02 [454ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildId = '18571592'
2024-01-09 17:14:02 [455ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildMajor = '105'
2024-01-09 17:14:02 [455ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildMinor = '1'
2024-01-09 17:14:02 [461ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildMr = '0'
2024-01-09 17:14:02 [467ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildNumber = '133510'
2024-01-09 17:14:02 [471ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildPatch = '2'
2024-01-09 17:14:02 [472ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  buildVersion = '105.1.2'
2024-01-09 17:14:02 [473ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  commandLine = '/isaac-sim/kit/kit /isaac-sim/apps/omni.isaac.sim.headless.native.kit --ext-folder /isaac-sim/apps --no-window --/persistent/isaac/asset_root/default=http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/2023.1.1 --merge-config=/isaac-sim/config/open_endpoint.toml --allow-root'
2024-01-09 17:14:02 [474ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  cpuId = 'Intel64 Family 23 Model 49 Stepping 0'
2024-01-09 17:14:02 [474ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  cpuName = 'AMD EPYC 7302 16-Core Processor'
2024-01-09 17:14:02 [475ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  cpuVendor = 'AuthenticAMD'
2024-01-09 17:14:02 [476ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  environmentName = 'Individual'
2024-01-09 17:14:02 [477ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  experience = 'Isaac Sim'
2024-01-09 17:14:02 [477ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  externalBuild = '1'
2024-01-09 17:14:02 [478ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  lastCommand = 'URDFCreateImportConfig'
2024-01-09 17:14:02 [478ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  lastCommands = 'MJCFCreateImportConfig,URDFCreateImportConfig'
2024-01-09 17:14:02 [479ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  memoryStats = '(avail/total) RAM: 442.645/503.657GB, Swap: 2/2GB, VM: 1.71799e+10/1.71799e+10GB'
2024-01-09 17:14:02 [480ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  nvidia-smi = 'Tue Jan  9 18:13:42 2024       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 545.23.08              Driver Version: 545.23.08    CUDA Version: 12.3     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA GeForce RTX 3090        On  | 00000000:A1:00.0 Off |                  N/A |
| 30%   30C    P8              19W / 350W |      3MiB / 24576MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+
'
2024-01-09 17:14:02 [481ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  osDistro = 'ubuntu'
2024-01-09 17:14:02 [485ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  osName = '22.04.3 LTS (Jammy Jellyfish)'
2024-01-09 17:14:02 [489ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  osVersion = '22.04.3'
2024-01-09 17:14:02 [494ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  portableMode = '0'
2024-01-09 17:14:02 [498ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  runEnvironment = 'Individual'
2024-01-09 17:14:02 [498ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  systemInfo = ''
2024-01-09 17:14:02 [504ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  telemetrySessionId = '11704295276583442521'
2024-01-09 17:14:02 [505ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  terminatedByAbort = '0'
2024-01-09 17:14:02 [506ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  userId = 'default'
2024-01-09 17:14:02 [506ms] [Warn] [carb.crashreporter-breakpad.plugin] [crash]  workingDirectory = '/storage/homefs/ld20d359'
2024-01-09 17:14:02 [507ms] [Fatal] [carb.crashreporter-breakpad.plugin] [crash] Thread 30927 backtrace follows:
2024-01-09 17:14:03 [514ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50
2024-01-09 17:14:03 [521ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: libimgui.so!ImGui::PushStyleColor(int, ImVec4 const&)+0x2a
2024-01-09 17:14:03 [527ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: libcarb.imgui.plugin.so!_init+0x364f
2024-01-09 17:14:03 [532ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: imgui.cpython-310-x86_64-linux-gnu.so!pybind11::error_already_set::~error_already_set()+0x6f40
2024-01-09 17:14:03 [536ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: imgui.cpython-310-x86_64-linux-gnu.so!pybind11::error_already_set::~error_already_set()+0xc8c1
2024-01-09 17:14:03 [543ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: libpython3.10.so.1.0!PyBuffer_ToContiguous+0x9a7
2024-01-09 17:14:03 [551ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: libpython3.10.so.1.0!_PyObject_MakeTpCall+0x9a
2024-01-09 17:14:03 [558ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: libpython3.10.so.1.0!PyCell_Set+0x8b5
2024-01-09 17:14:03 [565ms] [Fatal] [carb.crashreporter-breakpad.plugin] 008: libpython3.10.so.1.0!_init+0xbaad
2024-01-09 17:14:03 [572ms] [Fatal] [carb.crashreporter-breakpad.plugin] 009: libpython3.10.so.1.0!_PyEval_EvalFrameDefault+0x6e78
2024-01-09 17:14:03 [578ms] [Fatal] [carb.crashreporter-breakpad.plugin] 010: libpython3.10.so.1.0!PyEval_EvalFrameEx+0xb24
2024-01-09 17:14:03 [588ms] [Fatal] [carb.crashreporter-breakpad.plugin] 011: libpython3.10.so.1.0!_init+0xbaad
2024-01-09 17:14:03 [594ms] [Fatal] [carb.crashreporter-breakpad.plugin] 012: libpython3.10.so.1.0!_PyEval_EvalFrameDefault+0x38bc
2024-01-09 17:14:03 [605ms] [Fatal] [carb.crashreporter-breakpad.plugin] 013: libpython3.10.so.1.0!PyEval_EvalFrameEx+0xb24
2024-01-09 17:14:03 [612ms] [Fatal] [carb.crashreporter-breakpad.plugin] 014: libpython3.10.so.1.0!PyVectorcall_Call+0x54
2024-01-09 17:14:03 [618ms] [Fatal] [carb.crashreporter-breakpad.plugin] 015: libpython3.10.so.1.0!_PyEval_EvalFrameDefault+0x5745
2024-01-09 17:14:03 [627ms] [Fatal] [carb.crashreporter-breakpad.plugin] 016: libpython3.10.so.1.0!PyEval_EvalFrameEx+0xb24
2024-01-09 17:14:03 [634ms] [Fatal] [carb.crashreporter-breakpad.plugin] 017: libpython3.10.so.1.0!_init+0xbaad
2024-01-09 17:14:03 [645ms] [Fatal] [carb.crashreporter-breakpad.plugin] 018: libpython3.10.so.1.0!_PyEval_EvalFrameDefault+0x38bc
2024-01-09 17:14:03 [652ms] [Fatal] [carb.crashreporter-breakpad.plugin] 019: libpython3.10.so.1.0!PyEval_EvalFrameEx+0xb24
2024-01-09 17:14:03 [662ms] [Fatal] [carb.crashreporter-breakpad.plugin] 020: libpython3.10.so.1.0!_init+0xbaad
2024-01-09 17:14:03 [675ms] [Fatal] [carb.crashreporter-breakpad.plugin] 021: libpython3.10.so.1.0!_PyEval_EvalFrameDefault+0x38bc
2024-01-09 17:14:03 [686ms] [Fatal] [carb.crashreporter-breakpad.plugin] 022: libpython3.10.so.1.0!PyEval_EvalFrameEx+0xb24
2024-01-09 17:14:03 [694ms] [Fatal] [carb.crashreporter-breakpad.plugin] 023: libpython3.10.so.1.0!_init+0xbaad
2024-01-09 17:14:03 [704ms] [Fatal] [carb.crashreporter-breakpad.plugin] 024: libpython3.10.so.1.0!_PyEval_EvalFrameDefault+0x6e78
2024-01-09 17:14:03 [711ms] [Fatal] [carb.crashreporter-breakpad.plugin] 025: libpython3.10.so.1.0!PyEval_EvalCode+0x504
2024-01-09 17:14:03 [722ms] [Fatal] [carb.crashreporter-breakpad.plugin] 026: libcarb.scripting-python.plugin.so!carbOnPluginPreStartup+0xdf1
2024-01-09 17:14:03 [729ms] [Fatal] [carb.crashreporter-breakpad.plugin] 027: libcarb.scripting-python.plugin.so!carbOnPluginPreStartup+0x164f
2024-01-09 17:14:03 [739ms] [Fatal] [carb.crashreporter-breakpad.plugin] 028: libomni.ext.plugin.so!std::string& std::vector<std::string, std::allocator<std::string> >::emplace_back<char const*&>(char const*&)+0x9251
2024-01-09 17:14:03 [747ms] [Fatal] [carb.crashreporter-breakpad.plugin] 029: libomni.ext.plugin.so!std::string::replace(unsigned long, unsigned long, char const*, unsigned long)+0xa7aa
2024-01-09 17:14:03 [754ms] [Fatal] [carb.crashreporter-breakpad.plugin] 030: libomni.ext.plugin.so!carbOnPluginPreStartup+0x2193
2024-01-09 17:14:03 [760ms] [Fatal] [carb.crashreporter-breakpad.plugin] 031: libomni.ext.plugin.so!carbOnPluginPreStartup+0x10e06
2024-01-09 17:14:03 [769ms] [Fatal] [carb.crashreporter-breakpad.plugin] 032: libomni.ext.plugin.so!carbOnPluginPreStartup+0x11e03
2024-01-09 17:14:03 [776ms] [Fatal] [carb.crashreporter-breakpad.plugin] 033: libomni.kit.app.plugin.so!char* std::string::_S_construct<char*>(char*, char*, std::allocator<char> const&, std::forward_iterator_tag)+0x7f33
2024-01-09 17:14:03 [783ms] [Fatal] [carb.crashreporter-breakpad.plugin] 034: libomni.kit.app.plugin.so!char* std::string::_S_construct<char*>(char*, char*, std::allocator<char> const&, std::forward_iterator_tag)+0x886c
2024-01-09 17:14:03 [792ms] [Fatal] [carb.crashreporter-breakpad.plugin] 035: libomni.kit.app.plugin.so!_init+0x5d6e
2024-01-09 17:14:03 [793ms] [Fatal] [carb.crashreporter-breakpad.plugin] 036: kit!_init+0x6eb
2024-01-09 17:14:03 [800ms] [Fatal] [carb.crashreporter-breakpad.plugin] 037: libc.so.6!__libc_init_first+0x90
2024-01-09 17:14:03 [810ms] [Fatal] [carb.crashreporter-breakpad.plugin] 038: libc.so.6!__libc_start_main+0x80
2024-01-09 17:14:03 [811ms] [Fatal] [carb.crashreporter-breakpad.plugin] 039: kit!_start+0x29
Segmentation fault

Hi. The errors looks like it is caused by the driver version. Please re-install the latest 525 drivers.