I have a server with 4 A6000, running the isaac sim server using docker, and using the streaming client in my local environment.
I’m following along with the ros2 tutorial.
But when I run these, the program pretty much freezes. It runs very, very slowly.
I guess this is probably a problem when using sensors with a lot of data to process, but I already have enough resources to run the simulation.
I’m attaching the execution logs together.
2024-07-25 02:12:10 [653,944ms] [Warning] [carb] [Plugin: omni.sensors.tiled.plugin] Module /isaac-sim/extscache/omni.sensors.tiled-0.0.3+106.0.0.lx64.r/bin/libomni.sensors.tiled.plugin.so remained loaded after unload request
2024-07-25 02:12:10 [653,947ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass PopulateRenderingPass (pass id 12)
2024-07-25 02:12:10 [653,947ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass PopulatePreRenderingPass (pass id 13)
2024-07-25 02:12:10 [653,947ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass PopulatePostRenderingPass (pass id 14)
2024-07-25 02:12:10 [653,947ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass PopulatePreRenderingDefPass (pass id 15)
2024-07-25 02:12:10 [653,947ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass PopulatePostRenderingDefPass (pass id 16)
2024-07-25 02:12:10 [653,953ms] [Warning] [carb] [Plugin: omni.spectree.delegate.plugin] Module /isaac-sim/kit/exts/omni.usd_resolver/bin/libomni.spectree.delegate.plugin.so remained loaded after unload request
2024-07-25 02:12:10 [653,955ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass ActionGraphPass (pass id 10)
2024-07-25 02:12:10 [653,955ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass DependencyFoldPass (pass id 11)
^C^CSegmentation fault (core dumped)
root@ddc183d28c2d:/isaac-sim# runheadless.native -v
The NVIDIA Omniverse License Agreement (EULA) must be accepted before
Omniverse Kit can start. The license terms for this product can be viewed at
https://docs.omniverse.nvidia.com/app_isaacsim/common/NVIDIA_Omniverse_License_Agreement.html
Omniverse Software collects installation and configuration details about your software, hardware, and network
configuration (e.g., version of operating system, applications installed, type of hardware, network speed, IP
address) based on our legitimate interest in improving your experience. To improve performance, troubleshooting
and diagnostic purposes of our software, we also collect session behavior, error and crash logs.
Data Collection in container mode is completely anonymous unless specified. You may opt-out of this collection
anytime by not setting the OMNI_ENV_PRIVACY_CONSENT environment variable.
To opt-in set the OMNI_ENV_PRIVACY_CONSENT environment variable when running the container. Set the
OMNI_ENV_PRIVACY_USERID environment variable tag the telemetry data with a user ID.
Loading user config located at: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/user.config.json'
[Info] [carb] Logging to file: /root/.nvidia-omniverse/logs/Kit/Isaac-Sim/4.0/kit_20240725_021231.log
2024-07-25 02:12:31 [6ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/053b46e7-f51c-4b9a-1e2d28b0-70f28a78.dmp.zip'
2024-07-25 02:12:31 [11ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/d682767f-a952-410f-937e6698-a23329b2.dmp.zip'
2024-07-25 02:12:31 [18ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/83957c6a-800f-48f9-c002669d-8ecd5e1c.dmp.zip'
2024-07-25 02:12:31 [19ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/67fc02f0-ac53-43a8-a10a13b2-8e9c97be.dmp.zip'
2024-07-25 02:12:31 [20ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/17e67350-38b0-4da2-67d2c3ac-0844a014.dmp.zip'
2024-07-25 02:12:31 [21ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/08d82512-7f9b-4739-de88a982-4ef9c88c.dmp.zip'
2024-07-25 02:12:31 [21ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/a60911e7-ff6a-4c5a-219803b2-4e6ce563.dmp.zip'
2024-07-25 02:12:31 [22ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/d83d6097-c8d9-4ff4-a942348d-37e490fa.dmp.zip'
2024-07-25 02:12:31 [25ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/c67b4920-1f72-425c-c849c0bf-2e29bcc2.dmp.zip'
2024-07-25 02:12:31 [30ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/16ddb68c-12e3-41e3-4dd74394-47c86a9a.dmp.zip'
2024-07-25 02:12:31 [33ms] [Warning] [carb.crashreporter-breakpad.plugin] [previous crash] preventing upload of minidump due to user opt-out: '/root/.local/share/ov/data/Kit/Isaac-Sim/4.0/d1dc18ef-48c7-46a7-7db66796-d73b3db4.dmp.zip'
[0.200s] [ext: omni.kit.async_engine-0.0.0] startup
[0.952s] [ext: omni.stats-0.0.0] startup
[0.954s] [ext: omni.client-1.1.0] startup
[0.980s] [ext: omni.datastore-0.0.0] startup
[0.981s] [ext: omni.blobkey-1.1.0] startup
[0.981s] [ext: omni.ujitso.default-1.0.0] startup
[0.983s] [ext: omni.hsscclient-0.0.0] startup
[0.983s] [ext: omni.rtx.shadercache.vulkan-1.0.0] startup
[0.984s] [ext: omni.assets.plugins-0.0.0] startup
[0.986s] [ext: omni.gpu_foundation-0.0.0] startup
[1.002s] [ext: carb.windowing.plugins-1.0.0] startup
2024-07-25 02:12:32 [979ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:32 [979ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[1.004s] [ext: omni.kit.renderer.init-0.0.0] startup
2024-07-25 02:12:32 [1,031ms] [Warning] [omni.platforminfo.plugin] failed to open the default display. Can't verify X Server version.
2024-07-25 02:12:32 [1,175ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:32 [1,176ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:12:32 [1,176ms] [Error] [carb.glinterop.plugin] GLInteropContext::init: carb::windowing is not available
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.183.01 | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
| | | | | | Device-ID | UUID |
| | | | | | Bus-ID | |
|---------------------------------------------------------------------------------------------|
| 0 | NVIDIA RTX A6000 | Yes: 0 | | 49386 MB | 10de | 0 |
| | | | | | 2230 | 96ae80a4.. |
| | | | | | 1 | |
|---------------------------------------------------------------------------------------------|
| 1 | NVIDIA RTX A6000 | Yes: 1 | | 49386 MB | 10de | 0 |
| | | | | | 2230 | 48ddc747.. |
| | | | | | 61 | |
|---------------------------------------------------------------------------------------------|
| 2 | NVIDIA RTX A6000 | Yes: 2 | | 49386 MB | 10de | 0 |
| | | | | | 2230 | 0cb0480a.. |
| | | | | | 81 | |
|---------------------------------------------------------------------------------------------|
| 3 | NVIDIA RTX A6000 | Yes: 3 | | 49386 MB | 10de | 0 |
| | | | | | 2230 | 5e7b8650.. |
| | | | | | e1 | |
|=============================================================================================|
| OS: 22.04.3 LTS (Jammy Jellyfish) ubuntu, Version: 22.04.3, Kernel: 6.5.0-44-generic
| Processor: AMD EPYC 7313 16-Core Processor | Cores: 32 | Logical: 64
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 257774 | Free Memory: 218926
| Total Page/Swap (MB): 2047 | Free Page/Swap: 1832
|---------------------------------------------------------------------------------------------|
[4.039s] [ext: omni.kit.pipapi-0.0.0] startup
[4.042s] [ext: omni.kit.pip_archive-0.0.0] startup
[4.042s] [ext: omni.pip.compute-1.3.1] startup
[4.042s] [ext: omni.mtlx-0.1.0] startup
[4.043s] [ext: omni.usd.config-1.0.3] startup
[4.050s] [ext: omni.gpucompute.plugins-0.0.0] startup
[4.051s] [ext: omni.usd.libs-1.0.0] startup
[4.187s] [ext: omni.pip.cloud-1.1.3] startup
[4.191s] [ext: omni.isaac.core_archive-2.3.0] startup
[4.191s] [ext: omni.kit.telemetry-0.5.0] startup
[4.284s] [ext: omni.kit.loop-isaac-1.2.0] startup
[4.286s] [ext: omni.kit.test-0.0.0] startup
[4.353s] [ext: omni.isaac.ml_archive-2.0.1] startup
[4.353s] [ext: omni.appwindow-1.1.8] startup
2024-07-25 02:12:35 [4,330ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:35 [4,330ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[4.358s] [ext: omni.kit.renderer.core-1.0.1] startup
2024-07-25 02:12:35 [4,337ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:35 [4,337ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:12:35 [4,369ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:35 [4,369ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[4.397s] [ext: omni.kit.renderer.capture-0.0.0] startup
[4.400s] [ext: omni.kit.renderer.imgui-1.0.1] startup
2024-07-25 02:12:35 [4,379ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:35 [4,379ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:12:35 [4,380ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:35 [4,381ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:12:35 [4,381ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:35 [4,381ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[4.497s] [ext: omni.ui-2.23.11] startup
[4.510s] [ext: omni.kit.mainwindow-1.0.3] startup
[4.511s] [ext: carb.audio-0.1.0] startup
[4.519s] [ext: omni.uiaudio-1.0.0] startup
[4.520s] [ext: omni.kit.uiapp-0.0.0] startup
[4.520s] [ext: omni.usd.schema.metrics.assembler-106.0.1] startup
[4.658s] [ext: omni.usd.schema.omnigraph-1.0.0] startup
[4.665s] [ext: omni.usd.schema.geospatial-0.0.0] startup
[4.669s] [ext: omni.usd.schema.semantics-0.0.0] startup
[4.693s] [ext: omni.usd.schema.anim-0.0.0] startup
[4.711s] [ext: omni.usd.schema.audio-0.0.0] startup
[4.715s] [ext: omni.anim.navigation.schema-106.0.2] startup
[4.719s] [ext: omni.usd.schema.isaac-2.0.2] startup
[4.727s] [ext: omni.usd.schema.physx-106.0.16] startup
[4.779s] [ext: omni.anim.graph.schema-106.0.2] startup
[4.787s] [ext: omni.usd.schema.scene.visualization-2.0.2] startup
[4.789s] [ext: omni.usd.schema.omniscripting-1.0.0] startup
[4.793s] [ext: omni.graph.exec-0.9.3] startup
[4.795s] [ext: omni.kit.actions.core-1.0.0] startup
[4.798s] [ext: omni.kit.usd_undo-0.1.8] startup
[4.799s] [ext: omni.kit.exec.core-0.13.0] startup
[4.802s] [ext: omni.kit.commands-1.4.9] startup
[4.814s] [ext: omni.usd_resolver-1.0.0] startup
[4.821s] [ext: omni.resourcemonitor-105.0.1] startup
[4.824s] [ext: omni.kit.window.popup_dialog-2.0.24] startup
[4.830s] [ext: omni.activity.core-1.0.1] startup
[4.833s] [ext: omni.usd.core-1.2.11] startup
[4.839s] [ext: omni.timeline-1.0.10] startup
[4.841s] [ext: omni.kit.widget.nucleus_connector-1.1.5] startup
[4.844s] [ext: usdrt.scenegraph-7.4.8] startup
[4.903s] [ext: omni.kit.audiodeviceenum-1.0.1] startup
[4.905s] [ext: omni.hydra.usdrt_delegate-7.4.7] startup
[4.928s] [ext: omni.hydra.scene_delegate-0.3.3] startup
[4.935s] [ext: omni.iray.libs-0.0.0] startup
[4.943s] [ext: omni.usd-1.10.39] startup
[4.990s] [ext: omni.mdl.neuraylib-0.2.4] startup
[4.992s] [ext: omni.kit.asset_converter-2.1.10] startup
[5.181s] [ext: omni.usd.schema.forcefield-106.0.16] startup
[5.191s] [ext: omni.kit.collaboration.telemetry-1.0.0] startup
[5.192s] [ext: omni.kit.collaboration.channel_manager-1.0.11] startup
[5.193s] [ext: omni.kit.widget.path_field-2.0.9] startup
[5.194s] [ext: omni.kit.usd.layers-2.1.30] startup
[5.204s] [ext: omni.kit.clipboard-1.0.3] startup
[5.204s] [ext: omni.kit.widget.browser_bar-2.0.9] startup
[5.205s] [ext: omni.kit.notification_manager-1.0.8] startup
[5.208s] [ext: omni.kit.collaboration.presence_layer-1.0.8] startup
[5.210s] [ext: omni.kit.helper.file_utils-0.1.7] startup
[5.212s] [ext: omni.kit.widget.nucleus_info-1.0.2] startup
[5.213s] [ext: omni.kit.widget.options_menu-1.1.4] startup
[5.217s] [ext: omni.kit.widget.filebrowser-2.3.47] startup
[5.222s] [ext: omni.kit.search_core-1.0.5] startup
[5.223s] [ext: omni.kit.widget.options_button-1.0.2] startup
[5.224s] [ext: omni.kit.widget.versioning-1.4.6] startup
[5.227s] [ext: omni.kit.widget.search_delegate-1.0.4] startup
[5.228s] [ext: omni.kit.widget.context_menu-1.2.1] startup
[5.230s] [ext: omni.convexdecomposition-106.0.16] startup
[5.237s] [ext: omni.ui.scene-1.9.3] startup
[5.242s] [ext: omni.kit.menu.utils-1.5.23] startup
[5.257s] [ext: omni.kit.window.filepicker-2.10.32] startup
[5.270s] [ext: omni.kvdb-106.0.16] startup
[5.272s] [ext: omni.physx.foundation-106.0.16] startup
[5.272s] [ext: omni.kit.widget.searchable_combobox-1.0.5] startup
[5.273s] [ext: omni.usdphysics-106.0.16] startup
[5.277s] [ext: omni.localcache-106.0.16] startup
[5.279s] [ext: omni.kit.widget.prompt-1.0.7] startup
[5.280s] [ext: omni.kit.widget.settings-1.1.0] startup
[5.283s] [ext: omni.physx.cooking-106.0.16] startup
[5.299s] [ext: omni.kit.context_menu-1.8.0] startup
[5.302s] [ext: omni.kit.window.preferences-1.5.1] startup
[5.307s] [ext: omni.kit.widget.live_session_management.ui-1.0.1] startup
[5.310s] [ext: omni.kit.widget.filter-1.1.3] startup
[5.311s] [ext: omni.inspect-1.0.1] startup
[5.314s] [ext: omni.kit.window.file_exporter-1.0.29] startup
[5.317s] [ext: omni.kit.hotkeys.core-1.3.3] startup
[5.318s] [ext: omni.kit.widget.graph-1.12.6] startup
[5.324s] [ext: omni.graph.core-2.170.0] startup
[5.329s] [ext: omni.kit.widget.stage-2.10.26] startup
[5.342s] [ext: omni.kit.widget.live_session_management-1.2.18] startup
[5.346s] [ext: omni.graph.tools-1.77.0] startup
[5.375s] [ext: omni.kit.window.extensions-1.4.7] startup
[5.382s] [ext: omni.ujitso.processor.texture-1.0.0] startup
[5.384s] [ext: omni.kit.window.file_importer-1.1.11] startup
[5.385s] [ext: omni.kit.primitive.mesh-1.0.16] startup
[5.389s] [ext: omni.volume-0.5.0] startup
[5.393s] [ext: omni.ujitso.client-0.0.0] startup
[5.393s] [ext: omni.mdl-52.0.1] startup
[5.415s] [ext: omni.kit.stage_template.core-1.1.20] startup
[5.416s] [ext: omni.kit.widget.highlight_label-1.0.1] startup
[5.417s] [ext: omni.kit.stage_templates-1.2.2] startup
[5.419s] [ext: omni.hydra.rtx-0.2.0] startup
[5.439s] [ext: omni.kit.material.library-1.4.0] startup
[5.446s] [ext: omni.hydra.engine.stats-1.0.1] startup
[5.450s] [ext: omni.kit.widget.searchfield-1.1.5] startup
[5.451s] [ext: omni.kit.window.file-1.3.52] startup
[5.454s] [ext: omni.kit.hydra_texture-1.2.6] startup
[5.459s] [ext: omni.kit.window.drop_support-1.0.1] startup
[5.459s] [ext: omni.kit.widget.viewport-106.0.2] startup
[5.467s] [ext: omni.kit.viewport.registry-104.0.6] startup
[5.468s] [ext: omni.kit.raycast.query-1.0.5] startup
[5.477s] [ext: omni.kit.window.content_browser_registry-0.0.4] startup
[5.478s] [ext: omni.kit.viewport.window-106.0.8] startup
[5.506s] [ext: omni.kit.window.property-1.11.1] startup
[5.508s] [ext: omni.kit.window.content_browser-2.9.13] startup
[5.527s] [ext: omni.kit.widget.text_editor-1.0.2] startup
[5.529s] [ext: omni.kit.viewport.utility-1.0.17] startup
[5.530s] [ext: omni.kit.property.usd-3.21.26] startup
[5.541s] [ext: omni.graph-1.135.0] startup
[5.701s] [ext: omni.physx-106.0.16] startup
[5.718s] [ext: omni.graph.ui-1.67.1] startup
[5.753s] [ext: omni.graph.action_core-1.1.4] startup
[5.761s] [ext: omni.graph.image.core-0.3.2] startup
[5.765s] [ext: omni.graph.action_nodes-1.21.3] startup
[5.779s] [ext: omni.graph.image.nodes-1.0.2] startup
[5.783s] [ext: omni.kit.numpy.common-0.1.2] startup
[5.787s] [ext: omni.graph.nodes-1.141.2] startup
[5.803s] [ext: omni.physics.tensors-106.0.16] startup
[5.819s] [ext: omni.physx.stageupdate-106.0.16] startup
[5.825s] [ext: omni.graph.action-1.101.1] startup
[5.830s] [ext: omni.warp.core-1.1.0] startup
Warp 1.1.0 initialized:
CUDA Toolkit 11.5, Driver 12.2
Devices:
"cpu" : "x86_64"
"cuda:0" : "NVIDIA RTX A6000" (48 GiB, sm_86, mempool enabled)
"cuda:1" : "NVIDIA RTX A6000" (48 GiB, sm_86, mempool enabled)
"cuda:2" : "NVIDIA RTX A6000" (48 GiB, sm_86, mempool enabled)
"cuda:3" : "NVIDIA RTX A6000" (48 GiB, sm_86, mempool enabled)
CUDA peer access:
Supported fully (all-directional)
Kernel cache:
/root/.cache/warp/1.1.0
[6.049s] [ext: omni.isaac.dynamic_control-1.3.7] startup
[6.125s] [ext: omni.warp-1.1.0] startup
[6.206s] [ext: omni.kit.viewport.actions-105.2.8] startup
[6.223s] [ext: omni.kit.widget.imageview-1.0.3] startup
[6.227s] [ext: omni.debugdraw-0.1.3] startup
[6.236s] [ext: omni.physx.tensors-106.0.16] startup
[6.253s] [ext: omni.kit.window.cursor-1.1.2] startup
[6.270s] [ext: omni.isaac.version-1.1.0] startup
[6.277s] [ext: omni.kit.widget.toolbar-1.6.2] startup
[6.566s] [ext: omni.kit.manipulator.transform-104.7.5] startup
[6.650s] [ext: omni.kit.viewport.menubar.core-107.0.0] startup
[6.737s] [ext: omni.isaac.nucleus-0.1.2] startup
[6.739s] [ext: omni.kit.manipulator.tool.snap-1.4.5] startup
[6.748s] [ext: omni.kit.viewport.menubar.display-106.0.0] startup
[6.756s] [ext: omni.kit.window.quicksearch-2.4.4] startup
[6.762s] [ext: omni.physx.commands-106.0.16] startup
[6.771s] [ext: omni.usdphysics.ui-106.0.16] startup
[6.799s] [ext: omni.isaac.core-3.12.0] startup
[8.255s] [ext: omni.syntheticdata-0.6.7] startup
[8.286s] [ext: omni.kit.property.material-1.9.3] startup
[8.299s] [ext: omni.kit.manipulator.selector-1.1.1] startup
[8.307s] [ext: omni.physx.ui-106.0.16] startup
[8.352s] [ext: omni.fabric.commands-1.1.4] startup
[8.360s] [ext: omni.kit.manipulator.viewport-107.0.0] startup
[8.365s] [ext: omni.kit.viewport.manipulator.transform-106.0.0] startup
ViewportTransformManipulatorExt on_startup
[8.366s] [ext: omni.kit.property.physx-106.0.16] startup
[8.457s] [ext: omni.physx.demos-106.0.16] startup
[8.484s] [ext: omni.ui_query-1.1.2] startup
[8.488s] [ext: omni.kit.manipulator.prim.core-106.0.2] startup
[8.496s] [ext: omni.graph.visualization.nodes-2.1.1] startup
[8.509s] [ext: omni.physx.vehicle-106.0.16] startup
[8.550s] [ext: omni.kit.ui_test-1.2.18] startup
[8.556s] [ext: omni.kit.manipulator.prim.fabric-106.0.1] startup
[8.560s] [ext: omni.kit.manipulator.prim.usd-106.0.1] startup
[8.564s] [ext: omni.physx.camera-106.0.16] startup
[8.576s] [ext: omni.physx.cct-106.0.16] startup
[8.588s] [ext: omni.kit.manipulator.selection-104.0.9] startup
[8.596s] [ext: omni.kit.manipulator.prim-106.0.0] startup
[8.596s] [ext: omni.kit.window.toolbar-1.6.1] startup
[8.603s] [ext: omni.kit.widget.layers-1.7.9] startup
[8.635s] [ext: omni.kit.graph.delegate.default-1.2.2] startup
[8.638s] [ext: omni.physx.graph-106.0.16] startup
[8.670s] [ext: omni.graph.ui_nodes-1.24.1] startup
[8.681s] [ext: omni.physx.supportui-106.0.16] startup
[8.733s] [ext: omni.kit.graph.usd.commands-1.3.1] startup
[8.739s] [ext: omni.kit.graph.editor.core-1.5.3] startup
[8.747s] [ext: omni.physx.telemetry-106.0.16] startup
[8.759s] [ext: omni.graph.bundle.action-2.0.4] startup
[8.761s] [ext: omni.command.usd-1.0.3] startup
[8.766s] [ext: omni.kit.widget.material_preview-1.0.16] startup
[8.772s] [ext: omni.isaac.debug_draw-0.7.1] startup
[8.788s] [ext: omni.kit.window.material_graph-1.8.15] startup
[8.875s] [ext: omni.sensors.tiled-0.0.3] startup
[8.879s] [ext: omni.physx.bundle-106.0.16] startup
[8.879s] [ext: omni.graph.scriptnode-1.18.2] startup
[8.881s] [ext: omni.isaac.ui-0.15.1] startup
[8.903s] [ext: omni.replicator.core-1.11.8] startup
2024-07-25 02:12:40 [8,921ms] [Warning] [omni.replicator.core.scripts.annotators] Annotator PostProcessDispatch is already registered, overwriting annotator template
[9.071s] [ext: omni.sensors.nv.common-1.0.1] startup
[9.092s] [ext: omni.isaac.range_sensor-3.0.1] startup
[9.151s] [ext: omni.isaac.core_nodes-1.15.4] startup
[9.212s] [ext: omni.sensors.nv.wpm-1.0.0] startup
[9.220s] [ext: omni.sensors.nv.materials-1.0.0] startup
[9.225s] [ext: omni.isaac.lula-3.0.1] startup
[9.247s] [ext: omni.isaac.surface_gripper-1.0.1] startup
[9.269s] [ext: omni.isaac.motion_generation-7.0.1] startup
[9.353s] [ext: omni.isaac.manipulators-2.1.0] startup
[9.381s] [ext: omni.sensors.nv.radar-1.0.1] startup
[9.391s] [ext: omni.sensors.nv.lidar-1.0.1] startup
[9.399s] [ext: omni.isaac.franka-0.4.1] startup
[9.406s] [ext: omni.isaac.dofbot-0.3.2] startup
[9.420s] [ext: omni.isaac.sensor-11.3.0] startup
[9.602s] [ext: omni.isaac.cortex-0.3.8] startup
[9.607s] [ext: omni.isaac.universal_robots-0.3.5] startup
[9.615s] [ext: omni.isaac.quadruped-1.4.5] startup
[9.670s] [ext: omni.isaac.cortex.sample_behaviors-1.0.5] startup
[9.676s] [ext: omni.kit.graph.widget.variables-2.1.0] startup
[9.693s] [ext: omni.kit.graph.delegate.modern-1.10.6] startup
[9.719s] [ext: omni.isaac.wheeled_robots-2.1.3] startup
[9.740s] [ext: omni.graph.window.core-1.107.1] startup
[9.769s] [ext: omni.isaac.examples-2.0.0] startup
[9.953s] [ext: omni.importer.mjcf-1.1.0] startup
[10.002s] [ext: omni.graph.window.generic-1.23.1] startup
[10.033s] [ext: omni.importer.onshape-0.7.1] startup
[10.058s] [ext: omni.isaac.manipulators.ui-1.2.1] startup
[10.064s] [ext: omni.importer.urdf-1.14.1] startup
[10.132s] [ext: omni.kit.streamsdk.plugins-3.2.1] startup
[10.133s] [ext: omni.isaac.robot_description_editor-2.4.0] startup
[10.170s] [ext: omni.isaac.examples_nodes-0.1.3] startup
[10.176s] [ext: omni.isaac.cloner-0.8.1] startup
[10.184s] [ext: omni.isaac.extension_templates-1.7.0] startup
[10.189s] [ext: omni.isaac.gain_tuner-1.1.1] startup
[10.199s] [ext: omni.isaac.gym-0.11.3] startup
[10.203s] [ext: omni.isaac.import_wizard-0.5.2] startup
[10.210s] [ext: omni.isaac.kit-1.10.0] startup
[10.224s] [ext: omni.kit.mesh.raycast-105.4.0] startup
[10.233s] [ext: omni.anim.curve.core-1.1.13] startup
[10.253s] [ext: omni.isaac.block_world-1.0.0] startup
[10.259s] [ext: omni.anim.shared.core-106.0.0] startup
[10.272s] [ext: omni.anim.curve.ui-1.3.16] startup
[10.293s] [ext: omni.isaac.occupancy_map-1.0.1] startup
[10.303s] [ext: omni.isaac.merge_mesh-1.0.1] startup
[10.316s] [ext: omni.kit.widget.stage_icons-1.0.3] startup
[10.330s] [ext: omni.anim.curve.bundle-1.2.3] startup
[10.333s] [ext: omni.isaac.occupancy_map.ui-1.1.0] startup
[10.343s] [ext: omni.kit.widget.zoombar-1.0.5] startup
[10.358s] [ext: omni.kit.window.stage-2.5.9] startup
[10.370s] [ext: omni.kit.usd.collect-2.2.21] startup
[10.381s] [ext: omni.kit.browser.core-2.3.11] startup
[10.393s] [ext: omni.kit.menu.stage-1.2.5] startup
[10.398s] [ext: omni.kit.tool.collect-2.2.12] startup
[10.407s] [ext: omni.kit.browser.folder.core-1.9.12] startup
[10.420s] [ext: omni.kit.search.files-1.0.4] startup
[10.426s] [ext: omni.isaac.physics_inspector-0.1.4] startup
[10.431s] [ext: omni.isaac.asset_browser-0.4.6] startup
[10.444s] [ext: omni.kit.usda_edit-1.1.11] startup
[10.462s] [ext: omni.scene.optimizer.core-106.0.4] startup
[10.482s] [ext: omni.isaac.scene_blox-0.1.1] startup
[10.485s] [ext: omni.isaac.surface_gripper.ui-1.0.0] startup
[10.491s] [ext: omni.isaac.synthetic_recorder-1.7.3] startup
[10.508s] [ext: omni.kit.converter.common-201.0.2] startup
[10.518s] [ext: omni.isaac.throttling-1.1.0] startup
[10.520s] [ext: omni.isaac.utils-1.0.1] startup
[10.526s] [ext: omni.isaac.wheeled_robots.ui-1.1.1] startup
[10.532s] [ext: omni.kit.converter.cad_core-201.0.2] startup
[10.553s] [ext: omni.kit.converter.jt_core-201.0.2] startup
[10.578s] [ext: omni.kit.tool.asset_importer-2.5.5] startup
[10.591s] [ext: omni.kit.actions.window-1.1.1] startup
[10.601s] [ext: omni.isaac.window.about-1.1.0] startup
[10.610s] [ext: omni.kit.browser.asset-1.3.9] startup
[10.618s] [ext: omni.kit.selection-0.1.4] startup
[10.622s] [ext: omni.kit.converter.cad-201.0.2] startup
[10.632s] [ext: omni.kit.hotkeys.window-1.4.5] startup
[10.652s] [ext: omni.kit.manipulator.camera-105.0.5] startup
[10.667s] [ext: omni.kit.menu.aov-1.1.3] startup
[10.673s] [ext: omni.kit.menu.edit-1.1.19] startup
[10.681s] [ext: omni.kit.property.audio-1.0.11] startup
[10.686s] [ext: omni.hydra.scene_api-0.1.2] startup
[10.695s] [ext: omni.kit.property.camera-1.0.6] startup
[10.699s] [ext: omni.kit.property.geometry-1.3.0] startup
[10.708s] [ext: omni.kit.property.light-1.0.8] startup
[10.713s] [ext: omni.kit.property.render-1.1.1] startup
[10.719s] [ext: omni.kit.property.transform-1.5.1] startup
[10.730s] [ext: omni.kit.menu.file-1.1.9] startup
[10.742s] [ext: omni.kit.core.collection-0.1.7] startup
[10.746s] [ext: omni.kit.preferences.animation-1.1.7] startup
[10.754s] [ext: omni.isaac.menu-0.4.1] startup
[10.761s] [ext: omni.kit.property.bundle-1.2.11] startup
[10.774s] [ext: omni.kit.menu.create-1.0.12] startup
[10.781s] [ext: omni.isaac.physics_utilities-0.1.4] startup
[10.791s] [ext: omni.kit.property.collection-0.1.17] startup
[10.797s] [ext: omni.kit.property.isaac-0.2.3] startup
[10.803s] [ext: omni.mdl.usd_converter-1.0.18] startup
[10.811s] [ext: omni.kit.property.layer-1.1.5] startup
[10.818s] [ext: omni.kit.stagerecorder.core-105.0.5] startup
[10.827s] [ext: omni.kit.scripting-106.0.1] startup
[10.839s] [ext: semantics.schema.property-1.0.2] startup
[10.846s] [ext: omni.kit.stage.copypaste-1.2.2] startup
[10.852s] [ext: omni.kit.stage.mdl_converter-1.0.5] startup
[10.855s] [ext: omni.kit.widgets.custom-1.0.8] startup
[10.880s] [ext: omni.kit.stagerecorder.ui-105.0.6] startup
[10.886s] [ext: omni.kit.stage_column.variant-1.0.13] startup
[10.892s] [ext: omni.kit.stage_column.payload-2.0.0] startup
[10.897s] [ext: omni.isaac.range_sensor.examples-1.0.0] startup
[10.931s] [ext: omni.graph.window.action-1.25.2] startup
[10.951s] [ext: omni.kit.variant.editor-106.0.0] startup
[10.994s] [ext: omni.kit.stagerecorder.bundle-105.0.2] startup
[10.995s] [ext: omni.kit.thumbnails.usd-1.0.9] startup
[11.105s] [ext: omni.isaac.range_sensor.ui-1.0.0] startup
[11.110s] [ext: omni.kit.variant.presenter-105.1.2] startup
[11.123s] [ext: omni.kit.viewport.menubar.camera-105.1.8] startup
[11.143s] [ext: omni.kit.viewport.menubar.lighting-106.0.2] startup
[11.158s] [ext: omni.rtx.window.settings-0.6.15] startup
[11.169s] [ext: omni.kit.viewport.menubar.render-106.1.2] startup
[11.184s] [ext: omni.kit.widget.live-2.1.6] startup
[11.193s] [ext: omni.kit.widget.calendar-1.0.8] startup
[11.197s] [ext: omni.kit.viewport.menubar.settings-106.0.0] startup
[11.213s] [ext: omni.kit.widget.collection-0.1.18] startup
[11.219s] [ext: omni.kit.viewport.rtx-104.0.1] startup
[11.222s] [ext: omni.kit.viewport_widgets_manager-1.0.8] startup
[11.229s] [ext: omni.kit.widget.cache_indicator-2.0.8] startup
[12.040s] [ext: omni.kit.widget.extended_searchfield-1.0.27] startup
2024-07-25 02:12:43 [12,051ms] [Warning] [omni.kit.widget.cache_indicator.cache_state_menu] Unable to detect Omniverse Cache Server. Consider installing it for better IO performance.
[12.085s] [ext: omni.kit.widget.timeline-105.0.1] startup
[12.091s] [ext: omni.kit.window.collection-0.1.22] startup
[12.097s] [ext: omni.kit.window.commands-0.2.5] startup
[12.100s] [ext: omni.kit.window.console-0.2.12] startup
[12.116s] [ext: omni.kit.window.imageviewer-1.0.7] startup
[12.124s] [ext: omni.kit.window.privacy-0.1.0] startup
[12.127s] [ext: omni.kit.tool.asset_exporter-1.3.3] startup
[12.131s] [ext: omni.kit.window.script_editor-1.7.6] startup
[12.135s] [ext: omni.kit.window.status_bar-0.1.6] startup
[12.142s] [ext: omni.kit.window.usd_paths-1.0.6] startup
[12.145s] [ext: omni.usd.metrics.assembler-106.0.1] startup
[12.155s] [ext: omni.replicator.isaac-1.15.0] startup
[12.177s] [ext: omni.kit.browser.material-1.5.2] startup
[12.184s] [ext: omni.replicator.replicator_yaml-2.0.5] startup
[12.195s] [ext: omni.kit.ui.actions-1.0.1] startup
[12.203s] [ext: omni.rtx.settings.core-0.6.0] startup
[12.215s] [ext: omni.simready.explorer-1.0.26] startup
[12.251s] [ext: omni.usd.metrics.assembler.physics-106.0.2] startup
[12.258s] [ext: omni.kit.tool.remove_unused.core-0.1.2] startup
[12.266s] [ext: omni.kit.window.material-1.5.7] startup
[12.284s] [ext: omni.usd.metrics.assembler.ui-106.0.2] startup
[12.291s] [ext: omni.kit.menu.common-1.1.5] startup
[12.294s] [ext: omni.kit.renderer.cuda_interop-1.0.1] startup
[12.297s] [ext: omni.kit.quicklayout-1.0.6] startup
[12.300s] [ext: omni.kit.window.title-1.1.3] startup
2024-07-25 02:12:43 [12,278ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:43 [12,278ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:12:43 [12,281ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:12:43 [12,281ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
[12.307s] [ext: semantics.schema.editor-0.3.4] startup
[12.313s] [ext: omni.kit.tool.remove_unused.controller-0.1.3] startup
[12.315s] [ext: omni.isaac.robot_assembler-1.5.0] startup
[12.319s] [ext: omni.isaac.camera_inspector-0.2.1] startup
[12.323s] [ext: omni.kit.livestream.core-3.2.0] startup
[12.330s] [ext: omni.kit.window.stats-0.1.6] startup
[12.335s] [ext: omni.isaac.app.setup-0.13.2] startup
[12.340s] Isaac Sim Headless Native Version: 4.0.0-rc.21
[12.353s] [ext: omni.isaac.assets_check-0.3.4] startup
[12.356s] [ext: omni.kit.profiler.window-2.2.1] startup
2024-07-25 02:12:43 [12,336ms] [Warning] [omni.kit.profiler.window] remove _SpanInstance.__lt__ and use insort 'key' arg instead
[12.365s] [ext: omni.isaac.sim.base-4.0.0] startup
[12.368s] [ext: omni.kit.livestream.native-4.1.0] startup
Failed to open [/var/run/utmp]
Active user not found. Using default user [kiosk]Streaming server started.
[12.580s] [ext: omni.isaac.sim.headless.native-4.0.0] startup
[12.580s] [ext: omni.isaac.ros2_bridge-2.26.4] startup
2024-07-25 02:12:44 [12,559ms] [Warning] [omni.isaac.ros2_bridge.scripts.extension] ROS_DISTRO env var not found, Please source ROS2 Foxy, or Humble, before enabling this extension
[12.584s] Using backup internal ROS2 humble distro
[12.629s] Attempting to load system rclpy
[12.629s] Could not import system rclpy: No module named 'rclpy'
[12.629s] Attempting to load internal rclpy
[12.664s] rclpy loaded
[12.679s] [ext: omni.isaac.repl-1.0.3] startup
[20.404s] app ready
2024-07-25 02:12:52 [21,319ms] [Warning] [omni.kit.imgui_renderer.plugin] _createExtendCursor: No windowing.
2024-07-25 02:12:52 [21,319ms] [Warning] [omni.kit.imgui_renderer.plugin] _createExtendCursor: No windowing.
[21.498s] Isaac Sim Headless Native App is loaded.
main: thread_init: already added for thread
main: thread_init: already added for thread
2024-07-25 02:14:47 [135,908ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/4.0/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl?watch=00007cd5b16fa470(36,21): C183 unused parameter 'MultiMap_Box'
2024-07-25 02:14:47 [135,908ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/4.0/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl?watch=00007cd5b16fa470(36,21): C183 unused parameter 'MultiMap_Box'
2024-07-25 02:14:47 [135,909ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/4.0/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl?watch=00007cd5b16fa470(36,21): C183 unused parameter 'MultiMap_Box'
2024-07-25 02:14:47 [135,909ms] [Warning] [rtx.neuraylib.plugin] [MDLC:COMPILER] 1.0 MDLC comp warn : http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/4.0/Isaac/Environments/Simple_Warehouse/Materials/MaterialInstanceDynamic_1220.mdl?watch=00007cd5b16fa470(36,21): C183 unused parameter 'MultiMap_Box'
2024-07-25 02:15:15 [164,309ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:15:15 [164,309ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:15:15 [164,317ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:15:15 [164,317ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
2024-07-25 02:15:15 [164,318ms] [Warning] [carb.windowing-glfw.plugin] GLFW initialization failed.
2024-07-25 02:15:15 [164,318ms] [Warning] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.4]) (impl: carb.windowing-glfw.plugin)
^C2024-07-25 02:16:30 [238,676ms] [Warning] [carb] [Plugin: omni.sensors.tiled.plugin] Module /isaac-sim/extscache/omni.sensors.tiled-0.0.3+106.0.0.lx64.r/bin/libomni.sensors.tiled.plugin.so remained loaded after unload request
2024-07-25 02:16:30 [238,685ms] [Warning] [carb] [Plugin: omni.spectree.delegate.plugin] Module /isaac-sim/kit/exts/omni.usd_resolver/bin/libomni.spectree.delegate.plugin.so remained loaded after unload request
2024-07-25 02:16:30 [238,737ms] [Warning] [omni.core.ITypeFactory] Module /isaac-sim/kit/exts/omni.activity.core/bin/libomni.activity.core.plugin.so remained loaded after unload request.