I am currently using ISACC SIM to configure the LiDAR. I started using version 2023.1.1 and it works fine.
I also know that after Isaac SIM 4.0, some changes were made to the configuration files.
I also know that after Isaac SIM 4.0, some changes were made to the configuration files. However, when I used the built-in configuration file for testing, unfortunately there were some errors and I was unable to use it. The configuration file I am using is the case file “ov/pkg/isaac-sim-4.0.0/exts/omni. isaac. sensor/data/lidar_configs/NVIDIA/Simple_Sample_Solid_State. json”,He can be successfully created, but will encounter an error and crash during execution.
import omni.kit.commands
from pxr import Gf
import omni.replicator.core as rep
lidar_config = "Simple_Example_Solid_State.json"
_, sensor = omni.kit.commands.execute(
"IsaacSensorCreateRtxLidar",
path="/sensor",
parent=None,
config=lidar_config,
translation=(0, 0, 1.0),
orientation=Gf.Quatd(1,0,0,0),
)
render_product = rep.create.render_product(sensor.GetPath(), [1, 1])
annotator = rep.AnnotatorRegistry.get_annotator("RtxSensorCpuIsaacCreateRTXLidarScanBuffer")
annotator.attach(render_product)
writer = rep.writers.get("RtxLidarDebugDrawPointCloudBuffer")
writer.attach(render_product)
The error message is
2024-10-14 09:55:02 [79,598ms] [Error] [omni.isaac.sensor.plugin] CUDA error 1: cudaErrorInvalidValue - invalid argument)
2024-10-14 09:55:02 [79,598ms] [Error] [omni.isaac.sensor.plugin] CUDA error 1: cudaErrorInvalidValue - invalid argument)
2024-10-14 09:55:02 [79,598ms] [Error] [omni.isaac.sensor.plugin] CUDA error 1: cudaErrorInvalidValue - invalid argument)
2024-10-14 09:55:02 [79,607ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:02 [79,607ms] [Error] [carb.cudainterop.plugin] Failed to wait on external semaphore in CUDA.
2024-10-14 09:55:02 [79,607ms] [Error] [gpu.foundation.plugin] Wait for external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 0, frame submission index 2)"
2024-10-14 09:55:02 [79,613ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:02 [79,613ms] [Error] [carb.cudainterop.plugin] Failed to wait on external semaphore in CUDA.
2024-10-14 09:55:02 [79,613ms] [Error] [gpu.foundation.plugin] Wait for external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 1, frame submission index 2)"
2024-10-14 09:55:32 [109,613ms] [Error] [gpu.foundation.plugin] Submission barrier "CUDA event dependency in MGPU resource" timeout in command list "Render graph command list (Render queue 0, device 0, frame submission index 2)"!
2024-10-14 09:55:32 [109,613ms] [Error] [gpu.foundation.plugin] Wait count: 1, Received signals: 0:
2024-10-14 09:55:32 [109,613ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:32 [109,613ms] [Error] [carb.cudainterop.plugin] Failed to wait on CUDA event.
2024-10-14 09:55:32 [109,613ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:32 [109,613ms] [Error] [carb.cudainterop.plugin] Failed to copy async (dst: 0x79a8e8000000, src: 0x79a8e8800000, size: 3686400).
2024-10-14 09:55:32 [109,613ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:32 [109,613ms] [Error] [carb.cudainterop.plugin] Failed to signal external semaphore in CUDA.
2024-10-14 09:55:32 [109,613ms] [Error] [gpu.foundation.plugin] Signal external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 0, frame submission index 2)"
2024-10-14 09:55:32 [109,620ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:32 [109,621ms] [Error] [carb.cudainterop.plugin] Failed to wait on external semaphore in CUDA.
2024-10-14 09:55:32 [109,621ms] [Error] [gpu.foundation.plugin] Wait for external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 0, frame submission index 0)"
2024-10-14 09:55:32 [109,623ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:55:32 [109,623ms] [Error] [carb.cudainterop.plugin] Failed to wait on external semaphore in CUDA.
2024-10-14 09:55:32 [109,623ms] [Error] [gpu.foundation.plugin] Wait for external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 1, frame submission index 0)"
2024-10-14 09:56:02 [139,623ms] [Error] [gpu.foundation.plugin] Submission barrier "CUDA event dependency in MGPU resource" timeout in command list "Render graph command list (Render queue 0, device 0, frame submission index 0)"!
2024-10-14 09:56:02 [139,623ms] [Error] [gpu.foundation.plugin] Wait count: 1, Received signals: 0:
2024-10-14 09:56:02 [139,623ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:02 [139,624ms] [Error] [carb.cudainterop.plugin] Failed to wait on CUDA event.
2024-10-14 09:56:02 [139,624ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:02 [139,624ms] [Error] [carb.cudainterop.plugin] Failed to copy async (dst: 0x79a888a00000, src: 0x79a8e9800000, size: 3686400).
2024-10-14 09:56:02 [139,624ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:02 [139,624ms] [Error] [carb.cudainterop.plugin] Failed to signal external semaphore in CUDA.
2024-10-14 09:56:02 [139,624ms] [Error] [gpu.foundation.plugin] Signal external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 0, frame submission index 0)"
2024-10-14 09:56:02 [139,641ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:02 [139,641ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA
2024-10-14 09:56:02 [139,641ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource!
2024-10-14 09:56:02 [139,641ms] [Error] [gpu.foundation.plugin] Texture creation failed for the device: 0.
2024-10-14 09:56:02 [139,641ms] [Error] [carb.scenerenderer-rtx.plugin] Failed to allocate 1x1 LdrColor resource for device mask 0x1
2024-10-14 09:56:02 [139,642ms] [Warning] [omni.hydra] Rendering failed.
2024-10-14 09:56:02 [139,642ms] [Error] [omni.usd] HydraEngine::render failed to end the compute graph: error code 6
2024-10-14 09:56:02 [139,646ms] [Warning] [omni.isaac.sensor.plugin] Input to IsaacCreateRTXLidarScanBuffer is not a valid LIDAR POINTCLOUD type. Buffer will not be parsed.
2024-10-14 09:56:03 [139,656ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:03 [139,656ms] [Error] [carb.cudainterop.plugin] Failed to import external memory in CUDA
2024-10-14 09:56:03 [139,656ms] [Error] [gpu.foundation.plugin] Cannot create cuda external memory for resource!
2024-10-14 09:56:03 [139,657ms] [Error] [gpu.foundation.plugin] Texture creation failed for the device: 0.
2024-10-14 09:56:03 [139,657ms] [Error] [carb.scenerenderer-rtx.plugin] Failed to allocate 1x1 LdrColor resource for device mask 0x1
2024-10-14 09:56:03 [139,657ms] [Warning] [omni.hydra] Rendering failed.
2024-10-14 09:56:03 [139,657ms] [Error] [omni.usd] HydraEngine::render failed to end the compute graph: error code 6
2024-10-14 09:56:03 [139,663ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:03 [139,663ms] [Error] [carb.cudainterop.plugin] Failed to wait on external semaphore in CUDA.
2024-10-14 09:56:03 [139,663ms] [Error] [gpu.foundation.plugin] Wait for external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 1, frame submission index 1)"
2024-10-14 09:56:33 [169,663ms] [Error] [gpu.foundation.plugin] Submission barrier "CUDA event dependency in MGPU resource" timeout in command list "Render graph command list (Render queue 0, device 0, frame submission index 1)"!
2024-10-14 09:56:33 [169,663ms] [Error] [gpu.foundation.plugin] Wait count: 1, Received signals: 0:
2024-10-14 09:56:33 [169,663ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:33 [169,663ms] [Error] [carb.cudainterop.plugin] Failed to wait on CUDA event.
2024-10-14 09:56:33 [169,663ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:33 [169,663ms] [Error] [carb.cudainterop.plugin] Failed to copy async (dst: 0x79a8e9000000, src: 0x79a8ea000000, size: 3686400).
2024-10-14 09:56:33 [169,663ms] [Error] [carb.cudainterop.plugin] CUDA error 700: cudaErrorIllegalAddress - an illegal memory access was encountered)
2024-10-14 09:56:33 [169,663ms] [Error] [carb.cudainterop.plugin] Failed to signal external semaphore in CUDA.
2024-10-14 09:56:33 [169,663ms] [Error] [gpu.foundation.plugin] Signal external semaphore failed in CUDA submission in command list "Render graph command list (Render queue 0, device 0, frame submission index 1)"
2024-10-14 09:56:33 [169,666ms] [Warning] [omni.isaac.sensor.plugin] Input to IsaacCreateRTXLidarScanBuffer is not a valid LIDAR POINTCLOUD type. Buffer will not be parsed.
2024-10-14 09:56:33 [169,671ms] [Warning] [omni.physx.plugin] PhysX warning: /builds/omniverse/physics/physx/source/gpucommon/src/PxgCudaMemoryAllocator.cpp, FILE /builds/omniverse/physics/physx/source/gpucommon/src/PxgCudaMemoryAllocator.cpp, LINE 167
2024-10-14 09:56:33 [169,681ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,681ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,682ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,682ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,682ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,683ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,683ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,683ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,683ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,684ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,684ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,684ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,685ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,685ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,685ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,685ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,686ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,686ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,686ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,687ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,687ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,687ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
2024-10-14 09:56:33 [169,687ms] [Error] [omni.physx.plugin] PhysX error: Failed to unload CUDA module data, returned 700., FILE /builds/omniverse/physics/physx/source/cudamanager/src/CudaContextManager.cpp, LINE 817
The computer is configured as
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.183.01 | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
| | | | | | Device-ID | UUID |
| | | | | | Bus-ID | |
|---------------------------------------------------------------------------------------------|
| 0 | NVIDIA GeForce RTX 3070 Ti | Yes: 0 | | 8438 MB | 10de | 0 |
| | | | | | 2482 | 5713ffd4.. |
| | | | | | 1 | |
|---------------------------------------------------------------------------------------------|
| 1 | NVIDIA GeForce RTX 3070 Ti | Yes: 1 | | 8438 MB | 10de | 0 |
| | | | | | 2482 | 092c2cd5.. |
| | | | | | 5 | |
|=============================================================================================|
| OS: 22.04.4 LTS (Jammy Jellyfish) ubuntu, Version: 22.04.4, Kernel: 6.8.0-45-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: 12th Gen Intel(R) Core(TM) i7-12700KF | Cores: 12 | Logical: 20
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31933 | Free Memory: 22964
| Total Page/Swap (MB): 2047 | Free Page/Swap: 1945
The configuration of the driver is
Mon Oct 14 18:15:45 2024
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.183.01 Driver Version: 535.183.01 CUDA Version: 12.2 |
|-----------------------------------------+----------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+======================+======================|
| 0 NVIDIA GeForce RTX 3070 Ti Off | 00000000:01:00.0 On | N/A |
| 46% 62C P2 77W / 290W | 2601MiB / 8192MiB | 4% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
| 1 NVIDIA GeForce RTX 3070 Ti Off | 00000000:05:00.0 Off | N/A |
| 39% 60C P2 70W / 290W | 2250MiB / 8192MiB | 0% Default |
| | | N/A |
+-----------------------------------------+----------------------+----------------------+
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 2458 G /usr/lib/xorg/Xorg 594MiB |
| 0 N/A N/A 2641 G /usr/bin/gnome-shell 54MiB |
| 0 N/A N/A 2879 G ...in/bin/sunloginclient --cmd=autorun 12MiB |
| 0 N/A N/A 3060 G ...) Chrome/58.0.3029.81 Safari/537.36 3MiB |
| 0 N/A N/A 3135 G ...en=A01DE550C902E4CE5E3F78984C7777B8 9MiB |
| 0 N/A N/A 3251 G ...ures=SpareRendererForSitePerProcess 24MiB |
| 0 N/A N/A 7319 G ...seed-version=20241011-130141.903000 78MiB |
| 0 N/A N/A 7685 G ...irefox/5091/usr/lib/firefox/firefox 18MiB |
| 0 N/A N/A 10731 G /proc/self/exe 48MiB |
| 0 N/A N/A 58898 C+G ...hare/ov/pkg/isaac-sim-4.0.0/kit/kit 1529MiB |
| 1 N/A N/A 2458 G /usr/lib/xorg/Xorg 4MiB |
| 1 N/A N/A 58898 C+G ...hare/ov/pkg/isaac-sim-4.0.0/kit/kit 2066MiB |
+---------------------------------------------------------------------------------------+
I hope to receive some help to solve my confusion. I can’t find any reason.