Note: For any Isaac Lab topics, please submit your topic to its GitHub repo (GitHub - isaac-sim/IsaacLab: Unified framework for robot learning built on NVIDIA Isaac Sim) following the instructions provided on Isaac Lab’s Contributing Guidelines (Contribution Guidelines — Isaac Lab Documentation).
Please provide all relevant details below before submitting your post. This will help the community provide more accurate and timely assistance. After submitting, you can check the appropriate boxes. Remember, you can always edit your post later to include additional information if needed.
Isaac Sim Version
4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):
Operating System
Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):
GPU Information
- Model: Tesla V100
- Driver Version:
Topic Description
I am trying to setup IssacLab on a cluster and run the Isaac-Cartpole-v0 script to test my pipeline.
but I get the error:
Error] [carb] [Plugin: libomni.physx.tensors.plugin.so] Could not load the dynamic library from /isaac-sim/extsPhysics/omni.physx.tensors/bin/libomni.physx.tensors.plugin.so. Error: libcuda.so.1: cannot open shared object file: No such file or directory (Additional information may be available by running the process with the LD_DEBUG environment variable set)
See below for a more detailed log.
Detailed Description
Steps to Reproduce
- create the apptainer env by running
apptainer shell isaac-lab-base.sif - run:
./isaaclab.sh -p scripts/reinforcement_learning/sb3/play.py --task Isaac-Cartpole-v0 --headless
Error Messages
Apptainer> ./isaaclab.sh -p scripts/reinforcement_learning/sb3/play.py --task Isaac-Cartpole-v0 --headless
[INFO] Using python from: /home/jsyu/RL/isaaclab_20250425_001727/_isaac_sim/python.sh
[INFO][AppLauncher]: Using device: cuda:0
[INFO][AppLauncher]: Loading experience file: /workspace/isaaclab/apps/isaaclab.python.headless.kit
[Info] [carb] Logging to file: /isaac-sim/kit/logs/Kit/Isaac-Sim/4.5/kit_20250505_222832.log
2025-05-05 20:28:32 [0ms] [Warning] [omni.kit.app.plugin] No crash reporter present, dumps uploading isn’t available.
2025-05-05 20:28:33 [58ms] [Warning] [omni.ext.plugin] [ext: rendering_modes] Extensions config ‘extension.toml’ doesn’t exist ‘/workspace/isaaclab/apps/rendering_modes’ or ‘/workspace/isaaclab/apps/rendering_modes/config’
2025-05-05 20:28:38 [6,011ms] [Warning] [omni.usd_config.extension] Enable omni.materialx.libs extension to use MaterialX
2025-05-05 20:28:40 [7,033ms] [Warning] [omni.platforminfo.plugin] failed to open the default display. Can’t verify X Server version.
2025-05-05 20:28:41 [8,055ms] [Warning] [omni.datastore] OmniHub is inaccessible
2025-05-05 20:28:42 [9,573ms] [Warning] [omni.isaac.dynamic_control] omni.isaac.dynamic_control is deprecated as of Isaac Sim 4.5. No action is needed from end-users.
2025-05-05 20:28:43 [10,048ms] [Error] [carb] [Plugin: libomni.physx.tensors.plugin.so] Could not load the dynamic library from /isaac-sim/extsPhysics/omni.physx.tensors/bin/libomni.physx.tensors.plugin.so. Error: libcuda.so.1: cannot open shared object file: No such file or directory (Additional information may be available by running the process with the LD_DEBUG environment variable set)
2025-05-05 20:28:43 [10,048ms] [Warning] [carb] Potential plugin preload failed: /isaac-sim/extsPhysics/omni.physx.tensors/bin/libomni.physx.tensors.plugin.so
2025-05-05 20:28:43 [10,048ms] [Error] [omni.ext.plugin] [ext: omni.physx.tensors-106.5.7] failed to load native plugin: /isaac-sim/extsPhysics/omni.physx.tensors/bin/libomni.physx.tensors.plugin.so
2025-05-05 20:28:48 [15,058ms] [Error] [carb] [Plugin: libomni.physx.fabric.plugin.so] Could not load the dynamic library from /isaac-sim/extsPhysics/omni.physx.fabric/bin/libomni.physx.fabric.plugin.so. Error: libcuda.so.1: cannot open shared object file: No such file or directory (Additional information may be available by running the process with the LD_DEBUG environment variable set)
2025-05-05 20:28:48 [15,058ms] [Warning] [carb] Potential plugin preload failed: /isaac-sim/extsPhysics/omni.physx.fabric/bin/libomni.physx.fabric.plugin.so
2025-05-05 20:28:48 [15,058ms] [Error] [omni.ext.plugin] [ext: omni.physx.fabric-106.5.7] failed to load native plugin: /isaac-sim/extsPhysics/omni.physx.fabric/bin/libomni.physx.fabric.plugin.so
2025-05-05 20:28:48 [15,077ms] [Error] [carb.scripting-python.plugin] RuntimeError: Failed to acquire interface: omni::physx::IPhysxFabric (pluginName: nullptr)
At:
/isaac-sim/extsPhysics/omni.physx.fabric/omni/physxfabric/init.py(7): _get_interface
/isaac-sim/extsPhysics/omni.physx.fabric/omni/physxfabric/init.py(11): get_physx_fabric_interface
/isaac-sim/extsPhysics/omni.physx.fabric/omni/physxfabric/scripts/extension.py(12): on_startup
/home/jsyu/RL/isaaclab_20250425_001727/_isaac_sim/kit/kernel/py/omni/ext/_impl/_internal.py(166): _startup_ext
/home/jsyu/RL/isaaclab_20250425_001727/_isaac_sim/kit/kernel/py/omni/ext/_impl/_internal.py(224): startup
/home/jsyu/RL/isaaclab_20250425_001727/_isaac_sim/kit/kernel/py/omni/ext/_impl/_internal.py(328): startup_extension
PythonExtension.cpp::startup()(2):
/home/jsyu/RL/isaaclab_20250425_001727/_isaac_sim/exts/isaacsim.simulation_app/isaacsim/simulation_app/simulation_app.py(427): _start_app
/home/jsyu/RL/isaaclab_20250425_001727/_isaac_sim/exts/isaacsim.simulation_app/isaacsim/simulation_app/simulation_app.py(212): init
/workspace/isaaclab/source/isaaclab/isaaclab/app/app_launcher.py(780): _create_app
/workspace/isaaclab/source/isaaclab/isaaclab/app/app_launcher.py(131): init
/home/jsyu/RL/isaaclab_20250425_001727/scripts/reinforcement_learning/sb3/play.py(44):
2025-05-05 20:28:48 [15,078ms] [Error] [omni.ext.plugin] [ext: omni.physx.fabric-106.5.7] Failed to startup python extension.
Warp CUDA error: Could not open libcuda.so.
Warp CUDA error: Function cuDriverGetVersion_f: a suitable driver entry point was not found
Warp CUDA error 36 (in function cuda_driver_version, /builds/omniverse/warp/warp/native/warp.cu:1649)
2025-05-05 20:28:57 [24,732ms] [Error] [omni.gpucompute-cuda.plugin] CUDA error in createContext: CUDA driver version is insufficient for CUDA runtime version: ../../../source/plugins/omni.gpucompute-cuda/GpuCompute-Cuda.cpp: 179 (device 593655145)
2025-05-05 20:28:57 [24,733ms] [Error] [omni.physx.plugin] PhysX error: Could not load libcuda.so: libcuda.so: cannot open shared object file: No such file or directory
, FILE /builds/omniverse/physics/physx/source/physx/src/gpu/PxPhysXGpuModuleLoader.cpp, LINE 204
[INFO]: Parsing configuration from: isaaclab_tasks.manager_based.classic.cartpole.cartpole_env_cfg:CartpoleEnvCfg
[INFO]: Parsing configuration from: /workspace/isaaclab/source/isaaclab_tasks/isaaclab_tasks/manager_based/classic/cartpole/agents/sb3_ppo_cfg.yaml
Traceback (most recent call last):
File “/home/jsyu/RL/isaaclab_20250425_001727/scripts/reinforcement_learning/sb3/play.py”, line 168, in
main()
File “/home/jsyu/RL/isaaclab_20250425_001727/scripts/reinforcement_learning/sb3/play.py”, line 92, in main
checkpoint_path = get_checkpoint_path(log_root_path, “.*”, checkpoint)
File “/workspace/isaaclab/source/isaaclab_tasks/isaaclab_tasks/utils/parse_cfg.py”, line 173, in get_checkpoint_path
os.path.join(log_path, run) for run in os.scandir(log_path) if run.is_dir() and re.match(run_dir, run.name)
FileNotFoundError: [Errno 2] No such file or directory: ‘/home/jsyu/RL/isaaclab_20250425_001727/logs/sb3/Isaac-Cartpole-v0’
Screenshots or Videos
(If applicable, add screenshots or links to videos that demonstrate the issue)
Additional Information
What I’ve Tried
(Describe any troubleshooting steps you’ve already taken)
Related Issues
(If you’re aware of any related issues or forum posts, please link them here)
Additional Context
(Add any other context about the problem here)