SKRL Documentation Jetbot example for Isaac sim doesn't work

Jetbot Example throws an error when i follow the steps and run it.

[skrl:WARNING] Using a deprecated version of OpenAI Gym's API: 0.21.0
  0%|                                                                                                                                                | 0/500000 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "", line 137, in <module>
  File "/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/standalone_examples/api/omni.isaac.jetbot/skrl_example/src/skrl/skrl/trainers/torch/", line 77, in train
  File "/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/standalone_examples/api/omni.isaac.jetbot/skrl_example/src/skrl/skrl/trainers/torch/", line 172, in single_agent_train
    actions = self.agents.act(states, timestep=timestep, timesteps=self.timesteps)[0]
  File "/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/standalone_examples/api/omni.isaac.jetbot/skrl_example/src/skrl/skrl/agents/torch/ppo/", line 213, in act
    actions, log_prob, outputs = self.policy.act({"states": self._state_preprocessor(states)}, role="policy")
  File "/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/standalone_examples/api/omni.isaac.jetbot/skrl_example/src/skrl/skrl/models/torch/", line 138, in act
    mean_actions, log_std, outputs = self.compute(inputs, role)
  File "", line 48, in compute
    x =["states"].view(-1, *self.observation_space.shape).permute(0, 3, 1, 4))
RuntimeError: permute(sparse_coo): number of dimensions in the tensor input does not match the length of the desired ordering of dimensions i.e. input.dim() = 2 is not equal to len(dims) = 4
[skrl:INFO] Closing environment
[10.196s] Simulation App Shutting Down

For reference i ran cartpole and worked fine despite the same Gym error, i tried also import Gymnasium as Gym but didn’t work.

I’m ultimately trying to expand this example to use IPPO.

Hi @qwe.marty

Please, note that the Jetbot example in the skrl documentation (to shows how to define and use CNN) is for an old Isaac Sim version (2021.2.1). In that version (2021.2.1), the jetbot observation space was a 128 X 128 RGB image, while in the latest Isaac Sim (2022.2.1) the observation space is a 16 dim vector as indicted next:

You can use the following script (which uses a MLP policy and new hyperparameters) for training in the latest Isaac Sim version: (4.2 KB)

Got this when i ran non headless, and with headless pc sort of crashed. Headless worked for my other example though.

Hi @qwe.marty

I can run the new file in non-headless mode without any problem.
Can you please share the Isaac Sim logs?

[skrl:INFO] Seed: 1521575493
[Warning] [omni.isaac.kit.simulation_app] Modules: ['omni.isaac.kit.app_framework'] were loaded before SimulationApp was started and might not be loaded correctly.
[Warning] [omni.isaac.kit.simulation_app] Please check to make sure no extra omniverse or pxr modules are imported before the call to SimulationApp(...)
Starting kit application with the following args:  ['/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.isaac.kit/omni/isaac/kit/', '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/apps/omni.isaac.sim.python.kit', '--/app/tokens/exe-path=/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/kit', '--/persistent/app/viewport/displayOptions=3094', '--/rtx/materialDb/syncLoads=True', '--/rtx/hydra/materialSyncLoads=True--/omni.kit.plugin/syncUsdLoads=True', '--/app/renderer/resolution/width=1280', '--/app/renderer/resolution/height=720', '--/app/window/width=1440', '--/app/window/height=900', '--/renderer/multiGpu/enabled=True', '--/app/fastShutdown=True', '--ext-folder', '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts', '--ext-folder', '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/apps', '--/physics/cudaDevice=0', '--portable', '--no-window']
Passing the following args to the base kit application:  []
[Warning] [] No crash reporter present, dumps uploading isn't available.
[Info] [carb] Logging to file: /home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/logs/Kit/Isaac-Sim/2022.2/kit_20230830_202343.log
2023-08-30 19:23:43 [20ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.lidar] Extensions config 'extension.toml' doesn't exist '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar' or '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar/config'
2023-08-30 19:23:43 [20ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.radar] Extensions config 'extension.toml' doesn't exist '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar' or '/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar/config'
[0.191s] [ext: omni.stats-0.0.0] startup
[0.226s] [ext: omni.rtx.shadercache-1.0.0] startup
[0.231s] [ext: omni.assets.plugins-0.0.0] startup
[0.234s] [ext: omni.gpu_foundation-0.0.0] startup
[0.258s] [ext: carb.windowing.plugins-1.0.0] startup
[0.265s] [ext: omni.kit.renderer.init-0.0.0] startup
2023-08-30 19:23:45 [1,893ms] [Warning] [] No command queue family supports flags: 0x100, queue type: 3. No queues of this type will be created
2023-08-30 19:23:45 [1,908ms] [Warning] [] Raytracing is not supported on GPU: 0. Skipping this device.

| Driver Version: 535.86.05     | Graphics API: Vulkan
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
| 0   | AMD Unknown (RADV RENOIR)        |        |     | 5468    MB | 1002      | 0          |
|     |                                  |        |     |            | 1638      | 00000000.. |
| 1   | NVIDIA GeForce RTX 3060 Laptop.. | Yes: 0 |     | 6144    MB | 10de      | 0          |
|     |                                  |        |     |            | 2520      | 8aea3097.. |
| OS: Linux marty-Blade-14-RZ09-0370, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (
| Processor: AMD Ryzen 9 5900HX with Radeon Graphics         | Cores: Unknown | Logical: 16
| Total Memory (MB): 15380 | Free Memory: 3364
| Total Page/Swap (MB): 2047 | Free Page/Swap: 2047
2023-08-30 19:23:45 [1,957ms] [Warning] [] IOMMU is enabled. Found 11 items in /sys/kernel/iommu_groups/.
2023-08-30 19:23:45 [1,957ms] [Warning] [] On Linux only, CUDA and the display driver does not support IOMMU-enabled bare-metal PCIe peer to peer memory copy.
However, CUDA and the display driver does support IOMMU via VM pass through. As a consequence, users on Linux,
when running on a native bare metal system, should disable the IOMMU. The IOMMU should be enabled and the VFIO driver
be used as a PCIe pass through for virtual machines.
2023-08-30 19:23:45 [1,957ms] [Warning] [] 
2023-08-30 19:23:45 [1,957ms] [Warning] [] -----------------------------------------------------------------------
2023-08-30 19:23:45 [1,957ms] [Warning] [] !!!!! Local system validation failed! Incorrect configuration detected.
2023-08-30 19:23:45 [1,957ms] [Warning] []       Summary below. Details above.
2023-08-30 19:23:45 [1,957ms] [Warning] [] -----------------------------------------------------------------------
2023-08-30 19:23:45 [1,957ms] [Warning] [] 
2023-08-30 19:23:45 [1,957ms] [Warning] []  - ECC:                         OK
2023-08-30 19:23:45 [1,957ms] [Warning] []  - IOMMU:                       FAILED
2023-08-30 19:23:45 [1,957ms] [Warning] [] 
2023-08-30 19:23:45 [1,957ms] [Warning] [] -----------------------------------------------------------------------
[2.220s] [ext: omni.kit.pipapi-0.0.0] startup
[2.239s] [ext: omni.kit.pip_archive-0.0.0] startup
[2.243s] [ext: omni.kit.loop-isaac-1.0.0] startup
[2.244s] [ext: omni.kit.async_engine-0.0.0] startup
[2.245s] [ext: omni.kit.test-0.0.0] startup
[2.278s] [ext: omni.usd.config-1.0.0] startup
[2.285s] [ext: omni.usd.libs-1.0.0] startup
[2.544s] [ext: omni.isaac.core_archive-2.0.1] startup
[2.556s] [ext: omni.pip.torch-1_13_1-0.1.4] startup
[2.558s] [ext: omni.isaac.ml_archive-1.1.0] startup
[2.559s] [ext: omni.client-0.1.1] startup
[2.579s] [ext: omni.appwindow-1.0.1] startup
[2.582s] [ext: omni.kit.renderer.core-0.0.0] startup
[2.589s] [ext: omni.kit.renderer.capture-0.0.0] startup
[2.593s] [ext: omni.kit.renderer.imgui-0.0.0] startup
[2.651s] [ext:] startup
[2.656s] [ext: omni.ui-2.14.4] startup
[2.715s] [ext: omni.uiaudio-1.0.0] startup
[2.717s] [ext: omni.kit.mainwindow-1.0.0] startup
[2.719s] [ext: omni.kit.uiapp-0.0.0] startup
[2.719s] [ext: omni.usd.schema.physics-1.0.0] startup
[2.773s] [ext: omni.usd.schema.isaac-1.1.0] startup
[2.794s] [ext: omni.usd.schema.semantics-0.0.0] startup
[2.807s] [ext: omni.usd.schema.omnigraph-1.0.0] startup
[2.819s] [ext: omni.usd.schema.forcefield-0.0.0] startup
[2.831s] [ext: omni.usd.schema.omniscripting-1.0.0] startup
[2.843s] [ext: omni.usd.schema.geospatial-0.0.0] startup
[2.851s] [ext: omni.usd.schema.anim-0.0.0] startup
[2.916s] [ext:] startup
[2.923s] [ext: omni.usd.schema.scene.visualization-1.0.0] startup
[2.925s] [ext: omni.usd.schema.physx-0.0.0] startup
[2.961s] [ext: omni.gpucompute.plugins-0.0.0] startup
[2.962s] [ext: omni.timeline-1.0.5] startup
[2.964s] [ext: omni.kit.search_core-1.0.2] startup
[2.966s] [ext: omni.hydra.scene_delegate-0.3.0] startup
[2.976s] [ext: omni.kit.widget.path_field-2.0.4] startup
[2.983s] [ext: omni.kit.widget.filebrowser-2.3.10] startup
[3.000s] [ext: omni.kit.widget.browser_bar-2.0.5] startup
[3.002s] [ext: omni.kit.window.popup_dialog-2.0.16] startup
[3.008s] [ext: omni.kit.actions.core-1.0.0] startup
[3.012s] [ext: omni.usd.core-1.0.4] startup
[3.014s] [ext: omni.kit.audiodeviceenum-1.0.0] startup
[3.016s] [ext: omni.kit.widget.nucleus_connector-1.0.3] startup
[3.018s] [ext: omni.kit.commands-1.4.5] startup
[3.024s] [ext: omni.hydra.usdrt_delegate-4.3.2] startup
[3.042s] [ext: omni.kit.notification_manager-1.0.5] startup
[3.045s] [ext: omni.usd-1.6.30] startup
[3.104s] [ext: omni.kit.widget.versioning-1.3.8] startup
[3.107s] [ext: omni.iray.libs-0.0.0] startup
[3.148s] [ext: omni.kit.window.filepicker-2.7.15] startup
[3.211s] [ext: omni.mdl.neuraylib-0.1.0] startup
[3.216s] [ext: omni.kit.collaboration.channel_manager-1.0.9] startup
[3.218s] [ext: omni.kit.window.file_importer-1.0.10] startup
[3.219s] [ext: omni.mdl-0.1.0] startup
[3.241s] [ext: omni.kit.usd.layers-2.0.11] startup
[3.253s] [ext:] startup
[3.266s] [ext: omni.kit.material.library-1.3.21] startup
[3.272s] [ext:] startup
[3.274s] [ext: omni.kit.clipboard-1.0.0] startup
[3.275s] [ext: omni.kit.widget.graph-1.5.6-104_2] startup
[3.364s] [ext: omni.kit.context_menu-1.5.12] startup
[3.368s] [ext: omni.kit.window.extensions-1.1.1] startup
[3.375s] [ext: omni.inspect-1.0.1] startup
[3.380s] [ext:] startup
[3.383s] [ext: omni.kit.primitive.mesh-1.0.8] startup
[3.388s] [ext: omni.graph.core-2.65.4] startup
[3.394s] [ext: omni.isaac.version-1.0.0] startup
[3.396s] [ext: omni.kit.stage_templates-1.1.13] startup
[3.398s] [ext: omni.kit.usd_undo-0.1.2] startup
[3.399s] [ext:] startup
[3.419s] [ext: omni.ui.scene-1.5.18] startup
[3.428s] [ext: omni.graph-1.50.2] startup
[3.476s] [ext: omni.ui_query-1.1.1] startup
[3.478s] [ext: omni.volume-0.1.0] startup
[3.483s] [ext: omni.kit.ui_test-1.2.9] startup
[3.485s] [ext: omni.hydra.rtx-0.1.0] startup
[3.507s] [ext: omni.kit.widget.searchfield-1.0.10] startup
[3.509s] [ext: omni.kit.graph.delegate.default-1.0.18] startup
[3.513s] [ext: omni.debugdraw-0.1.1] startup
[3.518s] [ext: omni.kit.graph.editor.core-1.4.7] startup
[3.522s] [ext: omni.hydra.pxr-1.1.2] startup
[3.529s] [ext: omni.activity.core-1.0.1] startup
[3.533s] [ext: omni.kit.hydra_texture-1.0.11] startup
[3.540s] [ext: omni.kit.viewport.legacy_gizmos-1.0.10] startup
[3.547s] [ext: omni.kit.viewport.registry-104.0.2] startup
[3.548s] [ext: omni.kit.widget.viewport-104.1.16] startup
[3.551s] [ext: omni.kit.window.drop_support-1.0.1] startup
[3.552s] [ext: omni.kit.window.file_exporter-1.0.10] startup
[3.554s] [ext: omni.hydra.engine.stats-1.0.0] startup
[3.558s] [ext: omni.kit.window.content_browser_registry-0.0.1] startup
[3.559s] [ext: omni.kit.window.file-1.3.32] startup
[3.563s] [ext: omni.kit.viewport.window-104.1.23] startup
[3.589s] [ext: omni.kit.widget.settings-1.0.1] startup
[3.591s] [ext: omni.kit.widget.stage-2.7.24] startup
[3.596s] [ext: omni.kit.window.content_browser-2.6.8] startup
[3.613s] [ext: omni.kit.viewport.utility-1.0.14] startup
[3.615s] [ext: omni.kit.window.preferences-1.3.8] startup
[3.640s] [ext: omni.kit.widget.text_editor-1.0.2] startup
[3.644s] [ext: omni.kit.widget.prompt-1.0.5] startup
[3.645s] [ext:] startup
[3.656s] [ext: omni.kit.graph.delegate.modern-1.6.5] startup
[3.658s] [ext: omni.graph.ui-1.24.2] startup
[3.699s] [ext: omni.physics.tensors-0.1.0] startup
[3.709s] [ext: omni.kit.graph.widget.variables-2.0.4] startup
[3.711s] [ext: omni.kit.graph.usd.commands-1.2.0] startup
[3.712s] [ext: omni.convexdecomposition-104.2.4-5.1] startup
[3.716s] [ext: omni.graph.window.core-1.43.3] startup
[3.725s] [ext: omni.kit.widget.zoombar-1.0.4] startup
[3.726s] [ext: omni.kvdb-0.0.0] startup
[3.731s] [ext: omni.usdphysics-104.2.4-5.1] startup
[3.734s] [ext: omni.localcache-0.0.0] startup
[3.737s] [ext: omni.graph.scriptnode-0.10.0] startup
[3.741s] [ext: omni.physx-104.2.4-5.1] startup
[3.778s] [ext: omni.command.usd-1.0.2] startup
[3.781s] [ext: omni.physx.tensors-0.1.0] startup
[3.789s] [ext: omni.graph.window.generic-1.3.15] startup
[3.792s] [ext: omni.kit.browser.core-2.2.2] startup
[3.798s] [ext: omni.graph.action-1.31.1] startup
[3.880s] [ext: omni.kit.browser.folder.core-1.7.3] startup
[3.885s] [ext: omni.kit.window.cursor-1.1.1] startup
[3.886s] [ext: omni.kit.widget.spinner-1.0.4] startup
[3.888s] [ext: omni.kit.browser.sample-1.2.5] startup
[3.891s] [ext: omni.graph.nodes-1.48.3] startup
[3.913s] [ext: omni.kit.viewport.menubar.core-104.4.3] startup
[3.935s] [ext: omni.kit.numpy.common-0.1.0] startup
[3.938s] [ext: omni.warp-0.6.3] startup
Warp 0.6.3 initialized:
   CUDA Toolkit: 11.5, Driver: 12.2
     "cpu"    | x86_64
     "cuda:0" | NVIDIA GeForce RTX 3060 Laptop GPU (sm_86)
   Kernel cache: /home/marty/.cache/warp/0.6.3
[4.158s] [ext: omni.syntheticdata-0.2.4] startup
2023-08-30 19:23:47 [4,161ms] [Warning] [omni.kit.viewport.menubar.core.menu_item.viewport_menu_item] ViewportMenuItem order argument is deprecated, use order_setting_path
[4.180s] [ext: omni.isaac.dynamic_control-1.2.3] startup
[4.195s] [ext: omni.replicator.core-1.7.8] startup
2023-08-30 19:23:47 [4,210ms] [Warning] [omni.replicator.core.scripts.annotators] Annotator PostProcessDispatch is already registered, overwriting annotator template
[4.368s] [ext: omni.isaac.core-1.46.3] startup
[4.458s] [ext: omni.kit.manipulator.viewport-104.0.7] startup
[4.460s] [ext: omni.isaac.core_nodes-0.23.2] startup
[4.569s] [ext: omni.isaac.cloner-0.4.1] startup
[4.570s] [ext: omni.isaac.lula-1.2.1] startup
[4.591s] [ext: omni.graph.visualization.nodes-2.0.0] startup
[4.598s] [ext: omni.isaac.debug_draw-0.2.3] startup
[4.606s] [ext: omni.isaac.gym-0.3.3] startup
[4.606s] [ext: omni.graph.window.action-1.5.5] startup
[4.608s] [ext: omni.isaac.ui-0.8.0] startup
[4.613s] [ext: usdrt.scenegraph-4.3.2] startup
[4.638s] [ext: omni.isaac.motion_planning-0.2.2] startup
[4.656s] [ext: omni.isaac.surface_gripper-0.4.0] startup
[4.663s] [ext: omni.isaac.range_sensor-0.8.1] startup
[4.698s] [ext: omni.isaac.motion_generation-4.5.6] startup
[4.705s] [ext: omni.isaac.manipulators-1.1.0] startup
[4.708s] [ext: omni.isaac.sensor-5.6.3] startup
2023-08-30 19:23:48 [4,695ms] [Warning] [omni.ext.plugin] [ext: omni.isaac.sensor-5.6.3] Native plugin search dir contains several files: /home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.isaac.sensor/bin . It makes dir walk slow, replace with the exact path to the plugin instead of a wildcard.
[4.786s] [ext: omni.isaac.dofbot-0.3.0] startup
[4.788s] [ext: omni.isaac.occupancy_map-0.2.7] startup
[4.800s] [ext: omni.isaac.quadruped-1.3.0] startup
[5.128s] [ext: omni.isaac.scene_blox-0.1.0] startup
[5.129s] [ext: omni.isaac.synthetic_utils-0.4.3] startup
[5.132s] [ext: omni.isaac.universal_robots-0.3.2] startup
[5.133s] [ext: omni.isaac.isaac_sensor-2.0.0] startup
2023-08-30 19:23:48 [5,120ms] [Warning] [omni.isaac.isaac_sensor] omni.isaac.isaac_sensor is deprecated and was renamed; use omni.isaac.sensor
[5.134s] [ext: omni.kit.widget.live_session_management-1.1.3] startup
[5.137s] [ext: omni.kit.hotkeys.core-1.0.8] startup
[5.145s] [ext: omni.isaac.wheeled_robots-0.6.3] startup
[5.155s] [ext: omni.kit.widget.stage_icons-1.0.2] startup
[5.157s] [ext: omni.kit.widget.layers-1.6.11] startup
[5.169s] [ext: omni.kit.selection-0.1.0] startup
[5.171s] [ext: omni.isaac.mjcf-0.3.1] startup
[5.185s] [ext: omni.kit.window.stage-2.3.12] startup
[5.189s] [ext:] startup
[5.191s] [ext:] startup
[5.194s] [ext:] startup
[5.196s] [ext:] startup
[5.198s] [ext:] startup
[5.199s] [ext:] startup
[5.201s] [ext:] startup
[5.203s] [ext:] startup
[5.205s] [ext: omni.hydra.scene_api-0.1.1] startup
[5.213s] [ext:] startup
[5.216s] [ext:] startup
[5.217s] [ext:] startup
[5.219s] [ext:] startup
[5.224s] [ext: omni.kit.manipulator.transform-104.6.12] startup
[5.226s] [ext: omni.kit.widget.toolbar-1.4.0] startup
[5.234s] [ext: omni.kit.profiler.window-2.0.5] startup
[5.437s] [ext:] startup
[5.439s] [ext: omni.kit.manipulator.selector-1.0.1] startup
[5.441s] [ext: omni.kit.manipulator.tool.snap-1.2.4] startup
[5.447s] [ext: omni.kit.window.toolbar-1.4.0] startup
[5.450s] [ext:] startup
[5.452s] [ext: omni.kit.stage_column.payload-1.0.8] startup
[5.455s] [ext:] startup
[5.455s] [ext: omni.kit.manipulator.prim-104.10.7] startup
[5.461s] [ext: omni.kit.manipulator.selection-104.0.6] startup
[5.461s] [ext: omni.kit.viewport.menubar.display-104.1.11] startup
[5.463s] [ext:] startup
[5.468s] [ext: omni.rtx.window.settings-0.6.2] startup
[5.475s] [ext: omni.kit.viewport.menubar.settings-104.3.5] startup
[5.481s] [ext: omni.kit.viewport.menubar.render-104.0.20] startup
[5.484s] [ext: omni.physx.commands-104.2.4-5.1] startup
[5.488s] [ext: omni.kit.stage_column.variant-1.0.9] startup
[5.490s] [ext: omni.hydra.pxr.settings-1.0.3] startup
[5.492s] [ext: omni.kit.viewport.bundle-104.0.2] startup
[5.492s] [ext: omni.physx.ui-104.2.4-5.1] startup
[5.536s] [ext:] startup
[5.539s] [ext: omni.kit.viewport.pxr-104.0.1] startup
[5.539s] [ext: omni.kit.viewport.ready-1.0.2] startup
[5.540s] [ext: omni.physx.demos-104.2.4-5.1] startup
[5.543s] [ext:] startup
[5.585s] [ext: omni.isaac.urdf-0.5.9] startup
[5.613s] [ext: omni.kit.widget.highlight_label-1.0.0] startup
[5.614s] [ext: omni.physx.supportui-104.2.4-5.1] startup
[5.632s] [ext: omni.physx.vehicle-104.2.4-5.1] startup
[5.647s] [ext: omni.physx.cct-104.2.4-5.1] startup
[5.656s] [ext:] startup
[5.665s] [ext: omni.kit.actions.window-1.1.0] startup
[5.671s] [ext: omni.kit.window.commands-0.2.4] startup
[5.673s] [ext: omni.kit.window.console-0.2.3] startup
[5.684s] [ext: omni.physx.bundle-104.2.4-5.1] startup
[5.684s] [ext: omni.graph.bundle.action-1.3.0] startup
[5.684s] [ext: omni.kit.window.script_editor-1.7.2] startup
[5.688s] [ext: omni.kit.hotkeys.window-1.1.3] startup
[5.695s] [ext: omni.kit.window.status_bar-0.1.5] startup
[5.701s] [ext: omni.kit.window.title-1.1.2] startup
[5.702s] [ext: omni.replicator.composer-1.2.10] startup
[5.708s] [ext: omni.replicator.isaac-1.7.4] startup
[5.726s] [ext: omni.resourcemonitor-1.0.0] startup
[5.734s] [ext: omni.rtx.settings.core-0.5.8] startup
[5.739s] [ext: omni.isaac.franka-0.4.0] startup
[5.741s] [ext: omni.kit.viewport.rtx-104.0.0] startup
[5.741s] [ext: semantics.schema.editor-0.3.3] startup
[5.745s] [ext:] startup
[5.747s] [ext: omni.isaac.utils-0.2.4] startup
[5.752s] [ext: omni.isaac.kit-1.4.1] startup
[5.753s] [ext: omni.isaac.cortex-0.3.2] startup
[5.753s] [ext: omni.kit.window.stats-0.1.2] startup
[5.755s] [ext: omni.isaac.sim.python-2022.2.1] startup
[5.756s] Simulation App Starting
/home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/ line 41: 83899 Killed                  $python_exe "$@" $args
There was an error running python

Is that what you meant by logs? Right now i ran it headless as you sent me, still gave this error

Hi @qwe.marty

Please, check the next link for the location for Isaac Sim logs.

Btw, do you have the same problem if you run the Jetbot stable baselines example?

  1. attached
    kit_20230830_053818.log (1.4 MB)

  2. No i dont, works fine

  3. Ultimately i want to be able to use SKRL for MARL for this codebase Reinforcement Learning using Stable Baselines — isaacsim latest documentation

Hi @qwe.marty

  • Regarding the execution of the example:

    If the sb3 example works, running the skrl script for Isaac Sim 2022.2.1 Jetbot environment should work as well. Can you try running it again (by downloading the following files to any folder and running the command shown)? (6.0 KB) (4.2 KB)

  • Regarding the logs. The following has come to my attention:

    What implementation are you performing that produces the following messages related to Isaac Gym Preview (isaacgymenvs)?

    2023-08-30 04:38:41 [22,914ms] [Info] [] Executing file: /tmp/carb.tF0yGW/
    2023-08-30 04:38:41 [22,915ms] [Info] [] Found a script to execute: /tmp/carb.tF0yGW/
    2023-08-30 04:38:41 [22,917ms] [Error] [carb.scripting-python.plugin] ModuleNotFoundError: No module named 'isaacgymenvs'
      /tmp/carb.tF0yGW/ <module>
    2023-08-30 04:38:41 [22,917ms] [Error] [] [py stderr]: ModuleNotFoundError: No module named 'isaacgymenvs'
      /tmp/carb.tF0yGW/ <module>
    2023-08-30 04:38:58 [40,051ms] [Info] [] Executing file: /tmp/carb.tF0yGW/
    2023-08-30 04:38:58 [40,051ms] [Info] [] Found a script to execute: /tmp/carb.tF0yGW/
    2023-08-30 04:38:58 [40,053ms] [Error] [carb.scripting-python.plugin] ModuleNotFoundError: No module named 'isaacgym'
      /tmp/carb.tF0yGW/ <module>
    2023-08-30 04:38:58 [40,053ms] [Error] [] [py stderr]: ModuleNotFoundError: No module named 'isaacgym'
      /tmp/carb.tF0yGW/ <module>

Btw, If you wish to perform RL with Omnniverse, I recommend moving your implementation to OIGE RL Framework or Isaac Orbit (both also supported by skrl).

The example implemented on Gym is extremely slow and does not take advantage of the simulation capabilities of massively parallel environments.

Same error with the files you sent
Not sure what you mean by which implementation?
kit_20230830_053818.log (1.4 MB)

If i were to run this on Orbit or OIGE, i wouldn’t need to change anything in the code?

Hi @qwe.marty

What skrl version are you using?

~/.local/share/ov/pkg/isaac_sim-2022.2.1/ -m pip show skrl

Regarding the environment: Yes, you need to implement your environment in OIGE or Issac Orbit.
It could take some time but you will gain on performance and will learn about creating your custom environment on top of those frameworks :)

~$ ~/.local/share/ov/pkg/isaac_sim-2022.2.1/ -m pip show skrl
Name: skrl
Version: 1.0.0
Summary: Modular and flexible library for reinforcement learning on PyTorch and JAX
Author: Toni-SM
License: MIT License
Location: /home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/standalone_examples/api/omni.isaac.jetbot/skrl_example/src/skrl
Editable project location: /home/marty/.local/share/ov/pkg/isaac_sim-2022.2.1/standalone_examples/api/omni.isaac.jetbot/skrl_example/src/skrl
Requires: gym, gymnasium, packaging, tensorboard, tqdm

P.S Thanks for the information right now i do not care about speed of training or simulation, i care about the code working, so until then i will probably use Isaac sim vs Orbit/OIGE

It appears i made a silly mistake (when downloading the last file you sent it was showing as torch_isaacsim_jetbot_ppo(1).py as i had another older copy that wasn’t working

It works now, very slow compared to SB3, is that normal?
SB3 was running faster not headless compared to headless here

ALso what about Step 2 and 3 of Reinforcement Learning using Stable Baselines — Omniverse IsaacSim latest documentation of Launching Tensorboard and visualizing the training policy, should i use the same exact file and commands as that example?

Resolved, tensorboard works well with SKRL, just need to setup the directory

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.