Sequencer not working in Isaac Sim

I try to create a sequence like this:

  • Start with an empty stage
  • Enable the sequencer extension
  • Choose an animated character from Nucleus: omniverse://localhost/NVIDIA/Assets/Characters/Reallusion/Worker/Worker.usd
  • Drag it into the sequencer window
    Result: No clip is created

This is the log:

Loading user config located at: '/home/brunovetter/.local/share/ov/data/Kit/Isaac-Sim/2021.2/user.config.json'
[Info] [carb] Logging to file: /home/brunovetter/.nvidia-omniverse/logs/Kit/Isaac-Sim/2021.2/kit_20220201_181615.log
[0.092s] [ext: omni.kit.extpath.git-0.0.0] startup
git version 2.25.1
[0.106s] [ext: omni.kit.pipapi-0.0.0] startup
[0.109s] [ext: omni.kit.pip_archive-0.0.0] startup
[0.112s] [ext: omni.isaac.pip_archive-0.1.0] startup
[0.225s] [ext: omni.usd.config-1.0.0] startup
[0.226s] [ext: omni.usd.libs-1.0.0] startup
[0.363s] [ext: omni.stats-0.0.0] startup
[0.365s] [ext: omni.gpu_foundation-0.0.0] startup
[0.369s] [ext: omni.usd.schema.semantics-0.0.0] startup
[0.372s] [ext: omni.usd.schema.audio-0.0.0] startup
[0.375s] [ext: omni.hydra.iray-0.1.0] startup
[0.377s] [ext: omni.kit.loop-default-0.1.0] startup
[0.377s] [ext: omni.kit.async_engine-0.0.0] startup
[0.385s] [ext: omni.assets.plugins-0.0.0] startup
[0.386s] [ext: omni.appwindow-1.0.0] startup
[0.399s] [ext: omni.client-0.1.0] startup
[0.406s] [ext: omni.kit.test-0.0.0] startup
[0.473s] [ext: omni.kit.renderer.core-0.0.0] startup
MESA-INTEL: warning: Performance support disabled, consider sysctl dev.i915.perf_stream_paranoid=0


|---------------------------------------------------------------------------------------------|
| Driver Version: 470.86      | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 3080 Laptop.. | Yes: 0 |     | 16384   MB | 10de      | 0          |
|     |                                  |        |     |            | 249c      | 1a6d9cb0.. |
|---------------------------------------------------------------------------------------------|
| 1   | Intel(R) UHD Graphics (TGL GT1)  |        |     | 23890   MB | 8086      | 0          |
|     |                                  |        |     |            | 9a60      | ee98bced.. |
|=============================================================================================|
| OS: Linux brunovetter-Blade-17-Mid-2021-RZ09-0406, Version: 5.13.0-27-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12013000 (1.20.13.0)
| Processor: 11th Gen Intel(R) Core(TM) i9-11900H @ 2.50GHz | Cores: Unknown | Logical: 16
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31854 | Free Memory: 28939
| Total Page/Swap (MB): 65535 | Free Page/Swap: 65535
|---------------------------------------------------------------------------------------------|
2022-02-01 17:16:16 [868ms] [Warning] [gpu.foundation.plugin] Different GPUs have different availalbe VRAM. The texture streaming system will be limited to the lower VRAM number
[1.129s] [ext: omni.ui-2.5.3] startup
[1.140s] [ext: omni.kit.mainwindow-0.0.0] startup
[1.142s] [ext: omni.kit.uiapp-0.0.0] startup
[1.143s] [ext: omni.usd.schema.physics-1.0.0] startup
[1.148s] [ext: omni.usd.schema.anim-0.0.0] startup
[1.157s] [ext: omni.timeline-1.0.2] startup
[1.159s] [ext: omni.hydra.scene_delegate-0.1.0] startup
[1.165s] [ext: carb.audio-0.1.0] startup
[1.187s] [ext: omni.kit.commands-0.0.0] startup
[1.192s] [ext: omni.usd-1.4.5] startup
[1.219s] [ext: omni.kit.asset_converter-1.1.43] startup
[1.230s] [ext: omni.usd.schema.isaac-0.1.1] startup
[1.245s] [ext: omni.usd.schema.physx-0.0.0] startup
[1.259s] [ext: omni.usd.schema.add_on-0.0.2] startup
[1.260s] [ext: omni.services.facilities.base-1.0.0] startup
[1.262s] [ext: omni.services.core-1.1.1] startup
[1.325s] [ext: omni.services.transport.client.base-1.1.0] startup
[1.326s] [ext: omni.services.transport.server.base-1.0.0] startup
[1.328s] [ext: omni.services.client-0.2.3] startup
[1.348s] [ext: omni.services.transport.server.http-1.0.0] startup
[1.402s] [ext: omni.services.transport.client.http_async-1.0.0] startup
[1.520s] [ext: omni.kit.notification_manager-1.0.0] startup
[1.523s] [ext: omni.kit.agent-0.1.0] startup
[1.525s] [ext: omni.debugdraw-0.1.0] startup
[1.528s] [ext: omni.kit.thumbnails.images-0.1.0] startup
[1.531s] [ext: omni.kit.menu.utils-1.0.2] startup
[1.539s] [ext: omni.isaac.lula-0.1.0] startup
[1.546s] [ext: omni.kit.material.library-1.2.3] startup
[1.614s] [ext: omni.kit.menu.create-1.0.1] startup
[1.617s] [ext: omni.kit.search_core-1.0.0] startup
[1.620s] [ext: omni.kit.window.drop_support-1.0.0] startup
[1.622s] [ext: omni.renderer-rtx-0.0.0] startup
[1.623s] [ext: omni.kit.context_menu-1.3.2] startup
[1.651s] [ext: omni.hydra.rtx-0.1.0] startup
[1.656s] [ext: omni.kit.widget.filebrowser-2.2.20] startup
[1.663s] [ext: omni.kit.widget.path_field-2.0.3] startup
[1.666s] [ext: omni.kit.window.viewport-0.0.0] startup
[2.415s] [ext: omni.kit.widget.versioning-1.3.4] startup
[2.419s] [ext: omni.kit.widget.browser_bar-2.0.2] startup
[2.422s] [ext: omni.kit.window.popup_dialog-2.0.4] startup
[2.426s] [ext: omni.syntheticdata-0.1.6] startup
[2.478s] [ext: omni.kit.window.filepicker-2.4.12] startup
[2.520s] [ext: omni.kit.stage_templates-1.0.6] startup
[2.525s] [ext: omni.kvdb-0.0.0] startup
[2.527s] [ext: omni.convexdecomposition-1.3.14] startup
[2.530s] [ext: omni.localcache-0.0.0] startup
[2.532s] [ext: omni.usdphysics-1.3.14] startup
[2.533s] [ext: omni.kit.widget.graph-1.1.4] startup
[2.539s] [ext: omni.physx-1.3.14-5.1] startup
[2.582s] [ext: omni.kit.numpy.common-0.1.0] startup
[2.607s] [ext: omni.kit.window.extensions-1.0.2] startup
[2.614s] [ext: omni.kit.window.property-1.6.2] startup
[2.636s] [ext: omni.isaac.dynamic_control-0.1.8] startup
[2.645s] [ext: omni.isaac.ui-0.1.2] startup
[2.649s] [ext: omni.kit.window.file-1.3.5] startup
[2.699s] [ext: omni.isaac.core-0.1.12] startup
[2.786s] [ext: omni.isaac.debug_draw-0.1.1] startup
[2.799s] [ext: omni.kit.usd_undo-0.1.0] startup
[2.808s] [ext: omni.isaac.dr-0.1.8] startup
[2.826s] [ext: omni.isaac.range_sensor-0.1.5] startup
[2.849s] [ext: omni.kit.window.content_browser-2.4.10] startup
[2.881s] [ext: omni.kit.tool.collect-2.0.8] startup
[2.887s] [ext: omni.kit.primitive.mesh-1.0.0] startup
[2.893s] [ext: omni.physx.commands-1.3.14-5.1] startup
[2.896s] [ext: omni.kit.widget.settings-1.0.0] startup
[2.900s] [ext: omni.isaac.synthetic_utils-0.1.5] startup
[2.905s] [ext: omni.kit.window.script_editor-1.5.0] startup
[2.906s] [ext: omni.isaac.tests-0.0.0] startup
[2.910s] [ext: omni.kit.profiler.window-1.3.3] startup
[2.917s] [ext: omni.isaac.synthetic_recorder-0.1.0] startup
[2.921s] [ext: omni.kit.window.usd_paths-1.0.3] startup
[2.925s] [ext: semantics.schema.editor-0.2.2] startup
[2.928s] [ext: omni.kit.widget.stage-2.6.8] startup
[2.935s] [ext: omni.graph.core-1.0.2] startup
[2.937s] [ext: omni.graph.tools-1.0.0] startup
[2.945s] [ext: omni.kit.property.usd-3.11.4] startup
[2.970s] [ext: omni.graph-1.0.0] startup
[3.002s] [ext: omni.kit.widget.layers-1.5.12] startup
[3.015s] [ext: omni.kit.renderer.capture-0.0.0] startup
[3.020s] [ext: omni.kit.widget.fast_search-0.3.0] startup
[3.025s] [ext: omni.graph.action-1.0.0] startup
[3.054s] [ext: omni.kit.property.layer-1.1.2] startup
[3.059s] [ext: omni.isaac.window.about-1.0.0] startup
[3.064s] [ext: omni.graph.ui-1.0.1] startup
[3.146s] [ext: omni.kit.property.audio-1.0.5] startup
[3.151s] [ext: omni.kit.window.preferences-1.1.5] startup
[3.185s] [ext: omni.physx.ui-1.3.14-5.1] startup
[3.196s] [ext: omni.kit.property.material-1.7.2] startup
[3.201s] [ext: omni.kit.window.toolbar-1.2.1] startup
[3.236s] [ext: omni.kit.property.skel-1.0.0] startup
[3.242s] [ext: omni.kit.property.camera-1.0.3] startup
[3.247s] [ext: omni.physx.demos-1.3.14-5.1] startup
[3.250s] [ext: omni.kit.property.physx-0.1.0] startup
[3.296s] [ext: omni.physx.tests-1.3.14-5.1] startup
[3.399s] [ext: omni.kit.property.geometry-1.2.0] startup
[3.405s] [ext: omni.kit.property.light-1.0.4] startup
[3.411s] [ext: omni.kit.property.transform-1.0.2] startup
[3.418s] [ext: omni.physx.vehicle-1.3.14-5.1] startup
[3.430s] [ext: omni.physx.cct-1.3.14-5.1] startup
[3.438s] [ext: omni.kit.window.console-0.1.0] startup
[3.440s] [ext: omni.graph.examples.python-1.0.0] startup
[3.816s] [ext: omni.kit.property.bundle-1.2.4] startup
[3.822s] [ext: omni.isaac.motion_planning-0.1.7] startup
[3.831s] [ext: omni.physx.bundle-1.3.14-5.1] startup
[3.831s] [ext: omni.kit.widget.live-0.1.0] startup
[3.832s] [ext: omni.kit.tool.asset_exporter-1.0.8] startup
[3.840s] [ext: omni.isaac.shapenet-1.0.0] startup
[3.915s] env var SHAPENET_LOCAL_DIR not set, using default data dir /home/brunovetter/.local/share/ov/data/Kit/Isaac-Sim/2021.2/shapenet
[3.915s] omni.isaac.shapenet's receiver for external messages has started. on ('localhost', '7011')
[3.916s] [ext: omni.isaac.motion_generation-0.1.2] startup
[3.922s] [ext: omni.isaac.kit-0.1.2] startup
[3.926s] [ext: omni.isaac.surface_gripper-0.1.0] startup
[3.932s] [ext: omni.isaac.utils-0.1.10] startup
[3.938s] [ext: omni.kit.property.isaac-0.1.1] startup
[3.944s] [ext: omni.isaac.kaya-0.0.0] startup
[3.949s] [ext: omni.isaac.gamepad-0.1.4] startup
[3.954s] [ext: omni.isaac.demos-0.1.1] startup
[3.969s] [ext: omni.isaac.franka-0.0.0] startup
[3.974s] [ext: omni.isaac.dofbot-0.1.1] startup
[3.979s] [ext: omni.isaac.unit_converter-0.1.1] startup
[3.984s] [ext: omni.isaac.universal_robots-0.1.1] startup
[3.989s] [ext: omni.isaac.jetbot-0.0.0] startup
[3.994s] [ext: omni.isaac.merge_mesh-0.1.0] startup
[3.999s] [ext: omni.isaac.physics_utilities-0.1.0] startup
[4.042s] [ext: omni.isaac.robot_engine_bridge_ui-0.1.0] startup
[4.049s] [ext: omni.isaac.examples-0.1.17] startup
[4.119s] [ext: omni.isaac.urdf-0.1.13] startup
[4.145s] [ext: omni.kit.tool.asset_importer-2.3.12] startup
[4.154s] [ext: omni.isaac.contact_sensor-0.1.0] startup
[4.162s] [ext: omni.kit.widget.prompt-1.0.0] startup
[4.168s] [ext: omni.isaac.ros_bridge_ui-0.1.0] startup
[4.175s] [ext: omni.kit.importer.cad-0.3.0] startup
[4.241s] [ext: omni.isaac.robot_engine_bridge-0.1.0] startup
[4.386s] [ext: omni.isaac.physics_inspector-0.1.0] startup
[4.393s] [ext: omni.kit.widget.stage_icons-1.0.2] startup
[4.400s] [ext: omni.isaac.ros2_bridge-0.1.1] startup
[4.473s] [ext: omni.command.usd-1.0.1] startup
[4.479s] [ext: omni.isaac.utils_manager-0.1.1] startup
[4.486s] [ext: omni.rtx.window.settings-0.6.0] startup
[4.492s] [ext: omni.kit.window.stage-2.3.4] startup
[4.501s] [ext: omni.isaac.occupancy_map-0.1.1] startup
[4.513s] [ext: omni.kit.menu.edit-1.0.3] startup
[4.568s] [ext: omni.videoencoding-0.1.0] startup
[4.571s] [ext: omni.kit.widget.imageview-1.0.1] startup
[4.579s] [ext: omni.iray.settings.core-0.6.2] startup
[4.585s] [ext: omni.kit.widget.sliderbar-1.0.9] startup
[4.594s] [ext: omni.kit.capture-0.4.7] startup
[4.602s] [ext: omni.rtx.settings.core-0.5.4] startup
[4.613s] [ext: omni.kit.window.imageviewer-1.0.5] startup
[4.624s] [ext: omni.kit.window.cursor-1.0.1] startup
[4.633s] [ext: omni.kit.menu.file-1.0.3] startup
[4.640s] [ext: omni.kit.window.movie_maker-0.5.9] startup
[4.650s] [ext: omni.isaac.imu_sensor-0.1.1] startup
[4.659s] [ext: omni.kit.thumbnails.usd-0.5.0] startup
[4.700s] [ext: omni.kit.window.title-1.1.0] startup
[4.707s] [ext: omni.kit.search.service-0.1.0] startup
[4.728s] [ext: omni.kit.selection-0.1.0] startup
[4.735s] [ext: omni.isaac.onshape-0.3.14] startup
[5.146s] [ext: omni.isaac.replicator_playground-0.1.0] startup
[5.234s] [ext: omni.kit.window.status_bar-0.1.0] startup
[5.236s] [ext: omni.kit.window.commands-0.1.1] startup
[5.244s] [ext: omni.kit.window.stats-0.1.0] startup
[5.252s] [ext: omni.isaac.app.setup-0.1.2] startup
[5.259s] Writing Isaac Sim icon file
[5.260s] [ext: omni.isaac.sim.base-2021.2.1] startup
[5.260s] [ext: omni.add_on.ros_bridge_ui-0.0.2] startup
[5.267s] [ext: omni.graph.nodes-1.0.0] startup
[5.316s] [ext: omni.isaac.sim-2021.2.1] startup
[5.316s] [ext: omni.add_on.ros2_bridge-0.0.1] startup
[5.367s] app started
MESA-INTEL: warning: Performance support disabled, consider sysctl dev.i915.perf_stream_paranoid=0

2022-02-01 17:16:21 [6,204ms] [Warning] [carb.graphics-vulkan.plugin] Physical device with name: llvmpipe (LLVM 12.0.0, 256 bits) does not support 'Vulkan 1.1', it has api version: 1.0.
MESA-INTEL: warning: Performance support disabled, consider sysctl dev.i915.perf_stream_paranoid=0

2022-02-01 17:16:21 [6,274ms] [Warning] [carb.graphics-vulkan.plugin] Physical device with name: llvmpipe (LLVM 12.0.0, 256 bits) does not support 'Vulkan 1.1', it has api version: 1.0.
[9.799s] Isaac Sim App is loaded.
[9.824s] Checking for Isaac Sim assets on Nucleus 
[11.975s] Nucleus detected successfully: omniverse://localhost
[142.962s] [ext: omni.kit.registry.nucleus-0.0.0] startup
[147.497s] [ext: omni.usd.schema.sequence-1.0.9] startup
[147.506s] [ext: omni.audioplayer-0.2.0] startup
[147.513s] [ext: omni.kit.sequencer.usd-102.1.5] startup
[147.521s] [ext: omni.kit.sequencer.core-102.1.2] startup
[147.531s] [ext: omni.kit.widget.timeline-102.1.16] startup
[147.540s] [ext: omni.kit.window.sequencer-102.1.21] startup
2022-02-01 17:19:10 [174,384ms] [Warning] [omni.kit.widget.versioning.checkpoints_model] Failed to get checkpoints for omniverse://localhost/NVIDIA/Assets/Characters/Reallusion/Worker/Worker.usd: Result.ERROR
2022-02-01 17:19:57 [222,135ms] [Error] [omni.kit.sequencer.core.scripts.sequencer_commands] Sequence failed to create.
2022-02-01 17:19:57 [222,136ms] [Error] [omni.kit.commands.command] Failed to execute a command: SequencerTrackCreateCommand.
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.widget.timeline-102.1.16+cp37/omni/kit/widget/timeline/scripts/timeline_view.py", line 555, in <lambda>
    self._view.get_timeline_bottom_frame().set_drop_fn(lambda event: self._on_drop(event))
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.widget.timeline-102.1.16+cp37/omni/kit/widget/timeline/scripts/timeline_view.py", line 561, in _on_drop
    self._view._on_drop(event)
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.window.sequencer-102.1.21+cp37/omni/kit/window/sequencer/scripts/sequencer_timeline_view.py", line 150, in _on_drop
    sequencer_drop_controller.sequencer_drop(url, timeline_pos)
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.window.sequencer-102.1.21+cp37/omni/kit/window/sequencer/scripts/sequencer_drop_controller.py", line 85, in sequencer_drop
    res, track = omni.kit.commands.execute("SequencerTrackCreateCommand", sequence_path=sequence_path, track_name=track_name, track_type=track_type)
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/kit/extscore/omni.kit.commands/omni/kit/commands/command.py", line 235, in execute
    return omni.kit.undo.execute(command, name, kwargs)
[...skipped...]
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/kit/extscore/omni.kit.commands/omni/kit/undo/undo.py", line 72, in execute
    result = _execute(command, name, level, history_key)
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/kit/extscore/omni.kit.commands/omni/kit/undo/undo.py", line 312, in _execute
    raise e
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/kit/extscore/omni.kit.commands/omni/kit/undo/undo.py", line 279, in _execute
    result = command.do()
  File "/home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.sequencer.core-102.1.2+cp37/omni/kit/sequencer/core/scripts/sequencer_commands.py", line 154, in do
    raise ValueError(f"Specified sequence path is not valid: {self._sequence_path}")

 <class 'ValueError'> Specified sequence path is not valid: /World/Sequence
2022-02-01 17:19:57 [222,136ms] [Error] [omni.kit.window.sequencer.scripts.sequencer_drop_controller] Cannot create clip - failed to create track for omniverse://localhost/NVIDIA/Assets/Characters/Reallusion/Worker/Worker.usd
2022-02-01 17:19:57 [222,136ms] [Error] [omni.ui.python] AttributeError: 'NoneType' object has no attribute 'GetPrim'

At:
  /home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.window.sequencer-102.1.21+cp37/omni/kit/window/sequencer/scripts/sequencer_drop_controller.py(90): sequencer_drop
  /home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.window.sequencer-102.1.21+cp37/omni/kit/window/sequencer/scripts/sequencer_timeline_view.py(150): _on_drop
  /home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.widget.timeline-102.1.16+cp37/omni/kit/widget/timeline/scripts/timeline_view.py(561): _on_drop
  /home/brunovetter/.local/share/ov/pkg/isaac_sim-2021.2.1/exts/omni.kit.widget.timeline-102.1.16+cp37/omni/kit/widget/timeline/scripts/timeline_view.py(555): <lambda>

Hi Bruno,
Seems like it is an issue with the load of the USD sequence schema. It needs to be loaded at startup. Could you try setting the USD sequence schema extension to auto-load (you can do it in the Extensions Manager). Restart Isaac SIM and then try again?

Thanks Teresa,

this made it work!

Kind regards
Bruno

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.