WebRTC streaming does not work on Orbit scripts with Isaac Sim 2023.1.1

[ozhanozen]

If I use the 2023.1.1 version of Isaac Sim as a base in Orbit and enable WebRTC livestream on Orbit scripts, WebRTC does not start correctly, and I get the following errors on the terminal:

[ext: omni.kit.livestream.webrtc-2.3.2] startup
[Error] [carb.livestream.plugin] Stream Server: Net Stream Creation failed, 0x800B1000
[Error] [carb.livestream.plugin] Could not initialize streaming components
[Error] [carb.livestream.plugin] Couldn’t initialize the capture device.
[ext: omni.services.streamclient.webrtc-1.3.8] startup

Steps to reproduce

Run random_ageny.py with WebRTC enabled (livestream=3) on any environment.

System Info

• Isaac Sim Version: [2023.1.1]
• OS: [Ubuntu 20.04]
• GPU: [RTX A6000]
• CUDA: [12.0]
• GPU Driver: [525.60.11]

Additional context

WebRTC works correctly with Orbit scripts if the Isaac Sim version is 2023.1.0-hotfix.1. The problem is specific to the 2023.1.1 version.

Interestingly, even on version 2023.1.1, running directly runheadless.webrtc.sh from the container successfully enables the WebRTC. Hence, the problem is most probably related to Orbit.

The link to the corresponding Orbit GitHub issue is here.

[ozhanozen]

Update: it seems like the problem is not specific to Orbit, as the livestream.py example of Isaac Sim also fails the same way when WebRTC is enabled.

[jaohsu]

I think you using ./python.sh to execute your python file

It can be solved by:

1. edit isaac_sim-2023.1.1/apps/omni.isaac.sim.python.kit
2. comment the followings

# Livestream - OV Streaming Client
#"omni.kit.livestream.native" = {version = "2.4.0", exact = true}
#"omni.kit.streamsdk.plugins" = {version = "2.5.2", exact = true}

–
I think the root cause is:

1. if you use ./python.sh to load your python script, it will use the config of “omni.isaac.sim.python.kit”
2. it will load “omni.kit.livestream.native” → usedfor streaming client in default
3. streaming client & webrtc cannot exists at the same time; so we always got the error message from webrtc

[ozhanozen]

@jaohsu Thanks a lot for the answer; this brings back the webrtc!