Isaac SIM WebRTC Via Cloud GCP not working - RedButton but grey screen

Omniverse Isaac Sim
, , ,
1

Isaac Sim Version

4.2.0

Operating System

Ubuntu 22.04

GPU Information

Tesla 4 , n1-standard 8

Topic Description

Detailed Description

I’m trying to use Isaac sim webrtc via web browser it doesnt work when i ran the command ./runheadless.webrtc.sh and then I go to the link below

http://<external_ip>.149:8211/streaming/webrtc-client/?server=<external_ip>

it shows a red button and when pressed play it shows a grey screen , I’ve found that this link says that through cloud we should use Turn and Stun ,
https://docs.omniverse.nvidia.com/extensions/latest/ext_livestream/webrtc.html

I tried to use via coturn , and tried the command in the link

./kit apps/omni.create.kit \
    --enable omni.services.streamclient.webrtc \
    --/exts/omni.services.streamclient.webrtc/ice_servers/1/urls/0="turn:turn.example.com:3478?transport=udp" \
    --/exts/omni.services.streamclient.webrtc/ice_servers/1/urls/1="turn:turn.example.com:3478?transport=tcp" \
    --/exts/omni.services.streamclient.webrtc/ice_servers/1/username="user" \
    --/exts/omni.services.streamclient.webrtc/ice_servers/1/credential="secret" \
    --no-window \
    --allow-root

but there is no ./kit apps/omni.create.kit and tried via different methods in AI responses which said to add this line at the end

--host 0.0.0.0  --vulkan
 --turn-server "107.178.221.149:3478" --turn-user "user" --turn-password "password"

but still no result

, I tried the native run it works via omiverse streaming client if i ran the command via ./runheadless.native.sh it works successfully but I want to use the webrtc via browser

Steps to Reproduce

  1. install docker and container and run it via the next command
    then >
docker run --name isaac-sim --entrypoint bash -it --runtime=nvidia --gpus all -e "ACCEPT_EULA=Y" --rm --network=host      -e "PRIVACY_CONSENT=Y"          -e OMNI_ENV_PRIVACY_CONSENT=1       -v ~/docker/isaac-sim/cache/kit:/isaac-sim/kit/cache:rw \
    -v ~/docker/isaac-sim/cache/ov:/root/.cache/ov:rw \
    -v ~/docker/isaac-sim/cache/pip:/root/.cache/pip:rw \
    -v ~/docker/isaac-sim/cache/glcache:/root/.cache/nvidia/GLCache:rw \
    -v ~/docker/isaac-sim/cache/computecache:/root/.nv/ComputeCache:rw \
    -v ~/docker/isaac-sim/logs:/root/.nvidia-omniverse/logs:rw \
    -v ~/docker/isaac-sim/data:/root/.local/share/ov/data:rw \
    -v ~/docker/isaac-sim/documents:/root/Documents:rw \
    nvcr.io/nvidia/isaac-sim:4.2.0
./runheadless.webrtc.sh

then I go to the browser >
http://<external_ip>.149:8211/streaming/webrtc-client/?server=<external_ip>

It Shows red button and when pressed play , it shows nothing , only grey screen

2

Please upgrade to the latest version, Isaac Sim 4.5.0, and use the Omniverse Streaming Client for over the Internet streaming.

3

Ok I’ll , but does WebRtc works for version 4.5.0 for cloud streaming , as I wanted to use it via the browser .

4

Please refer to the following note in https://docs.isaacsim.omniverse.nvidia.com/4.5.0/installation/install_container.html:

  • Isaac Sim WebRTC Streaming Client is recommended to be used within the same network as an Isaac Sim headless instance.

  • See Omniverse Streaming Client [DEPRECATED] for an alternative streaming client if you have issue livestreaming remotely in the Cloud.