Help Needed for WebRTC Livestreaming Setup with Isaac Sim Container

Hello,

I need assistance configuring WebRTC for livestreaming from my Isaac Sim container.

Currently, I have my Isaac Sim container running on an AWS EC2 instance using the following command:

docker run --name isaac-sim --entrypoint bash -it --gpus all -e “ACCEPT_EULA=Y” --rm -network=host -v ~/docker/isaac-sim/cache/kit:/isaac-sim/kit/cache/Kit:rw -v ~/docker/isaac-sim/cache/ov:/root/.cache/ov:rw -v ~/docker/isaac-sim/cache/pip:/root/.cache/pip:rw -v ~/docker/isaac-sim/cache/glcache:/root/.cache/nvidia/GLCache:rw -v ~/docker/isaac-sim/cache/computecache:/root/.nv/ComputeCache:rw -v ~/docker/isaac-sim/logs:/root/.nvidia-omniverse/logs:rw -v ~/docker/isaac-sim/data:/root/.local/share/ov/data:rw -v ~/docker/isaac-sim/documents:/root/Documents:rw nvcr.io/nvidia/isaac-sim:4.2.0 ./isaac-sim.headless.webrtc.sh ----enable omni.services.streamclient.webrtc --/exts/omni.services.streamclient.webrtc/ice_servers/1/urls/0=“turn:MY_TURN_SERVER_IP:3478?transport=udp” --/exts/omni.services.streamclient.webrtc/ice_servers/1/urls/1=“turn:=MY_TURN_SERVER_IP:3478?transport=tcp” --/exts/omni.services.streamclient.webrtc/ice_servers/1/username=USER --/exts/omni.services.streamclient.webrtc/ice_servers/1/credential=KEY --no-window --allow-root

The container loads successfully, and I see the message “Isaac Sim Headless WebRTC App is loaded.”

I have also set up a TURN server using coturn on another AWS EC2 instance, and I’ve confirmed that MY_TURN_SERVER_IP is reachable from my Isaac Sim instance.

My question is: How do I connect to the livestream?

Thank you in advance.

1 Like

Have you followed WebRTC Browser Client?

Please provide all relevant details below before submitting your post. This will help the community provide more accurate and timely assistance. After submitting, you can check the appropriate boxes. Remember, you can always edit your post later to include additional information if needed.

Isaac Sim Version

4.2.0
4.1.0
4.0.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Isaac Lab Version (if applicable)

1.2
1.1
1.0
Other (please specify):

Operating System

Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model:
  • Driver Version:

Topic Description

Detailed Description

(Describe the issue in detail, including what you were trying to do, what you expected to happen, and what actually happened)

Steps to Reproduce

(Add more steps as needed)

Error Messages

(If applicable, copy and paste any error messages you received)

Screenshots or Videos

(If applicable, add screenshots or links to videos that demonstrate the issue)

Additional Information

What I’ve Tried

(Describe any troubleshooting steps you’ve already taken)

Related Issues

(If you’re aware of any related issues or forum posts, please link them here)

Additional Context

(Add any other context about the problem here)

Yes, indeed! I’ve followed Livestream Clients and WebRTC Browser Client.

I need to stream across networks, but the second tutorial states that I need to set up a TURN server. I’m having trouble with that and I would really appreciate clearer steps on this matter.

For setup I have followed AWS Deployment and Container Installation tutorials, so my container is running Isaac Sim 4.2.0 inside an AWS EC2 launched from the NVIDIA Omniverse GPU-Optimized AMI, which has Ubuntu 20.04.

Thank you.

For Isaac Sim 4.2 and earlier versions, we recommend using the Omniverse Streaming Client for the best streaming experience. The WebRTC Browser Client may not perform optimally when streaming over the Internet, which could explain the difficulties you’re encountering.

In the upcoming Isaac Sim release, we will be introducing a new streaming application. This new app is designed to replace both the current Omniverse Streaming Client and the WebRTC Browser Client.

Thanks for your response. I’m aware of the Streaming Client; however, it currently doesn’t support macOS, so I’m need an alternative streaming method.

I’ve had success with WebRTC on the same network as the container, but I need support on setting up a TURN server for cross-network streaming of Omniverse.

Additionally, do you have any updates on the release date for the new Isaac Sim? Will the streaming application be compatible with macOS? Thanks.

Yes, it is possible to run the new Streaming Client on macOS.

Regarding the release date for the new Isaac Sim version, while we don’t have an exact date to share, it’s currently planned for the end of this year or early next year.

Is the new Streaming Client available? Where can I download it? If not, when will it be released?

Sorry. I mean the new streaming application in the upcoming Isaac Sim release.