Omniverse Isaac Gym livestream with WebRTC client

Omniverse Isaac Sim
1

Hi,

Is it possible to livestream Omni Isaac Gym through WebRTC client?
If yes, where can I find tutorial to set this up?
If no, will it be available in the future? I am on MacOS, so I cannot install the Omniverse Streaming Client. What solutions are available to me to livestream in this case. I am running Isaac Gym on the server in a container.

Thanks

2

Hi @m.faldor22 - Have you referred to this streaming client doc? Livestream Clients — Omniverse IsaacSim latest documentation

3

Hi,

I have, but there is no information about Omni Isaac Gym.

My issue is still unresolved, any help is appreciated.

Thanks!

4

Can you clarify further about your request?

the document I linked has information about how to connect streaming client with container, and you mentioned that you have Isaac gym running in the container.

5

In Omni Isaac Gym, there is a way to turn livestream on as explained in this section: GitHub - NVIDIA-Omniverse/OmniIsaacGymEnvs: Reinforcement Learning Environments for Omniverse Isaac Gym

Following the README, if I run PYTHON_PATH scripts/rlgames_train.py task=Ant headless=True enable_livestream=True, it starts Isaac Sim and then it waits. I suppose it is waiting for the livestream client to start the simulation.

However, I could not find any option to livestream using WebRTC in the config, so I suppose that the Omniverse Streaming Client is the only option available?

Is there a solution to connect with WebRTC?

I have found this related issue on the Omni Isaac Gym repo, however, the answer is quiet vague…

Thank you for your help.

7

hi were you able to live steam over public internet any kit application using a turnserver (coturn). even though it streams on local host and same network , i have so far been unable to get it working outside the network using coturn .