Unable to connect remote pc to AI workstation using streaming client

Omniverse General Discussion
,
1

Hello Everyone!! I am a beginner to the NVIDIA Omniverse platform and Isaac Sim and have been recently exploring omniverse.

My goal
I have a AI workstation (Linux 22.04) with NVIDIA RTX 4090 GPUs along with NVIDIA isaac sim, streaming client, and nucleus installed through the omniverse launcher. I also have a remote PC (Windows 11) with streaming client and nucleus installed through the omniverse launcher.

My objective is to

  1. Use the streaming client, connect remote PC to isaac sim in workstation (when remote PC and workstation are in the same IP)
  2. Use the streaming client, again connect remote PC to isaac sim in workstation (When remote PC and workstation have totally different IPs and in different locations)

My Problem

  1. The streaming client is not able to connect my remote PC to my workstation when both remote PC and workstation are on the same local network. Assuming yyy.yyy.yyy.x1x1x1 is the local IP of my remote PC and yyy.yyy.yyy.x2x2x2 is the local IP of my workstation, my streaming client does not identify my workstation.

  2. The streaming client was also unable to identify my workstation even when I used the public IP of my workstation on streaming client of remote PC

Techniques I used so far
After following the online documentation and the discussion forums, I have

  1. Allowed the TCP/UDP ports specified by the omniverse streaming client documentation and ensured that both remote PC (windows) and AI workstation (linux 22.04) does not have any firewall restrictions
  2. got pings from remote PC on workstation as well as got pings from workstation on remote PC
  3. Have nucleus server running on both remote PC and workstation. I also ensured that “enable sharing” is ON for both remote PC and workstation.

Despite doing all these steps and consciously following the documentation, I am still not able to connect my remote PC to the workstation using streaming client. I’d be really happy if anyone could point me out in the right direction.

I hope I have given as much details to the best of my knowledge without any unwanted jargon. If you’d further require any information, please don’t hesitate to ask me.

I look forward to a interesting discussion. Thanks in advance.

2

Hi and thanks for your questions. Firstly, the Streaming Client, if you are referring to the standalone app from Launcher has been discontinued. Where did you get it from? From Launcher? We don’t use that now.

We just use the built in WebRTC and web sockets to stream to an http browser. But that all has to be on the “same local network”. It does not cross domains, it does not do NAT, Stun or Turn traversal. It will not work across the open web. Also, streaming has nothing to do with Nucleus, fyi.

However, this only applies to the old version of Kit, for USD Composer and Isaac Sim. The new versions have a specific kit file for streaming.

3

Hi @Richard3D, Thanks for your time and efforts. Firstly yes! I installed the streaming client from the launcher and tried using this streaming client from remote PC, to connect to workstation. Below is the screenshot from my omniverse launcher in remote PC.

streaming_client
streaming_client1869×1039 228 KB

My main objective is to connect my remote PC to workstation. The connection need not necessarily be through the streaming client. I just want a way to connect with my isaac sim in workstation.

If using WebRTC and web sockets is the best way that you’d recommend, where can I find the documentation to get started with the webRTC setup. Can you please point me out to the most updated and recent documentation?

Also, Let’s assume my remote PC is not on the “same local network”, as the workstation, what is the best possible way for me to connect to isaac sim in my workstation in this situation?

Thanks in advance.

4

For any of our solutions, it MUST be on the same local network yes. If not then you can use any normal remote desktop software, like Remote Desktop, VNC etc.

5

Hi @Richard3D, Thanks for your reply.

I was able to setup isaac sim using WebRTC Client. MY workstation’s local IP is “yyy.yyy.yyy.18” and my remote PC’s local IP is “yyy.yyy.yyy.189”.

When I use any browser in my workstation, I am able to use isaac sim using the WebRTC client. I don’t have any issues until this step.

When I follow the manual launch option from this documentation (WebRTC Browser Client — Omniverse Extensions), I am unable to get the webRTC client in my browser.

I did allow TCP and UDP ports for “8211” across all local IP addresses. Despite doing this step as well as getting pings from my workstation in windows terminal, I am unable to connect to the WebRTC client.

I did go through few other related discussion threads, but I feel I hit a dead end at this point in time. What am I missing in this setup?

6

Please try using the generic Kit port of 8011, rather than the specific isaac sim port.
http://:8011/streaming/webrtc-client?server=