Isaac Sim in Docker on remote Workstation

Omniverse Isaac Sim
,
1

Isaac Sim Version

4.2.0 (server)
4.1.0
4.0.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Isaac Lab Version (if applicable)

1.2 (server)
1.1
1.0
Other (please specify):

Operating System

Ubuntu 22.04 (server & client)
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

Other

  • Streaming Client V103.1.1
  • Browser: Chrome, Firefox

GPU Information

  • Model: RTX 3080 Ti
  • Driver Version: 535.183.01

Topic Description

I am currently trying to set up Isaac Sim on my workstation. I want to

  • run everything dockerized
  • be able to develop remotely, including streaming to a client PC in another network (I do have a VPN to the workstation’s network though).

While this should be possible according to what I read, I am not able to set it up. Specifically, the streaming to my client PC just isn’t working. Reading though docs and issues, I got conflicting information.

A) The streaming client seems to be deprecated
B) The streaming client is recommended

So anyways, I tried both - streaming client and WebRTC browser client, end ended up with neither working:

  1. Streaming Client not connecting
  2. The WebRTC client times out when trying to connect from the client PC. The only way to overcome this that I found so far was port forwarding and trying to access the web client locally, which led me to this issue.

Error Messages

I didn’t find any way to access/create logs for the client. I don’t see any messages about a connection attempt on the server.

High-Level Question

What is the recommended way to set up Isaac Sim in a docker on a server? The documentation doesn’t seem to mention this setup, though I believe it is a common need.

2

Does running Isaac Sim on the server and accessing it via VNC work?