Isaac Sim via ssh and Remote Desktop Connection windows and linux(host)

After connecting through remote desktop everything seems to work fine, but isaac sim doesn’t want to launch. headless .native seem to work but then the streaming client gives me the error message “unknown error (0x100)”
by the ./isaac-sim.sh command i receive the error failed to acquire IWindowing interface.
Thanks a lot in advance , I don’ t seem to be able fix it myself.

You need to launch ./isaac-sim.headless.native.sh to launch Isaac Sim and then connect with the Omniverse Streaming Client application.
If you want to launch a standalone application, set simulation_app = SimulationApp({“headless”: True}) and then use ./isaac-sim.sh to launch it, then connect with Omniverse Streaming Client

Is there anything specific i have to do to connect with the streaming Client ?

Put the IP of the host under Server without “user@” in front, then it should work
image

Im doing the same thing, hosting from Linux and streaming from Windows

do i have to install oniverse launcher and streaming client on both computers or only on the server is enough?

The client need the Omniverse Launcher and the Streaming Client app:

You dont need the Omniverse launcher to be running on the host, but you ofc need to install Isaac Sim on the host first.
Livestreaming is by default activated when Isaac Sim is in headless mode.
omni.isaac.sim.headless.native.kit:
[package]
title = “Isaac Sim (Headless Native)”
description = “Headless Isaac Sim with Native Livestream using Streaming Client”
version = “2023.1.1”
execFile = “isaac-sim.headless.native”

This happens when i try native and the client streaming

Is the streaming client window like that from the beginning or when does it turn black?`

You should get an error if the IP is not correct.

This is what i do

Steps:

  1. Open a terminal on my windows PC
  2. Connect to the host: ssh user@address
  3. From the established connection go to the root isaac folder: cd .local/share/ov/pkg/isaac_sim-2023.1.1
  4. Then run: ./isaac-sim.headless.native.sh
  5. Launch the streaming client from my windows pc
  6. In the Server tab write the address
  7. Connect

It turns black as soon as I launch it

I managed to make the client stream work in another computer and this error comes

Btw Thank you so much for your help so far

That I dont know. Looks like it cant find the server. Make sure they are on the same network and everything

Hi. Does the Streaming Client work while running on the host via Remote Desktop?

the ssh connection didn’t work, I tried with multiple laptops and OS combinations.
The steps taken as well as the error messages are described above. I’m all ears if anyone has any further ideas or advice on how to fixed it.

Other user have reported that, there is a problem with the streaming client itself, which I also encountered in two pcs:

Are you by any chance using an A100 GPU?

the gpu on the host computer is GeForce RTX 2080 Ti

Can you ping the host from the client?

yes I can! i can even use the windows remote desktop app with it the client.

Is your remote desktop on aws? I am trying with Vast ai? please let me know, if you have any valuable resource to work on a remote server in vast ai and streaming client from local machine. Please give some information on this.

At the moment my problem is that using my windows laptop, every time I execute the streaming client I get a black screen, as follows:

is there is any updates regarding, how fix this would be great.