Isaac Sim WebRTC client is uninteractive for Isaac Lab trainings

Omniverse Isaac Sim
,
1

Isaac Sim Version

4.5.0
4.2.0
4.1.0
4.0.0
4.5.0
2023.1.1
2023.1.0-hotfix.1
Other (please specify):

Operating System

Ubuntu 22.04
Ubuntu 20.04
Windows 11
Windows 10
Other (please specify):

GPU Information

  • Model: Quadro RTX 6000
  • Driver Version: 535.183.01

Topic Description

Detailed Description

I train a modified Isaac-Reach task from Isaac lab for a custom robot. I connect to a central server PC with above mentioned GPU from my local laptop via ssh and run the scripts using –livestream=2 for WebRTC streaming. I can see the training process but I’m unable to tilt, pan the views basically couldn’t interact with the application when training happens. I also use Isaac Sim 4.5 with Omniverse Streaming client and is having a smooth experience.

I would like to know if this is an issue or is it the default way of streaming using WebRTC?

Steps to Reproduce

  1. Run any example training task in a server
  2. Launch WebRTC application in Client and use the server IP to start streaming
  3. Check if the stream is interactive

Error Messages

[77450:0224/155214.065649:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.DBus.Properties.Get: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[77450:0224/155214.066203:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.UPower.GetDisplayDevice: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files
[77450:0224/155214.066477:ERROR:object_proxy.cc(576)] Failed to call method: org.freedesktop.UPower.EnumerateDevices: object_path= /org/freedesktop/UPower: org.freedesktop.DBus.Error.ServiceUnknown: The name org.freedesktop.UPower was not provided by any .service files

Screenshots or Videos

image
image809×632 19.3 KB

3

Thank you for your interest in Isaac Lab. To ensure efficient support and collaboration, please submit your topic to its GitHub repo following the instructions provided on Isaac Lab’s Contributing Guidelines regarding discussions, submitting issues, feature requests, and contributing to the project.

We appreciate your understanding and look forward to assisting you.