Issue streaming Isaac sim with docker to streaming client

Hi, I am a student working on a school project where we are going to do reinforcement learning on virtual robots in Isaac sim. Our first objective is to make a self driving RC car.
We have a server with a RTX4090 card, and its on Ubuntu 20.04. We installed Isaac sim there using the container tutorial:
https://docs.omniverse.nvidia.com/isaacsim/latest/installation/install_container.html

Next, we stream the GUI to Omniverse streaming client. So far so good, I can open the GUI in the streaming client and play around, load the hello world example etc.

The issue now is when we try to run python scripts on the server. I followed this tutorial:
https://docs.omniverse.nvidia.com/isaacsim/latest/manual_standalone_python.html

When I try to run this:
./python.sh standalone_examples/api/omni.isaac.kit/livestream.py

I get these errors:
2024-09-03 11:36:34 [1,173ms] [Error] [carb.glinterop.plugin] GLInteropContext::init: carb::windowing is not available

Failed to open [/var/run/utmp]
Active user not found. Using default user [kiosk]2024-09-03 11:36:53 [20,060ms] [Error] [carb.livestream.plugin] Stream Server: starting the server failed, 0x800B1002
2024-09-03 11:36:53 [20,060ms] [Error] [carb.livestream.plugin] Could not initialize streaming components
2024-09-03 11:36:53 [20,060ms] [Error] [carb.livestream.plugin] Couldn’t initialize the capture device.

(Also, when I run that script, in the GUI I just opened a “new file”. Am I supposed to open some type of template there first?).

Other scripts seems to work and outputs things in the terminal. If I run jetbot_move.py, the terminal outputs what looks like X and Y coordinates, but nothing is streamed to the stage in the streaming client.

We solved this. It turned out that starting Isaac (on container startup) was the issue. We didn’t realize that running ./python.sh scripts is supposed to startup Isaac independently. So those errors posted above was saying that the initially opened Isaac was blocking python to open Isaac again.

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.