RTX A6000 running isaac-sim container not able to connect with streaming client (GUI shows empty content)

Omniverse Isaac Sim
1

I am running isaac-sim container on my cloud server instance. I can start isaac_sim using runheadless.native.sh. But I cannot see anything from the streaming client GUI (I can see log that Isaac Sim Headless is loaded). I realized there is an error when isaac_sim initializing on the server. I search online and cannot find a solution. The error:

2024-10-29 05:39:03 [27,120ms] [Error] [carb.graphics-vulkan.plugin] Could not get NGX parameters block because NGX isn’t enabled.
2024-10-29 05:39:03 [27,120ms] [Error] [carb.graphics-vulkan.plugin] Failed to create NGX context.

I also checked ports it’s listening. I don’t find those defined on the offical guide: 47995:48012 (TCP/UDP), 49000:49007 (TCP/UDP), 49100 TCP. Below are the context I grabbed in container,

tcp 0 0 127.0.0.1:61209 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:111 0.0.0.0:* LISTEN
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:41821 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.53:53 0.0.0.0:* LISTEN
tcp 0 0 127.0.0.1:7000 0.0.0.0:* LISTEN
tcp6 0 0 :::111 :::* LISTEN
tcp6 0 0 :::22 :::* LISTEN

I also tried the WebRTC method. I can start isaac-sim webrtc on server using runheadless.webrtc.sh. But I cannot see anything in my browser. I opened port 8211 TCP/UPD on my server. I used telnet to check whether the port is open. I don’t see any error, but found one info from log:

Tick: provider_nucleus: Connection to omniverse:// failed: No host specified

Isaac-Sim version

4.2.0 container

Operating system

Ubuntu 22.04

GPU Model

RTX A6000

GPU Driver (both linux server and docker image)

550.120 (tried 535, 560 as well)

Vulkan API Version

1.3.204. I also tried vulkaninfo | grep “Device Name”, no GPU detected and below is the output

WARNING: [Loader Message] Code 0 : terminator_CreateInstance: Failed to CreateInstance in ICD 4.  Skipping ICD.

Kernel Version

6.8.0-47-generic

Steps to Reproduce

I am following this link: Container Installation — Omniverse IsaacSim latest documentation

Screenshots or Videos (Headless Native)

Screenshot 2024-10-29 at 10.06.05 AM
Screenshot 2024-10-29 at 10.06.05 AM1049×787 11.5 KB

Screenshots or Videos (WebRTC)

Screenshot 2024-10-29 at 10.12.15 AM
Screenshot 2024-10-29 at 10.12.15 AM1325×801 5.36 KB

Related Issues

Tried A100 as well. But it doesn’t support graphics well. So switched to RTX A6000.

3

Are you follow Container Installation to use Docker container?

4

Yes, I follow this link using docker container.
I also tried IsaacLab LiveStream (both Streaming Client & WebRTC), also not working: [Bug Report] Not able to use LiveStream and Streaming CLient · Issue #1399 · isaac-sim/IsaacLab · GitHub.

For WebRTC, must I need to install the extension? I didn’t find a way to install Omniverse on macbook.

6

Please check the following documentation: Linux Troubleshooting and try reinstalling the suggested drivers. Additionally, follow Container Installation — Omniverse IsaacSim to reinstall Docker and the latest container toolkit.

7

"vulkaninfo | grep “Device Name” seems to be a wrong command for checking. I tried "vulkaninfo | grep “GPU” and can find the GPU device. I also reinstall Cuda, driver, vulkan, kernel many times. I don’t see any trivial mistake. I’ve followed Container Installation multiple times. I don’t know what else I can do.

I searched in the forum, and seems vulkan and driver don’t match is a common answer. For this case, what could be wrong? I’ve listed all version info.

8

Hi, can you share the output of nvidia-ctk --version?
If it is older than 1.16.2 please re-install/update the NVIDIA Container Tookit.

Try running these to test:

docker run --rm --runtime=nvidia --gpus all ubuntu nvidia-smi

docker run --name isaac-sim --runtime=nvidia --gpus all -e “ACCEPT_EULA=Y” --rm --network=host -e “PRIVACY_CONSENT=Y” nvcr.io/nvidia/isaac-sim:4.2.0

2 Likes
9

Thanks for the response. Unfortunately, I didn’t figure out the solution for a while. So I cancelled the A6000 instance last week. Now I have a new A10 instance. Does it work for isaac sim and local GUI? If so, I will give another try and use your advises.

10

I believe the A6000 should be supported, but you can go ahead and try the A10.