Omniverse Kit Remote Client can't connect to AWS

I’m trying to setup an Isaac Sim instance on AWS but I have not been able to connect to it with the Omniverse Kit Remote Client.

I am running the client on Ubuntu 18.04.

When I run the client I get:

jservos@CPR02011L:/mnt/data/nvidia/omniverse-kit-remote$  ./omniverse-kit-remote.sh -s  3.128.236.182 /mnt/data/nvidia/omniverse-kit-remote/bin /mnt/data/nvidia/omniverse-kit-remote
I-!$> Sun Oct 11 17:26:54:898    INFO [BifrostClient: Scheduler] {691B6700} - Successfully set TLS with value 0x15f12d0
I-!$> Sun Oct 11 17:26:54:898    INFO [BifrostClient: Scheduler] {699B7700} - Successfully set TLS with value 0x15f12d0
I-!$> Sun Oct 11 17:26:54:898    INFO [BifrostClient: Scheduler] {689B5700} - Successfully set TLS with value 0x15f12d0
I-!$> Sun Oct 11 17:26:54:898    INFO [BifrostClient: Scheduler] {6A1B8700} - Successfully set TLS with value 0x15f12d0
Sun Oct 11 17:26:55:480   ERROR [BifrostClient: Streamer] {74830180} -  updateVideoSettingsForNVbProfile: profile 8 is not handled

Sun Oct 11 17:26:55:583   ERROR [NVST:ClientSession] {699B7700} -  Server URL is invalid 3.128.236.182
Sun Oct 11 17:26:55:888   ERROR [NVST:ClientSession] {699B7700} -  Number of channels(2) is not valid for surround configuration
Sun Oct 11 17:26:55:888   ERROR [NVST:ClientSession] {699B7700} -  Either in stereo or error in receiving opus information from server
Sun Oct 11 17:26:55:889   ERROR [NVST:ClientSession] {699B7700} -  Server URL is invalid 3.128.236.182
Sun Oct 11 17:26:56:804   ERROR [NVST:NattHolePunch] {37FFF700} -  NattHolePunch: Failed to receive hole punching packet
Sun Oct 11 17:26:56:804   ERROR [NVST:ClientSession] {699B7700} -  Control channel hole punching failed.
Sun Oct 11 17:27:02:814   ERROR [NVST:EnetClientSocket] {699B7700} -  Failed to connect to specified host
Sun Oct 11 17:27:02:814   ERROR [NVST:ServerControlEnet] {699B7700} -  Could not create control connection to server 172.17.0.2 port 47999
Sun Oct 11 17:27:02:815   ERROR [NVST:ClientSession] {699B7700} -  Failed to connect to server using RTSP handshake (error codes: 0X800C0014 0X800C0014)
Sun Oct 11 17:27:02:815   ERROR [NVST:ClientSession] {699B7700} -  Failed to create RTSP connection with error 0X800C0014
Sun Oct 11 17:27:02:815   ERROR [NVST:ClientLibraryWrapper] {699B7700} -  Could not create initial streaming connection : 0x800c0014
Sun Oct 11 17:27:02:815   ERROR [BifrostClient: Streamer] {699B7700} - Failed to initiate connection to rtsp://3.128.236.182:48010: Error: NVST_R_SERVER_CONTROL_HOLE_PUNCH_FAILURE (0x800c0014)
Sun Oct 11 17:27:02:815   ERROR [BifrostClient: Streamer] {699B7700} - Streamer connection failure. Error: NVST_R_SERVER_CONTROL_HOLE_PUNCH_FAILURE (0x800c0014)
Sun Oct 11 17:27:02:815   ERROR [RemoteGridApp] {691B6700} - STREAMING: FAILED: NVB_SN_STREAMING_START_FAILED (800c0014)
Sun Oct 11 17:27:02:815   ERROR [BifrostClient: SessionController] {699B7700} - Failed to start the streamer for session f1d5bec4-3140-45e4-8f3e-979a83521f11. Aborting the session.
Sun Oct 11 17:27:03:016   ERROR [NVST:RtspSessionPocoBase] {456FF700} -  rtsp perform() returnCode:No message received, [N4Poco3Net18NoMessageExceptionE]
Sun Oct 11 17:27:03:017   ERROR [NVST:RtspSessionPocoBase] {456FF700} -  perform() failed: 28
Sun Oct 11 17:27:03:017   ERROR [NVST:RtspPocoEvent] {456FF700} -  RTSP-XNvEvent Polling failed: 28, rc: 408
I-!#>
 Sun Oct 11 17:27:03:019    INFO [BifrostClient: Interface] {74830180} - nvbDestroyClient(). Successfully destroyed NVbClient
./omniverse-kit-remote.sh: line 18: 31492 Segmentation fault      (core dumped) ./omniverse-kit-remote $@

I can ping/ssh to the server just fine. Everything on the server side seems to be running just fine (no errors showing up that I can see). I followed the instructions here (https://docs.omniverse.nvidia.com/exp_robotics/exp_robotics/Robotics_QuickStart.html#aws-deployment) exactly.

Any help or suggestions would be appreciated.

Ah I just saw this note at the top of the AWS instructions:

Live-streaming to Isaac Sim on an AWS instance is not working for some cases. This user guide will be updated when the live-streaming feature is fixed. There are no issues with live-streaming Isaac Sim on remote workstation within the same network.

So I’m guessing AWS deployment is broken at the moment… any ETA on a fix?

Yes, the livestreaming from AWS is not working for some instances. Apologies, there is no ETA on a fix yet.
You could try using the --network host flag when running the docker container and have all ports open from your instance to the client IP address.

Thanks for the response.

I tried with --network host but did not seem to improve things.

On my AWS instance I beleive I have all the ports open as per the instructions:

Inbound rules
|Port range|Protocol|Source|Security groups|
|All|All|xx.xxx.xx.xxx/32|ISSAC_GPU_ACCESS|

Outbound rules
Port range|Protocol|Destination|Security groups
All|All|0.0.0.0/0|ISSAC_GPU_ACCESS

I unfortunatly don’t have a RTX graphics card locally so I can’t test it on my local network.

If there is a “Known Good” configuration for AWS that works I would be happy to change anything.

Hi,

I’m facing the same exact problem. Could let me know when you can have a fix for this.

Hi. We have a fix for this in the upcoming 2020.2 EA release this week. Please stay tuned.

1 Like

Yes, those Security Group settings are recommended. You can open all traffic to your public IP address. We will have a fix for this in the next release, in a couple of days.

1 Like