I am using official docker image for it.
When I run runheadless.native.sh script - everything works. I can connect to the server.
But when I launch sim from python file I get just black screen
Attaching log file of remote viewer. Seems like I cannot connect to some port, but why it works with .sh?
kit-remote.log (32.9 KB)
Hi please try this example. You can run it from the docker container. Try testing it with the Omniverse Streaming Client on the same host as the container.
Please share your Isaac Sim logs if you have any issues.
I can’t run streaming client on same host since it’s a headless server.
I tried the script and it’s the same issue - black screen. And I checked again running with .sh script works perfectly.
kit_20231114_075005.log (1.6 MB)
That logs looks like it’s from the headless native run that works.
Do you have the logs for the livestream example python script?
I think the issue could be caused by some config.
Try running with --reset-user too.
kit_20231115_152524.log (878.2 KB)
Uploaded log. I think it should be the correct one this time. Running with --reset-user gave no effect
Can you try run this instead?
docker run --name isaac-sim --entrypoint bash -it --gpus all -e “ACCEPT_EULA=Y” --rm --network=host
-e “PRIVACY_CONSENT=Y”
-v ~/docker/isaac-sim/cache/kit:/isaac-sim/kit/cache:rw
-v ~/docker/isaac-sim/cache/ov:/root/.cache/ov:rw
-v ~/docker/isaac-sim/cache/pip:/root/.cache/pip:rw
-v ~/docker/isaac-sim/cache/glcache:/root/.cache/nvidia/GLCache:rw
-v ~/docker/isaac-sim/cache/computecache:/root/.nv/ComputeCache:rw
-v ~/docker/isaac-sim/logs:/root/.nvidia-omniverse/logs:rw
-v ~/docker/isaac-sim/data:/root/.local/share/ov/data:rw
-v ~/docker/isaac-sim/documents:/root/Documents:rw
nvcr.io/nvidia/isaac-sim:2023.1.0-hotfix.1
./python.sh standalone_examples/api/omni.isaac.kit/livestream.py -v --reset-user
I’ve just got this to work with the container running on a Linux workstation and OV Streaming Client running on Windows in the same network.
Doesn’t work unfortunetaly. I suspect it might be due to firewall, but on another hand runheadless script works.
I made sure that firewall permits TCP/UDP 47995:48012, TCP/UDP 49000:49007, and TCP 49100
Kit remote logs include
ERROR [NVST:ClientSession] {73A58700} - clientPorts.useReserved: Failed to create a bound AUDIO stream on 0.0.0.0:49003.
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:51464 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:52090 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:51640 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:53897 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:53303 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:53478 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:53417 (Error: 22)
[2023-11-13 14:45:13,578]=15:45:13= ERROR [NVST:NvNetworkCommon] {73A58700} - Socket Bind: failed to bind socket 124 to 0.0.0.0:51137 (Error: 22)
...
[2023-11-13 14:45:13,582]=15:45:13= ERROR [NVST:ClientSession] {73A58700} - ClientSession: no available port in range: 50000-55000 (Error: 0x8000000B)
[2023-11-13 14:45:13,582]=15:45:13= ERROR [NVST:ClientSession] {73A58700} - AUDIO stream setup failed: 0x800b001e. Cannot continue, sorry.
[2023-11-13 14:45:23,556]=15:45:23= ERROR [BifrostClient: Streamer] {74259700} - *** NVSC LIBRARY method 'nvstConnectToServer' has not returned in 30 seconds.
Can it be related? Which ports more I should open? If I should, I don’t get why it’s different from running the sim from .sh script
Those ports should be enough. Do you have any other kit apps running? Try rebooting.
Also try disable firewall just to test.
You try get more clues by running --/app/livestream/logLevel=debug with the python script.
2023-11-17 12:16:07 [14,467ms] [Fatal] [carb.livestream.plugin] StreamSDK: Signaling: #8(M)[2023-11-17 12:16:07,862]=12:16:07=*00000*{6152416105448855322}&1165739F&<Signaling> Signaling server started.
2023-11-17 12:16:07 [14,467ms] [Info] [carb.livestream.plugin] StreamSDK: Server: #9(I)[2023-11-17 12:16:07,863]=12:16:07=*00000*{6152416105448855322}&0414BD9D&<Server> Successfully started server.
2023-11-17 12:16:07 [14,467ms] [Info] [carb.livestream.plugin] StreamSDK: Server: #0(I)[2023-11-17 12:16:07,863]=12:16:07=*00000*{6152416105448855322}&D4F95EB4&<Server> Server is now in state: Started
2023-11-17 12:16:07 [14,467ms] [Info] [carb.livestream.plugin] Stream Server: streaming instance started - waiting for a client...
2023-11-17 12:16:07 [14,467ms] [Info] [carb.livestream.plugin] Streaming server started.
Streaming server started.
2023-11-17 12:16:07 [14,467ms] [Info] [omni.kit.livestream.native.scripts.extension] The Streaming Manager extension was not available when enabling native streaming features.
2023-11-17 12:16:07 [14,467ms] [Info] [omni.ext.plugin] [ext: omni.kit.livestream.native-2.3.0] started, startup time: 79 (ms)
2023-11-17 12:16:19 [25,870ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #1(I)[2023-11-17 12:16:19,265]=12:16:19=*00000*{16263376236038749959}&92F16B9D&<RtspServerWebSoc> Handling request from "10.8.64.87:37314" to "simsoto-0007/rtsp".
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #3(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{5769595885814323909}&1577E9EC&<RtspServerWebSoc> Handling RTSP method OPTIONS
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #4(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{5769595885814323909}&30C9EE27&<RtspServerWebSoc> RTSP Header Version: 14.2
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #5(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{5769595885814323909}&62E90CBC&<RtspHandshake> onRtspOptions : handling request: 1
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #6(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{5769595885814323909}&F23C0516&<RtspHandshake> Session ID not set. Setting CSeq to 1
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #7(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{5769595885814323909}&42BF04B1&<RtspHandshake> Found client RTP extension header version 2
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #8(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{5769595885814323909}&BBFD4F8D&<RtspServerWebSoc> Status code: 200
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: StreamSdkEvents: #9(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{104950999488409285}&33D8F629&<StreamSdkEvents> Invoking clientEventCallback NvstEventDetail::NVST_ED_CLIENT_CONNECTING:
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: StreamSdkEvents: #0(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{104950999488409285}&491E1113&<StreamSdkEvents> Invoking diagnosticsEventRaised RtspOptions
2023-11-17 12:16:19 [25,878ms] [Info] [carb.livestream.plugin] StreamSDK: StreamSdkEvents: #1(I)[2023-11-17 12:16:19,274]=12:16:19=*00000*{104950999488409285}&77BBF756&<StreamSdkEvents> No diagnosticsEventRaised callback provided.
2023-11-17 12:16:19 [25,903ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #2(I)[2023-11-17 12:16:19,299]=12:16:19=*00024*{5769595885814323909}&1577E9EC&<RtspServerWebSoc> Handling RTSP method DESCRIBE
2023-11-17 12:16:19 [25,903ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #3(I)[2023-11-17 12:16:19,299]=12:16:19=*00000*{5769595885814323909}&62E90CBC&<RtspHandshake> onRtspDescribe : handling request: 2
2023-11-17 12:16:19 [25,903ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #4(I)[2023-11-17 12:16:19,299]=12:16:19=*00000*{5769595885814323909}&D85C49E9&<RtspHandshake> Setting up session-id: 1260413319
2023-11-17 12:16:19 [25,904ms] [Info] [carb.livestream.plugin] StreamSDK: NativeServer: #5(I)[2023-11-17 12:16:19,299]=12:16:19=*00000*{5769595885814323909}&EA6208C2&<NativeServer> Server is preparing for a new session.
2023-11-17 12:16:19 [25,904ms] [Info] [carb.livestream.plugin] StreamSDK: Etwprof: #6(I)[2023-11-17 12:16:19,299]=12:16:19=*00000*{5769595885814323909}&6026E29E&<Etwprof> StreamServerBackendMode is 0
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvscStreamingSession: #7(I)[2023-11-17 12:16:19,301]=12:16:19=*00002*{5769595885814323909}&B6269926&<NvscStreamingSes> Allocated 1 ConnectionInfo entries
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: Server: #9(I)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&D4F95EB4&<Server> Server is now in state: Configuring
2023-11-17 12:16:19 [25,906ms] [Fatal] [carb.livestream.plugin] StreamSDK: Server: #0(M)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&70BFD087&<Server> Server is now configuring.
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #1(I)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&2664922A&<RtspHandshake> Format ID 121 isn't supported by encoder
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #2(I)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&2664922A&<RtspHandshake> Format ID 122 isn't supported by encoder
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #3(I)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&2664922A&<RtspHandshake> Format ID 123 isn't supported by encoder
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #4(I)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&2664922A&<RtspHandshake> Format ID 123 isn't supported by encoder
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #5(I)[2023-11-17 12:16:19,301]=12:16:19=*00000*{5769595885814323909}&2664922A&<RtspHandshake> Format ID 124 isn't supported by encoder
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #6(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&2664922A&<RtspHandshake> Format ID 125 isn't supported by encoder
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #7(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&9216B414&<RtspHandshake> Not sending server's qosTimingsVersion because feature is disabled.
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #8(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&F9FCF607&<RtspHandshake> Sending SDP for audio: CAPS: Version=1 Bits=0x1
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #9(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fb300
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #0(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fb300 - 1, 0x7f470e5fb200, 32, (nil)
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #1(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 255
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #2(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #3(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fb300
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #4(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fb300 - 1, 0x7f470e5fb200, 32, (nil)
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #5(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 16777215
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #6(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #7(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fb300
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #8(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fb300 - 1, 0x7f470e5fb200, 32, (nil)
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #9(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 255
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #0(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #1(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fb300
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #2(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fb300 - 1, 0x7f470e5fb200, 32, (nil)
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #3(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 16777215
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #4(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #6(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&8C2AE4C6&<RtspHandshake> Max channels 1, opus mapping FALSE
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvscClientConfigSerialize: #7(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&C9719BB2&<NvscClientConfig> Failed to open config file from location: /isaac-sim/kit/python/bin//server_side_nvscClientConfig.txt
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #8(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&00000000&<RtspHandshake> Random HMAC seed: C9BA...2EB4 [64]
2023-11-17 12:16:19 [25,906ms] [Info] [carb.livestream.plugin] StreamSDK: NvscSerialize: #9(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&5B602769&<NvscSerialize> AppendNvscConfigToSdp
2023-11-17 12:16:19 [25,907ms] [Info] [carb.livestream.plugin] StreamSDK: NvscSerialize: #0(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&2F256CC5&<NvscSerialize> Successfully appended 1 NvscClientConfig attributes to SDP.
2023-11-17 12:16:19 [25,907ms] [Info] [carb.livestream.plugin] StreamSDK: SDP: #1(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&EBB67514&<SDP> Is Valid SDP: 1
2023-11-17 12:16:19 [25,907ms] [Info] [carb.livestream.plugin] StreamSDK: NvscSerialize: #2(I)[2023-11-17 12:16:19,302]=12:16:19=*00000*{5769595885814323909}&5B602769&<NvscSerialize> AppendNvscConfigToSdp
2023-11-17 12:16:19 [25,908ms] [Info] [carb.livestream.plugin] StreamSDK: NvscSerialize: #3(I)[2023-11-17 12:16:19,303]=12:16:19=*00000*{5769595885814323909}&2F256CC5&<NvscSerialize> Successfully appended 2160 NvscClientConfig attributes to SDP.
2023-11-17 12:16:19 [25,908ms] [Info] [carb.livestream.plugin] StreamSDK: SDP: #4(I)[2023-11-17 12:16:19,303]=12:16:19=*00000*{5769595885814323909}&EBB67514&<SDP> Is Valid SDP: 1
2023-11-17 12:16:19 [25,908ms] [Info] [carb.livestream.plugin] StreamSDK: StreamSdkEvents: #5(I)[2023-11-17 12:16:19,304]=12:16:19=*00029*{104950999488409285}&491E1113&<StreamSdkEvents> Invoking diagnosticsEventRaised RtspDescribe
2023-11-17 12:16:19 [25,908ms] [Info] [carb.livestream.plugin] StreamSDK: StreamSdkEvents: #6(I)[2023-11-17 12:16:19,304]=12:16:19=*00000*{104950999488409285}&77BBF756&<StreamSdkEvents> No diagnosticsEventRaised callback provided.
2023-11-17 12:16:19 [25,908ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #7(I)[2023-11-17 12:16:19,304]=12:16:19=*00000*{5769595885814323909}&BBFD4F8D&<RtspServerWebSoc> Status code: 200
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: RtspServerWebSocket: #8(I)[2023-11-17 12:16:19,375]=12:16:19=*00071*{5769595885814323909}&1577E9EC&<RtspServerWebSoc> Handling RTSP method SETUP
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: RtspMessageParser: #0(I)[2023-11-17 12:16:19,375]=12:16:19=*00000*{5769595885814323909}&732EF199&<RtspMessageParse> RTSP Message Parser: Client port is: 49003
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: RtspMessageParser: #1(I)[2023-11-17 12:16:19,375]=12:16:19=*00000*{5769595885814323909}&732EF199&<RtspMessageParse> RTSP Message Parser: Client port is: 49003
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: RtspMessageParser: #2(I)[2023-11-17 12:16:19,375]=12:16:19=*00000*{5769595885814323909}&732EF199&<RtspMessageParse> RTSP Message Parser: Client port is: 49003
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: RtspHandshake: #3(I)[2023-11-17 12:16:19,375]=12:16:19=*00000*{5769595885814323909}&E289E304&<RtspHandshake> onRtspSetup : handling request: 3 0 0 0 0
2023-11-17 12:16:19 [25,980ms] [Warning] [carb.livestream.plugin] StreamSDK: RtspHandshake: #4(W)[2023-11-17 12:16:19,375]=12:16:19=*00000*{5769595885814323909}&C811A96F&<RtspHandshake> Redundant setup request for streamid=audio/0/0
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: NativeServer: #5(I)[2023-11-17 12:16:19,375]=12:16:19=*00000*{5769595885814323909}&2676C52E&<NativeServer> Server is handling a request to setup a connection.
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: NvSocketUdp: #6(I)[2023-11-17 12:16:19,376]=12:16:19=*00000*{5769595885814323909}&00000000&<NvSocketUdp> UDP Socket is now configured as exclusive.
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #8(I)[2023-11-17 12:16:19,376]=12:16:19=*00000*{5769595885814323909}&3A08FF1D&<NattHolePunch> NattHolePunch: Set ping-version: 5
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #9(I)[2023-11-17 12:16:19,376]=12:16:19=*00000*{5769595885814323909}&1CA17458&<NattHolePunch> NattHolePunch: Set ping-string XNV258048650
2023-11-17 12:16:19 [25,980ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #0(I)[2023-11-17 12:16:19,376]=12:16:19=*00000*{5769595885814323909}&81EB5623&<NattHolePunch> Initialize hashing with text
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: Authentication: #2(I)[2023-11-17 12:16:19,380]=12:16:19=*00003*{5769595885814323909}&00000000&<Authentication> PING_KEY: F845...26EE [64]
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #3(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fcda0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #4(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fcda0 - 1, 0x7f470e5fcca0, 32, (nil)
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #5(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 255
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #6(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #7(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fcda0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #8(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fcda0 - 1, 0x7f470e5fcca0, 32, (nil)
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #9(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 16777215
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #0(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #1(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fcda0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #2(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fcda0 - 1, 0x7f470e5fcca0, 32, (nil)
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #3(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 255
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #4(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #5(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&52CD1234&<NvNetworkLinux> Adapter found with MAC: 0x7f470e5fcda0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #6(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&B02C5740&<NvNetworkLinux> Network Query Parameter: 0x7f470e5fcda0 - 1, 0x7f470e5fcca0, 32, (nil)
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #7(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&AC2F234D&<NvNetworkLinux> NetMaskBits: IP address not class A, B or C. First octet = 16777215
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NvNetworkLinux: #8(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&6456C047&<NvNetworkLinux> networkQueryParameter: return 0x0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #0(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&0D20B417&<NattHolePunch> Adding address: 127.0.0.1:48000
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #1(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&0D20B417&<NattHolePunch> Adding address: 10.8.1.122:48000
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #2(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&04857B7D&<NattHolePunch> Address 127.0.0.1:48000 already exists
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #3(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&04857B7D&<NattHolePunch> Address 10.8.1.122:48000 already exists
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: natt: #4(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&781B9D36&<natt> Creating NvNatTraversal
2023-11-17 12:16:19 [25,984ms] [Error] [carb.livestream.plugin] StreamSDK: natt: #5(E)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&9620D6EB&<natt> NATT Initialize: invalid STUN server count 0
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: natt: #6(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&70558E34&<natt> NATT GetSocket Endpoint: 194 - (nil) - 0x7f470e5fce00 - 7
2023-11-17 12:16:19 [25,984ms] [Error] [carb.livestream.plugin] StreamSDK: natt: #7(E)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&A7EC0954&<natt> NATT GetSocket Endpoint: NATT is not initialized
2023-11-17 12:16:19 [25,984ms] [Error] [carb.livestream.plugin] StreamSDK: NvNetworkCommon: #8(E)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&168334B0&<NvNetworkCommon> Network Address To String: invalid parameters 0x7f470e5fce80, 0x7f470e5fcea0, 48
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #9(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&0D20B417&<NattHolePunch> Adding address: 127.0.1.1:48300
2023-11-17 12:16:19 [25,984ms] [Info] [carb.livestream.plugin] StreamSDK: NattHolePunch: #0(I)[2023-11-17 12:16:19,380]=12:16:19=*00000*{5769595885814323909}&0D20B417&<NattHolePunch> Adding address: 127.0.1.1:48000
I have these errors. But good thing is that at least it sees that I try to connect(I inserted multiple newlines in the logs to highlight this moment)
Can you share the full logs when running with command below?
./python.sh standalone_examples/api/omni.isaac.kit/livestream.py -v --reset-user --/app/livestream/logLevel=debug
Is OV Streaming Client running on the same network as the host?
@Sheikh_Dawood Attaching logs here. Yep, they are on the same network
LOGS_EXAMPLE_LIVESTREAM.txt (933.2 KB)
@Sheikh_Dawood I also out of curiosity tried with 2022 version and it’s same issue. If I start with runheadless.native.sh streaming works, but not with python script
Can you try add these lines to the /apps/omni.isaac.sim.python.kit file?
[dependencies]
# The Main UI App
"omni.kit.uiapp" = {}
"omni.kit.renderer.core" = {}
#add these below
"omni.kit.livestream.native" = {version = "2.4.0", exact = true}
"omni.kit.streamsdk.plugins" = {version = "2.5.2", exact = true}
[settings.app.window]
title = "Isaac Sim Python"
hideUi = false
_iconSize = 256
iconPath = "${app}/../exts/omni.isaac.app.setup/data/nvidia-omniverse-isaacsim.ico"
#add these below
width = 1920
height = 1080
drawMouse = true
# add this section
[settings.app.livestream]
proto = "ws"
allowResize = true
outDirectory = "${data}"
Solver Input (requested extensions):
(name: 'omni.isaac.sim.python', tag: '', version: '2023.1.0', exact: 1, optional: 0)
2023-11-28 16:33:10 [2,939ms] [Error] [omni.ext.plugin] Failed to resolve extension dependencies. Failure hints:
[omni.isaac.sim.python-2023.1.0] dependency: (name: 'omni.kit.livestream.native', tag: '', version: '2.4.0', exact: 1, optional: 0) can't be satisfied. Available versions:
- [omni.kit.livestream.native-2.3.0+105.1.lx64.r.cp310] (/isaac-sim/extscache/omni.kit.livestream.native-2.3.0+105.1.lx64.r.cp310)
- [omni.kit.livestream.native-2.0.0+105.1.lx64.r.cp310] (/isaac-sim/extscache/omni.kit.livestream.native-2.0.0+105.1.lx64.r.cp310)
2023-11-28 16:33:10 [2,939ms] [Error] [omni.kit.app.plugin] Exiting app because of dependency solver failure...
2023-11-28 16:33:10 [2,940ms] [Info] [omni.kit.app.plugin] No run loop was found, quitting...
olver Input (requested extensions):
(name: 'omni.isaac.sim.python', tag: '', version: '2023.1.0', exact: 1, optional: 0)
2023-11-28 16:34:22 [7,878ms] [Error] [omni.ext.plugin] Failed to resolve extension dependencies. Failure hints:
[omni.isaac.sim.python-2023.1.0] dependency: (name: 'omni.kit.streamsdk.plugins', tag: '', version: '2.5.2', exact: 1, optional: 0) can't be satisfied. Available versions:
- [omni.kit.streamsdk.plugins-2.5.0+105.1.lx64.r] (registry)
- [omni.kit.streamsdk.plugins-2.3.7+105.1.lx64.r] (/isaac-sim/extscache/omni.kit.streamsdk.plugins-2.3.7+105.1.lx64.r)
- [omni.kit.streamsdk.plugins-2.1.3+105.1.lx64.r] (/isaac-sim/extscache/omni.kit.streamsdk.plugins-2.1.3+105.1.lx64.r)
- [omni.kit.streamsdk.plugins-2.0.3+105.0.lx64.r] (registry)
2023-11-28 16:34:22 [7,878ms] [Error] [omni.kit.app.plugin] Exiting app because of dependency solver failure...
2023-11-28 16:34:22 [7,878ms] [Info] [omni.kit.app.plugin] No run loop was found, quitting...
2023-11-28 16:34:22 [7,878ms] [Info] [omni.kit.app.plugin] Application auto-quits as it worked for the specified number of frames: 0
2023-11-28 16:34:22 [7,878ms] [Info] [omni.kit.app.plugin] app started
Actually it worked for me!!! But only if I pin the versions to 2.3.0 and 2.5.0 respectively.
Is it expected, should I do that everytime?
Thanks.
Sorry, it should be these lines:
"omni.kit.livestream.native" = {version = "2.0.0", exact = true}
"omni.kit.streamsdk.plugins" = {version = "2.1.3", exact = true}
We will be using an updated version(above) for the next 2023.1.1 release that we are working on. :)
Is it expected, should I do that everytime?
Yes, for the current version. I will look into adding these for the next version.
Please let me know if you have any issues with this change.
Tracking this as OM-115686.