Connection Error - OV Extension Repo

Hi team,

Trying to run the sample USD Viewer container with Minikube on Ubuntu 22. Everything looks good except when trying to run the USD Viewer KIT app. Getting connection errors at runtime. Seems like it’s trying to download more extensions and a sample USD file.

Do I need to configure something extra on in the Minikube network settings? Some logs below.

2024-11-25 12:25:03 [92,304ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://kit-extensions.ov.nvidia.com/omni/discovery: Create transport failed: Unable to connect to kit-extensions.ov.nvidia.com:443
2024-11-25 12:25:03 [92,304ms] [Verbose] [omni.client.plugin]  Tick: discovery: kit-extensions.ov.nvidia.com: Stopping
2024-11-25 12:25:03 [92,304ms] [Verbose] [omni.client.plugin]  Tick: http: POST https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:25:09 [98,319ms] [Info] [omni.client.plugin]  HTTP Client: http: libcurl error (6): Couldn't resolve host name for https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize
2024-11-25 12:25:09 [98,320ms] [Verbose] [omni.client.plugin]  HTTP Client: http: https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize retrying in 113ms
2024-11-25 12:25:09 [98,320ms] [Verbose] [omni.client.plugin]  HTTP Client: http: POST https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:25:13 [102,304ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Connection to omniverse://kit-extensions.ov.nvidia.com failed: Timed Out
2024-11-25 12:25:13 [102,304ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Will attempt to reconnect in 3796 milliseconds
2024-11-25 12:25:17 [106,100ms] [Verbose] [omni.client.plugin]  Tick: discovery: kit-extensions.ov.nvidia.com: Starting
2024-11-25 12:25:17 [106,101ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://kit-extensions.ov.nvidia.com/omni/discovery: Searching for services
2024-11-25 12:25:17 [106,101ms] [Verbose] [omni.client.plugin]  Tick: idl: connecting to wss://kit-extensions.ov.nvidia.com:443/omni/discovery
2024-11-25 12:25:23 [112,113ms] [Verbose] [omni.client.plugin]  Tick: idl: getaddrinfo(kit-extensions.ov.nvidia.com:443): Address resolution failure: Name or service not known
2024-11-25 12:25:23 [112,114ms] [Verbose] [omni.client.plugin]  Tick: idl: Failed to connect to kit-extensions.ov.nvidia.com:443
2024-11-25 12:25:23 [112,114ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: Sending CLOSE (reason=1000)
2024-11-25 12:25:23 [112,114ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: destroyed
2024-11-25 12:25:23 [112,114ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://kit-extensions.ov.nvidia.com/omni/discovery: Create transport failed: Unable to connect to kit-extensions.ov.nvidia.com:443
2024-11-25 12:25:23 [112,114ms] [Verbose] [omni.client.plugin]  Tick: discovery: kit-extensions.ov.nvidia.com: Stopping
2024-11-25 12:25:23 [112,114ms] [Verbose] [omni.client.plugin]  Tick: http: POST https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:25:29 [118,128ms] [Info] [omni.client.plugin]  HTTP Client: http: libcurl error (6): Couldn't resolve host name for https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize
2024-11-25 12:25:29 [118,128ms] [Verbose] [omni.client.plugin]  HTTP Client: http: https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize retrying in 121ms
2024-11-25 12:25:29 [118,128ms] [Verbose] [omni.client.plugin]  HTTP Client: http: POST https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:25:33 [122,114ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Connection to omniverse://kit-extensions.ov.nvidia.com failed: Timed Out
2024-11-25 12:25:33 [122,114ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Will attempt to reconnect in 5452 milliseconds
2024-11-25 12:25:38 [127,566ms] [Verbose] [omni.client.plugin]  Tick: discovery: kit-extensions.ov.nvidia.com: Starting
2024-11-25 12:25:38 [127,566ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://kit-extensions.ov.nvidia.com/omni/discovery: Searching for services
2024-11-25 12:25:38 [127,566ms] [Verbose] [omni.client.plugin]  Tick: idl: connecting to wss://kit-extensions.ov.nvidia.com:443/omni/discovery
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: idl: getaddrinfo(kit-extensions.ov.nvidia.com:443): Address resolution failure: Name or service not known
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: idl: Failed to connect to kit-extensions.ov.nvidia.com:443
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: Sending CLOSE (reason=1000)
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: destroyed
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://kit-extensions.ov.nvidia.com/omni/discovery: Create transport failed: Unable to connect to kit-extensions.ov.nvidia.com:443
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: discovery: kit-extensions.ov.nvidia.com: Stopping
2024-11-25 12:25:44 [133,583ms] [Verbose] [omni.client.plugin]  Tick: http: POST https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:25:50 [139,598ms] [Info] [omni.client.plugin]  HTTP Client: http: libcurl error (6): Couldn't resolve host name for https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize
2024-11-25 12:25:50 [139,598ms] [Verbose] [omni.client.plugin]  HTTP Client: http: https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize retrying in 83ms
2024-11-25 12:25:50 [139,598ms] [Verbose] [omni.client.plugin]  HTTP Client: http: POST https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:25:54 [143,583ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Connection to omniverse://kit-extensions.ov.nvidia.com failed: Timed Out
2024-11-25 12:25:54 [143,583ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Stopped automatic reconnects after 127 seconds (7 attempts)
2024-11-25 12:25:54 [143,583ms] [Verbose] [omni.client.plugin]  Tick: core: Request 1: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.zip) returned Error: Connection
2024-11-25 12:25:54 [143,584ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] stat result: Result.ERROR_CONNECTION
2024-11-25 12:25:54 [143,584ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] omni.client.stat: omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.json
2024-11-25 12:25:54 [143,584ms] [Verbose] [omni.client.plugin]  1: core: Request 3: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.json) starting
2024-11-25 12:25:54 [143,584ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] stat result: Result.ERROR_CONNECTION
2024-11-25 12:25:54 [143,584ms] [Verbose] [omni.client.plugin]  Tick: core: Request 3: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.json) returned Error: Connection
2024-11-25 12:25:54 [143,584ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] omni.client.stat: omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.toml
2024-11-25 12:25:54 [143,585ms] [Verbose] [omni.client.plugin]  1: core: Request 5: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.toml) starting
2024-11-25 12:25:54 [143,585ms] [Verbose] [omni.client.plugin]  Tick: core: Request 5: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/default/3/index.toml) returned Error: Connection
2024-11-25 12:25:54 [143,585ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] stat result: Result.ERROR_CONNECTION
2024-11-25 12:25:54 [143,585ms] [Warning] [omni.kit.registry.nucleus.index] OFFLINE MODE: syncing index failed. Using cached index from: Thu Mar  7 22:42:29 2024 (path: /home/ubuntu/.local/share/ov/data/exts/v2/urls/e35ea6e8263442bf3fea7c124350f54ce601c30d)
2024-11-25 12:25:54 [143,602ms] [Info] [omni.kit.registry.nucleus.utils.common] index download took: 143.35571837425232
2024-11-25 12:25:54 [143,864ms] [Info] [omni.kit.registry.nucleus.utils.common] unzipped index: /tmp/tmp3xnnj6e0/index.zip
2024-11-25 12:25:57 [146,031ms] [Info] [omni.kit.registry.nucleus.utils.common] index meta: {'locking_enabled': False, 'read_version': 1, 'write_version': 1, 'package': {}}
2024-11-25 12:25:57 [146,031ms] [Info] [omni.kit.registry.nucleus.utils.common] dictionary load took: 2.4290952682495117
2024-11-25 12:25:57 [146,031ms] [Info] [omni.kit.registry.nucleus.utils.common] index was loaded from file: '/tmp/tmp3xnnj6e0/index.zip'. index_is_new: False
2024-11-25 12:25:59 [147,938ms] [Info] [omni.ext.plugin] Syncing extension registry for provider 'kit/sdk'.
2024-11-25 12:25:59 [147,938ms] [Info] [omni.kit.registry.nucleus.utils.common] [kit/sdk] sync_index called.
2024-11-25 12:25:59 [147,938ms] [Info] [omni.kit.registry.nucleus.utils.common] [kit/sdk] [v1] _ensure_synced(resync=False) called
2024-11-25 12:25:59 [147,938ms] [Info] [omni.kit.registry.nucleus.utils.common] [kit/sdk] [v1] self._index_sync_required
2024-11-25 12:25:59 [147,938ms] [Info] [omni.kit.registry.nucleus.utils.common] [kit/sdk] [v1] Downloading and reading index...
2024-11-25 12:25:59 [147,938ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] omni.client.stat: omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.zip
2024-11-25 12:25:59 [147,938ms] [Verbose] [omni.client.plugin]  1: core: Request 7: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.zip) starting
2024-11-25 12:25:59 [147,939ms] [Error] [omni.kit.registry.nucleus.utils.common] syncing index failed. URL: 'omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3'. Result: Result.ERROR_CONNECTION
2024-11-25 12:25:59 [147,938ms] [Verbose] [omni.client.plugin]  Tick: core: Request 7: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.zip) returned Error: Connection
2024-11-25 12:25:59 [147,939ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] stat result: Result.ERROR_CONNECTION
2024-11-25 12:25:59 [147,939ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] omni.client.stat: omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.json
2024-11-25 12:25:59 [147,939ms] [Verbose] [omni.client.plugin]  1: core: Request 9: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.json) starting
2024-11-25 12:25:59 [147,939ms] [Error] [omni.ext.plugin] Syncing extension registry failed: registry dict is nullptr.
2024-11-25 12:25:59 [147,939ms] [Verbose] [omni.client.plugin]  Tick: core: Request 9: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.json) returned Error: Connection
2024-11-25 12:25:59 [147,939ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] stat result: Result.ERROR_CONNECTION
2024-11-25 12:25:59 [147,939ms] [Info] [omni.kit.registry.nucleus.utils.omni_client_utils] omni.client.stat: omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.toml
2024-11-25 12:25:59 [147,939ms] [Error] [omni.ext.plugin] Failed to resolve extension dependencies. Failure hints:
2024-11-25 12:25:59 [147,939ms] [Verbose] [omni.client.plugin]  1: core: Request 11: stat(omniverse://kit-extensions.ov.nvidia.com/exts/kit/sdk/105.1/09b309e7/3/index.toml) starting
	Can't find extension with name: omni.hsscclient
 Available versions:
	 (none found)
2024-11-25 12:27:36 [245,325ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://store.cluster.az.omniverse.acme.com/omni/discovery: Create transport failed: Unable to connect to store.cluster.az.omniverse.acme.com:443
2024-11-25 12:27:36 [245,325ms] [Verbose] [omni.client.plugin]  Tick: discovery: store.cluster.az.omniverse.acme.com: Stopping
2024-11-25 12:27:36 [245,325ms] [Verbose] [omni.client.plugin]  Tick: http: POST https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:27:42 [251,333ms] [Info] [omni.client.plugin]  HTTP Client: http: libcurl error (6): Couldn't resolve host name for https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize
2024-11-25 12:27:42 [251,333ms] [Verbose] [omni.client.plugin]  HTTP Client: http: https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize retrying in 57ms
2024-11-25 12:27:42 [251,333ms] [Verbose] [omni.client.plugin]  HTTP Client: http: POST https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:27:46 [255,325ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Connection to omniverse://store.cluster.az.omniverse.acme.com failed: Timed Out
2024-11-25 12:27:46 [255,325ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Will attempt to reconnect in 3780 milliseconds
2024-11-25 12:27:50 [259,105ms] [Verbose] [omni.client.plugin]  Tick: discovery: store.cluster.az.omniverse.acme.com: Starting
2024-11-25 12:27:50 [259,105ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://store.cluster.az.omniverse.acme.com/omni/discovery: Searching for services
2024-11-25 12:27:50 [259,105ms] [Verbose] [omni.client.plugin]  Tick: idl: connecting to wss://store.cluster.az.omniverse.acme.com:443/omni/discovery
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: idl: getaddrinfo(store.cluster.az.omniverse.acme.com:443): Address resolution failure: No address associated with hostname
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: idl: Failed to connect to store.cluster.az.omniverse.acme.com:443
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: Sending CLOSE (reason=1000)
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: destroyed
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://store.cluster.az.omniverse.acme.com/omni/discovery: Create transport failed: Unable to connect to store.cluster.az.omniverse.acme.com:443
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: discovery: store.cluster.az.omniverse.acme.com: Stopping
2024-11-25 12:27:56 [265,117ms] [Verbose] [omni.client.plugin]  Tick: http: POST https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:28:02 [271,126ms] [Info] [omni.client.plugin]  HTTP Client: http: libcurl error (6): Couldn't resolve host name for https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize
2024-11-25 12:28:02 [271,126ms] [Verbose] [omni.client.plugin]  HTTP Client: http: https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize retrying in 95ms
2024-11-25 12:28:02 [271,126ms] [Verbose] [omni.client.plugin]  HTTP Client: http: POST https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:28:06 [275,117ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Connection to omniverse://store.cluster.az.omniverse.acme.com failed: Timed Out
2024-11-25 12:28:06 [275,117ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Will attempt to reconnect in 5179 milliseconds
2024-11-25 12:28:11 [280,296ms] [Verbose] [omni.client.plugin]  Tick: discovery: store.cluster.az.omniverse.acme.com: Starting
2024-11-25 12:28:11 [280,296ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://store.cluster.az.omniverse.acme.com/omni/discovery: Searching for services
2024-11-25 12:28:11 [280,296ms] [Verbose] [omni.client.plugin]  Tick: idl: connecting to wss://store.cluster.az.omniverse.acme.com:443/omni/discovery
2024-11-25 12:28:27 [296,303ms] [Error] [omni.usd] Failed to open : omniverse://store.cluster.az.omniverse.acme.com/project-a/stage.usd
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: idl: getaddrinfo(store.cluster.az.omniverse.acme.com:443): Address resolution failure: No address associated with hostname
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: idl: Failed to connect to store.cluster.az.omniverse.acme.com:443
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: Sending CLOSE (reason=1000)
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: idl: 0: destroyed
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: discovery: wss://store.cluster.az.omniverse.acme.com/omni/discovery: Create transport failed: Unable to connect to store.cluster.az.omniverse.acme.com:443
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: discovery: store.cluster.az.omniverse.acme.com: Stopping
2024-11-25 12:28:17 [286,302ms] [Verbose] [omni.client.plugin]  Tick: http: POST https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:28:23 [292,311ms] [Info] [omni.client.plugin]  HTTP Client: http: libcurl error (6): Couldn't resolve host name for https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize
2024-11-25 12:28:23 [292,311ms] [Verbose] [omni.client.plugin]  HTTP Client: http: https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize retrying in 131ms
2024-11-25 12:28:23 [292,311ms] [Verbose] [omni.client.plugin]  HTTP Client: http: POST https://store.cluster.az.omniverse.acme.com/omni/auth/api/device/authorize (timeout=60)
2024-11-25 12:28:27 [296,303ms] [Info] [omni.client.plugin]  Tick: provider_nucleus: Connection to omniverse://store.cluster.az.omniverse.acme.com failed: Timed Out

I think it mostly boils down to this (and alike) errors:

Couldn't resolve host name for https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize

Please execute curl https://kit-extensions.ov.nvidia.com/omni/auth/api/device/authorize from your minicube’s host server, if you can reach it this means that the pods inside minicube can’t for some reason, perhaps due to misconfigured DNS, if you can’t - this means your host has connectivity issues as well.

Not sure on the exact reason for your connection problems, but clearly at least one of your machines cannot get out to the required services. Please manually try to access these links as requested from each of the machines and test their external access capabilities. A lot of kit services require the ability to check on additional resources on a live Internet connection. I would at least run this application on one machine first and have it download all the required extensions as needed, before trying to apply to multiple machines.

It is an issue with my host network setup. Thanks for replying.

Thanks for letting us know. I am glad you have identified this issue. Good Luck!!

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.