Hello,
I am currently installing and setting up the Enterprise Nucleus Server for development purposes, as Omniverse Launcher and Nucleus Workstation will be deprecated starting October 1, 2025.
While following the official installation guide, I encountered the following error when running the command to bring up the Docker containers.
As I am a beginner in this field, I tried searching for solutions based on the error message but was unable to find a resolution.
Would anyone be able to explain the cause of this issue and suggest a possible solution?
Thank you in advance for your help.
This is what I typed
sudo docker compose --env-file /opt/ove/base_stack/nucleus-stack.env -f /opt/ove/base_stack/nucleus-stack-no-ssl.yml up
This is the error message
(isaacsim) sh@ss:/opt/ove/base_stack$ sudo docksudo docker compose --env-file /opt/ove/base_stack/nucleus-stack.env -f /opt/ove/base_stack/nucleus-stack-no-ssl.yml up
[+] Running 12/12
β Container base_stack-nucleus-navigator-1 Created 0.0s
β Container base_stack-nucleus-discovery-1 Created 0.0s
β Container base_stack-utl-monpx-1 Created 0.0s
β Container base_stack-nucleus-tagging-1 Created 0.0s
β Container base_stack-nucleus-resolver-cache-1 Created 0.0s
β Container base_stack-nucleus-lft-1 Created 0.0s
β Container base_stack-nucleus-thumbnails-1 Created 0.0s
β Container base_stack-nucleus-log-processor-1 Created 0.0s
β Container base_stack-nucleus-lft-lb-1 Created 0.0s
β Container base_stack-nucleus-search-1 Created 0.0s
β Container base_stack-nucleus-api-1 Created 0.0s
β Container base_stack-nucleus-auth-1 Created 0.0s
Attaching to nucleus-api-1, nucleus-auth-1, nucleus-discovery-1, nucleus-lft-1, nucleus-lft-lb-1, nucleus-log-processor-1, nucleus-navigator-1, nucleus-resolver-cache-1, nucleus-search-1, nucleus-tagging-1, nucleus-thumbnails-1, utl-monpx-1
nucleus-resolver-cache-1 | ======================================
nucleus-resolver-cache-1 | The following nginx.conf will be used:
nucleus-resolver-cache-1 | ======================================
nucleus-resolver-cache-1 | worker_processes auto;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | events {
nucleus-resolver-cache-1 | worker_connections 1024;
nucleus-resolver-cache-1 | }
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | http {
nucleus-resolver-cache-1 | log_format omni '[$time_local] $request_method '
nucleus-resolver-cache-1 | '$remote_addr '
nucleus-resolver-cache-1 | '$scheme://$http_host$request_uri '
nucleus-resolver-cache-1 | '$status $upstream_cache_status '
nucleus-resolver-cache-1 | '$request_length $bytes_sent';
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | error_log /dev/stderr;
nucleus-resolver-cache-1 | access_log /dev/stderr omni;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | proxy_cache_path /omni/data levels=1:2 keys_zone=resolver_cache:1024m inactive=2h use_temp_path=off;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | server {
nucleus-resolver-cache-1 | listen 8891 reuseport;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | proxy_http_version 1.1;
nucleus-resolver-cache-1 | proxy_set_header Connection "";
nucleus-resolver-cache-1 | proxy_set_header Authorization "$http_omniverse_proxy_authorization";
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | proxy_buffering on; # Required for cache to work!!
nucleus-resolver-cache-1 | proxy_request_buffering off;
nucleus-resolver-cache-1 | client_max_body_size 0;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | proxy_cache resolver_cache;
nucleus-resolver-cache-1 | proxy_cache_background_update on;
nucleus-resolver-cache-1 | proxy_cache_revalidate on;
nucleus-resolver-cache-1 | proxy_cache_use_stale error timeout updating;
nucleus-resolver-cache-1 | proxy_cache_valid 200 302 1h;
nucleus-resolver-cache-1 | proxy_cache_valid any 30s;
nucleus-resolver-cache-1 | proxy_connect_timeout 5s;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | location / {
nucleus-resolver-cache-1 | resolver 127.0.0.11 valid=10s ipv6=off;
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | proxy_pass $scheme://$http_host$request_uri;
nucleus-resolver-cache-1 | }
nucleus-resolver-cache-1 |
nucleus-resolver-cache-1 | }
nucleus-resolver-cache-1 | }
nucleus-navigator-1 | mv: cannot stat '/etc/nginx/sites-available/default.http.conf.template': No such file or directory
nucleus-navigator-1 | Starting nginx on port 80 with public URL http://12.36.192.112:8080/ and SSL disabled
nucleus-lft-lb-1 | ======================================
nucleus-lft-lb-1 | The following nginx.conf will be used:
nucleus-lft-lb-1 | ======================================
nucleus-lft-lb-1 | worker_processes auto;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | events {
nucleus-lft-lb-1 | worker_connections 10240;
nucleus-lft-lb-1 | }
nucleus-lft-lb-1 |
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | http {
nucleus-lft-lb-1 | upstream lft {
nucleus-lft-lb-1 | server nucleus-lft:3030;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | keepalive 10;
nucleus-lft-lb-1 | keepalive_time 1h;
nucleus-lft-lb-1 | keepalive_requests 10000;
nucleus-lft-lb-1 | }
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | log_format omni '[$time_local] $request_method '
nucleus-lft-lb-1 | '$http_x_ov_username '
nucleus-lft-lb-1 | '$http_x_ov_uri '
nucleus-lft-lb-1 | '$http_x_ov_connection_id '
nucleus-lft-lb-1 | '$http_referer $http_user_agent '
nucleus-lft-lb-1 | '$request_length $bytes_sent';
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | error_log /dev/stderr;
nucleus-lft-lb-1 | access_log /dev/stderr omni;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | server {
nucleus-lft-lb-1 | listen 3030 reuseport;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | proxy_http_version 1.1;
nucleus-lft-lb-1 | proxy_set_header Connection "";
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | proxy_buffering off;
nucleus-lft-lb-1 | proxy_request_buffering off;
nucleus-lft-lb-1 | client_max_body_size 0;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | location / {
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | # client_max_body_size 10m;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | resolver 127.0.0.1 valid=10s;
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | proxy_pass http://lft;
nucleus-lft-lb-1 | }
nucleus-lft-lb-1 |
nucleus-lft-lb-1 | }
nucleus-lft-lb-1 | }
utl-monpx-1 | INFO 2025-03-17 06:14:16,994 Using list of URLs from env
utl-monpx-1 | INFO 2025-03-17 06:14:16,994 > http://nucleus-api:9500/metrics
utl-monpx-1 | INFO 2025-03-17 06:14:16,995 > http://nucleus-api:3010/metrics
utl-monpx-1 | INFO 2025-03-17 06:14:16,995 > http://nucleus-log-processor:9500/metrics
utl-monpx-1 | INFO 2025-03-17 06:14:16,995 Using blacklist from env at /omni/data/PathBlackList.json
utl-monpx-1 | INFO 2025-03-17 06:14:16,995 Using prefixes from environment: `omni:nginx:redis:exposer:otcollector:otelcol`
utl-monpx-1 | INFO 2025-03-17 06:14:16,995 Launching monpx server on 8080
utl-monpx-1 | ======== Running on http://0.0.0.0:8080 ========
utl-monpx-1 | (Press CTRL+C to quit)
nucleus-tagging-1 | [2025-03-17 06:14:17,027][OT] INFO: Press Ctrl + C to stop the service
nucleus-tagging-1 | [2025-03-17 06:14:17,027][OT] INFO: Starting Tagging Services Version 3.1.31+tag-3.1.31.gitlab.19364239.35bc759a
nucleus-tagging-1 | [2025-03-17 06:14:17,027][OT] INFO:
nucleus-tagging-1 | OV User: tags_service
nucleus-tagging-1 | Service HostName: fb7bfa21f6db
nucleus-tagging-1 | DiscoveryUrl: ws://nucleus-discovery:3333
nucleus-tagging-1 | DeploymentLookup: internal
nucleus-tagging-1 | ServiceBindHost: 0.0.0.0
nucleus-lft-1 | 2025-03-17 06:14:17,030 - system_log - INFO - DATA_DIR: /omni/data
nucleus-tagging-1 | ServiceBindPort: 3020
nucleus-tagging-1 | ServiceDeploymentsFile: config/deployments.default.yaml
nucleus-tagging-1 | ServiceDeploymentsString: reg:
nucleus-tagging-1 | - name: external
nucleus-tagging-1 | transport:
nucleus-tagging-1 | type: sows
nucleus-tagging-1 | params:
nucleus-tagging-1 | host: 12.36.192.112
nucleus-tagging-1 | port: 3020
nucleus-tagging-1 | - name: internal
nucleus-tagging-1 | transport:
nucleus-tagging-1 | params:
nucleus-tagging-1 | host: 12.36.192.112
nucleus-tagging-1 | port: 3020
nucleus-tagging-1 | type: sows
nucleus-tagging-1 |
nucleus-tagging-1 | InstanceName: my_omniverse
nucleus-tagging-1 | OmniConnectionTimeout: 60
nucleus-tagging-1 | OmniConnectionRetryTimeout: 5
nucleus-tagging-1 | OmniFetchTimeout: 5
nucleus-tagging-1 | ConnectionCacheTimeout: 60
nucleus-tagging-1 | DiscoveryRegisterTimeout: 2
nucleus-tagging-1 | MaxResults: 4096
nucleus-tagging-1 | LogFileName:
nucleus-tagging-1 | TsLoggingLevel: INFO
nucleus-tagging-1 | DiscoveryTokenFile: /omni/secrets/SERVICE_DISCOVERY_TOKEN
nucleus-tagging-1 | StorageBackend: sqlite_backend
nucleus-tagging-1 | StorageBackendConfig: {"defrag_interval": 86400, "storage_location": "/omni/data/Tagging.db"}
nucleus-tagging-1 | ServiceAuthPublicKey: /omni/secrets/SERVICE_AUTH_PUBLIC_KEY
nucleus-tagging-1 | MaxHttpLine: 20000
nucleus-tagging-1 | AuthorizedOnly: False
nucleus-tagging-1 | EnableStructuredLogging: False
nucleus-tagging-1 |
nucleus-tagging-1 | [2025-03-17 06:14:17,030][OT] INFO: deployments: {'reg': [{'name': 'external', 'transport': {'type': 'sows', 'params': {'host': '12.36.192.112', 'port': 3020}, 'meta': {}}, 'meta': {}}, {'name': 'internal', 'transport': {'type': 'sows', 'params': {'host': '12.36.192.112', 'port': 3020}, 'meta': {}}, 'meta': {}}]}
nucleus-tagging-1 | 2025-03-17 06:14:17,030 | Registering the service in the discovery with these parameters:
nucleus-tagging-1 | Discovery URI: ws://nucleus-discovery:3333
nucleus-tagging-1 | Transport settings: {'name': 'sows', 'params': '{"host": "12.36.192.112", "port": 3020}', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}
nucleus-tagging-1 | Meta: {'deployment': 'external', 'version': '3.1.31+tag-3.1.31.gitlab.19364239.35bc759a'}
nucleus-tagging-1 | 2025-03-17 06:14:17,034 | An error has occurred while registering the service in the discovery.
nucleus-tagging-1 | Info:
nucleus-tagging-1 | Discovery URI: ws://nucleus-discovery:3333
nucleus-tagging-1 | Transport settings: {'name': 'sows', 'params': '{"host": "12.36.192.112", "port": 3020}', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}
nucleus-tagging-1 | Meta: {'deployment': 'external', 'version': '3.1.31+tag-3.1.31.gitlab.19364239.35bc759a'}
nucleus-tagging-1 | Traceback (most recent call last):
nucleus-tagging-1 | File "/omni/src/server/_deps/discovery.client.py/omni/discovery/__init__.py", line 80, in register
nucleus-tagging-1 | raise ConnectionError(f"Failed to connect to the discovery service {self.uri}")
nucleus-tagging-1 | ConnectionError: Failed to connect to the discovery service ws://nucleus-discovery:3333
nucleus-log-processor-1 | Processing of LFT logs enabled
nucleus-log-processor-1 | Prometheus exporter listening on 9500
nucleus-log-processor-1 | > Omniverse instance set to 'my_omniverse'
nucleus-log-processor-1 | > setting up metrics for API Server
nucleus-log-processor-1 | > setting up metrics for LFT Server
nucleus-log-processor-1 | Processing API Server logs
nucleus-log-processor-1 | /omni/log/api/Access.log is not there: nothing to process, skipping
nucleus-log-processor-1 | Processing LFT Server logs
nucleus-log-processor-1 | /omni/log/lft/access.log is not there: nothing to process, skipping
nucleus-lft-1 | 2025-03-17 06:14:17,117 - system_log - INFO - Not bundled - using standard resolver path
nucleus-discovery-1 | 2025-03-17 06:14:17,123 | Nucleus Discovery 1.5.4+tag-1.5.4.gitlab.19447319.0b83f371
nucleus-discovery-1 | 2025-03-17 06:14:17,123 | Registering external deployment:
nucleus-discovery-1 | Meta: {'version': '1.5.4+tag-1.5.4.gitlab.19447319.0b83f371', 'deployment': 'external'}
nucleus-discovery-1 | Transport: {'name': 'sows', 'params': '{"host": "12.36.192.112", "port": 3333}', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}
nucleus-discovery-1 | 2025-03-17 06:14:17,123 | Registering internal deployment:
nucleus-discovery-1 | Meta: {'version': '1.5.4+tag-1.5.4.gitlab.19447319.0b83f371', 'deployment': 'internal'}
nucleus-discovery-1 | Transport: {'name': 'sows', 'params': '{"host": "12.36.192.112", "port": 3333}', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}
nucleus-discovery-1 | 2025-03-17 06:14:17,123 | Registering interface 'DiscoveryRegistration':
nucleus-discovery-1 | Method: register
nucleus-discovery-1 | Method: register_unsafe
nucleus-discovery-1 | Method: unregister_unsafe
nucleus-discovery-1 |
nucleus-discovery-1 | 2025-03-17 06:14:17,124 | Registering interface 'DiscoverySearch':
nucleus-discovery-1 | Method: find
nucleus-discovery-1 | Method: find_all
nucleus-discovery-1 |
nucleus-discovery-1 | 2025-03-17 06:14:17,124 | Listen.
nucleus-lft-1 | 2025-03-17 06:14:17,129 - system_log - INFO - reconnecting ...
nucleus-api-1 | [MON] Nucleus Core API Server Launcher and Monitor
nucleus-api-1 | [MON] > version 1.14.51+tag-1.14.51.gitlab.24471173.44570ca9
nucleus-api-1 | [MON] Importing metadata DB
nucleus-api-1 | [MON] > no DB present, new instance, import not required
nucleus-api-1 | [MON] > writing DB version tag file to /omni/data/__version_tag
nucleus-api-1 | [MON] Periodic meta snapshots disabled
nucleus-api-1 | [MON] Not enabling ASAN logging
nucleus-api-1 | [MON] Dangerous characters in paths DISABLED
nucleus-api-1 | [MON] Loading config from omni.server.app.config.json
nucleus-lft-1 | 2025-03-17 06:14:17,139 - system_log - INFO - [Errno 111] Connect call failed ('192.168.2.4', 3007)
nucleus-lft-1 | 2025-03-17 06:14:17,141 - system_log - ERROR - Traceback (most recent call last):
nucleus-lft-1 | File "/omni/lft_server/_build/tools/idl.py/idl/connection/transport/omni.py", line 209, in prepare
nucleus-lft-1 | self.ws = await websockets.connect(url,
nucleus-lft-1 | File "/omni/lft_server/_build/lib/websockets/legacy/client.py", line 650, in __await_impl_timeout__
nucleus-lft-1 | return await asyncio.wait_for(self.__await_impl__(), self.open_timeout)
nucleus-lft-1 | File "/usr/lib/python3.10/asyncio/tasks.py", line 445, in wait_for
nucleus-lft-1 | return fut.result()
nucleus-lft-1 | File "/omni/lft_server/_build/lib/websockets/legacy/client.py", line 654, in __await_impl__
nucleus-lft-1 | transport, protocol = await self._create_connection()
nucleus-lft-1 | File "/usr/lib/python3.10/asyncio/base_events.py", line 1076, in create_connection
nucleus-lft-1 | raise exceptions[0]
nucleus-lft-1 | File "/usr/lib/python3.10/asyncio/base_events.py", line 1060, in create_connection
nucleus-lft-1 | sock = await self._connect_sock(
nucleus-lft-1 | File "/usr/lib/python3.10/asyncio/base_events.py", line 969, in _connect_sock
nucleus-lft-1 | await self.sock_connect(sock, address)
nucleus-lft-1 | File "/usr/lib/python3.10/asyncio/selector_events.py", line 501, in sock_connect
nucleus-lft-1 | return await fut
nucleus-lft-1 | File "/usr/lib/python3.10/asyncio/selector_events.py", line 541, in _sock_connect_cb
nucleus-lft-1 | raise OSError(err, f'Connect call failed {address}')
nucleus-lft-1 | ConnectionRefusedError: [Errno 111] Connect call failed ('192.168.2.4', 3007)
nucleus-lft-1 |
nucleus-lft-1 | During handling of the above exception, another exception occurred:
nucleus-lft-1 |
nucleus-lft-1 | Traceback (most recent call last):
nucleus-lft-1 | File "/omni/lft_server/source/lft/server.py", line 556, in await_connection
nucleus-lft-1 | await application.api_server_transport.prepare()
nucleus-lft-1 | File "/omni/lft_server/_build/tools/idl.py/idl/connection/transport/omni.py", line 220, in prepare
nucleus-lft-1 | raise TransportError(str(err))
nucleus-lft-1 | idl.connection.transport.TransportError: [Errno 111] Connect call failed ('192.168.2.4', 3007)
nucleus-lft-1 |
nucleus-api-1 | [MON] > configuring mounts
nucleus-api-1 | [MON] > allowed resolvers:
nucleus-api-1 | [MON] > omniverse_resolver_s3
nucleus-api-1 | [MON] > omniverse_resolver_file
nucleus-api-1 | [MON] > file resolver detected, limiting paths to `/omni/mnt`
nucleus-api-1 | [MON] Mounts: [{'path': '%OMNI_S3_MOUNT_PATH%?:/NVIDIA', 'resolver': 'omniverse_resolver_s3', 'options': '{"service":"s3","host":"%OMNI_S3_HOST%?:content-production.omniverse.nvidia.com","bucket":"%OMNI_S3_BUCKET%","region":"%OMNI_S3_REGION%","access_key_id":"%OMNI_S3_ACCESS_KEY_ID%","secret_access_key":"%OMNI_S3_SECRET_ACCESS_KEY%","secure":%OMNI_S3_SECURE%?:false,"max_connections":%OMNI_S3_MAX_CONNECTIONS%?:256,"timeout":%OMNI_S3_TIMEOUT%?:30,"chunk_size":%OMNI_S3_CHUNK_SIZE%?:1000000000000,"rate":%OMNI_S3_RATE%?:0,"retry":%OMNI_S3_RETRY%?:0,"retry_interval":%OMNI_S3_RETRY_INTERVAL%?:30,"proxy":"%OMNI_S3_PROXY%","redirection":"%OMNI_S3_REDIRECTION%?:https://content-production.omniverse.nvidia.com/","redir_bucket":"%OMNI_S3_REDIR_BUCKET%","sign_redirection":%OMNI_S3_SIGN_REDIRECTION%?:false,"redir_access_key_id":"%OMNI_S3_REDIR_ACCESS_KEY_ID%","redir_secret_access_key":"%OMNI_S3_REDIR_SECRET_ACCESS_KEY%","redir_region":"%OMNI_S3_REDIR_REGION%","redir_expire_time_hours":%OMNI_S3_REDIR_EXPIRE_TIME_HOURS%?:24,"log_path":"%OMNI_S3_LOG_PATH%","certificate":"%OMNI_S3_CERTIFICATE%","relaxed_xml_parsing":%OMNI_S3_RELAXED_XML_PARSING%?:false}', 'override': True}]
nucleus-api-1 | [MON] configuring {'path': '%OMNI_S3_MOUNT_PATH%?:/NVIDIA', 'resolver': 'omniverse_resolver_s3', 'options': '{"service":"s3","host":"%OMNI_S3_HOST%?:content-production.omniverse.nvidia.com","bucket":"%OMNI_S3_BUCKET%","region":"%OMNI_S3_REGION%","access_key_id":"%OMNI_S3_ACCESS_KEY_ID%","secret_access_key":"%OMNI_S3_SECRET_ACCESS_KEY%","secure":%OMNI_S3_SECURE%?:false,"max_connections":%OMNI_S3_MAX_CONNECTIONS%?:256,"timeout":%OMNI_S3_TIMEOUT%?:30,"chunk_size":%OMNI_S3_CHUNK_SIZE%?:1000000000000,"rate":%OMNI_S3_RATE%?:0,"retry":%OMNI_S3_RETRY%?:0,"retry_interval":%OMNI_S3_RETRY_INTERVAL%?:30,"proxy":"%OMNI_S3_PROXY%","redirection":"%OMNI_S3_REDIRECTION%?:https://content-production.omniverse.nvidia.com/","redir_bucket":"%OMNI_S3_REDIR_BUCKET%","sign_redirection":%OMNI_S3_SIGN_REDIRECTION%?:false,"redir_access_key_id":"%OMNI_S3_REDIR_ACCESS_KEY_ID%","redir_secret_access_key":"%OMNI_S3_REDIR_SECRET_ACCESS_KEY%","redir_region":"%OMNI_S3_REDIR_REGION%","redir_expire_time_hours":%OMNI_S3_REDIR_EXPIRE_TIME_HOURS%?:24,"log_path":"%OMNI_S3_LOG_PATH%","certificate":"%OMNI_S3_CERTIFICATE%","relaxed_xml_parsing":%OMNI_S3_RELAXED_XML_PARSING%?:false}', 'override': True}
nucleus-api-1 | [MON] > checking mount to %OMNI_S3_MOUNT_PATH%?:/NVIDIA, resolver omniverse_resolver_s3
nucleus-api-1 | [MON] > checking source availability
nucleus-api-1 | [MON] > OMNI_S3_MOUNT_PATH: /NVIDIA
nucleus-api-1 | [MON] > OMNI_S3_BUCKET:
nucleus-api-1 | [MON] > OMNI_S3_HOST: content-production.omniverse.nvidia.com
nucleus-api-1 | [MON] > OMNI_S3_RELAXED_XML_PARSING: 0
nucleus-api-1 | [MON] > OMNI_S3_SECURE: 1
nucleus-api-1 | [MON] > host: content-production.omniverse.nvidia.com
nucleus-api-1 | [MON] > Bucket name is empty. Attempting to extract it from hostname
nucleus-api-1 | [MON] > Extracted bucket: content-production
nucleus-api-1 | [MON] > Extracted host: omniverse.nvidia.com
nucleus-api-1 | [MON] > attempting to connect https://content-production.omniverse.nvidia.com
nucleus-search-1 | 2025-03-17 06:14:17,283 | Nucleus Search 3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce
nucleus-thumbnails-1 | [2025-03-17 06:14:17,292][OT] INFO: Press Ctrl + C to stop the service
nucleus-thumbnails-1 | [2025-03-17 06:14:17,294][OT] INFO: Thumbnail service started. Version: 1.5.12+tag-1.5.12.gitlab.20658998.5460a92e
nucleus-thumbnails-1 | [2025-03-17 06:14:17,294][OT] INFO:
nucleus-thumbnails-1 | OV User: thumbnails_service
nucleus-thumbnails-1 | Service HostName: f380ce3d2360
nucleus-thumbnails-1 | DiscoveryUrl: ws://nucleus-discovery:3333
nucleus-thumbnails-1 | DeploymentLookup: internal
nucleus-thumbnails-1 | InstanceName: my_omniverse
nucleus-thumbnails-1 | Thumbnail resolutions: [(138, 108), (256, 256)]
nucleus-thumbnails-1 | RecreateAll: False
nucleus-thumbnails-1 | LogFileName: /omni/log/create_thumbnails.log
nucleus-thumbnails-1 | ExcludeUriSubstrings: ['/@', '/.tags/', '/.system/']
nucleus-thumbnails-1 | OmniConnectionTimeout: 60
nucleus-thumbnails-1 | CleanupThumbCacheInterval: 86400
nucleus-thumbnails-1 | SkipOmniWrites: False
nucleus-thumbnails-1 | TsLoggingLevel: INFO
nucleus-thumbnails-1 | FileFormats: {'gif', 'gd', 'gbr', 'ico', 'bmp', 'wal', 'tiff', 'pcd', 'jpe', 'eps', 'ps', 'iptc', 'spider', 'pdf', 'imt', 'jp2', 'mpo', 'ppm', 'fli', 'mic', 'ftex', 'dib', 'xpm', 'blp', 'jpeg', 'pcx', 'dcx', 'png', 'pbm', 'pixar', 'msp', 'spi', 'naa', 'im', 'cur', 'pgm', 'tif', 'dds', 'sgi', 'icns', 'fpx', 'jpg', 'webp', 'hdr', 'psd', 'tga', 'xbm', 'mcidas'}
nucleus-thumbnails-1 | MemoryLimit: 4096
nucleus-thumbnails-1 | MaxRes: (256, 256)
nucleus-api-1 | [MON] > bucket is not available
nucleus-thumbnails-1 | Prometheus Port: 8001
nucleus-api-1 | [MON] > trying path-style based requests
nucleus-discovery-1 | 2025-03-17 06:14:17,298 | > [1] DiscoverySearch.find: {'query': {'service_interface': {'origin': 'omni1.idl.ts', 'name': 'Connection', 'capabilities': {'ping': 0, 'auth': 2, 'authorize_token': 1, 'subscribe_server_notifications': 0, 'stat2': 1, 'list': 4, 'list2': 4, 'subscribe_list': 2, 'service_subscribe_list': 0, 'create': 2, 'update': 1, 'create_asset': 0, 'update_asset': 0, 'create_asset_with_hash': 0, 'update_asset_with_hash': 0, 'create_object': 0, 'update_object': 0, 'deep_copy_object_struct': 0, 'read': 1, 'read_asset_version': 0, 'read_asset_resolved': 0, 'subscribe_read_asset': 1, 'read_object_version': 0, 'read_object_resolved': 0, 'subscribe_read_object': 2, 'rename': 0, 'delete': 0, 'delete2': 0, 'copy2': 0, 'create_directory': 0, 'lock': 2, 'unlock': 1, 'copy': 1, 'get_transaction_id': 0, 'set_path_options': 1, 'set_path_options2': 0, 'get_acl': 0, 'change_acl': 0, 'get_acl_v2': 0, 'get_acl_resolved': 0, 'set_acl_v2': 0, 'get_groups': 0, 'get_group_users': 0, 'get_users': 0, 'get_user_groups': 0, 'create_group': 0, 'rename_group': 0, 'remove_group': 0, 'add_user_to_group': 0, 'remove_user_from_group': 0, 'mount': 0, 'unmount': 0, 'get_mount_info': 0, 'checkpoint_version': 1, 'replace_version': 0, 'get_checkpoints': 0, 'get_branches': 0}}, 'supported_transport': [{'name': 'sohttp', 'meta': {'marshaller': 'bs', 'serializer': 'json'}}, {'name': 'sohttp', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'true', 'supports_path': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false', 'supports_path': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'true', 'supports_path': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'false'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'false', 'supports_path': 'true'}}, {'name': 'connlib', 'meta': {'throttle': 'true'}}, {'name': 'connlib', 'meta': {'throttle': 'false'}}, {'name': 'connlib', 'meta': {}}], 'meta': {'deployment': 'internal'}}, 'version': 2}
nucleus-thumbnails-1 | ServiceBindHost: 0.0.0.0
nucleus-api-1 | [MON] > attempting to connect https://content-production.omniverse.nvidia.com/content-production
nucleus-discovery-1 | 2025-03-17 06:14:17,299 | < [1] DiscoverySearch.find: {'found': False, 'version': 2}
nucleus-thumbnails-1 | OmniConnectionRetryTimeout: 5
nucleus-thumbnails-1 | ThumbCacheLocation: /.system/thumbnailer/.thumbs
nucleus-thumbnails-1 | TaskQueueLimit: 50000
nucleus-thumbnails-1 | RedisMessageBusAddress:
nucleus-thumbnails-1 | RedisMessageChannel: omni_server_messages
nucleus-thumbnails-1 | EnableStructuredLogging: False
nucleus-thumbnails-1 | ServiceAuthPublicKey: config/auth.pub
nucleus-thumbnails-1 | AuthorizedOnly: False
nucleus-thumbnails-1 |
nucleus-thumbnails-1 | /omni/create_thumbnails.py:111: DiscoveryWarning: Capabilities for Connection interface are not specified, using the latest capabilities: {'ping': 0, 'auth': 2, 'authorize_token': 1, 'subscribe_server_notifications': 0, 'stat2': 1, 'list': 4, 'list2': 4, 'subscribe_list': 2, 'service_subscribe_list': 0, 'create': 2, 'update': 1, 'create_asset': 0, 'update_asset': 0, 'create_asset_with_hash': 0, 'update_asset_with_hash': 0, 'create_object': 0, 'update_object': 0, 'deep_copy_object_struct': 0, 'read': 1, 'read_asset_version': 0, 'read_asset_resolved': 0, 'subscribe_read_asset': 1, 'read_object_version': 0, 'read_object_resolved': 0, 'subscribe_read_object': 2, 'rename': 0, 'delete': 0, 'delete2': 0, 'copy2': 0, 'create_directory': 0, 'lock': 2, 'unlock': 1, 'copy': 1, 'get_transaction_id': 0, 'set_path_options': 1, 'set_path_options2': 0, 'get_acl': 0, 'change_acl': 0, 'get_acl_v2': 0, 'get_acl_resolved': 0, 'set_acl_v2': 0, 'get_groups': 0, 'get_group_users': 0, 'get_users': 0, 'get_user_groups': 0, 'create_group': 0, 'rename_group': 0, 'remove_group': 0, 'add_user_to_group': 0, 'remove_user_from_group': 0, 'mount': 0, 'unmount': 0, 'get_mount_info': 0, 'checkpoint_version': 1, 'replace_version': 0, 'get_checkpoints': 0, 'get_branches': 0}.
nucleus-thumbnails-1 | Add 'capabilities' argument and specify a dictionary with explicit method versions or pass an empty dictionary to use what is available on the server.
nucleus-thumbnails-1 | connection: Connection = await discovery.find(Connection,
nucleus-thumbnails-1 | [2025-03-17 06:14:17,299][OT] INFO: Connection to Nucleus lost.
nucleus-api-1 | [MON] > bucket is not available
nucleus-api-1 | [MON] > bucket is not available
nucleus-search-1 | 2025-03-17 06:14:17,309 | Registering the service in the discovery with these parameters:
nucleus-search-1 | Discovery URI: ws://nucleus-discovery:3333
nucleus-search-1 | Transport settings: {'name': 'sows', 'params': '{"host": "12.36.192.112", "port": 3400}', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}
nucleus-search-1 | Meta: {'deployment': 'external', 'version': '3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce'}
nucleus-search-1 | 2025-03-17 06:14:17,309 | Registering the service in the discovery with these parameters:
nucleus-search-1 | Discovery URI: ws://nucleus-discovery:3333
nucleus-search-1 | Transport settings: {'name': 'sows', 'params': '{"host": "12.36.192.112", "port": 3400}', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}
nucleus-search-1 | Meta: {'deployment': 'internal', 'version': '3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce'}
nucleus-search-1 | 2025-03-17 06:14:17,309 | Retrieving the access token from Nucleus Auth...
nucleus-discovery-1 | 2025-03-17 06:14:17,329 | Interfaces [{'origin': 'Search.idl.ts', 'name': 'Search', 'capabilities': {'find': 3, 'find2': 2, 'find_paged_cursor': 1, 'find_paged_skip': 1, 'get_prefixes': 0}}] has been registered using 'sows' with {'deployment': 'internal', 'version': '3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce'}.
nucleus-search-1 | 2025-03-17 06:14:17,329 | Registered in ws://nucleus-discovery:3333 with {'deployment': 'internal', 'version': '3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce'} meta.
nucleus-discovery-1 | 2025-03-17 06:14:17,330 | > [1] DiscoverySearch.find: {'query': {'service_interface': {'origin': 'OmniAuth.idl.ts', 'name': 'Credentials', 'capabilities': {'get_settings': 0, 'auth': 0, 'register': 0, 'reset': 0}}, 'supported_transport': [{'name': 'sohttp', 'meta': {'marshaller': 'bs', 'serializer': 'json'}}, {'name': 'sohttp', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'true', 'supports_path': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'json', 'ssl': 'false', 'supports_path': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'true', 'supports_path': 'true'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'false'}}, {'name': 'sows', 'meta': {'marshaller': 'bs', 'serializer': 'omni_json', 'ssl': 'false', 'supports_path': 'true'}}, {'name': 'connlib', 'meta': {'throttle': 'true'}}, {'name': 'connlib', 'meta': {'throttle': 'false'}}, {'name': 'connlib', 'meta': {}}], 'meta': {'deployment': 'internal'}}, 'version': 2}
nucleus-discovery-1 | 2025-03-17 06:14:17,330 | < [1] DiscoverySearch.find: {'found': False, 'version': 2}
nucleus-search-1 | 2025-03-17 06:14:17,331 | Traceback (most recent call last):
nucleus-search-1 | File "/omni/search/__init__.py", line 286, in _listen
nucleus-search-1 | token = await self.get_token()
nucleus-discovery-1 | 2025-03-17 06:14:17,331 | Interfaces [{'origin': 'Search.idl.ts', 'name': 'Search', 'capabilities': {'find': 3, 'find2': 2, 'find_paged_cursor': 1, 'find_paged_skip': 1, 'get_prefixes': 0}}] has been registered using 'sows' with {'deployment': 'external', 'version': '3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce'}.
nucleus-search-1 | File "/omni/search/__init__.py", line 391, in get_token
nucleus-search-1 | credentials: Credentials = await self.discovery.find(Credentials, {"deployment": config.deployments_lookup})
nucleus-search-1 | File "/omni/_build/omniverse_discovery_py/omni/discovery/__init__.py", line 166, in find
nucleus-search-1 | raise ConnectionError(
nucleus-search-1 | ConnectionError: Interface 'Credentials' from 'OmniAuth.idl.ts' has not been found.
nucleus-search-1 |
nucleus-search-1 | 2025-03-17 06:14:17,331 | Registered in ws://nucleus-discovery:3333 with {'deployment': 'external', 'version': '3.2.11+tag-3.2.11.gitlab.19447366.5d0fa5ce'} meta.
nucleus-api-1 exited with code 0
nucleus-auth-1 | 2025-03-17 06:14:17,863 | Nucleus Auth 1.5.7+tag-1.5.7.gitlab.24888392.be0af40d
nucleus-auth-1 | 2025-03-17 06:14:17,864 | Serving static files on port 3180.
Gracefully stopping... (press Ctrl+C again to force)
[+] Stopping 12/12
β Container base_stack-nucleus-search-1 Stopped 10.4s
β Container base_stack-nucleus-tagging-1 Stopped 10.5s
β Container base_stack-nucleus-auth-1 Stopped 10.5s
β Container base_stack-nucleus-resolver-cache-1 Stopped 10.2s
β Container base_stack-nucleus-navigator-1 Stopped 0.4s
β Container base_stack-nucleus-lft-lb-1 Stopped 10.5s
β Container base_stack-nucleus-thumbnails-1 Stopped 10.2s
β Container base_stack-nucleus-lft-1 Stopped 0.4s
β Container base_stack-nucleus-discovery-1 Stopped 0.3s
β Container base_stack-nucleus-api-1 Stopped 0.5s
β Container base_stack-nucleus-log-processor-1 Stopped 0.2s
β Container base_stack-utl-monpx-1 Stopped