2022-11-10 21:48:39 [0ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 21:48:39 [7ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 21:48:39 [17ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 21:48:39 [26ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-10 21:48:39 [32ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 21:48:39 [39ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 21:48:39 [42ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-10 21:48:39 [50ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 21:48:39 [58ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 21:48:39 [66ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 21:48:39 [81ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 21:48:39 [90ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 21:48:39 [98ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 21:48:39 [106ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-10 21:48:39 [112ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 21:48:39 [126ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 21:48:39 [129ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 21:48:39 [129ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 21:48:39 [129ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 21:48:39 [129ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 21:48:39 [129ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 21:48:39 [131ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-10 21:48:39 [131ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-10 21:48:39 [131ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-10 21:48:39 [132ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-10 21:48:39 [132ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-10 21:48:39 [132ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-10 21:48:39 [132ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-10 21:48:39 [132ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-10 21:48:39 [132ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-10 21:48:39 [133ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "127.0.0.1", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "127.0.0.1" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "127.0.0.1" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-10 21:48:39 [133ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-10 21:48:39 [133ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 21:48:39 [147ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 21:48:39 [149ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 21:48:39 [151ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 21:48:39 [151ms] [Info] [carb.launcher.plugin] [16648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001FC1AA4B950 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-10 21:48:39 [151ms] [Info] [carb.launcher.plugin] [16648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 2396. 2022-11-10 21:48:39 [151ms] [Info] [carb.launcher.plugin] [16648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-10 21:48:39 [151ms] [Info] [carb.launcher.plugin] [16648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-10 21:48:39 [176ms] [Info] [carb.launcher.plugin] [16648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 22152 to the job 00000000000003CC. 2022-11-10 21:48:39 [176ms] [Info] [carb.launcher.plugin] [19256] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 22152. 2022-11-10 21:48:39 [176ms] [Info] [carb.launcher.plugin] [16648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 22152 {process = 000001FC1AA4B950} 2022-11-10 21:48:39 [176ms] [Info] [carb.launcher.plugin] [17272] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 22152. 2022-11-10 21:48:39 [176ms] [Info] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-10 21:48:39 [177ms] [Info] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-10 21:48:39 [972ms] [Error] [omni.core] [17272] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-10 21:48:40 [1,191ms] [Error] [omni.core] [17272] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 15:48:40,194 - system_log - INFO - reconnecting ... 2022-11-10 21:48:41 [2,177ms] [Info] [omni.core] [16256] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-10 21:48:41 [2,177ms] [Info] [omni.core] [16256] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-10 21:48:41 [2,178ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 21:48:41 [2,204ms] [Info] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-10 21:48:41 [2,205ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 21:48:41 [2,205ms] [Info] [omni.core] [16256] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-10 21:48:41 [2,234ms] [Warning] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 21:48:41 [2,234ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 21:48:41 [2,246ms] [Warning] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 21:48:41 [2,246ms] [Info] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 21:48:41 [2,246ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-10 21:48:41 [2,246ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-10 21:48:41 [2,247ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-10 21:48:41 [2,247ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-10 21:48:41 [2,248ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 21:48:41 [2,248ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-10 21:48:41 [2,248ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-10 21:48:41 [2,249ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-10 21:48:41 [2,249ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-10 21:48:41 [2,249ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-10 21:48:41 [2,249ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-10 21:48:41 [2,249ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-10 21:48:41 [2,249ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-10 21:48:41 [2,249ms] [Error] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-10 21:48:41 [2,249ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-10 21:48:41 [2,249ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-10 21:48:41 [2,250ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-10 21:48:41 [2,250ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-10 21:48:41 [2,250ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-10 21:48:41 [2,250ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-10 21:48:41 [2,250ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-10 21:48:41 [2,250ms] [Info] [omni.meta-upgrade] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-10 21:48:41 [2,251ms] [Info] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-10 21:48:41 [2,252ms] [Info] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-10 21:48:41 [2,253ms] [Error] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-10 21:48:41 [2,255ms] [Info] [omni.core] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-10 21:48:41 [2,255ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-10 21:48:41 [2,255ms] [Info] [omni.core] [14820] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-10 21:48:43 [4,256ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-10 21:48:43 [4,259ms] [Error] [carb] [16648] e:\w\bb644fa5b0c66122\source\framework\filesystem.cpp:moveImpl():785: File move failed: 'C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus\Access.log' -> 'C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus\Access_OLD.log' (error code 2) 2022-11-10 21:48:43 [4,259ms] [Error] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apilogging\deprecated\apilogging.cpp:resetApiLogFile():210: Failed to rename access log file 'C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus\Access.log' to 'C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus\Access_OLD.log' 2022-11-10 21:48:43 [4,259ms] [Info] [omni.core] [14820] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-10 21:48:43 [4,260ms] [Info] [omni.server] [16648] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-10 21:48:43 [4,260ms] [Info] [carb.launcher.plugin] [14820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001FC1AC5AFC0 for 'omni.delta-applier.app.exe'. 2022-11-10 21:48:43 [4,260ms] [Info] [carb.launcher.plugin] [14820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 2396. 2022-11-10 21:48:43 [4,260ms] [Info] [carb.launcher.plugin] [14820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-10 21:48:43 [4,392ms] [Info] [carb.launcher.plugin] [14820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 17008 to the job 00000000000003CC. 2022-11-10 21:48:43 [4,392ms] [Info] [carb.launcher.plugin] [16636] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 17008. 2022-11-10 21:48:43 [4,393ms] [Info] [carb.launcher.plugin] [21192] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 17008. 2022-11-10 21:48:43 [4,393ms] [Info] [carb.launcher.plugin] [14820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 17008 {process = 000001FC1AC5AFC0} 2022-11-10 21:48:43 [4,731ms] [Error] [omni.core] [17272] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 15:48:43,734 - system_log - INFO - connected 2022-11-10 21:48:43 [4,737ms] [Error] [omni.core] [17272] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-10 21:48:43 [4,896ms] [Info] [omni.core] [14820] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-10 22:00:27 [0ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 22:00:27 [5ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 22:00:27 [13ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 22:00:27 [18ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-10 22:00:27 [22ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 22:00:27 [26ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 22:00:27 [30ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-10 22:00:27 [37ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 22:00:27 [41ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 22:00:27 [46ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 22:00:27 [52ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 22:00:27 [55ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 22:00:27 [59ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 22:00:27 [61ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-10 22:00:27 [64ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 22:00:27 [68ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 22:00:27 [73ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 22:00:27 [73ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 22:00:27 [73ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 22:00:27 [73ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 22:00:27 [73ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 22:00:27 [82ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-10 22:00:27 [82ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-10 22:00:27 [82ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-10 22:00:27 [84ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-10 22:00:27 [84ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-10 22:00:27 [84ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-10 22:00:27 [84ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-10 22:00:27 [84ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-10 22:00:27 [85ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-10 22:00:27 [86ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "127.0.0.1", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "127.0.0.1" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "127.0.0.1" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-10 22:00:27 [86ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-10 22:00:27 [87ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 22:00:27 [124ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 22:00:27 [128ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 22:00:27 [135ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 22:00:27 [135ms] [Info] [carb.launcher.plugin] [23156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001E145ECE1A0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-10 22:00:27 [135ms] [Info] [carb.launcher.plugin] [23156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 2680. 2022-11-10 22:00:27 [135ms] [Info] [carb.launcher.plugin] [23156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-10 22:00:27 [136ms] [Info] [carb.launcher.plugin] [23156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-10 22:00:27 [163ms] [Info] [carb.launcher.plugin] [23156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 11372 to the job 00000000000003AC. 2022-11-10 22:00:27 [165ms] [Info] [carb.launcher.plugin] [4636] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 11372. 2022-11-10 22:00:27 [166ms] [Info] [carb.launcher.plugin] [18176] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 11372. 2022-11-10 22:00:27 [166ms] [Info] [carb.launcher.plugin] [23156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 11372 {process = 000001E145ECE1A0} 2022-11-10 22:00:27 [166ms] [Info] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-10 22:00:27 [166ms] [Info] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-10 22:00:28 [1,660ms] [Error] [omni.core] [18176] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-10 22:00:29 [2,167ms] [Info] [omni.core] [17948] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-10 22:00:29 [2,167ms] [Info] [omni.core] [17948] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-10 22:00:29 [2,169ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 22:00:29 [2,181ms] [Info] [omni.core] [17948] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-10 22:00:29 [2,192ms] [Info] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-10 22:00:29 [2,193ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 22:00:29 [2,206ms] [Error] [omni.core] [18176] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 16:00:29,454 - system_log - INFO - reconnecting ... 2022-11-10 22:00:29 [2,259ms] [Warning] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 22:00:29 [2,259ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 22:00:29 [2,294ms] [Warning] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 22:00:29 [2,294ms] [Info] [carb] [23156] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 22:00:29 [2,294ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-10 22:00:29 [2,295ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-10 22:00:29 [2,295ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-10 22:00:29 [2,296ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-10 22:00:29 [2,296ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-10 22:00:29 [2,297ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-10 22:00:29 [2,298ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-10 22:00:29 [2,299ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-10 22:00:29 [2,300ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-10 22:00:29 [2,300ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-10 22:00:29 [2,301ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-10 22:00:29 [2,302ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-10 22:00:29 [2,302ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-10 22:00:29 [2,303ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 22:00:29 [2,304ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 22:00:29 [2,305ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-10 22:00:29 [2,306ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-10 22:00:29 [2,306ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-10 22:00:29 [2,306ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-10 22:00:29 [2,307ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-10 22:00:29 [2,307ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-10 22:00:29 [2,307ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-10 22:00:29 [2,307ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-10 22:00:29 [2,308ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-10 22:00:29 [2,308ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-10 22:00:29 [2,309ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-10 22:00:29 [2,309ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-10 22:00:29 [2,310ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-10 22:00:29 [2,310ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-10 22:00:29 [2,310ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-10 22:00:29 [2,311ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-10 22:00:29 [2,312ms] [Error] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-10 22:00:29 [2,312ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-10 22:00:29 [2,312ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-10 22:00:29 [2,312ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-10 22:00:29 [2,312ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-10 22:00:29 [2,312ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-10 22:00:29 [2,313ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-10 22:00:29 [2,313ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-10 22:00:29 [2,313ms] [Info] [omni.meta-upgrade] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-10 22:00:29 [2,316ms] [Info] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-10 22:00:29 [2,319ms] [Info] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-10 22:00:29 [2,320ms] [Error] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-10 22:00:29 [2,327ms] [Info] [omni.core] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-10 22:00:29 [2,329ms] [Info] [omni.core] [19400] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-10 22:00:29 [2,329ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-10 22:00:31 [4,330ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-10 22:00:31 [4,343ms] [Info] [omni.core] [19400] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-10 22:00:31 [4,344ms] [Info] [carb.launcher.plugin] [19400] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001E146095CD0 for 'omni.delta-applier.app.exe'. 2022-11-10 22:00:31 [4,344ms] [Info] [carb.launcher.plugin] [19400] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 2680. 2022-11-10 22:00:31 [4,344ms] [Info] [carb.launcher.plugin] [19400] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-10 22:00:31 [4,346ms] [Info] [omni.server] [23156] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-10 22:00:31 [4,354ms] [Info] [carb.launcher.plugin] [19400] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 22304 to the job 00000000000003AC. 2022-11-10 22:00:31 [4,356ms] [Info] [carb.launcher.plugin] [4576] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 22304. 2022-11-10 22:00:31 [4,361ms] [Info] [carb.launcher.plugin] [19400] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 22304 {process = 000001E146095CD0} 2022-11-10 22:00:31 [4,361ms] [Info] [carb.launcher.plugin] [8288] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 22304. 2022-11-10 22:00:32 [4,800ms] [Error] [omni.core] [18176] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 16:00:32,047 - system_log - INFO - connected 2022-11-10 22:00:32 [4,806ms] [Error] [omni.core] [18176] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-10 22:00:32 [4,867ms] [Info] [omni.core] [23432] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-10 22:33:09 [1,962,264ms] [Error] [omni.core] [19400] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:33:09 [1,962,277ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:33:09 [1,962,302ms] [Error] [omni.core] [19400] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:33:09 [1,962,331ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:33:24 [1,977,213ms] [Error] [omni.core] [23432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:33:24 [1,977,228ms] [Error] [omni.core] [19400] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:34:15 [2,028,035ms] [Error] [omni.core] [19400] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:51:45 [3,078,012ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:51:45 [3,078,020ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:51:45 [3,078,041ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:51:45 [3,078,055ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:51:57 [3,089,806ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:51:57 [3,089,813ms] [Error] [omni.core] [11432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:52:03 [3,096,300ms] [Error] [omni.core] [23432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:52:03 [3,096,335ms] [Error] [omni.core] [23432] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:52:05 [3,098,481ms] [Error] [omni.core] [19400] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:52:05 [3,098,489ms] [Error] [omni.core] [19400] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:53:45 [3,198,067ms] [Error] [omni.core] [18176] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-10 22:53:45 [3,198,069ms] [Error] [omni.core] [18176] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-10 22:54:04 [0ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 22:54:04 [2ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 22:54:04 [4ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 22:54:04 [6ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-10 22:54:04 [7ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 22:54:04 [9ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 22:54:04 [10ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-10 22:54:04 [12ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 22:54:04 [14ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 22:54:04 [16ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 22:54:04 [19ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 22:54:04 [20ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 22:54:04 [22ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 22:54:04 [23ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-10 22:54:04 [25ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 22:54:04 [27ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 22:54:04 [30ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 22:54:04 [30ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 22:54:04 [30ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 22:54:04 [30ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 22:54:04 [30ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 22:54:04 [32ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-10 22:54:04 [32ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-10 22:54:04 [32ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-10 22:54:04 [33ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-10 22:54:04 [33ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-10 22:54:04 [33ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-10 22:54:04 [33ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-10 22:54:04 [33ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-10 22:54:04 [33ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-10 22:54:04 [34ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-10 22:54:04 [34ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-10 22:54:04 [34ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 22:54:04 [48ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 22:54:04 [50ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 22:54:04 [52ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 22:54:04 [52ms] [Info] [carb.launcher.plugin] [20320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001F4F65FEF70 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-10 22:54:04 [52ms] [Info] [carb.launcher.plugin] [20320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 15548. 2022-11-10 22:54:04 [52ms] [Info] [carb.launcher.plugin] [20320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-10 22:54:04 [53ms] [Info] [carb.launcher.plugin] [20320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-10 22:54:04 [60ms] [Info] [carb.launcher.plugin] [20320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 3596 to the job 00000000000003A8. 2022-11-10 22:54:04 [61ms] [Info] [carb.launcher.plugin] [13052] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 3596. 2022-11-10 22:54:04 [61ms] [Info] [carb.launcher.plugin] [22444] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 3596. 2022-11-10 22:54:04 [61ms] [Info] [carb.launcher.plugin] [20320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 3596 {process = 000001F4F65FEF70} 2022-11-10 22:54:04 [61ms] [Info] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-10 22:54:04 [61ms] [Info] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-10 22:54:04 [635ms] [Error] [omni.core] [22444] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-10 22:54:04 [782ms] [Error] [omni.core] [22444] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 16:54:04,789 - system_log - INFO - reconnecting ... 2022-11-10 22:54:06 [2,062ms] [Info] [omni.core] [7832] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-10 22:54:06 [2,062ms] [Info] [omni.core] [7832] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-10 22:54:06 [2,063ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 22:54:06 [2,071ms] [Info] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-10 22:54:06 [2,071ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 22:54:06 [2,072ms] [Info] [omni.core] [7832] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-10 22:54:06 [2,095ms] [Warning] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 22:54:06 [2,095ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 22:54:06 [2,106ms] [Warning] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 22:54:06 [2,106ms] [Info] [carb] [20320] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 22:54:06 [2,106ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-10 22:54:06 [2,106ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-10 22:54:06 [2,106ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-10 22:54:06 [2,106ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-10 22:54:06 [2,106ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-10 22:54:06 [2,107ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-10 22:54:06 [2,107ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-10 22:54:06 [2,107ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 22:54:06 [2,108ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-10 22:54:06 [2,108ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-10 22:54:06 [2,108ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-10 22:54:06 [2,108ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-10 22:54:06 [2,109ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-10 22:54:06 [2,109ms] [Error] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-10 22:54:06 [2,109ms] [Info] [omni.meta-upgrade] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-10 22:54:06 [2,110ms] [Info] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-10 22:54:06 [2,112ms] [Info] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-10 22:54:06 [2,112ms] [Error] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-10 22:54:06 [2,115ms] [Info] [omni.core] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-10 22:54:06 [2,115ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-10 22:54:06 [2,115ms] [Info] [omni.core] [7832] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-10 22:54:08 [4,116ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-10 22:54:08 [4,128ms] [Info] [omni.core] [7832] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-10 22:54:08 [4,128ms] [Info] [carb.launcher.plugin] [7832] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001F4F6780B30 for 'omni.delta-applier.app.exe'. 2022-11-10 22:54:08 [4,128ms] [Info] [carb.launcher.plugin] [7832] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 15548. 2022-11-10 22:54:08 [4,128ms] [Info] [carb.launcher.plugin] [7832] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-10 22:54:08 [4,139ms] [Info] [carb.launcher.plugin] [7832] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 11880 to the job 00000000000003A8. 2022-11-10 22:54:08 [4,139ms] [Info] [carb.launcher.plugin] [23608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 11880. 2022-11-10 22:54:08 [4,139ms] [Info] [carb.launcher.plugin] [20352] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 11880. 2022-11-10 22:54:08 [4,139ms] [Info] [carb.launcher.plugin] [7832] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 11880 {process = 000001F4F6780B30} 2022-11-10 22:54:08 [4,174ms] [Info] [omni.server] [20320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-10 22:54:08 [4,312ms] [Error] [omni.core] [22444] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 16:54:08,319 - system_log - INFO - connected 2022-11-10 22:54:08 [4,314ms] [Error] [omni.core] [22444] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-10 22:54:08 [4,643ms] [Info] [omni.core] [5356] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-10 22:55:03 [0ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 22:55:03 [1ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 22:55:03 [3ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 22:55:03 [4ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-10 22:55:03 [5ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 22:55:03 [6ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 22:55:03 [6ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-10 22:55:03 [7ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 22:55:03 [8ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 22:55:03 [9ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 22:55:03 [10ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 22:55:03 [11ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 22:55:03 [12ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 22:55:03 [13ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-10 22:55:03 [13ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 22:55:03 [14ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 22:55:03 [17ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 22:55:03 [17ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 22:55:03 [17ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 22:55:03 [17ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 22:55:03 [17ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 22:55:03 [19ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-10 22:55:03 [19ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-10 22:55:03 [19ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-10 22:55:03 [20ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "localhost:8891" } } } 2022-11-10 22:55:03 [21ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-10 22:55:03 [21ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 22:55:03 [33ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 22:55:03 [35ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 22:55:03 [37ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 22:55:03 [37ms] [Info] [carb.launcher.plugin] [18892] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000014FF6880660 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-10 22:55:03 [37ms] [Info] [carb.launcher.plugin] [18892] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 16944. 2022-11-10 22:55:03 [37ms] [Info] [carb.launcher.plugin] [18892] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-10 22:55:03 [37ms] [Info] [carb.launcher.plugin] [18892] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-10 22:55:03 [42ms] [Info] [carb.launcher.plugin] [18892] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 8568 to the job 00000000000003A8. 2022-11-10 22:55:03 [42ms] [Info] [carb.launcher.plugin] [21880] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 8568. 2022-11-10 22:55:03 [42ms] [Info] [carb.launcher.plugin] [18892] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 8568 {process = 0000014FF6880660} 2022-11-10 22:55:03 [42ms] [Info] [carb.launcher.plugin] [20652] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 8568. 2022-11-10 22:55:03 [42ms] [Info] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-10 22:55:03 [42ms] [Info] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-10 22:55:04 [533ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-10 22:55:04 [670ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 16:55:04,261 - system_log - INFO - reconnecting ... 2022-11-10 22:55:05 [2,044ms] [Info] [omni.core] [2088] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-10 22:55:05 [2,044ms] [Info] [omni.core] [2088] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-10 22:55:05 [2,045ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 22:55:05 [2,049ms] [Info] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-10 22:55:05 [2,049ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 22:55:05 [2,051ms] [Info] [omni.core] [2088] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-10 22:55:05 [2,072ms] [Warning] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 22:55:05 [2,072ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 22:55:05 [2,082ms] [Warning] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 22:55:05 [2,082ms] [Info] [carb] [18892] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 22:55:05 [2,082ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-10 22:55:05 [2,082ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-10 22:55:05 [2,082ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-10 22:55:05 [2,083ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-10 22:55:05 [2,084ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 22:55:05 [2,084ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-10 22:55:05 [2,084ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-10 22:55:05 [2,085ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-10 22:55:05 [2,085ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-10 22:55:05 [2,085ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-10 22:55:05 [2,085ms] [Error] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-10 22:55:05 [2,085ms] [Info] [omni.meta-upgrade] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-10 22:55:05 [2,086ms] [Info] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-10 22:55:05 [2,088ms] [Info] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-10 22:55:05 [2,088ms] [Error] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-10 22:55:05 [2,090ms] [Info] [omni.core] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-10 22:55:05 [2,091ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-10 22:55:05 [2,091ms] [Info] [omni.core] [20984] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-10 22:55:07 [4,091ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-10 22:55:07 [4,095ms] [Info] [omni.core] [20984] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-10 22:55:07 [4,095ms] [Info] [carb.launcher.plugin] [20984] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000014FF6A9F010 for 'omni.delta-applier.app.exe'. 2022-11-10 22:55:07 [4,095ms] [Info] [carb.launcher.plugin] [20984] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 16944. 2022-11-10 22:55:07 [4,095ms] [Info] [carb.launcher.plugin] [20984] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-10 22:55:07 [4,100ms] [Info] [carb.launcher.plugin] [20984] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 1832 to the job 00000000000003A8. 2022-11-10 22:55:07 [4,100ms] [Info] [carb.launcher.plugin] [5344] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 1832. 2022-11-10 22:55:07 [4,101ms] [Info] [carb.launcher.plugin] [8640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 1832. 2022-11-10 22:55:07 [4,101ms] [Info] [carb.launcher.plugin] [20984] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 1832 {process = 0000014FF6A9F010} 2022-11-10 22:55:07 [4,142ms] [Info] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-10 22:55:07 [4,204ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 16:55:07,796 - system_log - INFO - connected 2022-11-10 22:55:07 [4,205ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-10 22:55:08 [4,605ms] [Info] [omni.core] [16912] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-10 22:57:22 [138,625ms] [Error] [omni.core] [2088] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:57:24 [141,070ms] [Error] [omni.core] [16912] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:57:27 [143,916ms] [Error] [omni.core] [2088] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:58:03 [180,182ms] [Error] [omni.core] [19212] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:58:03 [180,189ms] [Error] [omni.core] [19212] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:58:03 [180,209ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:58:03 [180,223ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 22:59:11 [247,427ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-10 22:59:11 [247,434ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-10 22:59:11 [247,436ms] [Error] [omni.core] [20652] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-10 23:01:01 [357,790ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:10:01 [897,684ms] [Error] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\_build\intermediate\core-cpp\x86_64\release\apirouter.cpp:parseRequest():934: Deserialization failure 2022-11-10 23:10:01 [897,684ms] [Error] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\_build\intermediate\core-cpp\x86_64\release\apirouter.cpp:parseRequest():934: Deserialization failure 2022-11-10 23:10:01 [897,684ms] [Error] [omni.server] [18892] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\_build\intermediate\core-cpp\x86_64\release\apirouter.cpp:parseRequest():934: Deserialization failure 2022-11-10 23:10:39 [936,016ms] [Error] [omni.core] [16912] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:10:44 [940,477ms] [Error] [omni.core] [16912] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:10:44 [940,484ms] [Error] [omni.core] [16912] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:11:23 [979,652ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:11:23 [979,659ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:11:41 [997,473ms] [Error] [omni.core] [2088] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:11:45 [1,001,417ms] [Error] [omni.core] [16912] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:12:01 [1,018,011ms] [Error] [omni.core] [19212] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:12:06 [1,023,303ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:12:06 [1,023,309ms] [Error] [omni.core] [20984] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:14:05 [1,142,231ms] [Error] [omni.core] [19212] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:14:05 [1,142,236ms] [Error] [omni.core] [19212] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:16:11 [0ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 23:16:11 [2ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 23:16:11 [4ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 23:16:11 [5ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-10 23:16:11 [6ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 23:16:11 [7ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 23:16:11 [8ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-10 23:16:11 [9ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 23:16:11 [11ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 23:16:11 [12ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 23:16:11 [14ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 23:16:11 [15ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 23:16:11 [16ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 23:16:11 [18ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-10 23:16:11 [19ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 23:16:11 [21ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 23:16:11 [24ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-10 23:16:11 [24ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-10 23:16:11 [24ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-10 23:16:11 [24ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-10 23:16:11 [24ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-10 23:16:11 [27ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-10 23:16:11 [27ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-10 23:16:11 [27ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-10 23:16:11 [28ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-10 23:16:11 [28ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-10 23:16:11 [28ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-10 23:16:11 [28ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-10 23:16:11 [28ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-10 23:16:11 [29ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-10 23:16:11 [29ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-10 23:16:11 [29ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-10 23:16:11 [29ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-10 23:16:11 [42ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-10 23:16:11 [43ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-10 23:16:11 [45ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-10 23:16:11 [45ms] [Info] [carb.launcher.plugin] [21660] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 00000249DBF9BE00 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-10 23:16:11 [45ms] [Info] [carb.launcher.plugin] [21660] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 21656. 2022-11-10 23:16:11 [45ms] [Info] [carb.launcher.plugin] [21660] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-10 23:16:11 [46ms] [Info] [carb.launcher.plugin] [21660] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-10 23:16:11 [53ms] [Info] [carb.launcher.plugin] [21660] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 21840 to the job 00000000000003BC. 2022-11-10 23:16:11 [53ms] [Info] [carb.launcher.plugin] [21848] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 21840. 2022-11-10 23:16:11 [53ms] [Info] [carb.launcher.plugin] [21660] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 21840 {process = 00000249DBF9BE00} 2022-11-10 23:16:11 [53ms] [Info] [carb.launcher.plugin] [21852] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 21840. 2022-11-10 23:16:11 [53ms] [Info] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-10 23:16:11 [53ms] [Info] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-10 23:16:12 [660ms] [Error] [omni.core] [21852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-10 23:16:12 [821ms] [Error] [omni.core] [21852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 17:16:12,442 - system_log - INFO - reconnecting ... 2022-11-10 23:16:13 [2,060ms] [Info] [omni.core] [21796] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-10 23:16:13 [2,060ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-10 23:16:13 [2,061ms] [Info] [omni.core] [21796] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-10 23:16:13 [2,095ms] [Info] [omni.core] [21796] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-10 23:16:13 [2,108ms] [Info] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-10 23:16:13 [2,108ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-10 23:16:13 [2,143ms] [Warning] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 23:16:13 [2,143ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-10 23:16:13 [2,161ms] [Warning] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-10 23:16:13 [2,161ms] [Info] [carb] [21660] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-10 23:16:13 [2,165ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-10 23:16:13 [2,167ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-10 23:16:13 [2,167ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-10 23:16:13 [2,167ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-10 23:16:13 [2,167ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-10 23:16:13 [2,168ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-10 23:16:13 [2,168ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-10 23:16:13 [2,168ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-10 23:16:13 [2,168ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-10 23:16:13 [2,168ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-10 23:16:13 [2,169ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-10 23:16:13 [2,169ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 23:16:13 [2,169ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-10 23:16:13 [2,169ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-10 23:16:13 [2,170ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-10 23:16:13 [2,170ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-10 23:16:13 [2,170ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-10 23:16:13 [2,170ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-10 23:16:13 [2,172ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-10 23:16:13 [2,172ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-10 23:16:13 [2,172ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-10 23:16:13 [2,172ms] [Error] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-10 23:16:13 [2,172ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-10 23:16:13 [2,172ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-10 23:16:13 [2,173ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-10 23:16:13 [2,173ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-10 23:16:13 [2,173ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-10 23:16:13 [2,173ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-10 23:16:13 [2,173ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-10 23:16:13 [2,173ms] [Info] [omni.meta-upgrade] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-10 23:16:13 [2,177ms] [Info] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-10 23:16:13 [2,187ms] [Info] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-10 23:16:13 [2,187ms] [Error] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-10 23:16:13 [2,190ms] [Info] [omni.core] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-10 23:16:13 [2,190ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-10 23:16:13 [2,190ms] [Info] [omni.core] [21804] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-10 23:16:15 [4,191ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-10 23:16:15 [4,195ms] [Info] [omni.core] [21796] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-10 23:16:15 [4,196ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 00000249DC161C40 for 'omni.delta-applier.app.exe'. 2022-11-10 23:16:15 [4,196ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 21656. 2022-11-10 23:16:15 [4,196ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-10 23:16:15 [4,205ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 22400 to the job 00000000000003BC. 2022-11-10 23:16:15 [4,205ms] [Info] [carb.launcher.plugin] [22412] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 22400. 2022-11-10 23:16:15 [4,205ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 22400 {process = 00000249DC161C40} 2022-11-10 23:16:15 [4,205ms] [Info] [carb.launcher.plugin] [22416] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 22400. 2022-11-10 23:16:15 [4,251ms] [Info] [omni.server] [21660] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-10 23:16:15 [4,368ms] [Error] [omni.core] [21852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 17:16:15,989 - system_log - INFO - connected 2022-11-10 23:16:16 [4,378ms] [Error] [omni.core] [21852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-10 23:16:16 [4,708ms] [Info] [omni.core] [21800] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-10 23:17:51 [99,721ms] [Error] [omni.core] [21804] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:17:51 [99,820ms] [Error] [omni.core] [21852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Exception in callback _ProactorBasePipeTransport._call_connection_lost(None) handle: Traceback (most recent call last): File "asyncio\events.py", line 81, in _run File "asyncio\proactor_events.py", line 162, in _call_connection_lost ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host 2022-11-10 23:17:54 [103,370ms] [Error] [omni.core] [21804] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:18:56 [165,337ms] [Error] [omni.core] [21800] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:18:56 [165,346ms] [Error] [omni.core] [21800] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:18:56 [165,368ms] [Error] [omni.core] [21800] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-10 23:18:57 [165,382ms] [Error] [omni.core] [21800] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 00:32:05 [4,553,971ms] [Info] [carb.launcher.plugin] [22412] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 00:32:05 [4,553,971ms] [Info] [carb.launcher.plugin] [22416] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 00:32:05 [4,553,971ms] [Info] [carb.launcher.plugin] [22412] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 22400, bytes = -1} 2022-11-11 00:32:05 [4,553,971ms] [Info] [carb.launcher.plugin] [22416] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 22400, bytes = -1} 2022-11-11 00:32:05 [4,553,971ms] [Info] [carb.launcher.plugin] [22412] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 22400. 2022-11-11 00:32:05 [4,553,971ms] [Info] [carb.launcher.plugin] [22416] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 22400. 2022-11-11 00:32:05 [4,554,222ms] [Warning] [omni.core] [21796] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():602: Restarting delta applier process because ping timed out. 2022-11-11 00:32:05 [4,554,222ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:kill():274: killing the child process 22400 {exitCode = 137, flags = 0x00000002, timeout = 5000} 2022-11-11 00:32:05 [4,554,222ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:terminate():151: failed to terminate the process 22400 {error = 5} 2022-11-11 00:32:05 [4,554,222ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:terminate():159: the process has already exited on its own (!?). 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():201: waiting for the process 00000249DC161C40 (22400) to exit {timeout = 18446744073709551615} 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():206: the process has already exited with code 137. 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():194: destroying the process object 00000249DC161C40 {pid = 22400} 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():196: done destroying the process object 00000249DC161C40 {pid = 22400} 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 00000249DC1F1F50 for 'omni.delta-applier.app.exe'. 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 21656. 2022-11-11 00:32:05 [4,554,223ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 00:32:05 [4,554,231ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 13504 to the job 00000000000003BC. 2022-11-11 00:32:05 [4,554,232ms] [Info] [carb.launcher.plugin] [8776] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 13504. 2022-11-11 00:32:05 [4,554,232ms] [Info] [carb.launcher.plugin] [8152] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 13504. 2022-11-11 00:32:05 [4,554,232ms] [Info] [carb.launcher.plugin] [21796] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 13504 {process = 00000249DC1F1F50} 2022-11-11 00:32:05 [4,554,264ms] [Info] [carb.launcher.plugin] [8776] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 00:32:05 [4,554,264ms] [Info] [carb.launcher.plugin] [8152] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 00:32:05 [4,554,264ms] [Info] [carb.launcher.plugin] [8776] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 13504, bytes = -1} 2022-11-11 00:32:05 [4,554,264ms] [Info] [carb.launcher.plugin] [8152] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 13504, bytes = -1} 2022-11-11 00:32:05 [4,554,264ms] [Info] [carb.launcher.plugin] [8776] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 13504. 2022-11-11 00:32:05 [4,554,264ms] [Info] [carb.launcher.plugin] [8152] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 13504. 2022-11-11 02:00:32 [0ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 02:00:32 [3ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 02:00:32 [6ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 02:00:32 [7ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 02:00:32 [9ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 02:00:32 [11ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 02:00:32 [13ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 02:00:32 [15ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 02:00:32 [18ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 02:00:32 [19ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 02:00:32 [23ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 02:00:32 [24ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 02:00:32 [26ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 02:00:32 [28ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 02:00:32 [30ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 02:00:32 [32ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 02:00:32 [37ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 02:00:32 [37ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 02:00:32 [37ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 02:00:32 [37ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 02:00:32 [37ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 02:00:32 [40ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 02:00:32 [40ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 02:00:32 [40ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 02:00:32 [41ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 02:00:32 [41ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 02:00:32 [41ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 02:00:32 [41ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 02:00:32 [41ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 02:00:32 [42ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 02:00:32 [42ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "localhost:8891" } } } 2022-11-11 02:00:32 [43ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 02:00:32 [43ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 02:00:32 [62ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 02:00:32 [64ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 02:00:32 [67ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 02:00:32 [67ms] [Info] [carb.launcher.plugin] [16864] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 00000233520DB750 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 02:00:32 [67ms] [Info] [carb.launcher.plugin] [16864] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 8308. 2022-11-11 02:00:32 [67ms] [Info] [carb.launcher.plugin] [16864] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 02:00:32 [67ms] [Info] [carb.launcher.plugin] [16864] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 02:00:32 [81ms] [Info] [carb.launcher.plugin] [16864] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 19400 to the job 00000000000003B0. 2022-11-11 02:00:32 [82ms] [Info] [carb.launcher.plugin] [14340] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 19400. 2022-11-11 02:00:32 [82ms] [Info] [carb.launcher.plugin] [16864] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 19400 {process = 00000233520DB750} 2022-11-11 02:00:32 [82ms] [Info] [carb.launcher.plugin] [12448] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 19400. 2022-11-11 02:00:32 [82ms] [Info] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 02:00:32 [82ms] [Info] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 02:00:33 [885ms] [Error] [omni.core] [12448] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 02:00:34 [1,107ms] [Error] [omni.core] [12448] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 20:00:34,016 - system_log - INFO - reconnecting ... 2022-11-11 02:00:34 [2,088ms] [Info] [omni.core] [10188] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 02:00:34 [2,089ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 02:00:34 [2,090ms] [Info] [omni.core] [10188] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 02:00:35 [2,139ms] [Info] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 02:00:35 [2,140ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 02:00:35 [2,146ms] [Info] [omni.core] [10188] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 02:00:35 [2,187ms] [Warning] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 02:00:35 [2,187ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 02:00:35 [2,209ms] [Warning] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 02:00:35 [2,209ms] [Info] [carb] [16864] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 02:00:35 [2,213ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 02:00:35 [2,216ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 02:00:35 [2,216ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 02:00:35 [2,216ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 02:00:35 [2,216ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 02:00:35 [2,216ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 02:00:35 [2,216ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 02:00:35 [2,217ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 02:00:35 [2,217ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 02:00:35 [2,217ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 02:00:35 [2,217ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 02:00:35 [2,217ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 02:00:35 [2,217ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 02:00:35 [2,217ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 02:00:35 [2,218ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 02:00:35 [2,218ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 02:00:35 [2,219ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 02:00:35 [2,219ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 02:00:35 [2,220ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 02:00:35 [2,220ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 02:00:35 [2,221ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 02:00:35 [2,221ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 02:00:35 [2,222ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 02:00:35 [2,222ms] [Error] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 02:00:35 [2,222ms] [Info] [omni.meta-upgrade] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 02:00:35 [2,227ms] [Info] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 02:00:35 [2,236ms] [Info] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 02:00:35 [2,236ms] [Error] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 02:00:35 [2,239ms] [Info] [omni.core] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 02:00:35 [2,240ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 02:00:35 [2,240ms] [Info] [omni.core] [10188] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 02:00:37 [4,240ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 02:00:37 [4,245ms] [Info] [omni.core] [24072] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 02:00:37 [4,245ms] [Info] [carb.launcher.plugin] [24072] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000023352282E00 for 'omni.delta-applier.app.exe'. 2022-11-11 02:00:37 [4,245ms] [Info] [carb.launcher.plugin] [24072] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 8308. 2022-11-11 02:00:37 [4,245ms] [Info] [carb.launcher.plugin] [24072] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 02:00:37 [4,256ms] [Info] [carb.launcher.plugin] [24072] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 14804 to the job 00000000000003B0. 2022-11-11 02:00:37 [4,256ms] [Info] [carb.launcher.plugin] [8300] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 14804. 2022-11-11 02:00:37 [4,257ms] [Info] [carb.launcher.plugin] [11612] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 14804. 2022-11-11 02:00:37 [4,257ms] [Info] [carb.launcher.plugin] [24072] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 14804 {process = 0000023352282E00} 2022-11-11 02:00:37 [4,316ms] [Info] [omni.server] [16864] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 02:00:37 [4,658ms] [Error] [omni.core] [12448] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-10 20:00:37,567 - system_log - INFO - connected 2022-11-11 02:00:37 [4,669ms] [Error] [omni.core] [12448] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 02:00:37 [4,761ms] [Info] [omni.core] [10188] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 13:27:43 [0ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 13:27:43 [2ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 13:27:43 [6ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 13:27:43 [8ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 13:27:43 [10ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 13:27:43 [11ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 13:27:43 [13ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 13:27:43 [16ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 13:27:43 [18ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 13:27:43 [20ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 13:27:43 [22ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 13:27:43 [24ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 13:27:43 [26ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 13:27:43 [27ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 13:27:43 [29ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 13:27:43 [30ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 13:27:43 [34ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 13:27:43 [34ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 13:27:43 [34ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 13:27:43 [34ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 13:27:43 [34ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 13:27:43 [36ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 13:27:43 [37ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 13:27:43 [37ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 13:27:43 [38ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 13:27:43 [38ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 13:27:43 [38ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 13:27:43 [38ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 13:27:43 [38ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 13:27:43 [38ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 13:27:43 [39ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "localhost:8891" } } } 2022-11-11 13:27:43 [39ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 13:27:43 [39ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 13:27:43 [54ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 13:27:43 [56ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 13:27:43 [58ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 13:27:43 [59ms] [Info] [carb.launcher.plugin] [1884] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002C5ABFFF950 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 13:27:43 [59ms] [Info] [carb.launcher.plugin] [1884] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 23316. 2022-11-11 13:27:43 [59ms] [Info] [carb.launcher.plugin] [1884] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 13:27:43 [59ms] [Info] [carb.launcher.plugin] [1884] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 13:27:43 [69ms] [Info] [carb.launcher.plugin] [1884] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 17600 to the job 00000000000003A8. 2022-11-11 13:27:43 [70ms] [Info] [carb.launcher.plugin] [12608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 17600. 2022-11-11 13:27:43 [70ms] [Info] [carb.launcher.plugin] [1884] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 17600 {process = 000002C5ABFFF950} 2022-11-11 13:27:43 [70ms] [Info] [carb.launcher.plugin] [6500] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 17600. 2022-11-11 13:27:43 [70ms] [Info] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 13:27:43 [70ms] [Info] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 13:27:44 [882ms] [Error] [omni.core] [6500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 13:27:44 [1,123ms] [Error] [omni.core] [6500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 07:27:44,659 - system_log - INFO - reconnecting ... 2022-11-11 13:27:45 [2,076ms] [Info] [omni.core] [17584] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 13:27:45 [2,077ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 13:27:45 [2,078ms] [Info] [omni.core] [17584] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 13:27:45 [2,109ms] [Info] [omni.core] [17584] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 13:27:45 [2,126ms] [Info] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 13:27:45 [2,127ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 13:27:45 [2,171ms] [Warning] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 13:27:45 [2,171ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 13:27:45 [2,193ms] [Warning] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 13:27:45 [2,193ms] [Info] [carb] [1884] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 13:27:45 [2,197ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 13:27:45 [2,199ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 13:27:45 [2,199ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 13:27:45 [2,199ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 13:27:45 [2,199ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 13:27:45 [2,199ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 13:27:45 [2,200ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 13:27:45 [2,200ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 13:27:45 [2,200ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 13:27:45 [2,200ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 13:27:45 [2,200ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 13:27:45 [2,200ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 13:27:45 [2,200ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 13:27:45 [2,201ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 13:27:45 [2,201ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 13:27:45 [2,201ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 13:27:45 [2,202ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 13:27:45 [2,202ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 13:27:45 [2,203ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 13:27:45 [2,203ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 13:27:45 [2,203ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 13:27:45 [2,205ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 13:27:45 [2,205ms] [Error] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 13:27:45 [2,205ms] [Info] [omni.meta-upgrade] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 13:27:45 [2,210ms] [Info] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 13:27:45 [2,220ms] [Info] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 13:27:45 [2,220ms] [Error] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 13:27:45 [2,223ms] [Info] [omni.core] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 13:27:45 [2,224ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 13:27:45 [2,224ms] [Info] [omni.core] [1916] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 13:27:47 [4,225ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 13:27:47 [4,233ms] [Info] [omni.core] [11560] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 13:27:47 [4,234ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002C5AC17BA10 for 'omni.delta-applier.app.exe'. 2022-11-11 13:27:47 [4,234ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 23316. 2022-11-11 13:27:47 [4,234ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 13:27:47 [4,248ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 19836 to the job 00000000000003A8. 2022-11-11 13:27:47 [4,249ms] [Info] [carb.launcher.plugin] [19608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 19836. 2022-11-11 13:27:47 [4,250ms] [Info] [carb.launcher.plugin] [14288] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 19836. 2022-11-11 13:27:47 [4,250ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 19836 {process = 000002C5AC17BA10} 2022-11-11 13:27:47 [4,308ms] [Info] [omni.server] [1884] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 13:27:48 [4,679ms] [Error] [omni.core] [6500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 07:27:48,215 - system_log - INFO - connected 2022-11-11 13:27:48 [4,689ms] [Error] [omni.core] [6500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 13:27:48 [4,754ms] [Info] [omni.core] [11560] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 14:49:27 [4,904,094ms] [Info] [carb.launcher.plugin] [19608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 14:49:27 [4,904,094ms] [Info] [carb.launcher.plugin] [14288] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 14:49:27 [4,904,094ms] [Info] [carb.launcher.plugin] [19608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 19836, bytes = -1} 2022-11-11 14:49:27 [4,904,094ms] [Info] [carb.launcher.plugin] [14288] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 19836, bytes = -1} 2022-11-11 14:49:27 [4,904,094ms] [Info] [carb.launcher.plugin] [14288] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 19836. 2022-11-11 14:49:27 [4,904,094ms] [Info] [carb.launcher.plugin] [19608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 19836. 2022-11-11 14:49:27 [4,904,104ms] [Info] [carb.launcher.plugin] [6500] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 14:49:27 [4,904,104ms] [Info] [carb.launcher.plugin] [12608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 14:49:27 [4,904,104ms] [Info] [carb.launcher.plugin] [6500] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 17600, bytes = -1} 2022-11-11 14:49:27 [4,904,104ms] [Info] [carb.launcher.plugin] [12608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 17600, bytes = -1} 2022-11-11 14:49:27 [4,904,105ms] [Info] [carb.launcher.plugin] [6500] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 17600. 2022-11-11 14:49:27 [4,904,105ms] [Info] [carb.launcher.plugin] [12608] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 17600. 2022-11-11 14:49:28 [4,904,585ms] [Warning] [omni.core] [11560] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():602: Restarting delta applier process because ping timed out. 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:kill():274: killing the child process 19836 {exitCode = 137, flags = 0x00000002, timeout = 5000} 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:terminate():151: failed to terminate the process 19836 {error = 5} 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:terminate():159: the process has already exited on its own (!?). 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():201: waiting for the process 000002C5AC17BA10 (19836) to exit {timeout = 18446744073709551615} 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():206: the process has already exited with code 137. 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():194: destroying the process object 000002C5AC17BA10 {pid = 19836} 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():196: done destroying the process object 000002C5AC17BA10 {pid = 19836} 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002C5AC25BFC0 for 'omni.delta-applier.app.exe'. 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 23316. 2022-11-11 14:49:28 [4,904,586ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 14:49:28 [4,904,596ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 6576 to the job 00000000000003A8. 2022-11-11 14:49:28 [4,904,596ms] [Info] [carb.launcher.plugin] [6556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 6576. 2022-11-11 14:49:28 [4,904,597ms] [Info] [carb.launcher.plugin] [7964] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 6576. 2022-11-11 14:49:28 [4,904,597ms] [Info] [carb.launcher.plugin] [11560] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 6576 {process = 000002C5AC25BFC0} 2022-11-11 14:49:28 [4,904,608ms] [Info] [carb.launcher.plugin] [7964] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 14:49:28 [4,904,608ms] [Info] [carb.launcher.plugin] [6556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-11 14:49:28 [4,904,608ms] [Info] [carb.launcher.plugin] [7964] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 6576, bytes = -1} 2022-11-11 14:49:28 [4,904,608ms] [Info] [carb.launcher.plugin] [7964] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 6576. 2022-11-11 14:49:28 [4,904,608ms] [Info] [carb.launcher.plugin] [6556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 6576, bytes = -1} 2022-11-11 14:49:28 [4,904,608ms] [Info] [carb.launcher.plugin] [6556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 6576. 2022-11-11 14:49:30 [4,907,027ms] [Info] [omni.core] [5372] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:operator ()():426: discovery client: received non-ok status from the discovery service: 5 / Connection is terminated 2022-11-11 15:58:34 [0ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 15:58:34 [3ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 15:58:34 [7ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 15:58:34 [9ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 15:58:34 [10ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 15:58:34 [12ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 15:58:34 [13ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 15:58:34 [16ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 15:58:34 [18ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 15:58:34 [20ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 15:58:34 [23ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 15:58:34 [24ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 15:58:34 [26ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 15:58:34 [27ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 15:58:34 [29ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 15:58:34 [31ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 15:58:34 [35ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 15:58:34 [35ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 15:58:34 [35ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 15:58:34 [35ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 15:58:34 [35ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 15:58:34 [37ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 15:58:34 [38ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 15:58:34 [38ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 15:58:34 [39ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 15:58:34 [39ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 15:58:34 [39ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 15:58:34 [39ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 15:58:34 [39ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 15:58:34 [39ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 15:58:34 [40ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-11 15:58:34 [41ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 15:58:34 [41ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 15:58:34 [59ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 15:58:34 [61ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 15:58:34 [64ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 15:58:34 [65ms] [Info] [carb.launcher.plugin] [21048] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001118A5886C0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 15:58:34 [65ms] [Info] [carb.launcher.plugin] [21048] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 4796. 2022-11-11 15:58:34 [65ms] [Info] [carb.launcher.plugin] [21048] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 15:58:34 [65ms] [Info] [carb.launcher.plugin] [21048] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 15:58:34 [83ms] [Info] [carb.launcher.plugin] [21048] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 5400 to the job 00000000000003A8. 2022-11-11 15:58:34 [84ms] [Info] [carb.launcher.plugin] [14668] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 5400. 2022-11-11 15:58:34 [84ms] [Info] [carb.launcher.plugin] [14956] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 5400. 2022-11-11 15:58:34 [84ms] [Info] [carb.launcher.plugin] [21048] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 5400 {process = 000001118A5886C0} 2022-11-11 15:58:34 [84ms] [Info] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 15:58:34 [84ms] [Info] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 15:58:35 [1,150ms] [Error] [omni.core] [14956] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 15:58:36 [1,437ms] [Error] [omni.core] [14956] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 09:58:36,066 - system_log - INFO - reconnecting ... 2022-11-11 15:58:36 [2,090ms] [Info] [omni.core] [17500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 15:58:36 [2,091ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 15:58:36 [2,092ms] [Info] [omni.core] [17500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 15:58:36 [2,138ms] [Info] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 15:58:36 [2,138ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 15:58:36 [2,144ms] [Info] [omni.core] [17500] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 15:58:36 [2,181ms] [Warning] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 15:58:36 [2,181ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 15:58:36 [2,202ms] [Warning] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 15:58:36 [2,202ms] [Info] [carb] [21048] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 15:58:36 [2,206ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 15:58:36 [2,207ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 15:58:36 [2,207ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 15:58:36 [2,207ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 15:58:36 [2,207ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 15:58:36 [2,207ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 15:58:36 [2,208ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 15:58:36 [2,208ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 15:58:36 [2,208ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 15:58:36 [2,208ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 15:58:36 [2,208ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 15:58:36 [2,208ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 15:58:36 [2,208ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 15:58:36 [2,208ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 15:58:36 [2,209ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 15:58:36 [2,209ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 15:58:36 [2,210ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 15:58:36 [2,210ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 15:58:36 [2,210ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 15:58:36 [2,212ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 15:58:36 [2,212ms] [Error] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 15:58:36 [2,212ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 15:58:36 [2,213ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 15:58:36 [2,213ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 15:58:36 [2,213ms] [Info] [omni.meta-upgrade] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 15:58:36 [2,217ms] [Info] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 15:58:36 [2,227ms] [Info] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 15:58:36 [2,227ms] [Error] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 15:58:36 [2,230ms] [Info] [omni.core] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 15:58:36 [2,231ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 15:58:36 [2,231ms] [Info] [omni.core] [17340] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 15:58:38 [4,232ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 15:58:38 [4,234ms] [Info] [omni.core] [19820] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 15:58:38 [4,235ms] [Info] [carb.launcher.plugin] [19820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001118A70D070 for 'omni.delta-applier.app.exe'. 2022-11-11 15:58:38 [4,235ms] [Info] [carb.launcher.plugin] [19820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 4796. 2022-11-11 15:58:38 [4,235ms] [Info] [carb.launcher.plugin] [19820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 15:58:38 [4,279ms] [Info] [carb.launcher.plugin] [19820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 15232 to the job 00000000000003A8. 2022-11-11 15:58:38 [4,280ms] [Info] [carb.launcher.plugin] [7180] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 15232. 2022-11-11 15:58:38 [4,281ms] [Info] [carb.launcher.plugin] [4116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 15232. 2022-11-11 15:58:38 [4,281ms] [Info] [carb.launcher.plugin] [19820] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 15232 {process = 000001118A70D070} 2022-11-11 15:58:38 [4,340ms] [Info] [omni.server] [21048] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 15:58:39 [4,500ms] [Error] [omni.core] [14956] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 09:58:39,129 - system_log - INFO - connected 2022-11-11 15:58:39 [4,510ms] [Error] [omni.core] [14956] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 15:58:39 [4,784ms] [Info] [omni.core] [17340] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 16:35:57 [2,242,637ms] [Error] [omni.core] [17500] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:36:26 [2,271,401ms] [Error] [omni.core] [20376] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:50:41 [0ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 16:50:41 [1ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 16:50:41 [4ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 16:50:41 [5ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 16:50:41 [6ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 16:50:41 [8ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 16:50:41 [9ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 16:50:41 [10ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 16:50:41 [12ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 16:50:41 [13ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 16:50:41 [14ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 16:50:41 [16ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 16:50:41 [17ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 16:50:41 [18ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 16:50:41 [19ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 16:50:41 [20ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 16:50:41 [23ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 16:50:41 [23ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 16:50:41 [23ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 16:50:41 [23ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 16:50:41 [23ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 16:50:41 [25ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 16:50:41 [25ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 16:50:41 [25ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 16:50:41 [26ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "localhost:8891" } } } 2022-11-11 16:50:41 [27ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 16:50:41 [27ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 16:50:41 [39ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 16:50:41 [41ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 16:50:41 [43ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 16:50:41 [43ms] [Info] [carb.launcher.plugin] [10556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002308D4198B0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 16:50:41 [43ms] [Info] [carb.launcher.plugin] [10556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 19692. 2022-11-11 16:50:41 [43ms] [Info] [carb.launcher.plugin] [10556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 16:50:41 [43ms] [Info] [carb.launcher.plugin] [10556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 16:50:41 [51ms] [Info] [carb.launcher.plugin] [10556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 13084 to the job 00000000000003B4. 2022-11-11 16:50:41 [51ms] [Info] [carb.launcher.plugin] [12712] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 13084. 2022-11-11 16:50:41 [51ms] [Info] [carb.launcher.plugin] [4760] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 13084. 2022-11-11 16:50:41 [51ms] [Info] [carb.launcher.plugin] [10556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 13084 {process = 000002308D4198B0} 2022-11-11 16:50:41 [52ms] [Info] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 16:50:41 [52ms] [Info] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 16:50:41 [619ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 16:50:41 [760ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 10:50:41,940 - system_log - INFO - reconnecting ... 2022-11-11 16:50:43 [2,052ms] [Info] [omni.core] [3292] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 16:50:43 [2,053ms] [Info] [omni.core] [3292] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 16:50:43 [2,053ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 16:50:43 [2,064ms] [Info] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 16:50:43 [2,064ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 16:50:43 [2,064ms] [Info] [omni.core] [3292] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 16:50:43 [2,127ms] [Warning] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 16:50:43 [2,127ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 16:50:43 [2,137ms] [Warning] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 16:50:43 [2,137ms] [Info] [carb] [10556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 16:50:43 [2,138ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 16:50:43 [2,138ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 16:50:43 [2,138ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 16:50:43 [2,138ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 16:50:43 [2,138ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 16:50:43 [2,138ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 16:50:43 [2,138ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 16:50:43 [2,139ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 16:50:43 [2,139ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 16:50:43 [2,139ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 16:50:43 [2,139ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 16:50:43 [2,139ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 16:50:43 [2,139ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 16:50:43 [2,139ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 16:50:43 [2,139ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 16:50:43 [2,139ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 16:50:43 [2,140ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 16:50:43 [2,140ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 16:50:43 [2,140ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 16:50:43 [2,141ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 16:50:43 [2,141ms] [Error] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 16:50:43 [2,141ms] [Info] [omni.meta-upgrade] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 16:50:43 [2,143ms] [Info] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 16:50:43 [2,145ms] [Info] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 16:50:43 [2,145ms] [Error] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 16:50:43 [2,147ms] [Info] [omni.core] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 16:50:43 [2,148ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 16:50:43 [2,148ms] [Info] [omni.core] [18640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 16:50:45 [4,148ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 16:50:45 [4,154ms] [Info] [omni.core] [18640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 16:50:45 [4,154ms] [Info] [carb.launcher.plugin] [18640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002308D663310 for 'omni.delta-applier.app.exe'. 2022-11-11 16:50:45 [4,154ms] [Info] [carb.launcher.plugin] [18640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 19692. 2022-11-11 16:50:45 [4,154ms] [Info] [carb.launcher.plugin] [18640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 16:50:45 [4,161ms] [Info] [carb.launcher.plugin] [18640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 16624 to the job 00000000000003B4. 2022-11-11 16:50:45 [4,162ms] [Info] [carb.launcher.plugin] [3248] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 16624. 2022-11-11 16:50:45 [4,164ms] [Info] [carb.launcher.plugin] [22960] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 16624. 2022-11-11 16:50:45 [4,164ms] [Info] [carb.launcher.plugin] [18640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 16624 {process = 000002308D663310} 2022-11-11 16:50:45 [4,209ms] [Info] [omni.server] [10556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 16:50:45 [4,296ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 10:50:45,475 - system_log - INFO - connected 2022-11-11 16:50:45 [4,298ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 16:50:45 [4,668ms] [Info] [omni.core] [18640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 16:51:22 [40,823ms] [Error] [omni.core] [18304] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:51:26 [45,227ms] [Error] [omni.core] [18640] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:54:04 [203,377ms] [Error] [omni.core] [21284] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:54:09 [207,868ms] [Error] [omni.core] [3292] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:54:11 [210,355ms] [Error] [omni.core] [18304] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:57:52 [431,190ms] [Error] [omni.core] [21284] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:57:52 [431,221ms] [Error] [omni.core] [18304] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:57:52 [431,276ms] [Error] [omni.core] [18304] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 16:57:52 [431,316ms] [Error] [omni.core] [21284] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:00:22 [581,687ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:00:22 [581,695ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:00:22 [581,698ms] [Error] [omni.core] [4760] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:01:41 [659,944ms] [Error] [omni.core] [3292] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:10:05 [0ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:10:05 [2ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:10:05 [12ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:10:05 [18ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 17:10:05 [24ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:10:05 [31ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:10:05 [37ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 17:10:05 [45ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:10:05 [53ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:10:05 [60ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:10:05 [71ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:10:05 [80ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:10:05 [85ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:10:05 [93ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 17:10:05 [98ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:10:05 [107ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:10:05 [110ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:10:05 [111ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:10:05 [111ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:10:05 [111ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:10:05 [111ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:10:05 [113ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 17:10:05 [113ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 17:10:05 [113ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 17:10:05 [114ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-11 17:10:05 [115ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 17:10:05 [115ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:10:05 [128ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:10:05 [130ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:10:05 [132ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:10:05 [132ms] [Info] [carb.launcher.plugin] [16808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002547277C0E0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 17:10:05 [132ms] [Info] [carb.launcher.plugin] [16808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 18508. 2022-11-11 17:10:05 [132ms] [Info] [carb.launcher.plugin] [16808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 17:10:05 [132ms] [Info] [carb.launcher.plugin] [16808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 17:10:05 [158ms] [Info] [carb.launcher.plugin] [16808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 16508 to the job 00000000000003B8. 2022-11-11 17:10:05 [159ms] [Info] [carb.launcher.plugin] [16436] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 16508. 2022-11-11 17:10:05 [159ms] [Info] [carb.launcher.plugin] [16808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 16508 {process = 000002547277C0E0} 2022-11-11 17:10:05 [159ms] [Info] [carb.launcher.plugin] [16428] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 16508. 2022-11-11 17:10:05 [159ms] [Info] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 17:10:05 [160ms] [Info] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 17:10:06 [983ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 17:10:06 [1,191ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:10:06,256 - system_log - INFO - reconnecting ... 2022-11-11 17:10:07 [2,160ms] [Info] [omni.core] [22172] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 17:10:07 [2,160ms] [Info] [omni.core] [22172] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 17:10:07 [2,161ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:10:07 [2,202ms] [Info] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 17:10:07 [2,202ms] [Info] [omni.core] [22172] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 17:10:07 [2,202ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:10:07 [2,229ms] [Warning] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:10:07 [2,229ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:10:07 [2,240ms] [Warning] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:10:07 [2,240ms] [Info] [carb] [16808] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:10:07 [2,240ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 17:10:07 [2,240ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 17:10:07 [2,240ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 17:10:07 [2,240ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 17:10:07 [2,240ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 17:10:07 [2,240ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 17:10:07 [2,241ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 17:10:07 [2,241ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 17:10:07 [2,241ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 17:10:07 [2,241ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 17:10:07 [2,241ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 17:10:07 [2,241ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 17:10:07 [2,241ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 17:10:07 [2,241ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:10:07 [2,242ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 17:10:07 [2,242ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 17:10:07 [2,243ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 17:10:07 [2,243ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 17:10:07 [2,243ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 17:10:07 [2,243ms] [Error] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 17:10:07 [2,243ms] [Info] [omni.meta-upgrade] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 17:10:07 [2,244ms] [Info] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 17:10:07 [2,246ms] [Info] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 17:10:07 [2,246ms] [Error] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 17:10:07 [2,248ms] [Info] [omni.core] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 17:10:07 [2,249ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 17:10:07 [2,249ms] [Info] [omni.core] [16532] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 17:10:09 [4,251ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 17:10:09 [4,253ms] [Info] [omni.core] [16532] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 17:10:09 [4,254ms] [Info] [carb.launcher.plugin] [16532] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002547291F340 for 'omni.delta-applier.app.exe'. 2022-11-11 17:10:09 [4,254ms] [Info] [carb.launcher.plugin] [16532] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 18508. 2022-11-11 17:10:09 [4,254ms] [Info] [carb.launcher.plugin] [16532] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 17:10:09 [4,263ms] [Info] [carb.launcher.plugin] [16532] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 10380 to the job 00000000000003B8. 2022-11-11 17:10:09 [4,263ms] [Info] [carb.launcher.plugin] [7840] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 10380. 2022-11-11 17:10:09 [4,264ms] [Info] [carb.launcher.plugin] [7632] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 10380. 2022-11-11 17:10:09 [4,265ms] [Info] [carb.launcher.plugin] [16532] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 10380 {process = 000002547291F340} 2022-11-11 17:10:09 [4,304ms] [Info] [omni.server] [16808] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 17:10:09 [4,741ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:10:09,806 - system_log - INFO - connected 2022-11-11 17:10:09 [4,748ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 17:10:09 [4,768ms] [Info] [omni.core] [16532] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 17:10:26 [21,401ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,403ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,405ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,407ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,413ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,419ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,424ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:26 [21,433ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:10:29 [24,808ms] [Error] [omni.core] [7348] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:11:48 [103,728ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 29, in download_asset_base File "lft\validation.py", line 49, in get_content_info File "meta_client\client.py", line 205, in get_content_id File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:11:48 [103,730ms] [Error] [omni.core] [16428] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-11 17:15:17 [0ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:15:17 [8ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:15:17 [18ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:15:17 [24ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 17:15:17 [30ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:15:17 [36ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:15:17 [43ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 17:15:17 [51ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:15:17 [58ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:15:17 [65ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:15:17 [75ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:15:17 [83ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:15:17 [90ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:15:17 [97ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 17:15:17 [104ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:15:17 [114ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:15:17 [117ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:15:17 [117ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:15:17 [117ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:15:17 [117ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:15:17 [117ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:15:17 [119ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 17:15:17 [119ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 17:15:17 [119ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 17:15:17 [120ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 17:15:17 [120ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 17:15:17 [120ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 17:15:17 [120ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 17:15:17 [120ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 17:15:17 [121ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 17:15:17 [121ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "localhost:8891" } } } 2022-11-11 17:15:17 [121ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 17:15:17 [121ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:15:17 [135ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:15:17 [137ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:15:17 [139ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:15:17 [139ms] [Info] [carb.launcher.plugin] [12128] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000022631B949D0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 17:15:17 [139ms] [Info] [carb.launcher.plugin] [12128] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 2320. 2022-11-11 17:15:17 [139ms] [Info] [carb.launcher.plugin] [12128] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 17:15:17 [139ms] [Info] [carb.launcher.plugin] [12128] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 17:15:17 [163ms] [Info] [carb.launcher.plugin] [12128] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 5240 to the job 00000000000003A8. 2022-11-11 17:15:17 [163ms] [Info] [carb.launcher.plugin] [21140] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 5240. 2022-11-11 17:15:17 [164ms] [Info] [carb.launcher.plugin] [12128] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 5240 {process = 0000022631B949D0} 2022-11-11 17:15:17 [164ms] [Info] [carb.launcher.plugin] [3320] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 5240. 2022-11-11 17:15:17 [164ms] [Info] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 17:15:17 [164ms] [Info] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 17:15:18 [968ms] [Error] [omni.core] [3320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 17:15:18 [1,173ms] [Error] [omni.core] [3320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:15:18,936 - system_log - INFO - reconnecting ... 2022-11-11 17:15:19 [2,165ms] [Info] [omni.core] [20624] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 17:15:19 [2,165ms] [Info] [omni.core] [20624] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 17:15:19 [2,166ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:15:19 [2,203ms] [Info] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 17:15:19 [2,204ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:15:19 [2,204ms] [Info] [omni.core] [20624] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 17:15:19 [2,231ms] [Warning] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:15:19 [2,231ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:15:20 [2,242ms] [Warning] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:15:20 [2,242ms] [Info] [carb] [12128] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:15:20 [2,242ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 17:15:20 [2,242ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 17:15:20 [2,243ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 17:15:20 [2,243ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 17:15:20 [2,243ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 17:15:20 [2,243ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 17:15:20 [2,244ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 17:15:20 [2,244ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:15:20 [2,244ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:15:20 [2,244ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 17:15:20 [2,245ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 17:15:20 [2,245ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 17:15:20 [2,245ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 17:15:20 [2,246ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 17:15:20 [2,246ms] [Error] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 17:15:20 [2,246ms] [Info] [omni.meta-upgrade] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 17:15:20 [2,247ms] [Info] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 17:15:20 [2,249ms] [Info] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 17:15:20 [2,249ms] [Error] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 17:15:20 [2,251ms] [Info] [omni.core] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 17:15:20 [2,252ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 17:15:20 [2,252ms] [Info] [omni.core] [21496] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 17:15:22 [4,253ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 17:15:22 [4,260ms] [Info] [omni.core] [21496] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 17:15:22 [4,261ms] [Info] [carb.launcher.plugin] [21496] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000022631D82D60 for 'omni.delta-applier.app.exe'. 2022-11-11 17:15:22 [4,261ms] [Info] [carb.launcher.plugin] [21496] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 2320. 2022-11-11 17:15:22 [4,261ms] [Info] [carb.launcher.plugin] [21496] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 17:15:22 [4,276ms] [Info] [carb.launcher.plugin] [21496] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 18564 to the job 00000000000003A8. 2022-11-11 17:15:22 [4,276ms] [Info] [carb.launcher.plugin] [19084] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 18564. 2022-11-11 17:15:22 [4,277ms] [Info] [carb.launcher.plugin] [2940] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 18564. 2022-11-11 17:15:22 [4,277ms] [Info] [carb.launcher.plugin] [21496] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 18564 {process = 0000022631D82D60} 2022-11-11 17:15:22 [4,307ms] [Info] [omni.server] [12128] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 17:15:22 [4,711ms] [Error] [omni.core] [3320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:15:22,473 - system_log - INFO - connected 2022-11-11 17:15:22 [4,719ms] [Error] [omni.core] [3320] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 17:15:22 [4,781ms] [Info] [omni.core] [20624] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 17:28:26 [0ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:28:26 [7ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:28:26 [17ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:28:26 [24ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 17:28:26 [30ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:28:26 [37ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:28:26 [42ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 17:28:26 [50ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:28:26 [57ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:28:26 [63ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:28:26 [74ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:28:26 [82ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:28:26 [88ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:28:26 [96ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 17:28:26 [102ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:28:26 [111ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:28:26 [114ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:28:26 [114ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:28:26 [114ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:28:26 [114ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:28:26 [114ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:28:26 [116ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 17:28:26 [116ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 17:28:26 [116ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 17:28:26 [117ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "localhost:8891" } } } 2022-11-11 17:28:26 [118ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 17:28:26 [118ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:28:26 [130ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:28:26 [131ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:28:26 [133ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:28:26 [134ms] [Info] [carb.launcher.plugin] [8032] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000020A52A10D90 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 17:28:26 [134ms] [Info] [carb.launcher.plugin] [8032] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 7932. 2022-11-11 17:28:26 [134ms] [Info] [carb.launcher.plugin] [8032] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 17:28:26 [134ms] [Info] [carb.launcher.plugin] [8032] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 17:28:26 [156ms] [Info] [carb.launcher.plugin] [8032] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 7572 to the job 00000000000003AC. 2022-11-11 17:28:26 [157ms] [Info] [carb.launcher.plugin] [5548] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 7572. 2022-11-11 17:28:26 [157ms] [Info] [carb.launcher.plugin] [14276] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 7572. 2022-11-11 17:28:26 [157ms] [Info] [carb.launcher.plugin] [8032] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 7572 {process = 0000020A52A10D90} 2022-11-11 17:28:26 [157ms] [Info] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 17:28:26 [157ms] [Info] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 17:28:27 [946ms] [Error] [omni.core] [14276] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 17:28:27 [1,189ms] [Error] [omni.core] [14276] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:28:27,441 - system_log - INFO - reconnecting ... 2022-11-11 17:28:28 [2,158ms] [Info] [omni.core] [8332] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 17:28:28 [2,158ms] [Info] [omni.core] [8332] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 17:28:28 [2,159ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:28:28 [2,166ms] [Info] [omni.core] [8332] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 17:28:28 [2,191ms] [Info] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 17:28:28 [2,191ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:28:28 [2,219ms] [Warning] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:28:28 [2,219ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:28:28 [2,231ms] [Warning] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:28:28 [2,231ms] [Info] [carb] [8032] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:28:28 [2,231ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 17:28:28 [2,231ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 17:28:28 [2,231ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 17:28:28 [2,232ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 17:28:28 [2,232ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 17:28:28 [2,233ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:28:28 [2,233ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 17:28:28 [2,233ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 17:28:28 [2,234ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 17:28:28 [2,234ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 17:28:28 [2,234ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 17:28:28 [2,234ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 17:28:28 [2,234ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 17:28:28 [2,234ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 17:28:28 [2,234ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 17:28:28 [2,234ms] [Error] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 17:28:28 [2,235ms] [Info] [omni.meta-upgrade] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 17:28:28 [2,236ms] [Info] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 17:28:28 [2,238ms] [Info] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 17:28:28 [2,238ms] [Error] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 17:28:28 [2,244ms] [Info] [omni.core] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 17:28:28 [2,245ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 17:28:28 [2,245ms] [Info] [omni.core] [10148] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 17:28:30 [4,245ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 17:28:30 [4,249ms] [Info] [omni.core] [10148] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 17:28:30 [4,250ms] [Info] [carb.launcher.plugin] [10148] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000020A52BEAA80 for 'omni.delta-applier.app.exe'. 2022-11-11 17:28:30 [4,250ms] [Info] [carb.launcher.plugin] [10148] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 7932. 2022-11-11 17:28:30 [4,250ms] [Info] [carb.launcher.plugin] [10148] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 17:28:30 [4,265ms] [Info] [carb.launcher.plugin] [10148] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 17164 to the job 00000000000003AC. 2022-11-11 17:28:30 [4,266ms] [Info] [carb.launcher.plugin] [13680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 17164. 2022-11-11 17:28:30 [4,266ms] [Info] [carb.launcher.plugin] [3748] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 17164. 2022-11-11 17:28:30 [4,266ms] [Info] [carb.launcher.plugin] [10148] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 17164 {process = 0000020A52BEAA80} 2022-11-11 17:28:30 [4,301ms] [Info] [omni.server] [8032] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 17:28:30 [4,513ms] [Error] [omni.core] [10148] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:28:30 [4,736ms] [Error] [omni.core] [14276] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:28:30,989 - system_log - INFO - connected 2022-11-11 17:28:30 [4,743ms] [Error] [omni.core] [14276] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 17:28:31 [4,770ms] [Info] [omni.core] [10148] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 17:28:40 [14,390ms] [Error] [omni.core] [8332] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:40 [14,514ms] [Error] [omni.core] [7628] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:40 [14,529ms] [Error] [omni.core] [9376] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:40 [14,541ms] [Error] [omni.core] [10148] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:45 [19,466ms] [Error] [omni.core] [9376] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:49 [23,238ms] [Error] [omni.core] [10148] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:49 [23,249ms] [Error] [omni.core] [8332] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:28:49 [23,261ms] [Error] [omni.core] [7628] authrequest.cpp:createNewUser():118: Request internal error 2022-11-11 17:29:04 [38,590ms] [Error] [omni.core] [9376] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:29:52 [85,827ms] [Error] [omni.core] [7628] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:30:13 [107,417ms] [Error] [omni.core] [7628] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:38:17 [591,346ms] [Error] [omni.core] [8332] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:40:12 [0ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:40:12 [2ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:40:12 [4ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:40:12 [5ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 17:40:12 [6ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:40:12 [7ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:40:12 [8ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 17:40:12 [10ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:40:12 [12ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:40:12 [13ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:40:12 [16ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:40:12 [17ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:40:12 [18ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:40:12 [19ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 17:40:12 [21ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:40:12 [22ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:40:12 [25ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 17:40:12 [25ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 17:40:12 [25ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 17:40:12 [25ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 17:40:12 [25ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 17:40:12 [27ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 17:40:12 [27ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 17:40:12 [27ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 17:40:12 [28ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 17:40:12 [28ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 17:40:12 [28ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 17:40:12 [28ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 17:40:12 [28ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 17:40:12 [29ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 17:40:12 [29ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-11 17:40:12 [29ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 17:40:12 [29ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 17:40:12 [42ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 17:40:12 [43ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 17:40:12 [45ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 17:40:12 [46ms] [Info] [carb.launcher.plugin] [1640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001CA9743B930 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 17:40:12 [46ms] [Info] [carb.launcher.plugin] [1640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 1648. 2022-11-11 17:40:12 [46ms] [Info] [carb.launcher.plugin] [1640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 17:40:12 [46ms] [Info] [carb.launcher.plugin] [1640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 17:40:12 [60ms] [Info] [carb.launcher.plugin] [1640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 19152 to the job 00000000000003B0. 2022-11-11 17:40:12 [60ms] [Info] [carb.launcher.plugin] [19232] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 19152. 2022-11-11 17:40:12 [60ms] [Info] [carb.launcher.plugin] [19236] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 19152. 2022-11-11 17:40:12 [60ms] [Info] [carb.launcher.plugin] [1640] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 19152 {process = 000001CA9743B930} 2022-11-11 17:40:12 [60ms] [Info] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 17:40:12 [60ms] [Info] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 17:40:12 [618ms] [Error] [omni.core] [19236] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 17:40:13 [765ms] [Error] [omni.core] [19236] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:40:13,127 - system_log - INFO - reconnecting ... 2022-11-11 17:40:14 [2,065ms] [Info] [omni.core] [19092] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 17:40:14 [2,066ms] [Info] [omni.core] [19092] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 17:40:14 [2,066ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 17:40:14 [2,077ms] [Info] [omni.core] [19092] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 17:40:14 [2,092ms] [Info] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 17:40:14 [2,092ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 17:40:14 [2,123ms] [Warning] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:40:14 [2,123ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 17:40:14 [2,137ms] [Warning] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 17:40:14 [2,137ms] [Info] [carb] [1640] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 17:40:14 [2,140ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 17:40:14 [2,140ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 17:40:14 [2,141ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 17:40:14 [2,141ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 17:40:14 [2,142ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:40:14 [2,142ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 17:40:14 [2,142ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 17:40:14 [2,143ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 17:40:14 [2,143ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 17:40:14 [2,143ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 17:40:14 [2,144ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 17:40:14 [2,144ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 17:40:14 [2,145ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 17:40:14 [2,145ms] [Error] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 17:40:14 [2,145ms] [Info] [omni.meta-upgrade] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 17:40:14 [2,148ms] [Info] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 17:40:14 [2,154ms] [Info] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 17:40:14 [2,154ms] [Error] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 17:40:14 [2,156ms] [Info] [omni.core] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 17:40:14 [2,157ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 17:40:14 [2,157ms] [Info] [omni.core] [19116] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 17:40:16 [4,157ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 17:40:16 [4,163ms] [Info] [omni.core] [19116] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 17:40:16 [4,164ms] [Info] [carb.launcher.plugin] [19116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001CA975E5430 for 'omni.delta-applier.app.exe'. 2022-11-11 17:40:16 [4,164ms] [Info] [carb.launcher.plugin] [19116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 1648. 2022-11-11 17:40:16 [4,164ms] [Info] [carb.launcher.plugin] [19116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 17:40:16 [4,177ms] [Info] [carb.launcher.plugin] [19116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 18612 to the job 00000000000003B0. 2022-11-11 17:40:16 [4,177ms] [Info] [carb.launcher.plugin] [5632] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 18612. 2022-11-11 17:40:16 [4,178ms] [Info] [carb.launcher.plugin] [19116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 18612 {process = 000001CA975E5430} 2022-11-11 17:40:16 [4,178ms] [Info] [carb.launcher.plugin] [5736] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 18612. 2022-11-11 17:40:16 [4,209ms] [Info] [omni.server] [1640] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 17:40:16 [4,306ms] [Error] [omni.core] [19236] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 11:40:16,667 - system_log - INFO - connected 2022-11-11 17:40:16 [4,313ms] [Error] [omni.core] [19236] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 17:40:17 [4,680ms] [Info] [omni.core] [19088] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-11 17:40:19 [7,596ms] [Error] [omni.core] [19088] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:40:33 [21,499ms] [Error] [omni.core] [19088] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 17:40:58 [46,185ms] [Error] [omni.core] [19120] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-11 23:01:41 [0ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 23:01:41 [8ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 23:01:41 [22ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 23:01:41 [31ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-11 23:01:41 [40ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 23:01:41 [50ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 23:01:41 [60ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-11 23:01:41 [72ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 23:01:41 [84ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 23:01:41 [93ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 23:01:41 [108ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 23:01:41 [118ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 23:01:41 [126ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 23:01:41 [135ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-11 23:01:41 [144ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 23:01:41 [157ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 23:01:41 [160ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-11 23:01:41 [160ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-11 23:01:41 [160ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-11 23:01:41 [160ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-11 23:01:41 [161ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-11 23:01:41 [163ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-11 23:01:41 [163ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-11 23:01:41 [163ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-11 23:01:41 [164ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-11 23:01:41 [164ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-11 23:01:41 [164ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-11 23:01:41 [164ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-11 23:01:41 [164ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-11 23:01:41 [165ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-11 23:01:41 [165ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-11 23:01:41 [165ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-11 23:01:41 [165ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-11 23:01:41 [179ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-11 23:01:41 [181ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-11 23:01:41 [183ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-11 23:01:41 [184ms] [Info] [carb.launcher.plugin] [9680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001406A08BA50 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-11 23:01:41 [184ms] [Info] [carb.launcher.plugin] [9680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 4448. 2022-11-11 23:01:41 [184ms] [Info] [carb.launcher.plugin] [9680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-11 23:01:41 [184ms] [Info] [carb.launcher.plugin] [9680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-11 23:01:41 [216ms] [Info] [carb.launcher.plugin] [9680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 16020 to the job 00000000000003B0. 2022-11-11 23:01:41 [216ms] [Info] [carb.launcher.plugin] [4808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 16020. 2022-11-11 23:01:41 [217ms] [Info] [carb.launcher.plugin] [5996] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 16020. 2022-11-11 23:01:41 [217ms] [Info] [carb.launcher.plugin] [9680] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 16020 {process = 000001406A08BA50} 2022-11-11 23:01:41 [217ms] [Info] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-11 23:01:41 [217ms] [Info] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-11 23:01:42 [1,121ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-11 23:01:42 [1,398ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 17:01:42,962 - system_log - INFO - reconnecting ... 2022-11-11 23:01:43 [2,223ms] [Info] [omni.core] [2592] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-11 23:01:43 [2,224ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-11 23:01:43 [2,224ms] [Info] [omni.core] [2592] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-11 23:01:43 [2,295ms] [Info] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-11 23:01:43 [2,295ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-11 23:01:43 [2,301ms] [Info] [omni.core] [2592] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-11 23:01:43 [2,330ms] [Warning] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 23:01:43 [2,331ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-11 23:01:43 [2,348ms] [Warning] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-11 23:01:43 [2,348ms] [Info] [carb] [9680] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-11 23:01:43 [2,352ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-11 23:01:43 [2,354ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-11 23:01:43 [2,354ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-11 23:01:43 [2,354ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-11 23:01:43 [2,355ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-11 23:01:43 [2,355ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 23:01:43 [2,355ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-11 23:01:43 [2,355ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-11 23:01:43 [2,356ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-11 23:01:43 [2,356ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-11 23:01:43 [2,356ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-11 23:01:43 [2,356ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-11 23:01:43 [2,356ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-11 23:01:43 [2,357ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-11 23:01:43 [2,357ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-11 23:01:43 [2,358ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-11 23:01:43 [2,358ms] [Error] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-11 23:01:43 [2,358ms] [Info] [omni.meta-upgrade] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-11 23:01:43 [2,361ms] [Info] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-11 23:01:43 [2,369ms] [Info] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-11 23:01:43 [2,369ms] [Error] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-11 23:01:43 [2,371ms] [Info] [omni.core] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-11 23:01:43 [2,373ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-11 23:01:43 [2,373ms] [Info] [omni.core] [12240] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-11 23:01:45 [4,374ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-11 23:01:45 [4,376ms] [Info] [omni.core] [21364] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-11 23:01:45 [4,376ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001406A217DC0 for 'omni.delta-applier.app.exe'. 2022-11-11 23:01:45 [4,376ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 4448. 2022-11-11 23:01:45 [4,376ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-11 23:01:45 [4,395ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 16748 to the job 00000000000003B0. 2022-11-11 23:01:45 [4,396ms] [Info] [carb.launcher.plugin] [19448] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 16748. 2022-11-11 23:01:45 [4,396ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 16748 {process = 000001406A217DC0} 2022-11-11 23:01:45 [4,396ms] [Info] [carb.launcher.plugin] [5684] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 16748. 2022-11-11 23:01:46 [4,448ms] [Info] [omni.server] [9680] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-11 23:01:46 [4,456ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 17:01:46,020 - system_log - INFO - connected 2022-11-11 23:01:46 [4,467ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-11 23:01:46 [4,901ms] [Info] [omni.core] [12240] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-12 00:21:08 [4,772,306ms] [Info] [omni.core] [21364] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:kill():125: Killing child server process omni-lft-service\omni-lft-service.exe 2022-11-12 00:21:08 [4,772,307ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:kill():274: killing the child process 16020 {exitCode = 137, flags = 0x00000003, timeout = 5000} 2022-11-12 00:21:08 [4,772,306ms] [Warning] [omni.core] [2592] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():602: Restarting delta applier process because ping timed out. 2022-11-12 00:21:08 [4,772,311ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:kill():274: killing the child process 16748 {exitCode = 137, flags = 0x00000002, timeout = 5000} 2022-11-12 00:21:08 [4,772,333ms] [Info] [carb.launcher.plugin] [4808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-12 00:21:08 [4,772,333ms] [Info] [carb.launcher.plugin] [5996] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-12 00:21:08 [4,772,333ms] [Info] [carb.launcher.plugin] [4808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 16020, bytes = -1} 2022-11-12 00:21:08 [4,772,333ms] [Info] [carb.launcher.plugin] [5996] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 16020, bytes = -1} 2022-11-12 00:21:08 [4,772,333ms] [Info] [carb.launcher.plugin] [4808] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 16020. 2022-11-12 00:21:08 [4,772,333ms] [Info] [carb.launcher.plugin] [5996] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 16020. 2022-11-12 00:21:08 [4,772,342ms] [Info] [omni.core] [21364] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:kill():127: Waiting for child server process omni-lft-service\omni-lft-service.exe to exit 2022-11-12 00:21:08 [4,772,686ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():201: waiting for the process 000001406A08BA50 (16020) to exit {timeout = 18446744073709551615} 2022-11-12 00:21:08 [4,772,686ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():206: the process has already exited with code 137. 2022-11-12 00:21:08 [4,772,686ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():194: destroying the process object 000001406A08BA50 {pid = 16020} 2022-11-12 00:21:08 [4,772,686ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():196: done destroying the process object 000001406A08BA50 {pid = 16020} 2022-11-12 00:21:08 [4,772,687ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001406A301580 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-12 00:21:08 [4,772,687ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 4448. 2022-11-12 00:21:08 [4,772,687ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-12 00:21:08 [4,772,700ms] [Info] [carb.launcher.plugin] [19448] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-12 00:21:08 [4,772,700ms] [Info] [carb.launcher.plugin] [5684] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-12 00:21:08 [4,772,700ms] [Info] [carb.launcher.plugin] [19448] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 16748, bytes = -1} 2022-11-12 00:21:08 [4,772,700ms] [Info] [carb.launcher.plugin] [5684] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 16748, bytes = -1} 2022-11-12 00:21:08 [4,772,700ms] [Info] [carb.launcher.plugin] [19448] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 16748. 2022-11-12 00:21:08 [4,772,700ms] [Info] [carb.launcher.plugin] [5684] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 16748. 2022-11-12 00:21:08 [4,772,736ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():201: waiting for the process 000001406A217DC0 (16748) to exit {timeout = 18446744073709551615} 2022-11-12 00:21:08 [4,772,736ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():206: the process has already exited with code 137. 2022-11-12 00:21:08 [4,772,736ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():194: destroying the process object 000001406A217DC0 {pid = 16748} 2022-11-12 00:21:08 [4,772,737ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():196: done destroying the process object 000001406A217DC0 {pid = 16748} 2022-11-12 00:21:08 [4,772,737ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001406A3013D0 for 'omni.delta-applier.app.exe'. 2022-11-12 00:21:08 [4,772,749ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 10920 to the job 00000000000003B0. 2022-11-12 00:21:08 [4,772,752ms] [Info] [carb.launcher.plugin] [20916] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 10920. 2022-11-12 00:21:08 [4,772,772ms] [Info] [carb.launcher.plugin] [10016] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 10920. 2022-11-12 00:21:08 [4,772,772ms] [Info] [carb.launcher.plugin] [21364] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 10920 {process = 000001406A301580} 2022-11-12 00:21:08 [4,772,772ms] [Info] [omni.core] [21364] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-12 00:21:08 [4,772,772ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 4448. 2022-11-12 00:21:08 [4,772,772ms] [Info] [omni.core] [21364] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-12 00:21:08 [4,772,772ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-12 00:21:09 [4,772,817ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 10024 to the job 00000000000003B0. 2022-11-12 00:21:09 [4,772,820ms] [Info] [carb.launcher.plugin] [18116] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 10024. 2022-11-12 00:21:09 [4,772,822ms] [Info] [carb.launcher.plugin] [2592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 10024 {process = 000001406A3013D0} 2022-11-12 00:21:09 [4,772,822ms] [Info] [carb.launcher.plugin] [21632] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 10024. 2022-11-12 00:21:11 [4,775,146ms] [Info] [omni.core] [12240] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-12 00:21:12 [4,776,539ms] [Error] [omni.core] [10016] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-12 00:21:13 [4,777,507ms] [Error] [omni.core] [10016] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 18:21:13,702 - system_log - INFO - reconnecting ... 2022-11-12 00:21:15 [4,779,647ms] [Error] [omni.core] [10016] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 18:21:15,843 - system_log - INFO - connected 2022-11-12 00:21:15 [4,779,743ms] [Error] [omni.core] [10016] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-12 00:30:49 [5,353,583ms] [Info] [carb.launcher.plugin] [20916] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-12 00:30:49 [5,353,583ms] [Info] [carb.launcher.plugin] [10016] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-12 00:30:49 [5,353,584ms] [Info] [carb.launcher.plugin] [20916] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 10920, bytes = -1} 2022-11-12 00:30:49 [5,353,584ms] [Info] [carb.launcher.plugin] [10016] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 10920, bytes = -1} 2022-11-12 00:30:49 [5,353,584ms] [Info] [carb.launcher.plugin] [20916] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 10920. 2022-11-12 00:30:49 [5,353,584ms] [Info] [carb.launcher.plugin] [10016] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 10920. 2022-11-12 01:19:14 [0ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-12 01:19:14 [3ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-12 01:19:14 [5ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-12 01:19:14 [6ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-12 01:19:14 [8ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-12 01:19:14 [9ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-12 01:19:14 [10ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-12 01:19:14 [12ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-12 01:19:14 [14ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-12 01:19:14 [15ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-12 01:19:14 [17ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-12 01:19:14 [18ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-12 01:19:14 [19ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-12 01:19:14 [21ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-12 01:19:14 [22ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-12 01:19:14 [23ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-12 01:19:14 [26ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-12 01:19:14 [26ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-12 01:19:14 [26ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-12 01:19:14 [26ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-12 01:19:14 [26ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-12 01:19:14 [29ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-12 01:19:14 [29ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-12 01:19:14 [29ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-12 01:19:14 [30ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-12 01:19:14 [30ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-12 01:19:14 [30ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-12 01:19:14 [30ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-12 01:19:14 [30ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-12 01:19:14 [30ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-12 01:19:14 [31ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-12 01:19:14 [31ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-12 01:19:14 [31ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-12 01:19:14 [45ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-12 01:19:14 [47ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-12 01:19:14 [50ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-12 01:19:14 [50ms] [Info] [carb.launcher.plugin] [1556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002A6E32D9A80 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-12 01:19:14 [50ms] [Info] [carb.launcher.plugin] [1556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 4228. 2022-11-12 01:19:14 [50ms] [Info] [carb.launcher.plugin] [1556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-12 01:19:14 [50ms] [Info] [carb.launcher.plugin] [1556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-12 01:19:14 [59ms] [Info] [carb.launcher.plugin] [1556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 424 to the job 00000000000003B0. 2022-11-12 01:19:14 [59ms] [Info] [carb.launcher.plugin] [22232] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 424. 2022-11-12 01:19:14 [60ms] [Info] [carb.launcher.plugin] [13636] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 424. 2022-11-12 01:19:14 [60ms] [Info] [carb.launcher.plugin] [1556] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 424 {process = 000002A6E32D9A80} 2022-11-12 01:19:14 [60ms] [Info] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-12 01:19:14 [60ms] [Info] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-12 01:19:14 [672ms] [Error] [omni.core] [13636] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-12 01:19:14 [822ms] [Error] [omni.core] [13636] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 19:19:14,949 - system_log - INFO - reconnecting ... 2022-11-12 01:19:16 [2,066ms] [Info] [omni.core] [17204] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-12 01:19:16 [2,066ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-12 01:19:16 [2,067ms] [Info] [omni.core] [17204] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-12 01:19:16 [2,107ms] [Info] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-12 01:19:16 [2,107ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-12 01:19:16 [2,113ms] [Info] [omni.core] [17204] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-12 01:19:16 [2,141ms] [Warning] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-12 01:19:16 [2,142ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-12 01:19:16 [2,158ms] [Warning] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-12 01:19:16 [2,158ms] [Info] [carb] [1556] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-12 01:19:16 [2,162ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-12 01:19:16 [2,164ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-12 01:19:16 [2,164ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-12 01:19:16 [2,164ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-12 01:19:16 [2,164ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-12 01:19:16 [2,164ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-12 01:19:16 [2,164ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-12 01:19:16 [2,164ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-12 01:19:16 [2,165ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-12 01:19:16 [2,165ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-12 01:19:16 [2,165ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-12 01:19:16 [2,165ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-12 01:19:16 [2,165ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-12 01:19:16 [2,165ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-12 01:19:16 [2,165ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-12 01:19:16 [2,165ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-12 01:19:16 [2,166ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-12 01:19:16 [2,167ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-12 01:19:16 [2,167ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-12 01:19:16 [2,167ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-12 01:19:16 [2,169ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-12 01:19:16 [2,169ms] [Error] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-12 01:19:16 [2,169ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-12 01:19:16 [2,170ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-12 01:19:16 [2,170ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-12 01:19:16 [2,170ms] [Info] [omni.meta-upgrade] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-12 01:19:16 [2,173ms] [Info] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-12 01:19:16 [2,182ms] [Info] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-12 01:19:16 [2,182ms] [Error] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-12 01:19:16 [2,185ms] [Info] [omni.core] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-12 01:19:16 [2,186ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-12 01:19:16 [2,186ms] [Info] [omni.core] [17204] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-12 01:19:18 [4,187ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-12 01:19:18 [4,191ms] [Info] [omni.core] [16852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-12 01:19:18 [4,192ms] [Info] [carb.launcher.plugin] [16852] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002A6E34E1D20 for 'omni.delta-applier.app.exe'. 2022-11-12 01:19:18 [4,192ms] [Info] [carb.launcher.plugin] [16852] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 4228. 2022-11-12 01:19:18 [4,192ms] [Info] [carb.launcher.plugin] [16852] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-12 01:19:18 [4,200ms] [Info] [carb.launcher.plugin] [16852] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 2668 to the job 00000000000003B0. 2022-11-12 01:19:18 [4,202ms] [Info] [carb.launcher.plugin] [14700] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 2668. 2022-11-12 01:19:18 [4,202ms] [Info] [carb.launcher.plugin] [17452] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 2668. 2022-11-12 01:19:18 [4,202ms] [Info] [carb.launcher.plugin] [16852] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 2668 {process = 000002A6E34E1D20} 2022-11-12 01:19:18 [4,246ms] [Info] [omni.server] [1556] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-12 01:19:18 [4,372ms] [Error] [omni.core] [13636] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-11 19:19:18,499 - system_log - INFO - connected 2022-11-12 01:19:18 [4,381ms] [Error] [omni.core] [13636] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-12 01:19:18 [4,705ms] [Info] [omni.core] [16852] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-13 19:26:14 [0ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-13 19:26:14 [2ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-13 19:26:15 [5ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-13 19:26:15 [7ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-13 19:26:15 [8ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-13 19:26:15 [9ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-13 19:26:15 [10ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-13 19:26:15 [12ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-13 19:26:15 [14ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-13 19:26:15 [15ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-13 19:26:15 [17ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-13 19:26:15 [19ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-13 19:26:15 [20ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-13 19:26:15 [22ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-13 19:26:15 [23ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-13 19:26:15 [25ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-13 19:26:15 [28ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-13 19:26:15 [28ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-13 19:26:15 [28ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-13 19:26:15 [28ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-13 19:26:15 [28ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-13 19:26:15 [31ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-13 19:26:15 [31ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-13 19:26:15 [31ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-13 19:26:15 [32ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-13 19:26:15 [32ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-13 19:26:15 [32ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-13 19:26:15 [32ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-13 19:26:15 [32ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-13 19:26:15 [32ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-13 19:26:15 [33ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-13 19:26:15 [33ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-13 19:26:15 [33ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-13 19:26:15 [47ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-13 19:26:15 [49ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-13 19:26:15 [52ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-13 19:26:15 [52ms] [Info] [carb.launcher.plugin] [9392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000021BBD4EC2F0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-13 19:26:15 [52ms] [Info] [carb.launcher.plugin] [9392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 18276. 2022-11-13 19:26:15 [52ms] [Info] [carb.launcher.plugin] [9392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-13 19:26:15 [53ms] [Info] [carb.launcher.plugin] [9392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-13 19:26:15 [63ms] [Info] [carb.launcher.plugin] [9392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 20800 to the job 00000000000003BC. 2022-11-13 19:26:15 [64ms] [Info] [carb.launcher.plugin] [2712] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 20800. 2022-11-13 19:26:15 [64ms] [Info] [carb.launcher.plugin] [1408] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 20800. 2022-11-13 19:26:15 [64ms] [Info] [carb.launcher.plugin] [9392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 20800 {process = 0000021BBD4EC2F0} 2022-11-13 19:26:15 [64ms] [Info] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-13 19:26:15 [64ms] [Info] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-13 19:26:16 [1,021ms] [Error] [omni.core] [1408] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-13 19:26:16 [1,217ms] [Error] [omni.core] [1408] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 13:26:16,212 - system_log - INFO - reconnecting ... 2022-11-13 19:26:17 [2,071ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-13 19:26:17 [2,072ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-13 19:26:17 [2,072ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-13 19:26:17 [2,098ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-13 19:26:17 [2,121ms] [Info] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-13 19:26:17 [2,122ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-13 19:26:17 [2,166ms] [Warning] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-13 19:26:17 [2,166ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-13 19:26:17 [2,185ms] [Warning] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-13 19:26:17 [2,186ms] [Info] [carb] [9392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-13 19:26:17 [2,190ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-13 19:26:17 [2,191ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-13 19:26:17 [2,191ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-13 19:26:17 [2,191ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-13 19:26:17 [2,192ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-13 19:26:17 [2,192ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-13 19:26:17 [2,193ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-13 19:26:17 [2,193ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-13 19:26:17 [2,193ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-13 19:26:17 [2,194ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-13 19:26:17 [2,194ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-13 19:26:17 [2,194ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-13 19:26:17 [2,196ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-13 19:26:17 [2,196ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-13 19:26:17 [2,196ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-13 19:26:17 [2,196ms] [Error] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-13 19:26:17 [2,196ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-13 19:26:17 [2,196ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-13 19:26:17 [2,197ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-13 19:26:17 [2,197ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-13 19:26:17 [2,197ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-13 19:26:17 [2,197ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-13 19:26:17 [2,197ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-13 19:26:17 [2,197ms] [Info] [omni.meta-upgrade] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-13 19:26:17 [2,200ms] [Info] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-13 19:26:17 [2,211ms] [Info] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-13 19:26:17 [2,211ms] [Error] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-13 19:26:17 [2,214ms] [Info] [omni.core] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-13 19:26:17 [2,215ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-13 19:26:17 [2,215ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-13 19:26:19 [4,216ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-13 19:26:19 [4,219ms] [Info] [omni.core] [12668] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-13 19:26:19 [4,220ms] [Info] [carb.launcher.plugin] [12668] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000021BBD63B0F0 for 'omni.delta-applier.app.exe'. 2022-11-13 19:26:19 [4,220ms] [Info] [carb.launcher.plugin] [12668] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 18276. 2022-11-13 19:26:19 [4,220ms] [Info] [carb.launcher.plugin] [12668] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-13 19:26:19 [4,264ms] [Info] [carb.launcher.plugin] [12668] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 20868 to the job 00000000000003BC. 2022-11-13 19:26:19 [4,265ms] [Info] [carb.launcher.plugin] [20064] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 20868. 2022-11-13 19:26:19 [4,267ms] [Info] [carb.launcher.plugin] [20380] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 20868. 2022-11-13 19:26:19 [4,267ms] [Info] [carb.launcher.plugin] [12668] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 20868 {process = 0000021BBD63B0F0} 2022-11-13 19:26:19 [4,327ms] [Info] [omni.server] [9392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-13 19:26:19 [4,772ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-13 19:26:19 [4,793ms] [Error] [omni.core] [1408] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 13:26:19,789 - system_log - INFO - connected 2022-11-13 19:26:19 [4,802ms] [Error] [omni.core] [1408] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-13 23:48:00 [15,710,118ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:kill():125: Killing child server process omni-lft-service\omni-lft-service.exe 2022-11-13 23:48:00 [15,710,531ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:kill():274: killing the child process 20800 {exitCode = 137, flags = 0x00000003, timeout = 5000} 2022-11-13 23:48:01 [15,710,652ms] [Info] [carb.launcher.plugin] [2712] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-13 23:48:01 [15,710,652ms] [Info] [carb.launcher.plugin] [1408] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-13 23:48:01 [15,710,652ms] [Info] [carb.launcher.plugin] [2712] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 20800, bytes = -1} 2022-11-13 23:48:01 [15,710,652ms] [Info] [carb.launcher.plugin] [1408] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 20800, bytes = -1} 2022-11-13 23:48:01 [15,710,653ms] [Info] [carb.launcher.plugin] [2712] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 20800. 2022-11-13 23:48:01 [15,710,653ms] [Info] [carb.launcher.plugin] [1408] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 20800. 2022-11-13 23:48:01 [15,710,667ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:kill():127: Waiting for child server process omni-lft-service\omni-lft-service.exe to exit 2022-11-13 23:48:01 [15,710,668ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():201: waiting for the process 0000021BBD4EC2F0 (20800) to exit {timeout = 18446744073709551615} 2022-11-13 23:48:01 [15,710,668ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():206: the process has already exited with code 137. 2022-11-13 23:48:01 [15,710,668ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():194: destroying the process object 0000021BBD4EC2F0 {pid = 20800} 2022-11-13 23:48:01 [15,710,668ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():196: done destroying the process object 0000021BBD4EC2F0 {pid = 20800} 2022-11-13 23:48:01 [15,710,669ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 0000021BBD7A12E0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-13 23:48:01 [15,710,672ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 18276. 2022-11-13 23:48:01 [15,710,672ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-13 23:48:01 [15,710,854ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 7432 to the job 00000000000003BC. 2022-11-13 23:48:01 [15,710,858ms] [Info] [carb.launcher.plugin] [19592] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 7432. 2022-11-13 23:48:01 [15,710,862ms] [Info] [carb.launcher.plugin] [18888] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 7432. 2022-11-13 23:48:01 [15,710,862ms] [Info] [carb.launcher.plugin] [15980] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 7432 {process = 0000021BBD7A12E0} 2022-11-13 23:48:01 [15,710,863ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-13 23:48:01 [15,710,863ms] [Info] [omni.core] [15980] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-13 23:48:05 [15,715,207ms] [Error] [omni.core] [18888] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-13 23:48:06 [15,716,342ms] [Error] [omni.core] [18888] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 17:48:06,723 - system_log - INFO - reconnecting ... 2022-11-13 23:48:08 [15,718,519ms] [Error] [omni.core] [18888] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 17:48:08,900 - system_log - INFO - connected 2022-11-13 23:48:09 [15,718,652ms] [Error] [omni.core] [18888] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-13 23:50:38 [0ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-13 23:50:38 [8ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-13 23:50:38 [19ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-13 23:50:38 [27ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-13 23:50:38 [34ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-13 23:50:38 [42ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-13 23:50:38 [50ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-13 23:50:38 [61ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-13 23:50:38 [71ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-13 23:50:38 [80ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-13 23:50:38 [93ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-13 23:50:38 [102ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-13 23:50:39 [108ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-13 23:50:39 [117ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-13 23:50:39 [124ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-13 23:50:39 [135ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-13 23:50:39 [138ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-13 23:50:39 [138ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-13 23:50:39 [138ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-13 23:50:39 [138ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-13 23:50:39 [138ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-13 23:50:39 [140ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-13 23:50:39 [141ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-13 23:50:39 [142ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-13 23:50:39 [142ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-13 23:50:39 [142ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-13 23:50:39 [142ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-13 23:50:39 [155ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-13 23:50:39 [157ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-13 23:50:39 [159ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-13 23:50:39 [159ms] [Info] [carb.launcher.plugin] [4132] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002449EC94480 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-13 23:50:39 [159ms] [Info] [carb.launcher.plugin] [4132] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 21864. 2022-11-13 23:50:39 [159ms] [Info] [carb.launcher.plugin] [4132] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-13 23:50:39 [160ms] [Info] [carb.launcher.plugin] [4132] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-13 23:50:39 [168ms] [Info] [carb.launcher.plugin] [4132] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 1192 to the job 00000000000003B0. 2022-11-13 23:50:39 [168ms] [Info] [carb.launcher.plugin] [22788] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 1192. 2022-11-13 23:50:39 [169ms] [Info] [carb.launcher.plugin] [5996] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 1192. 2022-11-13 23:50:39 [169ms] [Info] [carb.launcher.plugin] [4132] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 1192 {process = 000002449EC94480} 2022-11-13 23:50:39 [169ms] [Info] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-13 23:50:39 [169ms] [Info] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-13 23:50:39 [737ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-13 23:50:39 [908ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 17:50:39,799 - system_log - INFO - reconnecting ... 2022-11-13 23:50:41 [2,175ms] [Info] [omni.core] [3232] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-13 23:50:41 [2,175ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-13 23:50:41 [2,175ms] [Info] [omni.core] [3232] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-13 23:50:41 [2,230ms] [Info] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-13 23:50:41 [2,231ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-13 23:50:41 [2,236ms] [Info] [omni.core] [3232] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-13 23:50:41 [2,266ms] [Warning] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-13 23:50:41 [2,266ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-13 23:50:41 [2,281ms] [Warning] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-13 23:50:41 [2,282ms] [Info] [carb] [4132] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-13 23:50:41 [2,285ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-13 23:50:41 [2,287ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-13 23:50:41 [2,287ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-13 23:50:41 [2,287ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-13 23:50:41 [2,287ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-13 23:50:41 [2,287ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-13 23:50:41 [2,287ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-13 23:50:41 [2,287ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-13 23:50:41 [2,287ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-13 23:50:41 [2,288ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-13 23:50:41 [2,288ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-13 23:50:41 [2,288ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-13 23:50:41 [2,288ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-13 23:50:41 [2,288ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-13 23:50:41 [2,289ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-13 23:50:41 [2,289ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-13 23:50:41 [2,289ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-13 23:50:41 [2,289ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-13 23:50:41 [2,289ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-13 23:50:41 [2,290ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-13 23:50:41 [2,290ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-13 23:50:41 [2,291ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-13 23:50:41 [2,291ms] [Error] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-13 23:50:41 [2,291ms] [Info] [omni.meta-upgrade] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-13 23:50:41 [2,294ms] [Info] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-13 23:50:41 [2,301ms] [Info] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-13 23:50:41 [2,301ms] [Error] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-13 23:50:41 [2,304ms] [Info] [omni.core] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-13 23:50:41 [2,305ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-13 23:50:41 [2,305ms] [Info] [omni.core] [14384] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-13 23:50:43 [4,305ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-13 23:50:43 [4,314ms] [Info] [omni.core] [3952] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-13 23:50:43 [4,314ms] [Info] [carb.launcher.plugin] [3952] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000002449ED58430 for 'omni.delta-applier.app.exe'. 2022-11-13 23:50:43 [4,314ms] [Info] [carb.launcher.plugin] [3952] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 21864. 2022-11-13 23:50:43 [4,314ms] [Info] [carb.launcher.plugin] [3952] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-13 23:50:43 [4,359ms] [Info] [carb.launcher.plugin] [3952] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 15972 to the job 00000000000003B0. 2022-11-13 23:50:43 [4,360ms] [Info] [carb.launcher.plugin] [14388] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 15972. 2022-11-13 23:50:43 [4,360ms] [Info] [carb.launcher.plugin] [7532] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 15972. 2022-11-13 23:50:43 [4,360ms] [Info] [carb.launcher.plugin] [3952] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 15972 {process = 000002449ED58430} 2022-11-13 23:50:43 [4,403ms] [Info] [omni.server] [4132] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-13 23:50:43 [4,458ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 17:50:43,349 - system_log - INFO - connected 2022-11-13 23:50:43 [4,466ms] [Error] [omni.core] [5996] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-13 23:50:43 [4,865ms] [Info] [omni.core] [1688] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-14 00:38:35 [0ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-14 00:38:35 [3ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-14 00:38:35 [6ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-14 00:38:35 [8ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-14 00:38:35 [10ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-14 00:38:35 [11ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-14 00:38:35 [13ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-14 00:38:35 [15ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-14 00:38:35 [17ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-14 00:38:35 [18ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-14 00:38:35 [20ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-14 00:38:35 [22ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-14 00:38:35 [23ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-14 00:38:35 [25ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-14 00:38:35 [27ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-14 00:38:35 [28ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-14 00:38:35 [32ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-14 00:38:35 [32ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-14 00:38:35 [32ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-14 00:38:35 [32ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-14 00:38:35 [32ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-14 00:38:35 [35ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-14 00:38:35 [35ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-14 00:38:35 [35ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-14 00:38:35 [36ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-14 00:38:35 [36ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-14 00:38:35 [36ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-14 00:38:35 [36ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-14 00:38:35 [36ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-14 00:38:35 [36ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-14 00:38:35 [37ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-14 00:38:35 [37ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-14 00:38:35 [37ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-14 00:38:35 [54ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-14 00:38:35 [56ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-14 00:38:35 [59ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-14 00:38:35 [59ms] [Info] [carb.launcher.plugin] [22780] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001ABDC657CD0 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-14 00:38:35 [60ms] [Info] [carb.launcher.plugin] [22780] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 16864. 2022-11-14 00:38:35 [60ms] [Info] [carb.launcher.plugin] [22780] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-14 00:38:35 [60ms] [Info] [carb.launcher.plugin] [22780] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-14 00:38:35 [70ms] [Info] [carb.launcher.plugin] [22780] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 14988 to the job 00000000000003B4. 2022-11-14 00:38:35 [71ms] [Info] [carb.launcher.plugin] [15180] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 14988. 2022-11-14 00:38:35 [71ms] [Info] [carb.launcher.plugin] [22780] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 14988 {process = 000001ABDC657CD0} 2022-11-14 00:38:35 [71ms] [Info] [carb.launcher.plugin] [8104] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 14988. 2022-11-14 00:38:35 [71ms] [Info] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-14 00:38:35 [71ms] [Info] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-14 00:38:36 [829ms] [Error] [omni.core] [8104] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-14 00:38:36 [995ms] [Error] [omni.core] [8104] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 18:38:36,455 - system_log - INFO - reconnecting ... 2022-11-14 00:38:37 [2,077ms] [Info] [omni.core] [22144] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-14 00:38:37 [2,078ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-14 00:38:37 [2,078ms] [Info] [omni.core] [22144] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-14 00:38:37 [2,122ms] [Info] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-14 00:38:37 [2,122ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-14 00:38:37 [2,130ms] [Info] [omni.core] [22144] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-14 00:38:37 [2,162ms] [Warning] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-14 00:38:37 [2,162ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-14 00:38:37 [2,182ms] [Warning] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-14 00:38:37 [2,182ms] [Info] [carb] [22780] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-14 00:38:37 [2,187ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-14 00:38:37 [2,189ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-14 00:38:37 [2,189ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-14 00:38:37 [2,189ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-14 00:38:37 [2,189ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-14 00:38:37 [2,190ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-14 00:38:37 [2,190ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-14 00:38:37 [2,190ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-14 00:38:37 [2,190ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-14 00:38:37 [2,190ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-14 00:38:37 [2,190ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-14 00:38:37 [2,190ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-14 00:38:37 [2,191ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-14 00:38:37 [2,191ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-14 00:38:37 [2,191ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-14 00:38:37 [2,192ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-14 00:38:37 [2,192ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-14 00:38:37 [2,193ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-14 00:38:37 [2,193ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-14 00:38:37 [2,193ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-14 00:38:37 [2,195ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-14 00:38:37 [2,195ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-14 00:38:37 [2,195ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-14 00:38:37 [2,195ms] [Error] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-14 00:38:37 [2,195ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-14 00:38:37 [2,195ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-14 00:38:37 [2,196ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-14 00:38:37 [2,196ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-14 00:38:37 [2,196ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-14 00:38:37 [2,196ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-14 00:38:37 [2,196ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-14 00:38:37 [2,196ms] [Info] [omni.meta-upgrade] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-14 00:38:37 [2,199ms] [Info] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-14 00:38:37 [2,209ms] [Info] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-14 00:38:37 [2,209ms] [Error] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-14 00:38:37 [2,212ms] [Info] [omni.core] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-14 00:38:37 [2,214ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-14 00:38:37 [2,214ms] [Info] [omni.core] [12656] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-14 00:38:39 [4,214ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-14 00:38:39 [4,220ms] [Info] [omni.core] [13008] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-14 00:38:39 [4,220ms] [Info] [carb.launcher.plugin] [13008] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001ABDC8511F0 for 'omni.delta-applier.app.exe'. 2022-11-14 00:38:39 [4,220ms] [Info] [carb.launcher.plugin] [13008] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 16864. 2022-11-14 00:38:39 [4,220ms] [Info] [carb.launcher.plugin] [13008] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-14 00:38:39 [4,230ms] [Info] [carb.launcher.plugin] [13008] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 17216 to the job 00000000000003B4. 2022-11-14 00:38:39 [4,232ms] [Info] [carb.launcher.plugin] [7888] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 17216. 2022-11-14 00:38:39 [4,233ms] [Info] [carb.launcher.plugin] [13008] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 17216 {process = 000001ABDC8511F0} 2022-11-14 00:38:39 [4,233ms] [Info] [carb.launcher.plugin] [14184] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 17216. 2022-11-14 00:38:39 [4,286ms] [Info] [omni.server] [22780] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-14 00:38:40 [4,548ms] [Error] [omni.core] [8104] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-13 18:38:40,009 - system_log - INFO - connected 2022-11-14 00:38:40 [4,557ms] [Error] [omni.core] [8104] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-14 00:38:40 [4,739ms] [Info] [omni.core] [12656] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-14 14:23:40 [0ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-14 14:23:40 [2ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-14 14:23:40 [5ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-14 14:23:40 [7ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventlogger (interfaces: [omni::server::IEventLogger v1.0]) (impl: omni.eventlogger) 2022-11-14 14:23:40 [8ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-14 14:23:40 [9ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-14 14:23:40 [11ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.messaging (interfaces: [omni::server::IMessaging v1.0]) (impl: omni.messaging) 2022-11-14 14:23:40 [13ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-14 14:23:40 [16ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-14 14:23:40 [17ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-14 14:23:40 [20ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-14 14:23:40 [22ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-14 14:23:40 [23ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-14 14:23:40 [25ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.verifier (interfaces: [omni::server::IVerifier v1.1]) (impl: omni.verifier) 2022-11-14 14:23:40 [27ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-14 14:23:40 [29ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:registerPlugin():351: Registered plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-14 14:23:40 [33ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.signalhandler (interfaces: [omni::server::ISignalHandler v2.0]) (impl: omni.signalhandler) 2022-11-14 14:23:40 [33ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.wakeupthread (interfaces: [omni::server::IWakeupThread v1.0]) (impl: omni.wakeupthread) 2022-11-14 14:23:40 [33ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.eventsystem (interfaces: [omni::server::IEventSystem v1.0]) (impl: omni.eventsystem) 2022-11-14 14:23:40 [33ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.server (interfaces: [omni::server::IDeltaContentServer v1.0],[omni::server::IServer v1.1]) (impl: omni.server) 2022-11-14 14:23:40 [33ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.tasking.plugin (interfaces: [carb::tasking::ITasking v1.6],[carb::tasking::IThreadPool v1.0]) (impl: carb.tasking.plugin) 2022-11-14 14:23:40 [37ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():158: Launching C++ Omniverse API Server version (1.0.4ed2a56d) API version(1.20) 2022-11-14 14:23:40 [37ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:create():159: Build from commit 4ed2a56d on Tue Jul 12 06:17:40 2022 -0700 2022-11-14 14:23:40 [37ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():97: Starting up Omniverse Server. 2022-11-14 14:23:40 [38ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():71: ============================================================================== 2022-11-14 14:23:40 [38ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():72: Default Data Directory: C:\Users\Enoc\AppData\Local\ov\data\server 2022-11-14 14:23:40 [38ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():73: Default Log Directory : C:\Users\Enoc\AppData\Local\ov\cache\server 2022-11-14 14:23:40 [38ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\globals.cpp:initDefaultDirs():74: ============================================================================== 2022-11-14 14:23:40 [38ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:loadSettings():617: Setting Log directory to: C:\Users\Enoc\.nvidia-omniverse\logs\Nucleus 2022-11-14 14:23:40 [38ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:dumpResolvedConfig():46: Loaded settings: 2022-11-14 14:23:40 [39ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\resolvedconfig.h:operator ()():42: { "log": { "level": "Info", "includeTimeStamp": true, "file": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus/omni.server.app.log", "fileAppend": true, "includeFunctionName": true, "includeLineNumber": true, "includeThreadId": true, "includeSource": true, "includeFilename": true, "setElapsedTimeUnits": "milliseconds", "outputStream": "stderr", "sources": { "omni.server.API_CLIENT": { "enabled": false }, "omni.server.OMNI_OBJECTS": { "enabled": false }, "omni.server.API_SERVER": { "enabled": false }, "omni.server.DELTA_CONTENT": { "enabled": false }, "omni.server.SHUTDOWN": { "enabled": false }, "omni.server.DBCONTENT": { "enabled": false }, "omni.server.FRAMING": { "enabled": false }, "omni.server.EVENT_SYSTEM": { "enabled": false }, "omni.server.CONNECTIONS": { "enabled": false } }, "enabled": true, "async": false, "fileFlushLevel": "verbose", "flushStandardStreamOutput": false, "enableStandardStreamOutput": true, "enableDebugConsoleOutput": true, "processGroupId": 0, "enableColorOutput": true, "includeChannel": true, "includeProcessId": false, "detail": false, "fullDetail": false, "outputStreamLevel": "verbose", "debugConsoleLevel": "verbose", "fileLogLevel": "verbose" }, "pluginsLoaded": [ "carb.dictionary*.plugin", "carb.settings.plugin", "carb.launcher.plugin", "carb.tasking.plugin", "carb.crashreporter-breakpad.plugin", "omni.metrics-prometheus", "omni.signalhandler", "omni.wakeupthread", "omni.eventsystem", "omni.keyvaluedatabase.memdb", "omni.keyvaluedatabase.leveldb", "omni.server", "omni.websocketslib", "omni.resolver", "omni.core", "carb.omnitrace.plugin", "omni.objects", "omni.meta-upgrade", "omni.verifier", "omni.messaging-redis", "omni.eventlogger" ], "pluginSearchPaths": [ ".", "." ], "omni.common.settings": { "env.var.prefix": "OMNI_" }, "omni.server.app": {}, "crashreporter": { "enabled": "true", "dumpDir": ".", "url": "https://services.nvidia.com/submit", "product": "OmniverseNucleus", "log": "true", "version": "113.27+master.gitlab.21002.4ed2a56d", "alwaysUpload": false, "data": { "buildVersion": "113.27.0", "buildNumber": "21002", "buildHash": "4ed2a56d", "buildBranch": "master", "buildCi": "gitlab", "buildMajor": "113", "buildMr": "0", "buildMinor": "27", "buildPatch": "0" } }, "privacy": { "performance": "false" }, "plugins": { "omni.websocketslib": { "tracing": false, "defaults": { "http_max_header_length": 61440, "tcp_keepalive_probes": 2, "tcp_timeout_seconds": 10, "tcp_keepalive_time": 10, "tcp_keepalive_interval": 2 } }, "omni.meta-upgrade": { "enabled": "true", "repair": { "enabled": "true", "only_after_upgrade": "true" }, "exit_on_any_failure": false, "interactive": false, "report_progress_every": 1000, "content_resolver": { "resolver": "omniverse_resolver_file", "options": { "async": true, "root": "" } }, "remove_deduplicated_content": true, "convertors": { "meta": { "dry_run_since_version": -1 } } }, "omni.delta-applier": { "ports": { "server_port": 3001 } }, "carb.tasking.plugin": { "fiberCount": 4095, "threadCount": "4", "resetFiberStack": true, "stuckCheckSeconds": 1, "debugTaskBacktrace": false, "debugWaitingTasks": false, "debugLocks": false }, "omni.server": { "auth": { "connection_id_salt": "7b6a5f4e0a1b2c3d", "jwt_rs256_public_key": "-----BEGIN PUBLIC KEY-----\nMFwwDQYJKoZIhvcNAQEBBQADSwAwSAJBAJFEw8/EqME3ZB1dGk/fvIP6UTzrWA7d\ny3dLlSYkTI0IO7rhia55RVsuxVLuQ4QO1jsC6YF/jw8hqMdyXQkCetUCAwEAAQ==\n-----END PUBLIC KEY-----" }, "notifications": {}, "master_password": "omniverse", "discovery": { "enabled": "true", "deployment_string": "{ \"reg\": [ { \"name\": \"external\", \"transport\": { \"type\": \"connlib\", \"params\": { \"url\": \"ws://127.0.0.1:3009\" } } } ] }", "host": "localhost", "token": "test", "port_based_default_port": 3333 }, "omniobjects.cache": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "test_token_prefix": "", "api_logging": { "enable": "false", "source_base_name": "api-server", "enable_legacy_system": "1", "source_instance_name": "", "tsv_outputs": [ { "omit_columns": {}, "files": [ "eventlog.tsv" ], "column_order": [ "source", "time", "id", "type", "requestname", "status", "reqid", "username", "connectionid", "clientip", "uri", "eventsize", "optionalinfo", "branch", "checkpoint", "multiplepath" ], "omit_unknown_columns": true, "print_header_on_new_field": true } ], "event_buffer_max_size_bytes": 1048576, "file_settings": [ { "filename": "eventlog.tsv", "flush_frequency": 1 } ], "event_buffer_min_size_bytes": 1024, "event_buffer_try_shrink_interval_sec": 10, "omit_event_types": {}, "json_outputs": {} }, "auth_service_client": { "enabled": true, "override_service_address": "", "deployment_lookup": "internal" }, "home_folder_default_acls": { "owner": "rwa", "rest": { "users": "", "gm": "rwa" } }, "metric_period": 10.0, "token_expire_time": 86400, "auto_create_users": true, "delta_content_bw_estimate": 0.5, "metrics": { "request": { "duration": { "buckets": [ 100, 250, 500, 750, 1000, 2500, 5000, 7500, 10000.0, 50000.0, 100000.0, 1000000.0 ] } } }, "content_flush_enabled": true, "content_flush_time_sec": 10, "removed_content_pending_time_sec": 5, "crash_record_recovery": true, "file_system_table": true, "run": { "versioning": "true" }, "disable_passwords": false, "password_recovery": true, "admin_folders": [ "/Users/omniverse/", "/Users/deeptag_service/", "/Users/search_service/", "/Users/tags_service/", "/Users/thumbnails_service/", "/Users/index/", "/.system/" ], "content_type": "", "file_and_username_filter_exclude_regex": "", "concurrent_mount_commands": true, "mount_management_requires_admin": true, "delta_manager": { "delta_apply_throttle_ms": 500, "num_retries_until_ignored": 10, "delta_apply_limit_mb": 128, "ping_interval_ms": 1000, "ping_interval_on_startup_ms": 100, "ignorelist_retry_delay_ms": 5000, "delta_apply_timeout_ms": 5000, "bw_estimate_bps": 256, "ping_timeout_ms": 1000, "reconnect_timeout_s": 20 }, "metacache_flush_count": 1000, "record_integrity_check": false, "list_batch_size_limit": 100, "max_full_path_length": "16384", "metadata": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "meta.1.1", "delete_on_startup": "false" } }, "omniobjects": { "plugin": "omni.keyvaluedatabase.leveldb", "unpack_object_buffer_size": 33554432, "max_objects_in_cache": 1024, "options": { "async": true, "root": "", "subdir": "omniobjects.1.0", "delete_on_startup": "false" }, "lft_multi_content_threshold": 0, "max_content_mem_cache_size": 104857600, "lft_read_timeout_seconds": 3600, "ext_value_min_size": 262144, "mem_vs_file_threshold": 262144, "content_mem_limit": 268435456, "max_content_file_cache_size": 1048576000 }, "omniobjects.values": { "resolver_kind": "omniverse_resolver_file", "resolver_options": { "async": true, "root": "" } }, "max_path_piece_length": "255", "default_branch_name": "default", "non_utf8_paths_allowed": "false", "usergroups": { "plugin": "omni.keyvaluedatabase.leveldb", "options": { "async": true, "root": "", "subdir": "usergroups.1.0", "delete_on_startup": "false" } }, "lft_content_expiration_time": "600", "allowed_users_legacy": {}, "allowed_users": {}, "default_s3_proxy_cache": "", "endpoints": { "api": [ { "interface": "0.0.0.0", "secure": false, "port": "3009", "lft_address": "http://*:3030" } ], "service": [ { "interface": "127.0.0.1", "secure": false, "port": "3006" } ], "lft": [ { "interface": "127.0.0.1", "secure": false, "port": "3007" } ] }, "dirs": { "content_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "usergroups_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "meta_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "omniobjects_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "log_dir": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus", "metric_dir": "C:\\Users\\Enoc\\AppData\\Local\\ov\\data\\server", "record_dir": "" }, "lft": { "launch": "true", "check_alive_interval": 10, "threshold": "65536" }, "content_resolver": { "delete_on_startup": "false", "resolver": "omniverse_resolver_composite", "options": { "elem_size_max": 1048576, "persistent_kind": "omniverse_resolver_file", "number_elems_high": 120000, "number_elems_low": 100000, "temporal_kind": "omniverse_resolver_memory", "total_size_high": 6442450944, "total_size_low": 4294967296, "temporal_options": {}, "persistent_options": { "async": true, "root": "" } } }, "mounts": { "default_mounts": [ { "path": "/NVIDIA", "resolver": "omniverse_resolver_s3", "options": "{\"timeout\": 600, \"host\":\"dcb18d6mfegct.cloudfront.net\",\"service\":\"s3\",\"secure\":false,\"redirection\":\"http://dcb18d6mfegct.cloudfront.net/\"}", "override": true } ], "allowed_mount_resolvers": [ "omniverse_resolver_file", "omniverse_resolver_s3" ], "allowed_file_resolver_roots": {} }, "default_folders": [ [ "/", { "users": "r", "gm": "rwa" } ], [ "/Users/", { "users": "r", "gm": "rwa" } ], [ "/Projects/", { "users": "rw", "gm": "rwa" } ], [ "/Library/", { "users": "rw", "gm": "rwa" } ] ], "peer_messaging": { "enable": "false", "exit_on_connection_failure": "false", "channel": "omni_server_messages", "application_name": "Nucleus API", "payloads": { "create_event": { "name": "create" }, "list_event": { "name": "list" }, "servernotification_event": { "name": "servernotification" } } }, "quotas": { "list_subscriptions": "0", "read_subscriptions": "0" }, "default_acls": { "owner": "rwa", "rest": { "gm": "rwa" } }, "api_acls": { "create_asset": "w", "lock": "w", "read": "r", "create_object": "w", "create_directory": "w", "get_acl_v2": "r", "unlock": "w", "update": "w", "set_acl_v2": "a", "list": "r", "get_acl_resolved": "r", "delete": "a", "copy": "w", "rename": "a", "set_path_options": "w", "mount": "w", "unmount": "w", "checkpoint_version": "w", "get_checkpoints": "r" }, "store_crash_repro": true, "delta_content_hang_timeout": 2.0, "delta_content_ping_interval": 0.0 }, "omni.metrics-file": { "dumpPath": "metrics.csv", "flushTimeInSeconds": 5 }, "omni.resolver": { "directory": ".", "libraries": [ "omniverse_resolver_file", "omniverse_resolver_memory", "omniverse_resolver_composite", "omniverse_resolver_leveldb", "omniverse_resolver_s3" ] }, "omni.metrics-prometheus": { "model": "pull", "metricsPrefix": "omni_server_api", "pull": { "host": "127.0.0.1", "port": 3010, "endpoint": "/" }, "push": { "host": "", "port": 9091, "flushTimeInSeconds": 5 }, "predefined_labels": { "omni_instance": "" } }, "omni.messaging-redis": { "host": "kube-msk-redis.nvidia.com", "reconnect_interval_ms": 1000, "port": "6379", "password": "yBGfkZ0iRT", "max_reconnects": 5, "timeout_ms": 500 } }, "APILOGGING": 1, "LFT": { "INTERFACE": "0.0.0.0" }, "LOG": { "DIR": "C:\\Users\\Enoc\\.nvidia-omniverse\\logs\\Nucleus" }, "NUCLEUS": { "SERVER": { "INTERFACE": "0.0.0.0" } }, "S3": { "RESOLVER": { "CACHE": "" } } } 2022-11-14 14:23:40 [39ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\apiservercarblogging.cpp:omniToggleLogChannel():96: Unknown channel name benchmark 2022-11-14 14:23:40 [39ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.websocketslib (interfaces: [omni::server::IWebSockets v1.1]) (impl: omni.websocketslib) 2022-11-14 14:23:40 [57ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.metrics-prometheus (interfaces: [omni::server::IMetrics v1.1]) (impl: omni.metrics-prometheus) 2022-11-14 14:23:40 [59ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.core (interfaces: [omni::server::ICore v1.0],[omni::server::ICoreMetaContent v1.0],[omni::server::ICoreService v1.0],[omni::server::IServerFeatures v1.0]) (impl: omni.core) 2022-11-14 14:23:40 [61ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: carb.launcher.plugin (interfaces: [carb::launcher::ILauncher v1.2]) (impl: carb.launcher.plugin) 2022-11-14 14:23:40 [62ms] [Info] [carb.launcher.plugin] [13392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001694DF24330 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-14 14:23:40 [62ms] [Info] [carb.launcher.plugin] [13392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 23356. 2022-11-14 14:23:40 [62ms] [Info] [carb.launcher.plugin] [13392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-14 14:23:40 [62ms] [Info] [carb.launcher.plugin] [13392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():707: creating a job object to capture child processes. 2022-11-14 14:23:40 [75ms] [Info] [carb.launcher.plugin] [13392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 2636 to the job 00000000000003B8. 2022-11-14 14:23:40 [76ms] [Info] [carb.launcher.plugin] [12648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 2636. 2022-11-14 14:23:40 [76ms] [Info] [carb.launcher.plugin] [1552] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 2636. 2022-11-14 14:23:40 [76ms] [Info] [carb.launcher.plugin] [13392] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 2636 {process = 000001694DF24330} 2022-11-14 14:23:40 [76ms] [Info] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-14 14:23:40 [76ms] [Info] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-14 14:23:41 [970ms] [Error] [omni.core] [1552] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-14 14:23:42 [1,191ms] [Error] [omni.core] [1552] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-14 08:23:42,008 - system_log - INFO - reconnecting ... 2022-11-14 14:23:42 [2,083ms] [Info] [omni.core] [10328] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():307: discovery client: starting up 2022-11-14 14:23:42 [2,083ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.resolver (interfaces: [omni::IResolver v7.0]) (impl: omni.resolver) 2022-11-14 14:23:42 [2,084ms] [Info] [omni.core] [10328] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():350: discovery client: connecting to ws://localhost:3333 2022-11-14 14:23:42 [2,106ms] [Info] [omni.core] [10328] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\servicesclients.cpp:run():386: discovery client: registering 'external' with transport 'connlib' and transport parameters '{ "url": "ws://127.0.0.1:3009" }' 2022-11-14 14:23:42 [2,129ms] [Info] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:getOmniResolverInstance():85: Successfully created OmniResolver instance of type(omniverse_resolver_composite) 2022-11-14 14:23:42 [2,130ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.keyvaluedatabase.leveldb (interfaces: [omni::server::IKeyValueDatabase v1.0]) (impl: omni.keyvaluedatabase.leveldb) 2022-11-14 14:23:42 [2,172ms] [Warning] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IObjects v1.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-14 14:23:42 [2,172ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.objects (interfaces: [omni::server::IObjects v1.0]) (impl: omni.objects) 2022-11-14 14:23:43 [2,190ms] [Warning] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\frameworkimpl.cpp:acquireInterface():702: Acquiring non optional plugin interface which is not listed as dependency: [omni::server::IMetaUpgrade v2.0] (plugin: (null)), by client: omni.core. Add it to CARB_PLUGIN_IMPL_DEPS() macro of a client. 2022-11-14 14:23:43 [2,190ms] [Info] [carb] [13392] e:\w\bb644fa5b0c66122\source\framework\pluginimpl.cpp:initialize():406: Initializing plugin: omni.meta-upgrade (interfaces: [omni::server::IMetaUpgrade v2.0]) (impl: omni.meta-upgrade) 2022-11-14 14:23:43 [2,195ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:upgrade():2884: Meta database doesn't require upgrade 2022-11-14 14:23:43 [2,197ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1433: Fixing folder children counters .... 2022-11-14 14:23:43 [2,197ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1441: Processed 1 / 8 records 2022-11-14 14:23:43 [2,197ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default// 2022-11-14 14:23:43 [2,197ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Library/ 2022-11-14 14:23:43 [2,197ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//NVIDIA/ 2022-11-14 14:23:43 [2,198ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Projects/ 2022-11-14 14:23:43 [2,198ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/ 2022-11-14 14:23:43 [2,198ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enoc.soto/ 2022-11-14 14:23:43 [2,198ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/enocsoto/ 2022-11-14 14:23:43 [2,198ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1457: Error setting the key folderchildrencount://default//Users/omniverse/ 2022-11-14 14:23:43 [2,198ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1463: Checking for orphaned folder children counter records .... 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1474: Processed 1 / 8 records 2022-11-14 14:23:43 [2,199ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-14 14:23:43 [2,199ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1486: Failed to remove orphaned FCC 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixFolderChildrenCounters():1498: Fixing folder children counters done 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1281: Fixing content refcounts .... 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1288: Collecting content -> refcount mapping ... 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1292: Processed 1 / 8 records 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1327: Collecting content -> refcount mapping done 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1329: Setting refcount ... 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1353: Setting refcount done 2022-11-14 14:23:43 [2,199ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixContentRefcounts():1355: Checking content table for unused content 2022-11-14 14:23:43 [2,200ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1516: Repairing versioning data... 2022-11-14 14:23:43 [2,200ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1529: Reading meta records... 2022-11-14 14:23:43 [2,201ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enoc.soto/ default 0 2022-11-14 14:23:43 [2,201ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1549: Failed to get meta key /Users/enocsoto/ default 0 2022-11-14 14:23:43 [2,201ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1637: Checking branch lists... 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1682: Fixed branch lists count: 0 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1684: Check for orphaned branch lists... 2022-11-14 14:23:43 [2,203ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enoc.soto/ 2022-11-14 14:23:43 [2,203ms] [Error] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1698: Failed to delete orphaned branch list branchlist:///Users/enocsoto/ 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1705: Deleted 2 orphaned branch lists 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1707: Checking version reference counters... 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1762: Fixed version reference counters: 0 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1763: Deleted orphaned version reference counters 0 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1765: Checking checkpoint messages... 2022-11-14 14:23:43 [2,203ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():1826: Verifying checkpoints... 2022-11-14 14:23:43 [2,204ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2056: Deleted checkpoints without HEAD: 0 2022-11-14 14:23:43 [2,204ms] [Info] [omni.meta-upgrade] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.meta-upgrade\metaupgrade.cpp:fixVersioning():2057: Updated checkpoints ACLS: 0 2022-11-14 14:23:43 [2,207ms] [Info] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\coreimpl.cpp:initialize():578: Version: "113.27-4ed2a56d" 2022-11-14 14:23:43 [2,215ms] [Info] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:createMount():96: Successfully created resolver of type: omniverse_resolver_s3 2022-11-14 14:23:43 [2,215ms] [Error] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\mounts.cpp:load():328: Mount creation failed with status: ALREADY_EXISTS 2022-11-14 14:23:43 [2,218ms] [Info] [omni.core] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:processPendingDeltaManagerRecords():1437: Checking for any pending delta manager records. 2022-11-14 14:23:43 [2,219ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():126: waiting for Core to startup ... 2022-11-14 14:23:43 [2,219ms] [Info] [omni.core] [22860] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\requests\datastorebase.cpp:runContentRemove():350: Started content remove task 2022-11-14 14:23:45 [4,220ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():129: waiting for Core to startup (done) 2022-11-14 14:23:45 [4,223ms] [Info] [omni.core] [22188] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():597: Starting delta applier process. 2022-11-14 14:23:45 [4,223ms] [Info] [carb.launcher.plugin] [22188] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001694E0B3860 for 'omni.delta-applier.app.exe'. 2022-11-14 14:23:45 [4,223ms] [Info] [carb.launcher.plugin] [22188] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni.delta-applier.app.exe' from process 23356. 2022-11-14 14:23:45 [4,223ms] [Info] [carb.launcher.plugin] [22188] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni.delta-applier.app.exe"' 2022-11-14 14:23:45 [4,235ms] [Info] [carb.launcher.plugin] [22188] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 14156 to the job 00000000000003B8. 2022-11-14 14:23:45 [4,236ms] [Info] [carb.launcher.plugin] [13156] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 14156. 2022-11-14 14:23:45 [4,238ms] [Info] [carb.launcher.plugin] [22188] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 14156 {process = 000001694E0B3860} 2022-11-14 14:23:45 [4,238ms] [Info] [carb.launcher.plugin] [22340] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 14156. 2022-11-14 14:23:45 [4,296ms] [Info] [omni.server] [13392] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.server\omniverseserver.cpp:OmniverseServer():143: Omniverse C++ ApiServer server started. 2022-11-14 14:23:45 [4,742ms] [Info] [omni.core] [10328] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\omni.core\impl\deltamanager.cpp:pingTask():627: Successfully started delta applier process. 2022-11-14 14:23:45 [4,771ms] [Error] [omni.core] [1552] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-14 08:23:45,588 - system_log - INFO - connected 2022-11-14 14:23:45 [4,780ms] [Error] [omni.core] [1552] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-14 14:27:02 [197,673ms] [Error] [omni.core] [18936] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 14:27:03 [197,835ms] [Error] [omni.core] [1552] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 14:34:25 [640,529ms] [Error] [omni.core] [10328] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 14:34:32 [647,017ms] [Error] [omni.core] [22188] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 14:56:57 [1,997,744ms] [Info] [omni.core] [22860] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:kill():125: Killing child server process omni-lft-service\omni-lft-service.exe 2022-11-14 14:56:57 [1,997,744ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:kill():274: killing the child process 2636 {exitCode = 137, flags = 0x00000003, timeout = 5000} 2022-11-14 14:56:57 [1,998,136ms] [Info] [carb.launcher.plugin] [12648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-14 14:56:57 [1,998,136ms] [Info] [carb.launcher.plugin] [1552] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:read():255: read failed {bytesRead = 0, error = 109} 2022-11-14 14:56:57 [1,998,137ms] [Info] [carb.launcher.plugin] [12648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 2636, bytes = -1} 2022-11-14 14:56:57 [1,998,137ms] [Info] [carb.launcher.plugin] [1552] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():460: read failed. Exiting the read thread {pid = 2636, bytes = -1} 2022-11-14 14:56:57 [1,998,137ms] [Info] [carb.launcher.plugin] [12648] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stdout reader' for the process 2636. 2022-11-14 14:56:57 [1,998,137ms] [Info] [carb.launcher.plugin] [1552] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():481: done the read thread for 'launcher stderr reader' for the process 2636. 2022-11-14 14:56:57 [1,998,169ms] [Info] [omni.core] [22860] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:kill():127: Waiting for child server process omni-lft-service\omni-lft-service.exe to exit 2022-11-14 14:56:57 [1,998,169ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():201: waiting for the process 000001694DF24330 (2636) to exit {timeout = 18446744073709551615} 2022-11-14 14:56:57 [1,998,169ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:wait():206: the process has already exited with code 137. 2022-11-14 14:56:57 [1,998,169ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():194: destroying the process object 000001694DF24330 {pid = 2636} 2022-11-14 14:56:57 [1,998,170ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:~ProcessImpl():196: done destroying the process object 000001694DF24330 {pid = 2636} 2022-11-14 14:56:57 [1,998,176ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:ProcessImpl():177: created the process object 000001694E19A850 for 'omni-lft-service\omni-lft-service.exe'. 2022-11-14 14:56:57 [1,998,176ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():526: launching the process 'omni-lft-service\omni-lft-service.exe' from process 23356. 2022-11-14 14:56:57 [1,998,177ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():589: command = '"omni-lft-service\omni-lft-service.exe" "-lft-data" "\"C:\Users\Enoc\AppData\Local\ov\data\server\""' 2022-11-14 14:56:58 [1,998,442ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():817: adding the child process 8236 to the job 00000000000003B8. 2022-11-14 14:56:58 [1,998,443ms] [Info] [carb.launcher.plugin] [5308] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stdout reader' for the child process 8236. 2022-11-14 14:56:58 [1,998,444ms] [Info] [carb.launcher.plugin] [13880] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processcommon.cpp:readFromHandleThread():410: starting the read thread for 'launcher stderr reader' for the child process 8236. 2022-11-14 14:56:58 [1,998,444ms] [Info] [carb.launcher.plugin] [22860] e:\w\bb644fa5b0c66122\source\plugins\carb.launcher\processwin.cpp:launch():857: successfully launched the child process 8236 {process = 000001694E19A850} 2022-11-14 14:56:58 [1,998,444ms] [Info] [omni.core] [22860] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():110: Successfully launched the child server Process (C:\Users\Enoc\AppData\Local\ov\pkg\nucleus-workstation-2022.3.0\Nucleus/omni-lft-service\omni-lft-service.exe) 2022-11-14 14:56:58 [1,998,444ms] [Info] [omni.core] [22860] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:launch():111: Sleeping for 2 seconds to get the child server time to spin up 2022-11-14 14:57:03 [2,003,486ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:DATA_DIR: C:\Users\Enoc\AppData\Local\ov\data\serverBundled - using PyInstaller's runtime dir with resolvers 2022-11-14 14:57:04 [2,004,954ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-14 08:57:04,709 - system_log - INFO - reconnecting ... 2022-11-14 14:57:06 [2,007,035ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:2022-11-14 08:57:06,791 - system_log - INFO - connected 2022-11-14 14:57:06 [2,007,047ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Server started 2022-11-14 15:33:28 [4,188,548ms] [Error] [omni.core] [18936] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 15:33:28 [4,188,556ms] [Error] [omni.core] [10328] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 15:33:28 [4,188,577ms] [Error] [omni.core] [10328] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 15:33:28 [4,188,591ms] [Error] [omni.core] [10328] subscribelistrequests.cpp:subscribeList():68: Request internal error 2022-11-14 16:02:57 [5,957,894ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 16:02:57 [5,957,899ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 16:02:57 [5,957,904ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 16:02:57 [5,957,909ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 16:02:57 [5,957,914ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 16:02:57 [5,957,920ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info' 2022-11-14 16:02:57 [5,957,924ms] [Error] [omni.core] [13880] c:\gitlab-runner\builds\m8q7fhm4\0\omniverse\backend\api_server\source\plugins\common\childprocess.cpp:stderrReadCallback():31: From process omni-lft-service\omni-lft-service.exe:Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError Unhandled exception Traceback (most recent call last): File "lft\middlewares.py", line 99, in log_errors_middleware File "aiohttp\web_urldispatcher.py", line 197, in handler_wrapper File "lft\paths\download.py", line 58, in download_asset File "lft\paths\download.py", line 28, in download_asset_base File "lft\validation.py", line 38, in validate_path File "meta_client\client.py", line 221, in get_path_acl File "idl\connection\transport\omni.py", line 133, in call File "asyncio\queues.py", line 163, in get asyncio.exceptions.CancelledError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 435, in _handle_request File "aiohttp\web_app.py", line 504, in _handle File "aiohttp\web_middlewares.py", line 117, in impl File "lft\middlewares.py", line 73, in cors_middleware File "lft\middlewares.py", line 67, in cors_middleware File "lft\middlewares.py", line 129, in verbose_access_log_middleware File "lft\middlewares.py", line 79, in filesystem_error_middleware File "lft\middlewares.py", line 107, in log_errors_middleware aiohttp.web_exceptions.HTTPServiceUnavailable: Service Unavailable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 613, in finish_response File "aiohttp\web_response.py", line 421, in prepare File "aiohttp\web_response.py", line 764, in _start File "aiohttp\web_response.py", line 429, in _start File "aiohttp\web_response.py", line 502, in _write_headers File "aiohttp\http_writer.py", line 131, in write_headers File "aiohttp\http_writer.py", line 76, in _write ConnectionResetError: Cannot write to closing transport During handling of the above exception, another exception occurred: Traceback (most recent call last): File "aiohttp\web_protocol.py", line 514, in start File "aiohttp\web_protocol.py", line 440, in _handle_request File "aiohttp\web_protocol.py", line 616, in finish_response File "aiohttp\web_protocol.py", line 398, in log_access File "lft\server.py", line 617, in log AttributeError: 'NoneType' object has no attribute 'get_extra_info'