Slow startup time

Omniverse Developer Tools & Resources Samples & Examples
1

Hi!

I’m new to Omniverse in general.
I installed it in a 2xRTX 2080 Ti computer.

I’m running Omniverse Create using the following command:

./omni.create.singlegpu.sh --/renderer/activeGpu=1

However, the startup process is particularly slow, ranging from ~450 to ~600s.

Here’s the launch log:

Loading user config located at: '/home/rmclabs/.local/share/ov/data/Kit/Create.Next/2021.3/user.config.json'
[Info] [carb] Logging to file: /home/rmclabs/.nvidia-omniverse/logs/Kit/Create.Next/2021.3/kit_20210827_121215.log
[0.165s] [ext: omni.assets.plugins-0.0.0] startup
[0.167s] [ext: omni.kit.window.splash-0.0.0] startup
[0.199s] [ext: omni.kit.async_engine-0.0.0] startup
[0.213s] [ext: omni.kit.agent-0.1.0] startup
[0.216s] [ext: omni.kit.splash-0.2.1] startup
[0.227s] [ext: omni.kit.pipapi-0.0.0] startup
[0.234s] [ext: omni.usd.config-1.0.0] startup
[0.237s] [ext: omni.usd.libs-1.0.0] startup
[0.471s] [ext: omni.kit.pip_archive-0.0.0] startup
[0.478s] [ext: omni.stats-0.0.0] startup
[0.481s] [ext: omni.gpu_foundation-0.0.0] startup
[0.489s] [ext: omni.usd.schema.semantics-0.0.0] startup
[0.494s] [ext: omni.usd.schema.audio-0.0.0] startup
[0.498s] [ext: omni.hydra.iray-0.1.0] startup
[0.502s] [ext: omni.kit.loop-default-0.1.0] startup
[0.503s] [ext: omni.client-0.1.0] startup
[0.512s] [ext: omni.appwindow-1.0.0] startup
[0.536s] [ext: omni.kit.test-0.0.0] startup
[0.678s] [ext: omni.kit.renderer.core-0.0.0] startup

|---------------------------------------------------------------------------------------------|
| Driver Version: 465.19      | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 2080 Ti       |        |     | 11510   MB | 10de      | 0          |
|     |                                  |        |     |            | 1e07      | 8de1791a.. |
|---------------------------------------------------------------------------------------------|
| 1   | NVIDIA GeForce RTX 2080 Ti       | Yes    |     | 11510   MB | 10de      | 0          |
|     |                                  |        |     |            | 1e07      | f4b1a1e0.. |
|=============================================================================================|
| OS: Linux ventanas, Version: 5.8.0-50-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12009000 (1.20.9.0)
| Processor: AMD Ryzen Threadripper 1900X 8-Core Processor   | Cores: Unknown | Logical: 16
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 64257 | Free Memory: 28171
| Total Page/Swap (MB): 2047 | Free Page/Swap: 2047
|---------------------------------------------------------------------------------------------|
[2.301s] [ext: omni.ui-2.3.2] startup
[2.327s] [ext: omni.kit.mainwindow-0.0.0] startup
[2.332s] [ext: omni.kit.uiapp-0.0.0] startup
[2.333s] [ext: omni.usd.schema.physics-1.0.0] startup
[2.348s] [ext: omni.usd.schema.destruction-0.1.1] startup
[2.359s] [ext: omni.usd.schema.anim-0.0.0] startup
[2.383s] [ext: omni.timeline-1.0.2] startup
[2.387s] [ext: omni.hydra.scene_delegate-0.1.0] startup
[2.398s] [ext: carb.audio-0.1.0] startup
[2.401s] [ext: omni.kit.commands-0.0.0] startup
[2.408s] [ext: omni.usd-1.4.5] startup
[2.446s] [ext: omni.usd.fileformat.e57-0.1.5] startup
[2.448s] [ext: omni.usd.schema.physx-0.0.0] startup
[2.480s] [ext: omni.kit.window.script_editor-1.5.0] startup
[2.481s] [ext: omni.kit.window.usd_paths-1.0.3] startup
[2.494s] [ext: omni.kit.menu.utils-1.0.2] startup
[2.502s] [ext: omni.hydra.rtx-0.1.0] startup
[2.512s] [ext: omni.kit.usd_undo-0.1.0] startup
[2.516s] [ext: omni.kit.menu.create-1.0.1] startup
[2.520s] [ext: omni.kit.material.library-1.2.0] startup
[2.662s] [ext: omni.kit.window.drop_support-1.0.0] startup
[2.666s] [ext: omni.renderer-rtx-0.0.0] startup
[2.668s] [ext: omni.kit.context_menu-1.3.2] startup
[2.694s] [ext: omni.kit.search_core-1.0.0] startup
[2.699s] [ext: omni.kit.window.viewport-0.0.0] startup
[6.073s] [ext: omni.anim.skelJoint-102.2.0] startup
[6.551s] [ext: omni.kit.search.files-1.0.1] startup
[7.483s] [ext: omni.kit.viewport_widgets_manager-1.0.2] startup
[8.432s] [ext: omni.services.facilities.base-1.0.0] startup
[8.736s] [ext: omni.kit.collaboration.channel_manager-1.0.2] startup
[10.007s] [ext: omni.kit.notification_manager-1.0.0] startup
[11.861s] [ext: omni.services.transport.client.base-1.0.0] startup
[13.683s] [ext: omni.services.core-1.1.1] startup
[20.782s] [ext: omni.kit.collaboration.viewport.camera-1.0.1] startup
[22.481s] [ext: omni.services.client-0.2.0] startup
[30.301s] [ext: omni.services.transport.server.base-1.0.0] startup
[31.261s] [ext: omni.kit.widget.path_field-2.0.3] startup
[32.733s] [ext: omni.services.transport.client.http_async-1.0.0] startup
[53.026s] [ext: omni.services.transport.server.http-1.0.0] startup
[62.245s] [ext: omni.kit.window.popup_dialog-2.0.2] startup
[64.533s] [ext: omni.kit.widget.filebrowser-2.2.10] startup
[66.831s] [ext: omni.kit.widget.browser_bar-2.0.2] startup
[67.802s] [ext: omni.kit.widget.versioning-1.3.4] startup
[69.721s] [ext: omni.kit.thumbnails.images-0.1.0] startup
[71.148s] [ext: omni.kit.widget.zoombar-1.0.1] startup
[73.175s] [ext: omni.kit.widget.searchfield-1.0.4] startup
[74.149s] [ext: omni.kit.stage_templates-1.0.6] startup
[74.934s] [ext: omni.kit.window.filepicker-2.4.4] startup
[90.538s] [ext: omni.kit.browser.core-1.1.7] startup
[93.131s] [ext: omni.kit.window.file-1.3.3] startup
[98.714s] [ext: omni.kit.browser.folder.core-1.1.4] startup
[101.029s] [ext: omni.kit.renderer.capture-0.0.0] startup
[103.434s] [ext: omni.kit.window.content_browser-2.4.5] startup
[106.017s] [ext: omni.kit.browser.sky-1.0.7] startup
[109.814s] [ext: omni.kit.thumbnails.usd-0.5.0] startup
[115.787s] [ext: omni.kit.widget.settings-1.0.0] startup
[117.949s] [ext: omni.kit.widget.prompt-1.0.0] startup
[120.317s] [ext: omni.videoencoding-0.1.0] startup
[120.830s] [ext: omni.rtx.window.settings-0.6.0] startup
[121.621s] [ext: omni.kit.widget.imageview-1.0.0] startup
[123.027s] [ext: omni.kit.capture-0.4.6] startup
[124.454s] [ext: omni.iray.settings.core-0.6.2] startup
[125.272s] [ext: omni.kit.window.quicksearch-2.0.5] startup
[127.001s] [ext: omni.kit.widget.sliderbar-1.0.3] startup
[129.291s] [ext: omni.rtx.settings.core-0.5.4] startup
[132.684s] [ext: omni.kit.quicksearch.menu-0.8.2] startup
[134.623s] [ext: omni.kit.window.movie_maker-0.5.5] startup
[137.193s] [ext: omni.kit.window.status_bar-0.1.0] startup
[137.201s] [ext: omni.services.registry-1.0.0] startup
[145.582s] [ext: omni.kit.asset_converter-1.1.29] startup
[147.492s] [ext: omni.kit.widget.graph-1.1.4] startup
[149.024s] [ext: omni.kit.widget.timeline-102.1.2] startup
[151.046s] [ext: omni.anim.curve-102.1.4] startup
[154.447s] [ext: omni.kit.tool.asset_exporter-1.0.7] startup
[157.728s] [ext: omni.kit.window.extensions-1.0.2] startup
[160.816s] [ext: omni.kit.menu.file-1.0.3] startup
[163.308s] [ext: omni.kit.window.cursor-1.0.1] startup
[164.583s] [ext: omni.kit.window.console-0.1.0] startup
[164.587s] [ext: omni.kit.quicksearch.deeptag-0.8.1] startup
[167.752s] [ext: omni.kit.widget.live-0.1.0] startup
[167.765s] [ext: omni.kit.browser.sample-1.0.3] startup
[171.797s] [ext: omni.kit.window.property-1.6.2] startup
[175.230s] [ext: omni.kit.widget.stage-2.6.4] startup
[175.785s] [ext: omni.create.app.resources-0.1.0] startup
[175.785s] [ext: omni.kvdb-0.0.0] startup
[175.812s] [ext: omni.kit.property.usd-3.11.3] startup
[179.685s] [ext: omni.usdphysics-1.3.8] startup
[179.687s] [ext: omni.localcache-0.0.0] startup
[180.876s] [ext: omni.convexdecomposition-1.3.8] startup
[183.201s] [ext: omni.kit.property.light-1.0.4] startup
[185.285s] [ext: omni.kit.quicksearch.actions-0.8.5] startup
[187.468s] [ext: omni.flowusd-0.1.0] startup
[189.961s] [ext: omni.kit.tool.asset_importer-2.3.10] startup
[194.076s] [ext: omni.kit.primitive.mesh-1.0.0] startup
[196.444s] [ext: omni.physx-1.3.8-5.1] startup
[196.676s] [ext: omni.kit.tool.collect-2.0.3] startup
[200.227s] [ext: omni.kit.pointclouds-0.0.7] startup
[206.764s] [ext: omni.kit.quicksearch.settings-0.8.1] startup
[207.012s] [ext: omni.kit.quicksearch.commands-1.0.0] startup
[209.943s] [ext: omni.kit.quicksearch.material-0.8.3] startup
[212.388s] [ext: omni.physx.commands-1.3.8-5.1] startup
[213.646s] [ext: omni.debugdraw-0.1.0] startup
[214.977s] [ext: omni.kit.window.privacy-0.1.0] startup
[217.157s] [ext: omni.kit.quicksearch.hdri-0.8.4] startup
[221.486s] [ext: omni.kit.quicksearch.props-0.8.2] startup
[224.195s] [ext: omni.kit.window.about-1.0.0] startup
[226.978s] [ext: omni.command.usd-1.0.1] startup
[227.428s] [ext: omni.kit.window.preferences-1.1.3] startup
[228.299s] [ext: omni.physx.ui-1.3.8-5.1] startup
[229.813s] [ext: omni.kit.property.material-1.7.0] startup
[231.788s] [ext: omni.kit.window.toolbar-1.2.1] startup
[235.027s] [ext: omni.kit.browser.asset-1.0.5] startup
[237.313s] [ext: omni.kit.menu.edit-1.0.3] startup
[237.808s] [ext: omni.kit.widget.stage_icons-1.0.2] startup
[240.314s] [ext: omni.physx.demos-1.3.8-5.1] startup
[242.065s] [ext: omni.kit.property.physx-0.1.0] startup
[244.216s] [ext: omni.physx.tests-1.3.8-5.1] startup
[252.700s] [ext: omni.kit.selection-0.1.0] startup
[254.382s] [ext: omni.kit.window.provide_feedback-1.0.0] startup
[257.694s] [ext: omni.kit.window.stage-2.3.4] startup
[260.342s] [ext: omni.kit.profiler.window-1.3.1] startup
[264.788s] [ext: omni.physx.vehicle-1.3.8-5.1] startup
[266.597s] [ext: omni.physx.cct-1.3.8-5.1] startup
[271.136s] [ext: omni.kit.quicksearch.select-0.8.1] startup
[273.108s] [ext: omni.kit.stage_column.variant-1.0.2] startup
[276.167s] [ext: omni.kit.mesh.raycast-102.3.3] startup
[281.102s] [ext: omni.physx.zerogravity-1.3.8-5.1] startup
[285.215s] [ext: omni.physx.bundle-1.3.8-5.1] startup
[285.215s] [ext: omni.kit.widgets.custom-0.6.1] startup
[289.533s] [ext: omni.kit.widget.layers-1.5.8] startup
[293.667s] [ext: omni.kit.stage_column.payload-1.0.4] startup
[298.727s] [ext: omni.kit.window.title-1.1.0] startup
[303.500s] [ext: omni.graph.tools-1.0.0] startup
[307.455s] [ext: omni.kit.tool.paint-102.3.5] startup
[310.192s] [ext: omni.kit.property.layer-1.1.2] startup
[314.952s] [ext: omni.graph.core-1.0.2] startup
[314.959s] [ext: omni.kit.search.service-0.1.0] startup
[320.493s] [ext: omni.kit.hydra_texture-0.1.0] startup
[321.172s] [ext: omni.kit.graph.delegate.default-1.0.10] startup
[326.880s] [ext: omni.kit.tool.brush.scripting-102.1.2] startup
[330.849s] [ext: omni.kit.property.audio-1.0.5] startup
[333.417s] [ext: omni.graph-1.0.0] startup
[344.250s] [ext: omni.kit.property.camera-1.0.3] startup
[346.573s] [ext: omni.kit.widget.material_preview-1.0.2] startup
[351.478s] [ext: omni.kit.graph.editor.core-1.0.0] startup
[351.531s] [ext: omni.kit.thumbnails.mdl-1.0.6] startup
[354.696s] [ext: omni.kit.property.geometry-1.2.0] startup
[357.876s] [ext: omni.graph.expression-1.0.0] startup
2021-08-27 16:18:17 [362,145ms] [Warning] [omni.graph.core.plugin] Node type name 'Expression' is missing the unique namespace
[362.191s] [ext: omni.kit.tool.brush.scatter-102.3.4] startup
[369.619s] [ext: omni.kit.compatibility_checker-0.1.0] startup
[375.253s] [ext: omni.kit.window.material_graph-1.4.2] startup
[382.484s] [ext: omni.kit.browser.material-1.1.5] startup
[382.534s] [ext: omni.kit.property.transform-1.0.2] startup
[388.869s] [ext: omni.kit.tool.brush.attribute-102.0.0] startup
[402.815s] [ext: omni.kit.tool.brush.modify-102.3.3] startup
[403.181s] [ext: omni.kit.tool.brush.select-102.3.3] startup
[406.146s] [ext: omni.kit.quicklayout-1.0.1] startup
[410.747s] [ext: omni.kit.window.material-1.0.1] startup
[413.553s] [ext: omni.kit.property.bundle-1.2.4] startup
[420.038s] [ext: omni.kit.window.imageviewer-1.0.3] startup
[427.045s] [ext: omni.kit.telemetry-0.1.0] startup
[427.112s] [ext: omni.kit.tool.paint.bundle-102.3.6] startup
[427.112s] [ext: omni.create.app.setup-0.2.0] startup
[Warning] [omni.telemetry.transmitter] Couldn't acquire tokens interface and initialize default tokens.
Looking in indexes: https://pypi.org/simple, https://pypi.perflab.nvidia.com/simple/
WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x7f7739eb30d0>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/dssim-py/
WARNING: Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x7f7739eb3a10>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/dssim-py/
WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x7f7739eb3950>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/dssim-py/
WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x7f7739eb3550>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/dssim-py/
WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<pip._vendor.urllib3.connection.VerifiedHTTPSConnection object at 0x7f7739ec12d0>: Failed to establish a new connection: [Errno -2] Name or service not known')': /simple/dssim-py/
ERROR: Could not find a version that satisfies the requirement dssim-py (from versions: none)
ERROR: No matching distribution found for dssim-py
WARNING: You are using pip version 20.1.1; however, version 21.2.4 is available.
You should consider upgrading via the '/home/rmclabs/.local/share/ov/pkg/create-2021.3.2/kit/python/bin/python3 -m pip install --upgrade pip' command.
2021-08-27 16:19:39 [444,036ms] [Warning] [carb.python] [omni.kit.pipapi] 'dssim-py' failed to install.
2021-08-27 16:19:40 [444,445ms] [Warning] [omni.kit.ui] Failed to remove menu with path: Window/Material Preview. It doesn't exist.
[444.514s] [ext: omni.kit.window.stats-0.1.0] startup
[444.571s] [ext: omni.create-2021.3.2-rc.5] startup
[444.572s] app started
[450.457s] [ext: omni.kit.builtin.init] startup
[450.462s] [ext: omni.kit.builtin.menu] startup

Is this an expected behaviour? What can I do to improve performance?

Thanks!

2

Hello @pbcorrea1! I’ve notified the dev team about this post. Thanks for reaching out!

3

Hello @pbcorrea1, there is something very wrong with what you are seeing - Create can take a bit longer to start up the first time you run due to shader compilation, but generally 30s would be the the upper bound of what we’d expect to see.
Could you try sending us the more verbose log that Create writes? (You find it from the console - see the 2 rightmost little icons under the “Console” tab name).
Also, you could try attaching create to strace and see what it’s log says.

If neither of those show anything, we can look at some additional profiling/debugging steps
Thanks
Eoin

4

Trying to cover as many possibilities as we can…another option is to record a Kit Profile and send that to us. See kit docs.
Thanks
Eoin

5

Hello!

I’ve had the same experience trying to run the enterprise install of Create on my team’s RTX server. The hardware is crazy fast but create takes 2+ minutes to open - I have an (almost) similar launch log to the one shared in the original post. Though the hold up for me looks like it occurs much earlier

Files also occasionally take longer than expected to open - but sometimes the same file opens normally. (This might be a different issue)

Once launched and opened everything seems normal, but I’m left wondering what the hold up is to get running.

Looking at the log file it seems the bulk of the startup time (from 8s to 100s) is between discovering GPUs. I’ve attached my launch log from last week.

Idk if this is the verbose version or not, there was only one file in the log folder and it looks pretty similar to the command line output - let me know if there is any more helpful info I can provide.kit_20210902_100955.log (488.3 KB)

One last thing to note is that I’ve tried running with the renderer.multiGpu.enabled = true even though I’m pretty sure this is deprecated - I’ve noticed that it picks up all GPUs either way.

Thank you!

6

I have the same issue and the following errors:

image
image1117×148 21.5 KB

7

Thanks ruchirlives,
Any other info ? Just those two errors ? Does everything else run ok ? Can you provide more details ? Is this the latest Composer install, 2023.1.1 ?

8

Yes, it’s the latest 2023 install. There are also 15 warnings in the log. It takes around 8-10 mins to load on initial startup, then around 30 secs to restart. I also get lots of crashes and freezes within the app.

9

Please install the latest video drivers. Also go into Preferences and go to “Reset to Defaults” in blue right in the top left corner and let it reset the program.

1 Like