• Hardware Platform (Jetson / GPU) GPU (T4)
• DeepStream Version nvcr.io/nvidia/deepstream:6.1.1-devel
• NVIDIA GPU Driver Version (valid for GPU only) 515
• Issue Type( questions, new requirements, bugs) Question
I have setup a VM in GCP with an T4 and want to run the composer remotely with it. I’m using the image GCP Image “Debian 10 based Deep Learning VM with M98” which already has the NVidia driver, CUDA, docker-nvidia2 and the likes installed. To run deepstream, I’m using the docker image from NGC like so:
docker run --gpus all -it --rm --net=host --privileged -v /deepstream_samples:/home/leon_mueller/deepstream_samples -w /opt/nvidia/deepstream/deepstream-6.1 nvcr.io/nvidia/deepstream:6.1.1-devel
When I try to run the composer either with composer --enable-streaming websocket or composer --enable-streaming webrtc I can access the URLs, but the view stays blank after clicking the play button. This is the output of the composer, showing a couple errors related to GLFW.
root@ava-test-cuda:/opt/nvidia/deepstream/deepstream-6.1# composer --enable-streaming webrtc
Preparing files...
Done.
./kit/kit ./composer/composer-webrtc.kit --ext-folder composer --/plugins/carb.scripting-python.plugin/pythonPath=./registry/ --/exts/omni.ui/Window/enableDetach=false --allow-root --no-window
[Info] [carb] Logging to file: /root/.nvidia-omniverse/logs/Kit/composer-webrtc/2.0/kit_20221028_143232.log
root@ava-test-cuda:/opt/nvidia/deepstream/deepstream-6.1# 2022-10-28 14:32:33 [314ms] [Warning] [omni.ext.plugin] [ext: omni_kit] Extensions config 'extension.toml' doesn't exist '/tmp/.tmpNvXgRaphComposer/run/composer/omni_kit' or '/tmp/.tmpNvXgRaphComposer/run/composer/omni_kit/config'
[0.376s] [ext: omni.stats-0.0.0] startup
[0.387s] [ext: omni.gpu_foundation-0.0.0] startup
2022-10-28 14:32:33 [379ms] [Warning] [carb] FrameworkImpl::setDefaultPlugin(client: omni.gpu_foundation_factory.plugin, desc : [carb::graphics::Graphics v2.4], plugin : carb.graphics-vulkan.plugin) failed. Plugin selection is locked, because the interface was previously acquired by:
[0.400s] [ext: carb.windowing.plugins-1.0.0] startup
2022-10-28 14:32:33 [385ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:33 [385ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
[0.404s] [ext: omni.assets.plugins-0.0.0] startup
[0.406s] [ext: omni.kit.renderer.init-0.0.0] startup
|---------------------------------------------------------------------------------------------|
| Driver Version: 510.47.3 | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
| | | | | | Device-ID | UUID |
|---------------------------------------------------------------------------------------------|
| 0 | Tesla T4 | Yes: 0 | | 15606 MB | 10de | 0 |
| | | | | | 1eb8 | 67901482.. |
|=============================================================================================|
| OS: Linux ava-test-cuda, Version: 4.19.0-21-cloud-amd64
| Processor: Intel(R) Xeon(R) CPU @ 2.30GHz | Cores: Unknown | Logical: 4
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 15033 | Free Memory: 13641
| Total Page/Swap (MB): 0 | Free Page/Swap: 0
|---------------------------------------------------------------------------------------------|
2022-10-28 14:32:36 [3,298ms] [Error] [gpu.foundation.plugin] Failed opening shader cache version file: /root/.cache/ov/Kit/103.1/66b6689c/shadercache/release/version
2022-10-28 14:32:36 [3,298ms] [Error] [gpu.foundation.plugin] Failed to process shader cache version file
2022-10-28 14:32:36 [3,300ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:36 [3,300ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
2022-10-28 14:32:36 [3,300ms] [Error] [carb.glinterop.plugin] GLInteropContext::init: carb::windowing is not available
2022-10-28 14:32:36 [3,300ms] [Warning] [gpu.foundation.plugin] Realm: no OpenGL interop context.
[3.575s] [ext: omni.kit.pipapi-0.0.0] startup
[3.590s] [ext: omni.usd.config-1.0.0] startup
[3.592s] [ext: omni.usd.libs-1.0.0] startup
[3.748s] [ext: omni.kit.pip_archive-0.0.0] startup
[3.781s] [ext: omni.kit.loop-default-0.1.0] startup
[3.781s] [ext: omni.kit.async_engine-0.0.0] startup
[3.785s] [ext: omni.appwindow-1.0.0] startup
2022-10-28 14:32:36 [3,768ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:36 [3,768ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
[3.789s] [ext: omni.client-0.1.0] startup
[3.803s] [ext: omni.kit.test-0.0.0] startup
[4.019s] [ext: omni.kit.renderer.core-0.0.0] startup
2022-10-28 14:32:36 [4,006ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:36 [4,006ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
2022-10-28 14:32:36 [4,008ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:36 [4,008ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
2022-10-28 14:32:36 [4,009ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:36 [4,009ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
2022-10-28 14:32:36 [4,010ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:36 [4,010ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
[4.187s] [ext: omni.ui-2.7.9] startup
[4.238s] [ext: carb.audio-0.1.0] startup
[4.240s] [ext: omni.kit.mainwindow-0.0.0] startup
[4.246s] [ext: omni.uiaudio-1.0.0] startup
[4.250s] [ext: omni.kit.uiapp-0.0.0] startup
[4.250s] [ext: omni.usd.schema.physics-1.0.0] startup
[4.298s] [ext: omni.usd.schema.semantics-0.0.0] startup
[4.308s] [ext: omni.usd.schema.omnigraph-1.0.0] startup
[4.316s] [ext: omni.usd.schema.audio-0.0.0] startup
[4.322s] [ext: omni.usd.schema.anim-0.0.0] startup
[4.350s] [ext: omni.services.facilities.base-1.0.2] startup
[4.353s] [ext: omni.kit.commands-1.2.0] startup
[4.366s] [ext: omni.hydra.scene_delegate-0.1.0] startup
[4.373s] [ext: omni.timeline-1.0.2] startup
[4.377s] [ext: omni.kit.audiodeviceenum-1.0.0] startup
[4.381s] [ext: omni.services.core-1.2.0] startup
[4.671s] [ext: omni.usd-1.5.2] startup
2022-10-28 14:32:37 [4,657ms] [Warning] [omni.ext.plugin] [ext: omni.usd-1.5.2] '/tmp/.tmpNvXgRaphComposer/run/kit/plugins' in '[[native.plugin]]' was not found.
ALSA lib confmisc.c:767:(parse_card) cannot find card '0'
ALSA lib conf.c:4732:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4732:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1246:(snd_func_refer) error evaluating name
ALSA lib conf.c:4732:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:5220:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2642:(snd_pcm_open_noupdate) Unknown PCM default
2022-10-28 14:32:37 [4,776ms] [Error] [carb.audio.device] audio device is misconfigured or broken {deviceIndex = 0, name = 'default'} (The device is likely misconfigured, check your $HOME/.asoundrc)
2022-10-28 14:32:37 [4,776ms] [Warning] [carb.audio.output] failed to retrieve the capabilities for device 0 {result = eDeviceLost (2)}
2022-10-28 14:32:37 [4,776ms] [Warning] [carb.audio.context] failed to set the requested output during context creation. Using a null streamer instead {result = eDeviceLost (2)}
[4.799s] [ext: omni.kit.widget.path_field-2.0.3] startup
[4.823s] [ext: omni.kit.widget.searchfield-1.0.5] startup
[4.831s] [ext: omni.services.transport.server.base-1.0.2] startup
[4.835s] [ext: omni.kit.menu.utils-1.2.8] startup
[4.860s] [ext: omni.kit.widget.browser_bar-2.0.3] startup
[4.868s] [ext: omni.kit.search_core-1.0.1] startup
[4.874s] [ext: omni.kit.widget.versioning-1.3.6] startup
[4.889s] [ext: omni.kit.widget.graph-1.3.8] startup
[4.944s] [ext: omni.kit.notification_manager-1.0.4] startup
[4.959s] [ext: omni.kit.widget.filebrowser-2.2.24] startup
[4.996s] [ext: omni.kit.window.popup_dialog-2.0.5] startup
[5.009s] [ext: omni.kit.graph.delegate.default-1.0.13] startup
[5.014s] [ext: omni.kit.window.filepicker-2.4.21] startup
[5.310s] [ext: omni.kit.graph.editor.core-1.3.0] startup
[5.332s] [ext: omni.services.transport.server.http-1.1.2] startup
[5.464s] [ext: omni.kit.window.property-1.6.3] startup
[5.475s] [ext: omni.kit.streamsdk.plugins-0.0.0] startup
[5.475s] [ext: omni.kit.livestream.core-0.0.0] startup
[5.483s] [ext: omni.kit.window.title-1.1.1] startup
2022-10-28 14:32:38 [5,471ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:38 [5,471ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
2022-10-28 14:32:38 [5,472ms] [Error] [carb.windowing-glfw.plugin] GLFW initialization failed.
2022-10-28 14:32:38 [5,472ms] [Error] [carb] Failed to startup plugin carb.windowing-glfw.plugin (interfaces: [carb::windowing::IGLContext v1.0],[carb::windowing::IWindowing v1.3]) (impl: carb.windowing-glfw.plugin)
[5.492s] [ext: omni.kit.window.console-0.2.0] startup
[5.504s] [ext: omni.kit.graph.delegate.modern-1.3.0] startup
[5.520s] [ext: omni.kit.livestream.webrtc-0.1.0] startup
Active user not found. Using default user [kiosk]Streaming server started.
[5.919s] [ext: omni.exp.graph.core-0.0.1] startup
[5.937s] [ext: omni.services.streaming.manager-0.2.2] startup
[5.951s] [ext: omni.exp.graph.composer-2.0.1] startup
2022-10-28 14:32:39 [6,706ms] [Error] [omni.kit.app.impl] [py stderr]: /tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:29: CryptographyDeprecationWarning: Blowfish has been deprecated
from cryptography.hazmat.primitives.ciphers.algorithms import Blowfish, CAST5
/tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:29: CryptographyDeprecationWarning: Blowfish has been deprecated
from cryptography.hazmat.primitives.ciphers.algorithms import Blowfish, CAST5
2022-10-28 14:32:39 [6,706ms] [Error] [omni.kit.app.impl] [py stderr]: /tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:29: CryptographyDeprecationWarning: CAST5 has been deprecated
from cryptography.hazmat.primitives.ciphers.algorithms import Blowfish, CAST5
/tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:29: CryptographyDeprecationWarning: CAST5 has been deprecated
from cryptography.hazmat.primitives.ciphers.algorithms import Blowfish, CAST5
2022-10-28 14:32:39 [6,706ms] [Error] [omni.kit.app.impl] [py stderr]: /tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:30: CryptographyDeprecationWarning: SEED has been deprecated
from cryptography.hazmat.primitives.ciphers.algorithms import SEED, TripleDES
/tmp/.tmpNvXgRaphComposer/run/kit/python/lib/python3.7/asyncssh/crypto/cipher.py:30: CryptographyDeprecationWarning: SEED has been deprecated
from cryptography.hazmat.primitives.ciphers.algorithms import SEED, TripleDES
[7.077s] [ext: omni.services.streamclient.webrtc-1.3.5] startup
[7.098s] [ext: composer-webrtc-2.0.1] startup
[7.258s] app ready
2022-10-28 14:32:40 [7,397ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/omnigraph_state_0_toggle_dark.36x36.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,398ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/omnigraph_state_1_toggle_dark.36x36.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,399ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/omnigraph_state_2_toggle_dark.36x36.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,400ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/toolbar_play.36x36.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,400ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/cloud.36x36.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,400ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/toolbar_stop.36x36.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,403ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/search.32x32.png, but no renderer was initialized. Skipping post-processing ops
2022-10-28 14:32:40 [7,415ms] [Warning] [gpu.foundation.plugin] Post processing operations requested for texture /tmp/carb.P2MyT5/type_scene_graph_dark.240x240.png, but no renderer was initialized. Skipping post-processing ops
Do I need to install xorg or how can I get the composer GUI to work?