Suggested workflow for video analytics application workflow in laptop / error starting Graph Composer 1.0 in Deepstream SDK

• Hardware Platform: Laptop Gigabyte Aero 15 with NVIDIA RTX3070-MaxQ (*)
• OS: Ubuntu 20.04.
• Docker version: Docker version 20.10.14, build a224086.
• DeepStream Version: 6.01 (Docker: nvcr.io/nvidia/deepstream:6.0.1-devel)
• TensorRT Version: 8.0.1-1 / CUDA 11.3 (reported in docker with sudo dpkg -i deepstream-reference-graphs-6.0.deb)
• NVIDIA GPU Driver Version: 470.103.01 / CUDA Version: 11.4 (Host).
• Issue Type: question/bug

Question

Hello,

I’m interested in prototyping a video analytics application for custom object detection and tracking in a laptop with a NVIDIA RTX3070 (*) for later deployment in a Jetson/Xavier solution.

From the site documentation and webinars, I understand Deepstream SDK 6.01 + Graph Composer is the most efficient and effective way to do this, and all Ampere RTX GPUs are supported.

Is this correct, is this workflow valid for my HW/SW environment?

Problem

When attempting to run Graph Composer 1.0 included in docker nvcr.io/nvidia/deepstream:6.0.1-devel the following errors display and application fails to start:

root@55fea14ef7a2:/opt/nvidia/deepstream/deepstream-6.0# composer
Preparing files...
Done.
./kit/kit ./composer/composer-standalone.kit --ext-path ./composer/omni.exp.graph.composer/  --/plugins/carb.scripting-python.plugin/pythonPath=./registry/ --allow-root
[Info] [carb] Logging to file: /root/.nvidia-omniverse/logs/Kit/composer-standalone/1.0/kit_20220402_191949.log
root@55fea14ef7a2:/opt/nvidia/deepstream/deepstream-6.0# [0.194s] [ext: omni.kit.pipapi-0.0.0] startup
[0.214s] [ext: omni.kit.pip_archive-0.0.0] startup
[0.232s] [ext: omni.usd.config-1.0.0] startup
[0.234s] [ext: omni.usd.libs-1.0.0] startup
[0.381s] [ext: omni.stats-0.0.0] startup
[0.383s] [ext: omni.gpu_foundation-0.0.0] startup
2022-04-02 19:19:49 [354ms] [Warning] [omni.ext.plugin] [ext: omni.gpu_foundation-0.0.0] Failed to load plugins, folder doesn't exist: '/tmp/.tmpNvXgRaphComposer/run/kit/plugins/rtx'.
2022-04-02 19:19:49 [354ms] [Warning] [omni.ext.plugin] [ext: omni.gpu_foundation-0.0.0] '/tmp/.tmpNvXgRaphComposer/run/kit/plugins/rtx/rtx.xrtools.plugin' in '[[native.plugin]]' was not found.
[0.388s] [ext: omni.kit.async_engine-0.0.0] startup
[0.400s] [ext: omni.kit.loop-default-0.1.0] startup
[0.400s] [ext: omni.assets.plugins-0.0.0] startup
[0.401s] [ext: omni.appwindow-1.0.0] startup
[0.415s] [ext: omni.client-0.1.0] startup
[0.423s] [ext: omni.kit.renderer.core-0.0.0] startup
2022-04-02 19:19:49 [395ms] [Warning] [omni.ext.plugin] [ext: omni.kit.renderer.core-0.0.0] Failed to load plugins, folder doesn't exist: '/tmp/.tmpNvXgRaphComposer/run/kit/plugins/rtx'.
2022-04-02 19:19:49 [395ms] [Warning] [omni.ext.plugin] [ext: omni.kit.renderer.core-0.0.0] '/tmp/.tmpNvXgRaphComposer/run/kit/plugins/rtx/rtx.xrtools.plugin' in '[[native.plugin]]' was not found.

|---------------------------------------------------------------------------------------------|
| Driver Version: 470.103     | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 3070 Laptop.. | Yes: 0 |     | 8192    MB | 10de      | 0          |
|     |                                  |        |     |            | 249d      | 96fc6dc0.. |
|=============================================================================================|
| OS: Linux 55fea14ef7a2, Version: 5.13.0-37-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12013000 (1.20.13.0)
| Processor: 11th Gen Intel(R) Core(TM) i7-11800H @ 2.30GHz | Cores: Unknown | Logical: 16
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 15744 | Free Memory: 2033
| Total Page/Swap (MB): 7826 | Free Page/Swap: 7826
|---------------------------------------------------------------------------------------------|
2022-04-02 19:19:49 [564ms] [Warning] [carb.cudainterop.plugin] NVML could not be loaded. GPU Utilization stats will be unavailable. Error: libnvidia-ml.so: cannot open shared object file: No such file or directory
2022-04-02 19:19:49 [765ms] [Error] [carb.graphics-vulkan.plugin] Failed to find device surface formats.
2022-04-02 19:19:49 [765ms] [Error] [omni.kit.renderer.plugin] createSwapchain failed. Width: 2880, height: 1800, Format: 9
2022-04-02 19:19:49 [765ms] [Error] [omni.kit.renderer.plugin] Failed to initialize graphics environment.
2022-04-02 19:19:49 [876ms] [Fatal] [carb.crashreporter-breakpad.plugin] libcarb.events.plugin.so!carbOnPluginStartup
2022-04-02 19:19:49 [876ms] [Fatal] [carb.crashreporter-breakpad.plugin] libcarb.tasking.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (carb::tasking::Scheduler::*)(unsigned int, int, carb::cpp20::latch*), carb::tasking::Scheduler*, unsigned int, int, carb::cpp20::latch*> > >::_M_run()
2022-04-02 19:19:49 [878ms] [Fatal] [carb.crashreporter-breakpad.plugin] libpthread.so.0!funlockfile
2022-04-02 19:19:49 [878ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.kit.imgui_renderer.plugin.so!void std::vector<unsigned long, std::allocator<unsigned long> >::_M_realloc_insert<unsigned long const&>(__gnu_cxx::__normal_iterator<unsigned long*, std::vector<unsigned long, std::allocator<unsigned long> > >, unsigned long const&)
2022-04-02 19:19:49 [878ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.kit.imgui_renderer.plugin.so!void std::vector<unsigned long, std::allocator<unsigned long> >::_M_realloc_insert<unsigned long const&>(__gnu_cxx::__normal_iterator<unsigned long*, std::vector<unsigned long, std::allocator<unsigned long> > >, unsigned long const&)
2022-04-02 19:19:49 [878ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.kit.imgui_renderer.plugin.so!carbOnPluginPostShutdown
2022-04-02 19:19:49 [878ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.kit.renderer.ext.plugin.so!carbOnPluginPostShutdown
2022-04-02 19:19:49 [880ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!void std::vector<std::string, std::allocator<std::string> >::_M_realloc_insert<std::string&>(__gnu_cxx::__normal_iterator<std::string*, std::vector<std::string, std::allocator<std::string> > >, std::string&)
2022-04-02 19:19:49 [881ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!carbOnPluginShutdown
2022-04-02 19:19:49 [882ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!char* std::string::_S_construct<char*>(char*, char*, std::allocator<char> const&, std::forward_iterator_tag)
2022-04-02 19:19:49 [883ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!std::_Rb_tree<std::string, std::string, std::_Identity<std::string>, std::less<std::string>, std::allocator<std::string> >::_M_erase(std::_Rb_tree_node<std::string>*)
2022-04-02 19:19:49 [884ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!std::_Rb_tree<std::string, std::string, std::_Identity<std::string>, std::less<std::string>, std::allocator<std::string> >::_M_erase(std::_Rb_tree_node<std::string>*)
2022-04-02 19:19:49 [885ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!std::_Rb_tree<std::string, std::string, std::_Identity<std::string>, std::less<std::string>, std::allocator<std::string> >::_M_erase(std::_Rb_tree_node<std::string>*)
2022-04-02 19:19:49 [886ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.ext.plugin.so!std::_Hashtable<std::string, std::string, std::allocator<std::string>, std::__detail::_Identity, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, true, true> >::operator=(std::_Hashtable<std::string, std::string, std::allocator<std::string>, std::__detail::_Identity, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, true, true> > const&)
2022-04-02 19:19:49 [887ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.kit.app.plugin.so!std::string __gnu_cxx::__to_xstring<std::string, char>(int (*)(char*, unsigned long, char const*, __va_list_tag*), unsigned long, char const*, ...)
2022-04-02 19:19:49 [888ms] [Fatal] [carb.crashreporter-breakpad.plugin] libomni.kit.app.plugin.so!_init
2022-04-02 19:19:49 [888ms] [Fatal] [carb.crashreporter-breakpad.plugin] kit!_init
2022-04-02 19:19:49 [889ms] [Fatal] [carb.crashreporter-breakpad.plugin] libc.so.6!__libc_start_main
2022-04-02 19:19:49 [889ms] [Fatal] [carb.crashreporter-breakpad.plugin] kit!_init

Any suggestion?

Thanks in advance,

Nicolás

(*) The specific model is Aero 15 Oled XD: https://www.gigabyte.com/ar/Laptop/AERO-15-OLED--Intel-11th-Gen#kf.

Sorry for the late response, our team will do the investigation and provide suggestions soon. Thanks

1 Like

Please start the docker container with the command in Development Workflow — DeepStream 6.1.1 Release documentation

1 Like

Thanks

I’m testing with devel v6.01 and the errors disappeared. Some options were missing from my docker command. Currently downloading the extensions (seems ok until now).
Tagged as “solution”.
Kind regards,

Nicolás

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.