The AODT screen froze while opening the nyc.usd file. We have tried closing the application using the close button, however the screen does not close. We have tried to relaunch from omniverse launcher. It crashes every time we attempt.
Hi @subhams
Please provide the output of the nvidia-smi command, and also more details about your setup.
The nvidia-smi output looks like this:
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 555.42.02 Driver Version: 555.42.02 CUDA Version: 12.5 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA RTX 6000 Ada Gene... Off | 00000000:17:00.0 Off | Off |
| 30% 41C P5 36W / 300W | 1481MiB / 49140MiB | 20% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 1 NVIDIA A100X Off | 00000000:CF:00.0 Off | 0 |
| N/A 35C P0 74W / 300W | 240MiB / 81920MiB | 0% Default |
| | | Disabled |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 24648 G ...libexec/gnome-remote-desktop-daemon 0MiB |
| 0 N/A N/A 619938 C+G ...cal/share/ov/pkg/aodt-1.1.0/kit/kit 1430MiB |
| 1 N/A N/A 619938 C ...cal/share/ov/pkg/aodt-1.1.0/kit/kit 230MiB |
+-----------------------------------------------------------------------------------------+
We have a Dell-R750 server with one A100 and one RTX 6000 Ada GPUs.
@subhams
One thing to take note is your driver version which is 555.42.02.
The recommended driver version for 1.1.0 installation is 550.107.02 based on the documentation.
Can you please update the driver to this one and see if the issue still occurs?
if yes, please also provide the console dumps, located here: ~/.local/share/ov/pkg/aodt-1.1.0/logs/Kit/aodt/1.1
@rfarhoodi
We were able to run the AODT once. Here is the console dump from that run.
2025-01-15 22:21:01 [493,594ms] [Info] [rtx.indexlib.plugin] INDEX main info : DiCE option: tcp_send_group_leave = '0'.
2025-01-15 22:21:01 [493,594ms] [Info] [rtx.indexlib.plugin] INDEX main info : NVIDIA IndeX option: cuda_device_reset_disable = 'yes'.
2025-01-15 22:21:01 [493,594ms] [Info] [rtx.indexlib.plugin] INDEX main info : NVIDIA IndeX option: disable_picking = '1'.
2025-01-15 22:21:01 [493,594ms] [Info] [rtx.indexlib.plugin] INDEX main info : NVIDIA IndeX option: pipe_set_rt_flags = '2'.
2025-01-15 22:21:01 [493,594ms] [Info] [rtx.indexlib.plugin] INDEX main info : NVIDIA IndeX option: rasterizer_memory_allocation = '-1'.
2025-01-15 22:21:01 [493,598ms] [Info] [rtx.indexlib.plugin] INDEX main info : Starting the DiCE library (DiCE 2024, build 375500.3496, 03 Jul 2024, linux-x86-64) ...
2025-01-15 22:21:01 [493,624ms] [Info] [rtx.indexlib.plugin] CUDA rend info : Found 2 CUDA devices.
2025-01-15 22:21:01 [493,634ms] [Info] [rtx.indexlib.plugin] CLUSTR net info : Networking is switched off.
2025-01-15 22:21:01 [493,652ms] [Info] [rtx.indexlib.plugin] INDEX main info : NVIDIA driver version: NVIDIA UNIX Open Kernel Module for x86_64 555.42.02 Release Build (dvs-builder@U16-I3-A03-02-4) Mon May 13 17:10:33 UTC 2024
2025-01-15 22:21:01 [493,652ms] [Info] [rtx.indexlib.plugin] INDEX main info : CUDA runtime version: 12.3 / CUDA driver version: 12.5
2025-01-15 22:21:01 [493,655ms] [Info] [rtx.indexlib.plugin] INDEX main info : CUDA device 0: NVIDIA RTX 6000 Ada Generation, Compute 8.9, 47 GB.
2025-01-15 22:21:01 [493,657ms] [Info] [rtx.indexlib.plugin] INDEX main info : CUDA device 1: NVIDIA A100X, Compute 8.0, 79 GB, ECC enabled.
2025-01-15 22:21:01 [493,888ms] [Info] [rtx.indexlib.plugin] INDEX main info : NVIDIA IndeX service started successfully.
2025-01-15 22:21:01 [493,888ms] [Info] [rtx.indexlib.plugin] IDXVDB main info : NVIDIA IndeX extension initializing OpenVDB (version 10.0.1).
2025-01-15 22:21:01 [493,889ms] [Info] [carb.scenerenderer-index.plugin] Setting non-empty region of interest [0 0 0; 10 10 10].
2025-01-15 22:21:02 [494,306ms] [Info] [rtx.indexlib.plugin] INDEX main info : Initializing CUDA run-time compiler for device capability 8.0
2025-01-15 22:21:02 [494,308ms] [Info] [rtx.indexlib.plugin] INDEX main info : Scene bounding box is empty. A minimal spatial subdivision will be built with the following bounding box: [0 0 0; 510 510 510].
2025-01-15 22:21:02 [494,308ms] [Info] [rtx.indexlib.plugin] INDEX main info : Reserving compositing resources assigned for rendering issued from host 1.
2025-01-15 22:21:02 [494,356ms] [Info] [omni.kit.app._impl] [py stdout]: [494.389s] RTX ready
2025-01-15 22:21:29 [521,850ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:29 [521,855ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:29 [521,856ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:29 [521,857ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:29 [521,868ms] [Info] [rtx.multigpumanager.plugin] View 0 (/Render/RenderProduct_omni_kit_widget_viewport_ViewportTexture_0) assigned to device 0
2025-01-15 22:21:29 [521,868ms] [Info] [rtx.multigpumanager.plugin] View 0 (/Render/RenderProduct_omni_kit_widget_viewport_ViewportTexture_0) switching to 1x1 layout
2025-01-15 22:21:31 [524,008ms] [Info] [omni.usd] [MBVH]: enableHydraengineMasking: OFF, for indexForEngineInstance: 0
2025-01-15 22:21:31 [524,008ms] [Info] [omni.usd] [MBVH]: raytracingMotion/enable: OFF, for indexForEngineInstance: 0
2025-01-15 22:21:31 [524,008ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:31 [524,010ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:31 [524,011ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:31 [524,012ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:31 [524,020ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:31 [524,020ms] [Error] [omni.usd] TF_PYTHON_EXCEPTION: in TfPyConvertPythonExceptionToTfErrors at line 114 of /buildAgent/work/ac88d7d902b57417/USD/pxr/base/tf/pyError.cpp -- Tf Python Exception
2025-01-15 22:21:31 [524,044ms] [Info] [rtx.multigpumanager.plugin] View 0 (/Render/RenderProduct_omni_kit_widget_viewport_ViewportTexture_0) assigned to device 0
2025-01-15 22:21:31 [524,044ms] [Info] [rtx.multigpumanager.plugin] View 0 (/Render/RenderProduct_omni_kit_widget_viewport_ViewportTexture_0) switching to 1x1 layout
2025-01-15 22:21:40 [532,624ms] [Info] [omni.kit.app.plugin] Shutdown cancellation was requested: Interrupting shutdown - closing stage first
2025-01-15 22:21:40 [532,625ms] [Info] [omni.kit.app.plugin] Shutdown attempt was cancelled
2025-01-15 22:21:42 [535,071ms] [Info] [carb.crashreporter-breakpad.plugin] enabled: false
2025-01-15 22:21:42 [535,085ms] [Warning] [carb] [Plugin: omni.spectree.delegate.plugin] Module /home/aerial/.local/share/ov/pkg/aodt-1.1.0/extscache/omni.usd_resolver-1.0.0+3a7abd1c.lx64.r.cp310/bin/libomni.spectree.delegate.plugin.so remained loaded after unload request
2025-01-15 22:21:42 [535,108ms] [Info] [omni.graph.exec.unstable.passRegistry] IPassRegistry::deregisterPass: deregistered pass PassStronglyConnectedComponents (pass id 1)
2025-01-15 22:21:42 [535,108ms] [Warning] [omni.core.ITypeFactory] Module /home/aerial/.local/share/ov/pkg/aodt-1.1.0/extscache/omni.activity.core-1.0.1+3a7abd1c.lx64.r.cp310/bin/libomni.activity.core.plugin.so remained loaded after unload request.
In the second run, it crashed.
2025-01-15 22:36:14 [21,842ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] portableMode = '1'
2025-01-15 22:36:14 [21,843ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] runningInContainer = '0'
2025-01-15 22:36:14 [21,843ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_debugSymbols = '0'
2025-01-15 22:36:14 [21,843ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_dumpIncludeOverrides = '0'
2025-01-15 22:36:14 [21,844ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_dumpIntermediates = '0'
2025-01-15 22:36:14 [21,844ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_obfuscateCode = '1'
2025-01-15 22:36:14 [21,844ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] shaderdb_optimizationLevel = '1'
2025-01-15 22:36:14 [21,845ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 555.42.02 | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name | Active | LDA | GPU Memory | Vendor-ID | LUID |
| | | | | | Device-ID | UUID |
| | | | | | Bus-ID | |
|---------------------------------------------------------------------------------------------|
| 0 | NVIDIA RTX 6000 Ada Generation | Yes: 0 | | 49386 MB | 10de | 0 |
| | | | | | 26b1 | b31a8b51.. |
| | | | | | 17 | |
|---------------------------------------------------------------------------------------------|
| 1 | NVIDIA A100X | | | 81920 MB | 10de | 0 |
| | | | | | 20b8 | ba6e678a.. |
| | | | | | cf | |
|=============================================================================================|
| OS: 22.04.5 LTS (Jammy Jellyfish) ubuntu, Version: 22.04.5, Kernel: 5.15.0-1042-nvidia-lowlatency
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: Intel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz | Cores: 48 | Logical: 48
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 515486 | Free Memory: 490835
| Total Page/Swap (MB): 8191 | Free Page/Swap: 8191
|---------------------------------------------------------------------------------------------|
'
2025-01-15 22:36:14 [21,845ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] telemetrySessionId = '4680118087845291621'
2025-01-15 22:36:14 [21,845ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] terminatedByAbort = '0'
2025-01-15 22:36:14 [21,846ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] userId = ''
2025-01-15 22:36:14 [21,846ms] [Warning] [carb.crashreporter-breakpad.plugin] [crash] workingDirectory = '/home/<username>/aodt_bundle'
2025-01-15 22:36:14 [21,846ms] [Fatal] [carb.crashreporter-breakpad.plugin] [crash] Thread 95896 backtrace follows:
2025-01-15 22:36:14 [21,925ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50 (libc_sigaction.c:?)
2025-01-15 22:36:14 [21,929ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: librtx.raytracing.plugin.so!std::vector<rtx::RtxResult, std::allocator<rtx::RtxResult> >::_M_fill_insert(__gnu_cxx::__normal_iterator<rtx::RtxResult*, std::vector<rtx::RtxResult, std::allocator<rtx::RtxResult> > >, unsigned long, rtx::RtxResult const&)+0x7a4 (??:?)
2025-01-15 22:36:14 [21,950ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: libcarb.tasking.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (carb::tasking::ThreadPool::*)(), carb::tasking::ThreadPool*> > >::~_State_impl()+0x2cdd (??:?)
2025-01-15 22:36:14 [21,969ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: libcarb.tasking.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (carb::tasking::ThreadPool::*)(), carb::tasking::ThreadPool*> > >::~_State_impl()+0xb2b6 (??:?)
2025-01-15 22:36:14 [21,982ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: libcarb.tasking.plugin.so!unsigned long std::uniform_int_distribution<unsigned long>::operator()<std::linear_congruential_engine<unsigned long, 48271ul, 0ul, 2147483647ul> >(std::linear_congruential_engine<unsigned long, 48271ul, 0ul, 2147483647ul>&, std::uniform_int_distribution<unsigned long>::param_type const&)+0x5fe4 (??:?)
2025-01-15 22:36:14 [21,996ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: libcarb.tasking.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (carb::tasking::ThreadPool::*)(), carb::tasking::ThreadPool*> > >::~_State_impl()+0xe052 (??:?)
2025-01-15 22:36:14 [22,003ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: libcarb.tasking.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<void (carb::tasking::ThreadPool::*)(), carb::tasking::ThreadPool*> > >::~_State_impl()+0xe099 (??:?)
2025-01-15 22:36:14 [22,020ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: libcarb.tasking.plugin.so!make_fcontext+0x2f (??:?)
This is from the recent run. The log file keep growing in size.
2025-01-21 22:25:53 [15,194,889ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,194,906ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,194,923ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,194,940ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,194,956ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,194,973ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,194,990ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:53 [15,195,006ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,023ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,040ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,057ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,073ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,090ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,107ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,124ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,140ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,157ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,174ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,190ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,194ms] [Error] [carb.graphics-vulkan.plugin] Out of GPU memory allocating resource 'MemoryManager-allocate' [size: unknown]
2025-01-21 22:25:54 [15,195,194ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_OUT_OF_DEVICE_MEMORY
2025-01-21 22:25:54 [15,195,194ms] [Error] [carb.graphics-vulkan.plugin] vkAllocateMemory failed for flags: 0.
2025-01-21 22:25:54 [15,195,194ms] [Error] [gpu.foundation.plugin] Unable to allocate buffer
2025-01-21 22:25:54 [15,195,194ms] [Error] [gpu.foundation.plugin] Buffer creation failed for the device: 0.
2025-01-21 22:25:54 [15,195,207ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,224ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,241ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,245ms] [Warning] [omni.hydra] Rendering failed.
2025-01-21 22:25:54 [15,195,257ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,274ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,291ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,307ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,324ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,341ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,358ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,374ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,391ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,408ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,424ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,433ms] [Error] [carb.graphics-vulkan.plugin] Out of GPU memory allocating resource 'DLSS-D Positional' [size: unknown]
2025-01-21 22:25:54 [15,195,433ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_OUT_OF_DEVICE_MEMORY
2025-01-21 22:25:54 [15,195,433ms] [Error] [carb.graphics-vulkan.plugin] vkAllocateMemory failed.
2025-01-21 22:25:54 [15,195,433ms] [Error] [gpu.foundation.plugin] Texture creation failed for the device: 0.
2025-01-21 22:25:54 [15,195,441ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,458ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,475ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,481ms] [Warning] [omni.hydra] Rendering failed.
2025-01-21 22:25:54 [15,195,491ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,508ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,525ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,541ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,558ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,575ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
2025-01-21 22:25:54 [15,195,592ms] [Error] [omni.kit.renderer.plugin] Invalid backbuffer in the queue!
@subhams What is the compute capability you are running with? The backend will run on A100 which is compute capability 8.0
@kpasad1
The 6000 Ada has compute capability 8.9. I am using the following command:
nvidia-smi --query-gpu=compute_cap --format=csv
The output is:
compute_cap
8.9
8.0
@kpasad1 @rfarhoodi
What would be the procedure to kill the process?
@subhams
Did you get a chance to update the driver yet? The version in the logs above is still 555.42.02
You can use this to kill a process:
sudo kill SIGNAL PID
e.g. to kill a process with PID = 1122:
sudo kill -9 1122
@rfarhoodi
I am not able to find the PID of the process that is stuck. I am trying to kill any process named omniverse, but it is not exiting.
You can try this to find aodt-related processes:
sudo ps -ef | grep -i aodt
@subhams AODT 1.2 is released. Is it possible for you to do a fresh install? The GPU driver version has advanced as well.
Is there a way that I can uninstall AODT 1.1?
@subhams Are you able to reflash the server? If you can, please reflash and install AODT 1.2
If not, please reboot and install AODT 1.2
I am running into this error while installing:
Running /home/aerial/aodt_1.2.0/backend/install.sh
Running /home/aerial/aodt_1.2.0/backend/docker.sh
Running /home/aerial/aodt_1.2.0/backend/nucleus.sh
[+] Running 11/12
✔ Container base_stack-utl-monpx-1 Running0.0s
✔ Container base_stack-nucleus-lft-lb-1 Running0.0s
✔ Container base_stack-nucleus-api-1 Running0.0s
✔ Container base_stack-nucleus-tagging-1 Running0.0s
✔ Container base_stack-nucleus-resolver-cache-1 Running0.0s
✔ Container base_stack-nucleus-search-1 Running0.0s
✔ Container base_stack-nucleus-log-processor-1 Running0.0s
✔ Container base_stack-nucleus-auth-1 Running0.0s
✔ Container base_stack-nucleus-discovery-1 Running0.0s
✔ Container base_stack-nucleus-lft-1 Running0.0s
✔ Container base_stack-nucleus-thumbnails-1 Running0.0s
⠙ Container base_stack-nucleus-navigator-1 Starting0.2s
Error response from daemon: failed to set up container networking: driver failed programming external connectivity on endpoint base_stack-nucleus-navigator-1 (24118ff3a821e45612944e2cda0cd3ed7d6c09b9258c8cd5554fb13211e3b787): failed to bind host port for 0.0.0.0:8080:192.168.2.13:80/tcp: address already in use
Please let me know how to fix this.
Hi @subhams
Did this happen during the upgrade from 1.1 or a fresh install on a new OS?
Hi @rfarhoodi,
Thanks for getting back to me. I could solve the previous problem. However, I am not able to make new USD files from OSM. When I place the coordinates, I don’t see the file being generated.
I also tried to generate a USD file separately using blender. But, when I import the file, everything is pitch black.
Hi @subhams
please check to have a folder successfully mounted to the GIS container and pointing to it properly in the UI. Ensure mounting a folder and using the file path /src/aodt_gis/data/myfile.usd (if using the command from the docs) at the location:
docker run --rm -it -v <local data>:/src/aodt_gis/data --pull=always nvcr.io/esee5uzbruax/aodt-gis:1.2.0 /bin/bash
you can also try to write to an Omniverse path instead. This is not dependent on the container mount.
@subhams
Also, The scene being black may be because there are no lights in the scene. Try to right click on the UI viewport and click Create → Light.