Isaac Sim 2022.2.1 crashes after opening USD file

dave.vandermeer.001 · August 11, 2023, 4:50pm

nvidia_log_terminal.txt (24.3 KB)
I have a PC with Ubuntu 22.04 running on a Ryzen 9 7900X3D CPU, RTX 4060 16GB GPU and 32GB DDR5 RAM. I use the nvidia-driver-535.86.05-0ubuntu0.22.04.1 from the official Ubuntu repositories.

I can open Isaac Sim and I can add cubes without issues but when I try to directly open a USD file that I have generated from a URDF file, Isaac Sim crashes. I added the console messages to this post.

In fact, it happens with any USD file. I can load them into an empty scene, but as soon as I open any USD file (even when it only contains a cube, a plane and a light) Isaac Sim will crash.

I would need some help to debug this. Let me know if I can provide more information.

rthaker · August 11, 2023, 9:03pm

Hi @dave.vandermeer.001 - Can you update the linux driver mentioned in this doc and confirm if you are still facing the same issue?: 1. Isaac Sim Requirements — isaacsim latest documentation

Are you able to run USD Composer on your system?

dave.vandermeer.001 · August 17, 2023, 5:00pm

I alreadz tried, but when I run the installer that I downloaded from the driver archive website, I get the following message:

  ERROR: An NVIDIA kernel module 'nvidia-drm' appears to already be loaded in  
         your kernel.  This may be because it is in use (for example, by an X  
         server, a CUDA program, or the NVIDIA Persistence Daemon), but this   
         may also happen if your kernel was configured without support for     
         module unloading.  Please be sure to exit any programs that may be    
         using the GPU(s) before attempting to upgrade your driver.  If no     
         GPU-based programs are running, you know that your kernel supports    
         module unloading, and you still receive this message, then an error   
         may have occurred that has corrupted an NVIDIA kernel module's usage  
         count, for which the simplest remedy is to reboot your computer.
                                              OK

When I click OK, I get:

 ERROR: Installation has failed.  Please see the file
         '/var/log/nvidia-installer.log' for details.  You may find            
         suggestions on fixing installation problems in the README available   
         on the Linux driver download page at www.nvidia.com.
                                  OK

dave.vandermeer.001 · August 17, 2023, 5:12pm

I can open USD Composer 2022.3.3. But when I try to open an existing USD file, it crashes.

Simplychenable · August 17, 2023, 5:30pm

this probably has little relevance, but where are you sourcing these USD files, from the Nucleus server or local drive? i presume you’ve tried files from both locations?

dave.vandermeer.001 · August 17, 2023, 5:36pm

Hi @rthaker ,

Okay, I managed to upgrade to the latest driver version by removing the old driver, rebooting and then installing the new driver through TTY.

Now, I tried again, this time with a simple scene containing a cube, a sphere and a light source.

It still crashes.

Here is the error report in the console:

2023-08-17 17:29:32 [88,880ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_DEVICE_LOST
2023-08-17 17:29:32 [88,880ms] [Error] [carb.graphics-vulkan.plugin] submitToQueueCommon failed.
2023-08-17 17:29:32 [88,880ms] [Error] [gpu.foundation.plugin] A GPU crash occurred. Exiting the application...
Reasons for the failure: a device lost, out of memory, or an unexpected bug.
2023-08-17 17:29:37 [94,091ms] [Error] [carb.crashreporter-breakpad.plugin] crash detected
2023-08-17 17:29:37 [94,092ms] [Warning] [carb.crashreporter-breakpad.plugin] A crash has occurred.  If a debugger should be attached, please set the '/crashreporter/debuggerAttachTimeoutMs' setting to a timeout in milliseconds.  This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2023-08-17 17:29:37 [94,092ms] [Warning] [carb.crashreporter-breakpad.plugin] compressing 3 files into '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip' for upload.
2023-08-17 17:29:37 [94,092ms] [Warning] [carb.crashreporter-breakpad.plugin] failed to open the input file '/home/betsi/.nvidia-omniverse/logs/Kit/Isaac-Sim/2022.2/kit_20230817_192803.nv-gpudmp' for read.
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin] Uploading minidump: file:'/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip' svr:'https://services.nvidia.com/submit'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata for upload:
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '64de33a4-d50b-44c6-4605708f-ceb443ab'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1692293283'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '94'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   gpuCrash = '1'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.98'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 22.2621/31.0708GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.98        | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 28677
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '13451106285106662549'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash report files for upload:
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   upload_file_minidump = '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip'
2023-08-17 17:29:40 [97,065ms] [Warning] [carb.crashreporter-breakpad.plugin] uploaded minidump: file: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip', code:200, response:
2023-08-17 17:29:40 [97,065ms] [Warning] [carb.crashreporter-breakpad.plugin]     00000189096d03ac-18fe24

2023-08-17 17:29:40 [97,065ms] [Warning] [carb.crashreporter-breakpad.plugin] deleting minidump: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip' (use setting "/crashreporter/preserveDump=true" to save).
2023-08-17 17:29:40 [97,065ms] [Error] [carb.crashreporter-breakpad.plugin] Wrote dump file '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip'
2023-08-17 17:29:40 [97,065ms] [Error] [carb.crashreporter-breakpad.plugin]     the dump file was deleted due to a successful upload.  Its originalsize was 503122 bytes and was readable.
2023-08-17 17:29:40 [97,066ms] [Fatal] [carb.crashreporter-breakpad.plugin] Crash detected in pid 6518 thread 6811
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata:
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '64de33a4-d50b-44c6-4605708f-ceb443ab'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1692293283'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '94'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   gpuCrash = '1'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.98'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 22.2621/31.0708GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-17 17:29:40 [97,066ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.98        | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 28677
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-17 17:29:40 [97,067ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '13451106285106662549'
2023-08-17 17:29:40 [97,067ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-17 17:29:40 [97,067ms] [Fatal] [carb.crashreporter-breakpad.plugin] Thread 6811 backtrace follows:
2023-08-17 17:29:40 [97,187ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50 (libc_sigaction.c:?)
2023-08-17 17:29:40 [97,273ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: libgpu.foundation.plugin.so!carbGetPluginDeps+0x2b3f (??:?)
2023-08-17 17:29:40 [97,384ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: libgpu.foundation.plugin.so!void std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, char const*, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, char const*, unsigned int>*, std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > > >, std::tuple<char const*, float, char const*, unsigned int>&&)+0x1168f (??:?)
2023-08-17 17:29:40 [97,472ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: libgpu.foundation.plugin.so!void std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, char const*, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, char const*, unsigned int>*, std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > > >, std::tuple<char const*, float, char const*, unsigned int>&&)+0x1b9b9 (??:?)
2023-08-17 17:29:40 [97,584ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: libomni.kit.renderer.plugin.so!carbOnPluginPostShutdown+0x2af5 (??:?)
2023-08-17 17:29:40 [97,659ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: libomni.kit.renderer.plugin.so!carbOnPluginPostShutdown+0x2ca9 (??:?)
2023-08-17 17:29:40 [97,736ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: libomni.kit.renderer.plugin.so!std::__future_base::_State_baseV2::_M_is_deferred_future() const+0x8f (??:?)
2023-08-17 17:29:41 [97,823ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: libcarb.events.plugin.so!std::_Hashtable<unsigned long, unsigned long, std::allocator<unsigned long>, std::__detail::_Identity, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned long, false>*)+0x188c (??:?)
2023-08-17 17:29:41 [97,945ms] [Fatal] [carb.crashreporter-breakpad.plugin] 008: libcarb.events.plugin.so!std::_Hashtable<unsigned long, unsigned long, std::allocator<unsigned long>, std::__detail::_Identity, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned long, false>*)+0x2026 (??:?)
2023-08-17 17:29:41 [98,068ms] [Fatal] [carb.crashreporter-breakpad.plugin] 009: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::~_State_impl()+0x8ac (??:?)
2023-08-17 17:29:41 [98,190ms] [Fatal] [carb.crashreporter-breakpad.plugin] 010: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::~_State_impl()+0xe8e3 (??:?)
2023-08-17 17:29:41 [98,314ms] [Fatal] [carb.crashreporter-breakpad.plugin] 011: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::_M_run()+0x1d (??:?)
2023-08-17 17:29:41 [98,440ms] [Fatal] [carb.crashreporter-breakpad.plugin] 012: libstdc++.so.6!std::error_code::default_error_condition() const+0x33 (??:?)
2023-08-17 17:29:41 [98,593ms] [Fatal] [carb.crashreporter-breakpad.plugin] 013: libc.so.6!pthread_condattr_setpshared+0x513 (./nptl/pthread_create.c:442)
2023-08-17 17:29:41 [98,743ms] [Fatal] [carb.crashreporter-breakpad.plugin] 014: libc.so.6!__xmknodat+0x230 (./misc/../sysdeps/unix/sysv/linux/x86_64/clone3.S:83)
Segmentation fault (core dumped)

I notice that there are already some error message before I even try to load the scene:

[6.515s] Isaac Sim App is loaded.
2023-08-17 17:29:03 [60,215ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-08@22:05:10'
2023-08-17 17:29:03 [60,215ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-08@22:05:10'
2023-08-17 17:29:03 [60,215ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-08@22:05:10'
2023-08-17 17:29:03 [60,215ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/unknown_file_256.png:2023-08-08@22:05:10'
2023-08-17 17:29:32 [88,880ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_DEVICE_LOST
2023-08-17 17:29:32 [88,880ms] [Error] [carb.graphics-vulkan.plugin] submitToQueueCommon failed.
2023-08-17 17:29:32 [88,880ms] [Error] [gpu.foundation.plugin] A GPU crash occurred. Exiting the application...
Reasons for the failure: a device lost, out of memory, or an unexpected bug.
2023-08-17 17:29:37 [94,091ms] [Error] [carb.crashreporter-breakpad.plugin] crash detected
2023-08-17 17:29:37 [94,092ms] [Warning] [carb.crashreporter-breakpad.plugin] A crash has occurred.  If a debugger should be attached, please set the '/crashreporter/debuggerAttachTimeoutMs' setting to a timeout in milliseconds.  This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2023-08-17 17:29:37 [94,092ms] [Warning] [carb.crashreporter-breakpad.plugin] compressing 3 files into '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip' for upload.
2023-08-17 17:29:37 [94,092ms] [Warning] [carb.crashreporter-breakpad.plugin] failed to open the input file '/home/betsi/.nvidia-omniverse/logs/Kit/Isaac-Sim/2022.2/kit_20230817_192803.nv-gpudmp' for read.
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin] Uploading minidump: file:'/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip' svr:'https://services.nvidia.com/submit'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata for upload:
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '64de33a4-d50b-44c6-4605708f-ceb443ab'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1692293283'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '94'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   gpuCrash = '1'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.98'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 22.2621/31.0708GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.98        | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 28677
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '13451106285106662549'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash report files for upload:
2023-08-17 17:29:37 [94,300ms] [Warning] [carb.crashreporter-breakpad.plugin]   upload_file_minidump = '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip'
2023-08-17 17:29:40 [97,065ms] [Warning] [carb.crashreporter-breakpad.plugin] uploaded minidump: file: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip', code:200, response:
2023-08-17 17:29:40 [97,065ms] [Warning] [carb.crashreporter-breakpad.plugin]     00000189096d03ac-18fe24

2023-08-17 17:29:40 [97,065ms] [Warning] [carb.crashreporter-breakpad.plugin] deleting minidump: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/64de33a4-d50b-44c6-4605708f-ceb443ab.dmp.zip' (use setting "/crashreporter/preserveDump=true" to save).

I want to point out the following lines:

2023-08-17 17:29:32 [88,880ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_DEVICE_LOST
2023-08-17 17:29:32 [88,880ms] [Error] [carb.graphics-vulkan.plugin] submitToQueueCommon failed.
2023-08-17 17:29:32 [88,880ms] [Error] [gpu.foundation.plugin] A GPU crash occurred. Exiting the application...
Reasons for the failure: a device lost, out of memory, or an unexpected bug.
2023-08-17 17:29:37 [94,091ms] [Error] [carb.crashreporter-breakpad.plugin] crash detected

dave.vandermeer.001 · August 17, 2023, 5:38pm

Hi @Simplychenable ,

I have the files locally stored. I have trouble to set up a local nucleus server. I am assuming that the issue is more related to the new GPU where there might not be full support yet rather then how I open the file.

I might be wrong though with this assumption.

Simplychenable · August 17, 2023, 5:55pm

you are probably right, but i figured it doesn’t hurt to ask. there were a few other threads revolving ERROR_DEVICE_LOST. most, if not all, were related to the driver version (an issue you were having trouble downgrading to); aside from that, there’s one post from this thread that stood out that mentioned a BIOS update.

dave.vandermeer.001 · August 17, 2023, 6:16pm

The motherboard is fairly new. I bought it 2 months ago and immediately made a BIOS update. I can check if there is an update available.

dave.vandermeer.001 · August 26, 2023, 5:46pm

Hi @Simplychenable ,

Before making a BIOS upgrade, I wanted to check it it would work with a different driver version.

I tried the 535-open drivers, which did not work at all.

Then, I wanted to try the 525 driver as it is the one recommended on Linux for Omniverse, but this one does not support the 4060 Ti GPU.

Then, I saw there is an update for the 535 on the driver website, version 104.

I installed this one, and I installed the 2023 version of USD Composer. This works fine, I can open it and load existing USD files. When I tried for Isaac Sim 2022 with the driver 535.104, Isaac Sim 2022.2.1 does not even start.

When I launch it via terminal, I get the following terminal output:

Loading user config located at: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/user.config.json'
[Info] [carb] Logging to file: /home/betsi/.nvidia-omniverse/logs/Kit/Isaac-Sim/2022.2/kit_20230826_194003.log
2023-08-26 17:40:03 [38ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.lidar] Extensions config 'extension.toml' doesn't exist '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar' or '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar/config'
2023-08-26 17:40:03 [38ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.radar] Extensions config 'extension.toml' doesn't exist '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar' or '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar/config'
[0.146s] [ext: omni.stats-0.0.0] startup
[0.208s] [ext: omni.rtx.shadercache-1.0.0] startup
[0.214s] [ext: omni.assets.plugins-0.0.0] startup
[0.215s] [ext: omni.gpu_foundation-0.0.0] startup
[0.219s] [ext: carb.windowing.plugins-1.0.0] startup
2023-08-26 17:40:03 [207ms] [Warning] [carb.windowing-glfw.gamepad] Joystick with unknown remapping detected (will be ignored):  Microsoft Xbox Series S|X Controller [030000005e040000120b000009050000]
[0.224s] [ext: omni.kit.renderer.init-0.0.0] startup
2023-08-26 17:40:03 [281ms] [Error] [gpu.foundation.plugin] Multiple Installable Client Drivers (ICDs) are found for the same GPU on the system. This causes the same GPU to be reported multiple times by more than one driver and leads to instability or crash. 
For NVIDIA drivers, please follow troubleshooting docs to uninstall and completely purge Linux-distribution-provided driver packages, and then reinstall your driver cleanly via .run package. Otherwise, updating Ubuntu software may reinstall a secondary ICD or override the existing NVIDIA driver.

To verify the proper NVIDIA driver installation, only one of the following icd.d folders should contain nvidia_icd.json file:
/etc/vulkan/icd.d: Location of ICDs installed from non-Linux-distribution-provided packages
/usr/share/vulkan/icd.d : Location of ICDs installed from Linux-distribution-provided packages

|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|---------------------------------------------------------------------------------------------|
| 1   | NVIDIA GeForce RTX 4060 Ti       | Yes: 1 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 29220
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] IOMMU is enabled. Found 26 items in /sys/kernel/iommu_groups/.
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] On Linux only, CUDA and the display driver does not support IOMMU-enabled bare-metal PCIe peer to peer memory copy.
However, CUDA and the display driver does support IOMMU via VM pass through. As a consequence, users on Linux,
when running on a native bare metal system, should disable the IOMMU. The IOMMU should be enabled and the VFIO driver
be used as a PCIe pass through for virtual machines.
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] 
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] -----------------------------------------------------------------------
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] !!!!! Local system validation failed! Incorrect configuration detected.
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin]       Summary below. Details above.
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] -----------------------------------------------------------------------
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] 
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin]  - ECC:                         OK
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin]  - IOMMU:                       FAILED
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] 
2023-08-26 17:40:04 [600ms] [Warning] [gpu.foundation.plugin] -----------------------------------------------------------------------
2023-08-26 17:40:04 [773ms] [Warning] [realm:gpu] 2 GPUs requested, but only 1 available!
2023-08-26 17:40:04 [870ms] [Error] [carb.crashreporter-breakpad.plugin] crash detected
2023-08-26 17:40:04 [870ms] [Warning] [carb.crashreporter-breakpad.plugin] A crash has occurred.  If a debugger should be attached, please set the '/crashreporter/debuggerAttachTimeoutMs' setting to a timeout in milliseconds.  This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2023-08-26 17:40:04 [870ms] [Warning] [carb.crashreporter-breakpad.plugin] compressing 2 files into '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/a6a6fc49-31fd-4505-9cc61b85-6b83b188.dmp.zip' for upload.
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin] Uploading minidump: file:'/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/a6a6fc49-31fd-4505-9cc61b85-6b83b188.dmp.zip' svr:'https://services.nvidia.com/submit'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata for upload:
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = 'a6a6fc49-31fd-4505-9cc61b85-6b83b188'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1693071603'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '1'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'startup'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 26.5057/31.0708GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|---------------------------------------------------------------------------------------------|
| 1   | NVIDIA GeForce RTX 4060 Ti       | Yes: 1 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 29220
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '3886233904816862429'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash report files for upload:
2023-08-26 17:40:04 [957ms] [Warning] [carb.crashreporter-breakpad.plugin]   upload_file_minidump = '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/a6a6fc49-31fd-4505-9cc61b85-6b83b188.dmp.zip'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin] uploaded minidump: file: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/a6a6fc49-31fd-4505-9cc61b85-6b83b188.dmp.zip', code:200, response:
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]     00000189096d03ac-1fcb46

2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin] deleting minidump: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/a6a6fc49-31fd-4505-9cc61b85-6b83b188.dmp.zip' (use setting "/crashreporter/preserveDump=true" to save).
2023-08-26 17:40:06 [2,740ms] [Error] [carb.crashreporter-breakpad.plugin] Wrote dump file '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/a6a6fc49-31fd-4505-9cc61b85-6b83b188.dmp.zip'
2023-08-26 17:40:06 [2,740ms] [Error] [carb.crashreporter-breakpad.plugin]     the dump file was deleted due to a successful upload.  Its originalsize was 213862 bytes and was readable.
2023-08-26 17:40:06 [2,740ms] [Fatal] [carb.crashreporter-breakpad.plugin] Crash detected in pid 6134 thread 6134
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata:
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = 'a6a6fc49-31fd-4505-9cc61b85-6b83b188'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1693071603'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '1'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'startup'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 26.5057/31.0708GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|---------------------------------------------------------------------------------------------|
| 1   | NVIDIA GeForce RTX 4060 Ti       | Yes: 1 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-26-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 29220
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '3886233904816862429'
2023-08-26 17:40:06 [2,740ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-26 17:40:06 [2,740ms] [Fatal] [carb.crashreporter-breakpad.plugin] Thread 6134 backtrace follows:
2023-08-26 17:40:06 [2,817ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50 (libc_sigaction.c:?)
2023-08-26 17:40:06 [2,883ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: libgpu.foundation.plugin.so!Realm::Cuda::AutoGPUContext::~AutoGPUContext()+0x74ce (??:?)
2023-08-26 17:40:06 [2,944ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: libgpu.foundation.plugin.so!Realm::Cuda::AutoGPUContext::~AutoGPUContext()+0x10878 (??:?)
2023-08-26 17:40:06 [2,999ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: libgpu.foundation.plugin.so!Realm::Runtime::register_task(unsigned int, void (*)(void const*, unsigned long, void const*, unsigned long, Realm::Processor))+0x3617 (??:?)
2023-08-26 17:40:06 [3,054ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: libgpu.foundation.plugin.so!Realm::Runtime::configure_from_command_line(std::vector<std::string, std::allocator<std::string> >&, bool)+0xd2 (??:?)
2023-08-26 17:40:06 [3,110ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: libgpu.foundation.plugin.so!Realm::CodeDescriptor::CodeDescriptor<void (*)(void const*, unsigned long, void const*, unsigned long, Realm::Processor)>(void (*)(void const*, unsigned long, void const*, unsigned long, Realm::Processor))+0x3aa1 (??:?)
2023-08-26 17:40:06 [3,165ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: libgpu.foundation.plugin.so!carbGetPluginDeps+0x1c02 (??:?)
2023-08-26 17:40:06 [3,219ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: libomni.gpu_foundation_factory.plugin.so!carbOnPluginPostShutdown+0x1b02 (??:?)
2023-08-26 17:40:06 [3,274ms] [Fatal] [carb.crashreporter-breakpad.plugin] 008: libomni.kit.renderer.init.plugin.so!std::_Rb_tree<std::string, std::string, std::_Identity<std::string>, std::less<std::string>, std::allocator<std::string> >::_M_get_insert_hint_unique_pos(std::_Rb_tree_const_iterator<std::string>, std::string const&)+0x1524 (??:?)
2023-08-26 17:40:06 [3,329ms] [Fatal] [carb.crashreporter-breakpad.plugin] 009: libomni.ext.plugin.so!void std::vector<std::string, std::allocator<std::string> >::_M_realloc_insert<std::string&>(__gnu_cxx::__normal_iterator<std::string*, std::vector<std::string, std::allocator<std::string> > >, std::string&)+0x3033 (??:?)
2023-08-26 17:40:06 [3,384ms] [Fatal] [carb.crashreporter-breakpad.plugin] 010: libomni.ext.plugin.so!std::pair<std::__detail::_Node_iterator<std::string, true, true>, bool> std::_Hashtable<std::string, std::string, std::allocator<std::string>, std::__detail::_Identity, std::equal_to<std::string>, std::hash<std::string>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<true, true, true> >::_M_insert<std::string const&, std::__detail::_AllocNode<std::allocator<std::__detail::_Hash_node<std::string, true> > > >(std::string const&, std::__detail::_AllocNode<std::allocator<std::__detail::_Hash_node<std::string, true> > > const&, std::integral_constant<bool, true>)+0x2b89 (??:?)
2023-08-26 17:40:07 [3,440ms] [Fatal] [carb.crashreporter-breakpad.plugin] 011: libomni.ext.plugin.so!void std::vector<unsigned long, std::allocator<unsigned long> >::_M_realloc_insert<unsigned long>(__gnu_cxx::__normal_iterator<unsigned long*, std::vector<unsigned long, std::allocator<unsigned long> > >, unsigned long&&)+0x1800b (??:?)
2023-08-26 17:40:07 [3,494ms] [Fatal] [carb.crashreporter-breakpad.plugin] 012: libomni.ext.plugin.so!carbOnPluginShutdown+0x6358 (??:?)
2023-08-26 17:40:07 [3,549ms] [Fatal] [carb.crashreporter-breakpad.plugin] 013: libomni.ext.plugin.so!carbOnPluginShutdown+0xd883 (??:?)
2023-08-26 17:40:07 [3,605ms] [Fatal] [carb.crashreporter-breakpad.plugin] 014: libomni.ext.plugin.so!carbOnPluginShutdown+0xf099 (??:?)
2023-08-26 17:40:07 [3,660ms] [Fatal] [carb.crashreporter-breakpad.plugin] 015: libomni.kit.app.plugin.so!void std::vector<std::string, std::allocator<std::string> >::_M_realloc_insert<std::string>(__gnu_cxx::__normal_iterator<std::string*, std::vector<std::string, std::allocator<std::string> > >, std::string&&)+0x12de2 (??:?)
2023-08-26 17:40:07 [3,705ms] [Fatal] [carb.crashreporter-breakpad.plugin] 016: libomni.kit.app.plugin.so!void std::vector<std::string, std::allocator<std::string> >::_M_realloc_insert<std::string>(__gnu_cxx::__normal_iterator<std::string*, std::vector<std::string, std::allocator<std::string> > >, std::string&&)+0x135b3 (??:?)
2023-08-26 17:40:07 [3,741ms] [Fatal] [carb.crashreporter-breakpad.plugin] 017: libomni.kit.app.plugin.so!_init+0x4e9e (??:0)
2023-08-26 17:40:07 [3,798ms] [Fatal] [carb.crashreporter-breakpad.plugin] 018: libomni.kit.app.plugin.so!carbOnPluginPostShutdown+0x6f6 (??:?)
2023-08-26 17:40:07 [3,853ms] [Fatal] [carb.crashreporter-breakpad.plugin] 019: kit!_init+0x630 (??:0)
2023-08-26 17:40:07 [3,933ms] [Fatal] [carb.crashreporter-breakpad.plugin] 020: libc.so.6!__libc_init_first+0x90 (./csu/../sysdeps/nptl/libc_start_call_main.h:58)
2023-08-26 17:40:07 [4,011ms] [Fatal] [carb.crashreporter-breakpad.plugin] 021: libc.so.6!__libc_start_main+0x80 (./csu/../csu/libc-start.c:128)
2023-08-26 17:40:07 [4,065ms] [Fatal] [carb.crashreporter-breakpad.plugin] 022: kit!_init+0x9cb (??:0)
Segmentation fault (core dumped)

I guess I will have to wait until Isaac Sim 2023 will be released or I would need to purchase older hardware to make this work right now.

Sheikh_Dawood · August 28, 2023, 4:06pm

Hi. I think this is the root cause of your issue.

2023-08-26 17:40:03 [281ms] [Error] [gpu.foundation.plugin] Multiple Installable Client Drivers (ICDs) are found for the same GPU on the system. This causes the same GPU to be reported multiple times by more than one driver and leads to instability or crash.

Please do a clean install of the drivers. See Linux Troubleshooting — Omniverse Developer Guide latest documentation

I would recommend the latest 525.125.06 or 535.104.05 drivers.

dave.vandermeer.001 · August 30, 2023, 4:57pm

Dear @Sheikh_Dawood ,

I followed the steps to uninstall all the drivers, and I re-installed the latest 535.104.05 driver as recommended on the link you shared.

When I start omniverse using the trminal, I get the following:

Loading user config located at: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/user.config.json'
[Info] [carb] Logging to file: /home/betsi/.nvidia-omniverse/logs/Kit/Isaac-Sim/2022.2/kit_20230830_185134.log
2023-08-30 16:51:34 [40ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.lidar] Extensions config 'extension.toml' doesn't exist '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar' or '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar/config'
2023-08-30 16:51:34 [40ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.radar] Extensions config 'extension.toml' doesn't exist '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar' or '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar/config'
[0.146s] [ext: omni.stats-0.0.0] startup
[0.163s] [ext: omni.rtx.shadercache-1.0.0] startup
[0.168s] [ext: omni.assets.plugins-0.0.0] startup
[0.169s] [ext: omni.gpu_foundation-0.0.0] startup
[0.174s] [ext: carb.windowing.plugins-1.0.0] startup
2023-08-30 16:51:35 [168ms] [Warning] [carb.windowing-glfw.gamepad] Joystick with unknown remapping detected (will be ignored):  Microsoft Xbox Series S|X Controller [030000005e040000120b000009050000]
[0.186s] [ext: omni.kit.renderer.init-0.0.0] startup

|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-31-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 26017
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] IOMMU is enabled. Found 26 items in /sys/kernel/iommu_groups/.
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] On Linux only, CUDA and the display driver does not support IOMMU-enabled bare-metal PCIe peer to peer memory copy.
However, CUDA and the display driver does support IOMMU via VM pass through. As a consequence, users on Linux,
when running on a native bare metal system, should disable the IOMMU. The IOMMU should be enabled and the VFIO driver
be used as a PCIe pass through for virtual machines.
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] 
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] -----------------------------------------------------------------------
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] !!!!! Local system validation failed! Incorrect configuration detected.
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin]       Summary below. Details above.
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] -----------------------------------------------------------------------
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] 
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin]  - ECC:                         OK
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin]  - IOMMU:                       FAILED
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] 
2023-08-30 16:51:35 [432ms] [Warning] [gpu.foundation.plugin] -----------------------------------------------------------------------
[0.639s] [ext: omni.kit.pipapi-0.0.0] startup
[0.646s] [ext: omni.usd.config-1.0.0] startup
[0.648s] [ext: omni.usd.libs-1.0.0] startup
[0.730s] [ext: omni.kit.pip_archive-0.0.0] startup
[0.732s] [ext: omni.kit.async_engine-0.0.0] startup
[0.733s] [ext: omni.kit.loop-default-0.1.1] startup
[0.733s] [ext: omni.kit.test-0.0.0] startup
[0.765s] [ext: omni.usd.schema.semantics-0.0.0] startup
[0.792s] [ext: omni.usd.schema.audio-0.0.0] startup
[0.796s] [ext: omni.client-0.1.1] startup
[0.800s] [ext: omni.iray.libs-0.0.0] startup
[0.808s] [ext: omni.volume-0.1.0] startup
[0.810s] [ext: omni.usd.core-1.0.4] startup
[0.812s] [ext: omni.mdl.neuraylib-0.1.0] startup
[0.815s] [ext: omni.hydra.rtx-0.1.0] startup
[0.818s] [ext: omni.hydra.iray-0.1.0] startup
[0.820s] [ext: omni.isaac.core_archive-2.0.1] startup
[0.888s] [ext: omni.services.pip_archive-0.4.2] startup
[0.890s] [ext: omni.pip.torch-1_13_1-0.1.4] startup
[0.892s] [ext: omni.isaac.ml_archive-1.1.0] startup
[0.910s] [ext: omni.appwindow-1.0.1] startup
[0.913s] [ext: omni.kit.renderer.core-0.0.0] startup
[0.938s] [ext: omni.kit.renderer.capture-0.0.0] startup
[0.939s] [ext: omni.kit.renderer.imgui-0.0.0] startup
[0.975s] [ext: omni.ui-2.14.4] startup
[0.980s] [ext: carb.audio-0.1.0] startup
[0.982s] [ext: omni.uiaudio-1.0.0] startup
[0.983s] [ext: omni.kit.mainwindow-1.0.0] startup
[0.983s] [ext: omni.kit.uiapp-0.0.0] startup
[0.983s] [ext: omni.usd.schema.physics-1.0.0] startup
[0.990s] [ext: omni.usd.schema.anim-0.0.0] startup
[1.035s] [ext: omni.usd.schema.isaac-1.1.0] startup
[1.047s] [ext: omni.usd.schema.scene.visualization-1.0.0] startup
[1.049s] [ext: omni.usd.schema.physx-0.0.0] startup
[1.068s] [ext: omni.usd.schema.forcefield-0.0.0] startup
[1.074s] [ext: omni.usd.schema.geospatial-0.0.0] startup
[1.079s] [ext: omni.usd.schema.omniscripting-1.0.0] startup
[1.084s] [ext: omni.usd.schema.omnigraph-1.0.0] startup
[1.090s] [ext: omni.kit.actions.core-1.0.0] startup
[1.092s] [ext: omni.kit.audiodeviceenum-1.0.0] startup
[1.093s] [ext: omni.gpucompute.plugins-0.0.0] startup
[1.093s] [ext: omni.kit.window.popup_dialog-2.0.16] startup
[1.097s] [ext: omni.hydra.usdrt_delegate-4.3.2] startup
[1.107s] [ext: omni.kit.widget.nucleus_connector-1.0.3] startup
[1.109s] [ext: omni.timeline-1.0.5] startup
[1.110s] [ext: omni.kit.commands-1.4.5] startup
[1.112s] [ext: omni.hydra.scene_delegate-0.3.0] startup
[1.115s] [ext: omni.usd-1.6.30] startup
[1.141s] [ext: omni.usd.fileformat.e57-0.1.11] startup
[1.142s] [ext: omni.usd.schema.destruction-0.4.0] startup
[1.148s] [ext: omni.kit.asset_converter-1.3.4] startup
[1.159s] [ext: omni.usd.fileformat.sbsar-0.9.11] startup
[1.192s] [ext: omni.usd.schema.sequence-2.2.1] startup
[1.199s] [ext: omni.usd.schema.flow-104.1.6] startup
[1.200s] [ext: omni.inspect-1.0.1] startup
[1.201s] [ext: omni.kit.widget.path_field-2.0.4] startup
[1.202s] [ext: omni.debugdraw-0.1.1] startup
[1.205s] [ext: omni.kit.notification_manager-1.0.5] startup
[1.207s] [ext: omni.graph.core-2.65.4] startup
[1.209s] [ext: omni.kit.widget.browser_bar-2.0.5] startup
[1.210s] [ext: omni.kit.widget.versioning-1.3.8] startup
[1.212s] [ext: omni.kit.widget.filebrowser-2.3.10] startup
[1.220s] [ext: omni.kit.search_core-1.0.2] startup
[1.221s] [ext: omni.hydra.pxr-1.1.2] startup
[1.225s] [ext: omni.kit.collaboration.channel_manager-1.0.9] startup
[1.227s] [ext: omni.kit.window.filepicker-2.7.15] startup
UsdE57FileFormat
[1.263s] [ext: omni.kit.menu.utils-1.4.7] startup
[1.269s] [ext: omni.kit.usd.layers-2.0.11] startup
[1.275s] [ext: omni.mdl-0.1.0] startup
[1.290s] [ext: omni.kit.window.file_importer-1.0.10] startup
[1.291s] [ext: omni.kit.window.content_browser_registry-0.0.1] startup
[1.292s] [ext: omni.kit.primitive.mesh-1.0.8] startup
[1.295s] [ext: omni.kit.material.library-1.3.21] startup
[1.299s] [ext: omni.kit.clipboard-1.0.0] startup
[1.300s] [ext: omni.kit.window.file_exporter-1.0.10] startup
[1.300s] [ext: omni.kit.stage_templates-1.1.13] startup
[1.302s] [ext: omni.kit.menu.create-1.0.8] startup
[1.303s] [ext: omni.ui_query-1.1.1] startup
[1.303s] [ext: omni.kit.context_menu-1.5.12] startup
[1.306s] [ext: omni.activity.core-1.0.1] startup
[1.308s] [ext: omni.kit.window.file-1.3.32] startup
[1.310s] [ext: omni.kit.window.drop_support-1.0.1] startup
[1.310s] [ext: omni.kit.ui_test-1.2.9] startup
[1.312s] [ext: omni.kit.widget.stage-2.7.24] startup
[1.315s] [ext: omni.kit.window.property-1.8.2] startup
[1.317s] [ext: omni.kit.window.content_browser-2.6.8] startup
[1.328s] [ext: omni.kit.usd_undo-0.1.2] startup
[1.329s] [ext: omni.graph.tools-1.17.2] startup
[1.341s] [ext: omni.hydra.engine.stats-1.0.0] startup
[1.343s] [ext: omni.kit.property.usd-3.18.17] startup
[1.350s] [ext: omni.graph-1.50.2] startup
[1.385s] [ext: omni.kit.hydra_texture-1.0.11] startup
[1.389s] [ext: omni.kit.viewport.registry-104.0.2] startup
[1.390s] [ext: omni.ui.scene-1.5.18] startup
[1.393s] [ext: omni.kit.widget.viewport-104.1.16] startup
[1.395s] [ext: omni.kit.viewport.legacy_gizmos-1.0.10] startup
[1.397s] [ext: omni.kit.widget.searchfield-1.0.10] startup
[1.399s] [ext: omni.kit.widget.graph-1.5.6-104_2] startup
[1.416s] [ext: omni.kit.viewport.window-104.1.23] startup
[1.427s] [ext: omni.kit.widget.prompt-1.0.5] startup
[1.428s] [ext: omni.kit.window.extensions-1.1.1] startup
[1.432s] [ext: omni.kit.widget.text_editor-1.0.2] startup
[1.433s] [ext: omni.kit.viewport.utility-1.0.14] startup
[1.434s] [ext: omni.kit.graph.delegate.default-1.0.18] startup
[1.435s] [ext: omni.kit.widget.settings-1.0.1] startup
[1.437s] [ext: omni.kit.graph.delegate.modern-1.6.5] startup
[1.438s] [ext: omni.kit.window.preferences-1.3.8] startup
[1.454s] [ext: omni.graph.ui-1.24.2] startup
[1.478s] [ext: omni.kit.graph.editor.core-1.4.7] startup
[1.480s] [ext: omni.convexdecomposition-104.2.4-5.1] startup
[1.481s] [ext: omni.kit.numpy.common-0.1.0] startup
[1.483s] [ext: omni.kvdb-0.0.0] startup
[1.484s] [ext: omni.kit.graph.widget.variables-2.0.4] startup
[1.485s] [ext: omni.usdphysics-104.2.4-5.1] startup
[1.487s] [ext: omni.localcache-0.0.0] startup
[1.488s] [ext: omni.kit.graph.usd.commands-1.2.0] startup
[1.489s] [ext: omni.kit.widget.imageview-1.0.3] startup
[1.489s] [ext: omni.physx-104.2.4-5.1] startup
[1.503s] [ext: omni.isaac.debug_draw-0.2.3] startup
[1.506s] [ext: omni.kit.window.quicksearch-2.3.3] startup
[1.508s] [ext: omni.isaac.dynamic_control-1.2.3] startup
[1.515s] [ext: omni.graph.examples.cpp-1.4.2] startup
[1.518s] [ext: omni.graph.window.core-1.43.3] startup
[1.523s] [ext: omni.isaac.version-1.0.0] startup
[1.524s] [ext: usdrt.scenegraph-4.3.2] startup
[1.535s] [ext: omni.kit.widgets.custom-1.0.4] startup
[1.541s] [ext: omni.graph.window.action-1.5.5] startup
[1.542s] [ext: omni.graph.nodes-1.48.3] startup
[1.550s] [ext: omni.anim.retarget.core-104.2.1] startup
[1.556s] [ext: omni.kit.widget.zoombar-1.0.4] startup
[1.557s] [ext: omni.kit.widget.toolbar-1.4.0] startup
[1.561s] [ext: omni.kit.manipulator.transform-104.6.12] startup
[1.562s] [ext: omni.anim.graph.core-104.2.1] startup
[1.566s] [ext: omni.kit.browser.core-2.2.2] startup
[1.570s] [ext: omni.kit.manipulator.tool.snap-1.2.4] startup
[1.574s] [ext: omni.curve.creator-104.1.2] startup
[1.576s] [ext: omni.physics.tensors-0.1.0] startup
[1.581s] [ext: omni.kit.browser.folder.core-1.7.3] startup
[1.584s] [ext: omni.kit.widget.stage_icons-1.0.2] startup
[1.585s] [ext: omni.scene.visualization.core-104.4.0] startup
[1.621s] [ext: omni.ramp-104.1.3] startup
[1.624s] [ext: omni.kit.window.stage-2.3.12] startup
[1.626s] [ext: omni.kit.manipulator.viewport-104.0.7] startup
[1.628s] [ext: omni.genproc.core-104.5.14] startup
[1.639s] [ext: omni.curve.manipulator-104.7.3] startup
[1.648s] [ext: omni.physx.tensors-0.1.0] startup
[1.653s] [ext: omni.command.usd-1.0.2] startup
[1.656s] [ext: omni.kit.browser.sample-1.2.5] startup
[1.657s] [ext: omni.graph.visualization.nodes-2.0.0] startup
[1.661s] [ext: omni.graph.io-1.2.5] startup
[1.665s] [ext: omni.graph.action-1.31.1] startup
[1.670s] [ext: omni.kit.window.cursor-1.1.1] startup
[1.671s] [ext: omni.kit.widget.spinner-1.0.4] startup
[1.672s] [ext: omni.kit.widget.searchable_combobox-1.0.4] startup
[1.673s] [ext: omni.graph.bundle.action-1.3.0] startup
[1.673s] [ext: omni.kit.viewport.menubar.core-104.4.3] startup
[1.685s] [ext: omni.anim.graph.ui-104.2.0] startup
[1.693s] [ext: omni.isaac.core-1.46.3] startup
[2.210s] [ext: omni.graph.scriptnode-0.10.0] startup
[2.211s] [ext: omni.warp-0.6.3] startup
Warp 0.6.3 initialized:
   CUDA Toolkit: 11.5, Driver: 12.2
   Devices:
     "cpu"    | x86_64
     "cuda:0" | NVIDIA GeForce RTX 4060 Ti (sm_89)
   Kernel cache: /home/betsi/.cache/warp/0.6.3
[2.349s] [ext: omni.syntheticdata-0.2.4] startup
2023-08-30 16:51:37 [2,341ms] [Warning] [omni.kit.viewport.menubar.core.menu_item.viewport_menu_item] ViewportMenuItem order argument is deprecated, use order_setting_path
[2.362s] [ext: omni.anim.graph.bundle-104.2.0] startup
[2.362s] [ext: omni.isaac.ui-0.8.0] startup
[2.365s] [ext: omni.isaac.lula-1.2.1] startup
[2.372s] [ext: omni.isaac.motion_planning-0.2.2] startup
[2.377s] [ext: omni.replicator.core-1.7.8] startup
2023-08-30 16:51:37 [2,418ms] [Warning] [omni.replicator.core.scripts.annotators] Annotator PostProcessDispatch is already registered, overwriting annotator template
[2.468s] [ext: omni.isaac.utils-0.2.4] startup
[2.470s] [ext: omni.isaac.surface_gripper-0.4.0] startup
[2.473s] [ext: omni.isaac.motion_generation-4.5.6] startup
[2.478s] [ext: omni.isaac.range_sensor-0.8.1] startup
[2.498s] [ext: omni.isaac.core_nodes-0.23.2] startup
[2.507s] [ext: omni.isaac.demos-0.3.3] startup
[2.515s] [ext: omni.isaac.sensor-5.6.3] startup
2023-08-30 16:51:37 [2,498ms] [Warning] [omni.ext.plugin] [ext: omni.isaac.sensor-5.6.3] Native plugin search dir contains several files: /home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.isaac.sensor/bin . It makes dir walk slow, replace with the exact path to the plugin instead of a wildcard.
[2.543s] [ext: omni.isaac.manipulators-1.1.0] startup
[2.544s] [ext: omni.isaac.quadruped-1.3.0] startup
[2.711s] [ext: omni.isaac.synthetic_utils-0.4.3] startup
[2.713s] [ext: omni.isaac.universal_robots-0.3.2] startup
[2.714s] [ext: omni.isaac.wheeled_robots-0.6.3] startup
[2.719s] [ext: omni.isaac.franka-0.4.0] startup
[2.720s] [ext: omni.isaac.dofbot-0.3.0] startup
[2.721s] [ext: omni.isaac.diff_usd-1.0.1] startup
[2.722s] [ext: omni.isaac.examples-1.5.6] startup
/bin/bash: warning: setlocale: LC_ALL: cannot change locale (en_US.UTF-8)
Gtk-Message: 18:51:37.833: Not loading module "atk-bridge": The functionality is provided by GTK natively. Please try to not load it.
2023-08-30 16:51:40 [5,388ms] [Error] [omni.client.plugin]  Auth Token: authentication: Auth: Tokens.subscribe returned Username Required
2023-08-30 16:51:40 [5,388ms] [Warning] [omni.isaac.core.utils.nucleus] /persistent/app/omniverse/mountedDrives setting not found
2023-08-30 16:51:40 [5,389ms] [Warning] [omni.client.plugin]  HTTP Client: provider_http: CC-493: Request through cache failed. Retrying without cache for http://omniverse-content-production.s3-us-west-2.amazonaws.com/.cloudfront.toml
2023-08-30 16:51:40 [5,389ms] [Warning] [omni.client.plugin]  HTTP Client: omniclient: CC-873: Bypassing cache until the application is restarted
2023-08-30 16:51:45 [10,781ms] [Warning] [omni.client.plugin]  HTTP Client: provider_http: CC-493: Request through cache failed. Retrying without cache for http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/2022.2.1/
[11.013s] [ext: omni.activity.pump-1.0.0] startup
[11.015s] [ext: omni.activity.usd_resolver-1.0.1] startup
[11.017s] [ext: omni.anim.skelJoint-104.2.22] startup
[11.022s] [ext: omni.isaac.examples_nodes-0.1.0] startup
[11.024s] [ext: omni.graph.window.generic-1.3.15] startup
[11.026s] [ext: omni.isaac.extension_templates-1.0.0] startup
[11.026s] [ext: omni.activity.ui-1.0.20] startup
[11.031s] [ext: omni.anim.retarget.ui-104.2.0] startup
[11.036s] [ext: omni.isaac.isaac_sensor-2.0.0] startup
2023-08-30 16:51:45 [11,019ms] [Warning] [omni.isaac.isaac_sensor] omni.isaac.isaac_sensor is deprecated and was renamed; use omni.isaac.sensor
[11.037s] [ext: omni.kit.profiler.window-2.0.5] startup
[11.086s] [ext: omni.isaac.kit-1.4.1] startup
[11.086s] [ext: omni.anim.retarget.bundle-104.2.0] startup
[11.087s] [ext: omni.activity.freeze_monitor-1.0.1] startup
[11.091s] [ext: omni.isaac.merge_mesh-0.1.2] startup
[11.092s] [ext: omni.isaac.mjcf-0.3.1] startup
[11.096s] [ext: omni.isaac.articulation_inspector-0.1.3] startup
[11.097s] [ext: omni.isaac.occupancy_map-0.2.7] startup
[11.103s] [ext: omni.isaac.shapenet-2.0.1] startup
[11.111s] [ext: omni.kit.hotkeys.core-1.0.8] startup
[11.117s] [ext: omni.kit.widget.live_session_management-1.1.3] startup
[11.118s] [ext: omni.isaac.synthetic_recorder-1.5.0] startup
[11.121s] [ext: omni.isaac.unit_converter-0.1.6] startup
[11.122s] [ext: omni.kit.widget.calendar-1.0.5] startup
[11.123s] [ext: omni.kit.ngsearch-0.0.10] startup
2023-08-30 16:51:46 [11,112ms] [Warning] [idl.telemetry.opentelemetry] opentelemetry package is not available, context propagation will be disabled
[11.142s] [ext: omni.kit.widget.highlight_label-1.0.0] startup
[11.142s] [ext: omni.kit.widget.layers-1.6.11] startup
[11.150s] [ext: omni.kit.menu.stage-1.2.1] startup
[11.151s] [ext: omni.kit.tool.collect-2.1.20] startup
[11.154s] [ext: omni.kit.widget.extended_searchfield-1.0.17] startup
[11.162s] [ext: omni.isaac.urdf-0.5.9] startup
[11.178s] [ext: omni.kit.actions.window-1.1.0] startup
[11.181s] [ext: omni.kit.property.layer-1.1.4] startup
[11.182s] [ext: omni.isaac.window.about-1.1.0] startup
[11.183s] [ext: omni.kit.browser.asset-1.2.3] startup
[11.185s] [ext: omni.kit.browser.deepsearch-1.0.20] startup
[11.187s] [ext: omni.kit.compatibility_checker-0.1.0] startup
[11.189s] [ext: omni.kit.hotkeys.window-1.1.3] startup
[11.193s] [ext: omni.kit.property.audio-1.0.6] startup
[11.194s] [ext: omni.kit.property.camera-1.0.3] startup
[11.194s] [ext: omni.kit.property.geometry-1.2.2] startup
[11.196s] [ext: omni.kit.property.light-1.0.6] startup
[11.197s] [ext: omni.hydra.scene_api-0.1.1] startup
[11.201s] [ext: omni.kit.tool.asset_importer-2.4.0] startup
[11.203s] [ext: omni.kit.property.material-1.8.19] startup
[11.205s] [ext: omni.services.facilities.base-1.0.2] startup
[11.206s] [ext: omni.kit.property.render-1.1.0] startup
[11.206s] [ext: omni.kit.property.skel-1.0.1] startup
[11.207s] [ext: omni.kit.property.transform-1.3.5] startup
[11.210s] [ext: omni.kit.importer.cad-0.3.4] startup
[11.239s] [ext: omni.isaac.gain_tuner-0.1.1] startup
[11.240s] [ext: omni.services.core-1.3.0] startup
[11.306s] [ext: omni.anim.curve-104.16.6] startup
[11.315s] [ext: omni.anim.shared-104.14.1] startup
[11.320s] [ext: omni.kit.property.bundle-1.2.6] startup
[11.321s] [ext: omni.services.transport.client.base-1.2.1] startup
[11.322s] [ext: omni.slangnode-104.2.3] startup
[11.337s] [ext: omni.kit.quicksearch.menu-0.8.7] startup
[11.339s] [ext: omni.isaac.asset_browser-0.2.4] startup
[11.340s] [ext: omni.anim.timeline-104.0.7] startup
[11.342s] [ext: omni.vdb_timesample_editor-0.1.5] startup
[11.344s] [ext: omni.services.client-0.4.0] startup
[11.345s] [ext: omni.kit.menu.aov-1.1.3] startup
[11.346s] [ext: omni.kit.selection-0.1.0] startup
[11.347s] [ext: omni.flowusd-104.2.4] startup
[11.359s] [ext: omni.services.transport.client.http_async-1.3.2] startup
[11.360s] [ext: omni.kit.core.collection-0.1.1] startup
[11.362s] [ext: omni.kit.menu.edit-1.1.6] startup
[11.364s] [ext: omni.isaac.physics_inspector-0.1.3] startup
[11.365s] [ext: omni.kit.menu.file-1.1.4] startup
[11.366s] [ext: omni.kit.pointclouds-0.0.16] startup
[11.368s] [ext: omni.services.starfleet.auth-0.1.4] startup
[11.372s] [ext: omni.kit.property.collection-0.1.10] startup
[11.373s] [ext: omni.kit.property.isaac-0.2.0] startup
[11.374s] [ext: omni.kit.property.sbsar-0.9.9] startup
[11.376s] [ext: omni.kit.quicksearch.actions-0.8.11] startup
[11.377s] [ext: omni.kit.quicksearch.commands-1.1.3] startup
[11.377s] [ext: omni.kit.quicksearch.hdri-0.8.11] startup
[11.378s] [ext: omni.kit.quicksearch.material-0.8.10] startup
[11.379s] [ext: semantics.schema.editor-0.3.3] startup
[11.382s] [ext: omni.kit.quicksearch.props-0.8.6] startup
[11.382s] [ext: omni.kit.quicksearch.select-0.8.3] startup
[11.383s] [ext: omni.genproc.ui-104.1.6] startup
[11.385s] [ext: omni.rtx.window.settings-0.6.2] startup
[11.389s] [ext: omni.services.transport.server.base-1.1.0] startup
[11.389s] [ext: omni.kit.scripting-104.2.2] startup
2023-08-30 16:51:46 [11,371ms] [Warning] [omni.ext.plugin] [ext: omni.kit.scripting-104.2.2] '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/extscache/omni.kit.scripting-104.2.2+104.2.lx64.r.cp37/bin' in '[[native.plugin]]' was not found.
[11.392s] [ext: omni.kit.quicksearch.settings-0.8.6] startup
[11.393s] [ext: omni.isaac.physics_utilities-0.1.1] startup
[11.395s] [ext: omni.genproc.bundle-104.0.1] startup
[11.395s] [ext: omni.kit.viewport.rtx-104.0.0] startup
[11.395s] [ext: omni.kit.agent-0.1.5] startup
[11.396s] [ext: omni.services.transport.server.http-1.1.2] startup
[11.404s] [ext: omni.kit.search.files-1.0.4] startup
[11.405s] [ext: omni.kit.stage_column.variant-1.0.9] startup
[11.407s] [ext: omni.kit.thumbnails.mdl-1.0.20] startup
[11.409s] [ext: omni.kit.widget.material_preview-1.0.7] startup
[11.411s] [ext: omni.kit.thumbnails.images-0.2.3] startup
[11.412s] [ext: omni.kit.thumbnails.usd-0.5.2] startup
[11.413s] [ext: omni.kit.manipulator.selector-1.0.1] startup
[11.414s] [ext: omni.kit.browser.material-1.3.3] startup
[11.416s] [ext: omni.kit.window.material_graph-1.6.15] startup
[11.421s] [ext: omni.kit.window.toolbar-1.4.0] startup
[11.423s] [ext: omni.kit.tool.asset_exporter-1.2.0] startup
[11.424s] [ext: omni.kit.viewport.menubar.display-104.1.11] startup
[11.426s] [ext: omni.physx.commands-104.2.4-5.1] startup
[11.429s] [ext: omni.kit.manipulator.camera-104.0.23] startup
[11.429s] [ext: omni.kit.tool.remove_unused.core-0.1.1] startup
[11.430s] [ext: omni.kit.window.material-1.1.3] startup
[11.433s] [ext: omni.kit.manipulator.prim-104.10.7] startup
[11.436s] [ext: omni.kit.manipulator.selection-104.0.6] startup
[11.437s] [ext: omni.kit.viewport.menubar.camera-104.1.9] startup
[11.440s] [ext: omni.physx.ui-104.2.4-5.1] startup
[11.474s] [ext: omni.kit.viewport.menubar.render-104.0.20] startup
[11.475s] [ext: omni.kit.viewport.menubar.settings-104.3.5] startup
[11.478s] [ext: omni.kit.tool.remove_unused.controller-0.1.2] startup
[11.478s] [ext: omni.hydra.pxr.settings-1.0.3] startup
[11.479s] [ext: omni.kit.usda_edit-1.1.10] startup
[11.534s] [ext: omni.kit.viewport.actions-104.0.3] startup
[11.536s] [ext: omni.kit.property.physx-0.1.0] startup
[11.545s] [ext: omni.physx.demos-104.2.4-5.1] startup
[11.547s] [ext: omni.kit.viewport.bundle-104.0.2] startup
[11.547s] [ext: omni.kit.viewport.menubar.lighting-104.0.9] startup
[11.549s] [ext: omni.kit.viewport.pxr-104.0.1] startup
[11.549s] [ext: omni.kit.viewport.ready-1.0.2] startup
[11.550s] [ext: omni.kit.viewport_widgets_manager-1.0.6] startup
[11.552s] [ext: omni.kit.widget.live-2.0.3] startup
[11.553s] [ext: omni.physx.camera-104.2.4-5.1] startup
[11.558s] [ext: omni.physx.cct-104.2.4-5.1] startup
[11.564s] [ext: omni.kit.mesh.raycast-104.3.2] startup
[11.567s] [ext: omni.kit.widget.collection-0.1.11] startup
[11.569s] [ext: omni.physx.supportui-104.2.4-5.1] startup
[11.580s] [ext: omni.physx.vehicle-104.2.4-5.1] startup
[11.594s] [ext: omni.kit.search.service-0.1.5] startup
[11.597s] [ext: omni.isaac.robot_description_editor-2.1.1] startup
[11.599s] [ext: omni.videoencoding-0.1.0] startup
[11.601s] [ext: omni.paint.system.core-104.5.8] startup
[11.650s] [ext: omni.kit.window.collection-0.1.11] startup
[11.651s] [ext: omni.kit.window.commands-0.2.4] startup
[11.653s] [ext: omni.iray.settings.core-0.6.4] startup
[11.655s] [ext: omni.kit.sequencer.usd-103.3.1] startup
[11.658s] [ext: omni.kit.capture.viewport-1.1.24] startup
[11.660s] [ext: omni.paint.system.ui-104.3.14] startup
[11.665s] [ext: omni.physx.bundle-104.2.4-5.1] startup
[11.666s] [ext: omni.physx.zerogravity-104.2.4-5.1] startup
[11.673s] [ext: omni.rtx.settings.core-0.5.8] startup
[11.678s] [ext: omni.kit.preferences.time-0.2.0] startup
[11.680s] [ext: omni.kit.property.sequence-0.2.0] startup
[11.681s] [ext: omni.kit.sequencer.core-103.3.0] startup
[11.683s] [ext: omni.kit.window.console-0.2.3] startup
[11.689s] [ext: omni.kit.window.imageviewer-1.0.6] startup
[11.691s] [ext: omni.paint.brush.scatter-104.2.12] startup
[11.695s] [ext: omni.kit.window.movie_capture-2.1.8] startup
[11.699s] [ext: omni.kit.window.privacy-0.1.0] startup
[11.700s] [ext: omni.kit.window.script_editor-1.7.2] startup
[11.702s] [ext: omni.kit.window.sequencer-103.3.4] startup
[11.719s] [ext: omni.particle.system.core-104.7.19] startup
[11.727s] [ext: omni.paint.brush.attributes-1.1.2] startup
[11.729s] [ext: omni.paint.brush.modify-104.3.2] startup
[11.732s] [ext: omni.paint.brush.scripting-104.7.0] startup
[11.737s] [ext: omni.paint.brush.select-104.3.2] startup
[11.742s] [ext: omni.scene.optimizer.core-104.1.5] startup
[11.745s] [ext: omni.kit.manipulator.tool.mesh_snap-1.4.2] startup
[11.755s] [ext: omni.graph.window.particle.system-104.5.3] startup
[11.757s] [ext: omni.particle.system.ui-104.5.1] startup
[11.766s] [ext: omni.kit.window.status_bar-0.1.5] startup
[11.768s] [ext: omni.kit.window.usd_paths-1.0.4] startup
[11.769s] [ext: omni.paint.system.bundle-104.8.26] startup
[11.770s] [ext: omni.scene.optimizer.ui-104.1.5] startup
[11.771s] [ext: omni.scene.visualization.ui-104.0.6] startup
[11.773s] [ext: omni.mdl.usd_converter-1.0.0] startup
MDL python binding about to load ...
MDL python binding loaded
[omni.mdl.usd_converter] MDL to USD converter startup
[11.775s] [ext: omni.particle.system.bundle-104.2.24] startup
[11.775s] [ext: omni.replicator.composer-1.2.10] startup
[11.778s] [ext: omni.replicator.isaac-1.7.4] startup
[11.789s] [ext: omni.resourcemonitor-1.0.0] startup
[11.793s] [ext: omni.scene.optimizer.bundle-104.1.5] startup
[11.793s] [ext: omni.scene.visualization.bundle-104.0.1] startup
[11.793s] [ext: omni.kit.stage.mdl_converter-1.0.1] startup
[11.794s] [ext: omni.services.usd-1.1.0] startup
[11.796s] [ext: omni.tools.array-104.0.12] startup
[11.802s] [ext: omni.tools.pivot-104.1.0] startup
[11.807s] [ext: omni.kit.widget.timeline-104.0.3] startup
[11.809s] [ext: omni.tools.randomizer-104.0.9] startup
[11.813s] [ext: omni.kit.quicklayout-1.1.1] startup
[11.815s] [ext: omni.kit.window.title-1.1.2] startup
[11.816s] [ext: omni.kit.stage_column.payload-1.0.8] startup
[11.816s] [ext: omni.isaac.scene_blox-0.1.0] startup
[11.817s] [ext: omni.isaac.cortex-0.3.2] startup
[11.817s] [ext: omni.anim.curve_editor-104.12.7] startup
[11.831s] [ext: omni.isaac.onshape-0.6.2] startup
[12.165s] [ext: omni.kit.window.stats-0.1.2] startup
[12.166s] [ext: omni.isaac.app.setup-0.8.1] startup
[12.168s] Isaac Sim Version: 2022.2.1-rc.14
[12.175s] [ext: omni.isaac.ros_bridge-1.11.2] startup
2023-08-30 16:51:47 [12,207ms] [Warning] [omni.isaac.ros_bridge.scripts.extension] ROS_MASTER_URI not set, using default, ROS_MASTER_URI=http://localhost:11311
[12.248s] Writing Isaac Sim icon file
[12.249s] [ext: omni.isaac.assets_check-0.3.2] startup
[12.254s] [ext: omni.isaac.sim.base-2022.2.1] startup
[12.255s] [ext: omni.isaac.sim-2022.2.1] startup
[12.507s] app ready
[15.289s] RTX ready
[15.293s] Isaac Sim App is loaded.

When I then try to open a USD file, it still crashes with the following terminal output:

2023-08-30 16:55:17 [222,403ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-30@18:45:05'
2023-08-30 16:55:17 [222,403ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-30@18:45:05'
2023-08-30 16:55:17 [222,404ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-30@18:45:05'
2023-08-30 16:55:17 [222,404ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/unknown_file_256.png:2023-08-30@18:45:05'
DoExecute : m_NvOFAPI->GetAPI()->nvOFExecuteVk(m_NvOFAPI->GetHandle(), &executeInParamsVk, &executeOutParamsVk)returned error 11 at /dvs/p4/build/sw/devrel/libdev/NGX/snippets/rel_tot/source/frameworks/opticalflow/v7/dev/Common/NvOFBase/NvOFVulkan.cpp;421
terminate called after throwing an instance of 'NvOFException'
  what():  DoExecute : m_NvOFAPI->GetAPI()->nvOFExecuteVk(m_NvOFAPI->GetHandle(), &executeInParamsVk, &executeOutParamsVk)returned error 11 at /dvs/p4/build/sw/devrel/libdev/NGX/snippets/rel_tot/source/frameworks/opticalflow/v7/dev/Common/NvOFBase/NvOFVulkan.cpp;421

2023-08-30 16:55:25 [230,288ms] [Error] [carb.crashreporter-breakpad.plugin] crash detected
2023-08-30 16:55:25 [230,288ms] [Warning] [carb.crashreporter-breakpad.plugin] A crash has occurred.  If a debugger should be attached, please set the '/crashreporter/debuggerAttachTimeoutMs' setting to a timeout in milliseconds.  This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2023-08-30 16:55:25 [230,288ms] [Warning] [carb.crashreporter-breakpad.plugin] compressing 2 files into '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/10ad93f5-3129-49ac-9793e496-1d2d5d61.dmp.zip' for upload.
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin] Uploading minidump: file:'/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/10ad93f5-3129-49ac-9793e496-1d2d5d61.dmp.zip' svr:'https://services.nvidia.com/submit'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata for upload:
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '10ad93f5-3129-49ac-9793e496-1d2d5d61'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1693414294'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '231'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.104'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 20.8276/31.0709GB, Swap: 33.9084/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-31-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 26017
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '3591254679609441099'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash report files for upload:
2023-08-30 16:55:25 [230,507ms] [Warning] [carb.crashreporter-breakpad.plugin]   upload_file_minidump = '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/10ad93f5-3129-49ac-9793e496-1d2d5d61.dmp.zip'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin] uploaded minidump: file: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/10ad93f5-3129-49ac-9793e496-1d2d5d61.dmp.zip', code:200, response:
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]     00000189095e18cb-21fcaa

2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin] deleting minidump: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/10ad93f5-3129-49ac-9793e496-1d2d5d61.dmp.zip' (use setting "/crashreporter/preserveDump=true" to save).
2023-08-30 16:55:28 [233,054ms] [Error] [carb.crashreporter-breakpad.plugin] Wrote dump file '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/10ad93f5-3129-49ac-9793e496-1d2d5d61.dmp.zip'
2023-08-30 16:55:28 [233,054ms] [Error] [carb.crashreporter-breakpad.plugin]     the dump file was deleted due to a successful upload.  Its originalsize was 513093 bytes and was readable.
2023-08-30 16:55:28 [233,054ms] [Fatal] [carb.crashreporter-breakpad.plugin] Crash detected in pid 9077 thread 9077
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata:
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '10ad93f5-3129-49ac-9793e496-1d2d5d61'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1693414294'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '231'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.104'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 20.8276/31.0709GB, Swap: 33.9084/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-30 16:55:28 [233,054ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-31-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 26017
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-30 16:55:28 [233,055ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '3591254679609441099'
2023-08-30 16:55:28 [233,055ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-30 16:55:28 [233,055ms] [Fatal] [carb.crashreporter-breakpad.plugin] Thread 9077 backtrace follows:
2023-08-30 16:55:28 [233,206ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50 (libc_sigaction.c:?)
2023-08-30 16:55:28 [233,345ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: libc.so.6!pthread_kill+0x12c (./nptl/pthread_kill.c:44)
2023-08-30 16:55:28 [233,482ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: libc.so.6!raise+0x16 (./signal/../sysdeps/posix/raise.c:27)
2023-08-30 16:55:28 [233,619ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: libc.so.6!abort+0xd3 (./stdlib/abort.c:81 (discriminator 21))
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: 196!+0x102905
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: 196!+0x100e66
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: 196!+0x100ea1
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: 196!+0x100d03
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 008: 196!+0xf9be2
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 009: 196!+0xf593f
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 010: 196!+0xfab47
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 011: 196!+0xd1690
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 012: 196!+0xd4110
2023-08-30 16:55:28 [233,620ms] [Fatal] [carb.crashreporter-breakpad.plugin] 013: 196!+0xb55c8
2023-08-30 16:55:28 [233,621ms] [Fatal] [carb.crashreporter-breakpad.plugin] 014: 196!+0x92cdd
2023-08-30 16:55:28 [233,621ms] [Fatal] [carb.crashreporter-breakpad.plugin] 015: 196!+0x6e9cd
2023-08-30 16:55:28 [233,732ms] [Fatal] [carb.crashreporter-breakpad.plugin] 016: libcarb.graphics-vulkan.plugin.so!std::_Hashtable<void*, void*, std::allocator<void*>, std::__detail::_Identity, std::equal_to<void*>, std::hash<void*>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<void*, false>*)+0x7187 (??:?)
2023-08-30 16:55:28 [233,847ms] [Fatal] [carb.crashreporter-breakpad.plugin] 017: libcarb.graphics-vulkan.plugin.so!std::_Hashtable<void*, void*, std::allocator<void*>, std::__detail::_Identity, std::equal_to<void*>, std::hash<void*>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<void*, false>*)+0x640e (??:?)
2023-08-30 16:55:28 [233,959ms] [Fatal] [carb.crashreporter-breakpad.plugin] 018: librtx.postprocessing.plugin.so!_init+0x1de80 (??:0)
2023-08-30 16:55:29 [234,071ms] [Fatal] [carb.crashreporter-breakpad.plugin] 019: librtx.postprocessing.plugin.so!_init+0x2027a (??:0)
2023-08-30 16:55:29 [234,183ms] [Fatal] [carb.crashreporter-breakpad.plugin] 020: librtx.postprocessing.plugin.so!_init+0x207c3 (??:0)
2023-08-30 16:55:29 [234,298ms] [Fatal] [carb.crashreporter-breakpad.plugin] 021: libgpu.foundation.plugin.so!std::vector<unsigned char, std::allocator<unsigned char> >::_M_default_append(unsigned long)+0xdb39 (??:?)
2023-08-30 16:55:29 [234,410ms] [Fatal] [carb.crashreporter-breakpad.plugin] 022: libcarb.scenerenderer-rtx.plugin.so!void std::vector<int, std::allocator<int> >::emplace_back<int>(int&&)+0x142be (??:?)
2023-08-30 16:55:29 [234,522ms] [Fatal] [carb.crashreporter-breakpad.plugin] 023: libcarb.scenerenderer-rtx.plugin.so!void std::vector<int, std::allocator<int> >::emplace_back<int>(int&&)+0x1b4c9 (??:?)
2023-08-30 16:55:29 [234,634ms] [Fatal] [carb.crashreporter-breakpad.plugin] 024: libcarb.scenerenderer-rtx.plugin.so!void std::vector<int, std::allocator<int> >::emplace_back<int>(int&&)+0x1bb63 (??:?)
2023-08-30 16:55:29 [234,747ms] [Fatal] [carb.crashreporter-breakpad.plugin] 025: libcarb.scenerenderer-rtx.plugin.so!void std::vector<int, std::allocator<int> >::emplace_back<int>(int&&)+0x4a7db (??:?)
2023-08-30 16:55:29 [234,861ms] [Fatal] [carb.crashreporter-breakpad.plugin] 026: libcarb.scenerenderer-rtx.plugin.so!void std::vector<int, std::allocator<int> >::emplace_back<int>(int&&)+0x4e21b (??:?)
2023-08-30 16:55:29 [234,974ms] [Fatal] [carb.crashreporter-breakpad.plugin] 027: libcarb.scenerenderer-rtx.plugin.so!std::_Hashtable<unsigned int, unsigned int, std::allocator<unsigned int>, std::__detail::_Identity, std::equal_to<unsigned int>, std::hash<unsigned int>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned int, false>*)+0x1a917 (??:?)
2023-08-30 16:55:30 [235,087ms] [Fatal] [carb.crashreporter-breakpad.plugin] 028: librtx.hydra.so!carb::progress::ScopedLoadingEvent* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<carb::progress::ScopedLoadingEvent*>, carb::progress::ScopedLoadingEvent*>(std::move_iterator<carb::progress::ScopedLoadingEvent*>, std::move_iterator<carb::progress::ScopedLoadingEvent*>, carb::progress::ScopedLoadingEvent*)+0x78e4 (??:?)
2023-08-30 16:55:30 [235,201ms] [Fatal] [carb.crashreporter-breakpad.plugin] 029: librtx.hydra.so!carb::progress::ScopedLoadingEvent* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<carb::progress::ScopedLoadingEvent*>, carb::progress::ScopedLoadingEvent*>(std::move_iterator<carb::progress::ScopedLoadingEvent*>, std::move_iterator<carb::progress::ScopedLoadingEvent*>, carb::progress::ScopedLoadingEvent*)+0xae01 (??:?)
2023-08-30 16:55:30 [235,315ms] [Fatal] [carb.crashreporter-breakpad.plugin] 030: libomni.usd.so!std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> (), std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<void>, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker<std::tuple<omni::usd::UsdContext::Impl::saveLayers(std::string const&, std::vector<std::string, std::allocator<std::string> > const&, bool)::{lambda()#1}> >, void> >::_M_invoke(std::_Any_data const&)+0x5e7a (??:?)
2023-08-30 16:55:30 [235,427ms] [Fatal] [carb.crashreporter-breakpad.plugin] 031: libomni.usd.so!std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> (), std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<void>, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker<std::tuple<omni::usd::UsdContext::Impl::saveLayers(std::string const&, std::vector<std::string, std::allocator<std::string> > const&, bool)::{lambda()#1}> >, void> >::_M_invoke(std::_Any_data const&)+0xbfe1 (??:?)
2023-08-30 16:55:30 [235,541ms] [Fatal] [carb.crashreporter-breakpad.plugin] 032: libomni.usd.so!std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> (), std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<void>, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker<std::tuple<omni::usd::UsdContext::Impl::saveLayers(std::string const&, std::vector<std::string, std::allocator<std::string> > const&, bool)::{lambda()#1}> >, void> >::_M_invoke(std::_Any_data const&)+0xc9c6 (??:?)
2023-08-30 16:55:30 [235,654ms] [Fatal] [carb.crashreporter-breakpad.plugin] 033: libomni.usd.so!std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> (), std::__future_base::_Task_setter<std::unique_ptr<std::__future_base::_Result<void>, std::__future_base::_Result_base::_Deleter>, std::thread::_Invoker<std::tuple<omni::usd::UsdContext::Impl::saveLayers(std::string const&, std::vector<std::string, std::allocator<std::string> > const&, bool)::{lambda()#1}> >, void> >::_M_invoke(std::_Any_data const&)+0xcf41 (??:?)
2023-08-30 16:55:30 [235,768ms] [Fatal] [carb.crashreporter-breakpad.plugin] 034: libomni.usd.so!std::_Rb_tree<std::string, std::string, std::_Identity<std::string>, std::less<std::string>, std::allocator<std::string> >::_M_erase(std::_Rb_tree_node<std::string>*)+0x4f9f (??:?)
2023-08-30 16:55:30 [235,885ms] [Fatal] [carb.crashreporter-breakpad.plugin] 035: libcarb.events.plugin.so!std::_Hashtable<unsigned long, unsigned long, std::allocator<unsigned long>, std::__detail::_Identity, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned long, false>*)+0x188c (??:?)
2023-08-30 16:55:30 [236,001ms] [Fatal] [carb.crashreporter-breakpad.plugin] 036: libcarb.events.plugin.so!std::_Hashtable<unsigned long, unsigned long, std::allocator<unsigned long>, std::__detail::_Identity, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned long, false>*)+0x2026 (??:?)
2023-08-30 16:55:31 [236,115ms] [Fatal] [carb.crashreporter-breakpad.plugin] 037: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::~_State_impl()+0x8ac (??:?)
2023-08-30 16:55:31 [236,231ms] [Fatal] [carb.crashreporter-breakpad.plugin] 038: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::~_State_impl()+0xe8e3 (??:?)
2023-08-30 16:55:31 [236,348ms] [Fatal] [carb.crashreporter-breakpad.plugin] 039: libomni.kit.app.plugin.so!_init+0x28c7 (??:0)
2023-08-30 16:55:31 [236,464ms] [Fatal] [carb.crashreporter-breakpad.plugin] 040: libomni.kit.app.plugin.so!carbOnPluginPostShutdown+0x907 (??:?)
2023-08-30 16:55:31 [236,576ms] [Fatal] [carb.crashreporter-breakpad.plugin] 041: kit!_init+0x635 (??:0)
2023-08-30 16:55:31 [236,717ms] [Fatal] [carb.crashreporter-breakpad.plugin] 042: libc.so.6!__libc_init_first+0x90 (./csu/../sysdeps/nptl/libc_start_call_main.h:58)
2023-08-30 16:55:31 [236,856ms] [Fatal] [carb.crashreporter-breakpad.plugin] 043: libc.so.6!__libc_start_main+0x80 (./csu/../csu/libc-start.c:128)
2023-08-30 16:55:31 [236,966ms] [Fatal] [carb.crashreporter-breakpad.plugin] 044: kit!_init+0x9cb (??:0)
Aborted (core dumped)

Do you think, the IOMMU could be the issue?

dave.vandermeer.001 · August 30, 2023, 5:53pm

I disabled the IOMMU settings. It does not complain about IOMMU anymore, but it still crashes.

Loading user config located at: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/user.config.json'
[Info] [carb] Logging to file: /home/betsi/.nvidia-omniverse/logs/Kit/Isaac-Sim/2022.2/kit_20230830_195005.log
2023-08-30 17:50:05 [40ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.lidar] Extensions config 'extension.toml' doesn't exist '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar' or '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.lidar/config'
2023-08-30 17:50:05 [40ms] [Warning] [omni.ext.plugin] [ext: omni.sensors.nv.radar] Extensions config 'extension.toml' doesn't exist '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar' or '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.sensors.nv.radar/config'
[0.142s] [ext: omni.stats-0.0.0] startup
[0.157s] [ext: omni.rtx.shadercache-1.0.0] startup
[0.162s] [ext: omni.assets.plugins-0.0.0] startup
[0.162s] [ext: omni.gpu_foundation-0.0.0] startup
[0.166s] [ext: carb.windowing.plugins-1.0.0] startup
2023-08-30 17:50:05 [164ms] [Warning] [carb.windowing-glfw.gamepad] Joystick with unknown remapping detected (will be ignored):  Microsoft Xbox Series S|X Controller [030000005e040000120b000009050000]
[0.177s] [ext: omni.kit.renderer.init-0.0.0] startup

|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-31-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 27941
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
[0.613s] [ext: omni.kit.pipapi-0.0.0] startup
[0.621s] [ext: omni.usd.config-1.0.0] startup
[0.623s] [ext: omni.usd.libs-1.0.0] startup
[0.704s] [ext: omni.kit.pip_archive-0.0.0] startup
[0.706s] [ext: omni.kit.async_engine-0.0.0] startup
[0.706s] [ext: omni.kit.loop-default-0.1.1] startup
[0.707s] [ext: omni.kit.test-0.0.0] startup
[0.734s] [ext: omni.usd.schema.semantics-0.0.0] startup
[0.761s] [ext: omni.usd.schema.audio-0.0.0] startup
[0.770s] [ext: omni.client-0.1.1] startup
[0.773s] [ext: omni.iray.libs-0.0.0] startup
[0.776s] [ext: omni.volume-0.1.0] startup
[0.778s] [ext: omni.usd.core-1.0.4] startup
[0.780s] [ext: omni.mdl.neuraylib-0.1.0] startup
[0.782s] [ext: omni.hydra.rtx-0.1.0] startup
[0.786s] [ext: omni.hydra.iray-0.1.0] startup
[0.788s] [ext: omni.isaac.core_archive-2.0.1] startup
[0.844s] [ext: omni.services.pip_archive-0.4.2] startup
[0.846s] [ext: omni.pip.torch-1_13_1-0.1.4] startup
[0.849s] [ext: omni.isaac.ml_archive-1.1.0] startup
[0.869s] [ext: omni.appwindow-1.0.1] startup
[0.871s] [ext: omni.kit.renderer.core-0.0.0] startup
[0.903s] [ext: omni.kit.renderer.capture-0.0.0] startup
[0.905s] [ext: omni.kit.renderer.imgui-0.0.0] startup
[0.943s] [ext: omni.ui-2.14.4] startup
[0.948s] [ext: carb.audio-0.1.0] startup
[0.950s] [ext: omni.uiaudio-1.0.0] startup
[0.950s] [ext: omni.kit.mainwindow-1.0.0] startup
[0.951s] [ext: omni.kit.uiapp-0.0.0] startup
[0.951s] [ext: omni.usd.schema.physics-1.0.0] startup
[0.957s] [ext: omni.usd.schema.anim-0.0.0] startup
[1.002s] [ext: omni.usd.schema.isaac-1.1.0] startup
[1.012s] [ext: omni.usd.schema.scene.visualization-1.0.0] startup
[1.013s] [ext: omni.usd.schema.physx-0.0.0] startup
[1.031s] [ext: omni.usd.schema.forcefield-0.0.0] startup
[1.036s] [ext: omni.usd.schema.geospatial-0.0.0] startup
[1.041s] [ext: omni.usd.schema.omniscripting-1.0.0] startup
[1.047s] [ext: omni.usd.schema.omnigraph-1.0.0] startup
[1.053s] [ext: omni.kit.actions.core-1.0.0] startup
[1.054s] [ext: omni.kit.audiodeviceenum-1.0.0] startup
[1.055s] [ext: omni.gpucompute.plugins-0.0.0] startup
[1.055s] [ext: omni.kit.window.popup_dialog-2.0.16] startup
[1.059s] [ext: omni.hydra.usdrt_delegate-4.3.2] startup
[1.069s] [ext: omni.kit.widget.nucleus_connector-1.0.3] startup
[1.071s] [ext: omni.timeline-1.0.5] startup
[1.072s] [ext: omni.kit.commands-1.4.5] startup
[1.074s] [ext: omni.hydra.scene_delegate-0.3.0] startup
[1.077s] [ext: omni.usd-1.6.30] startup
[1.103s] [ext: omni.usd.fileformat.e57-0.1.11] startup
[1.103s] [ext: omni.usd.schema.destruction-0.4.0] startup
[1.108s] [ext: omni.kit.asset_converter-1.3.4] startup
[1.116s] [ext: omni.usd.fileformat.sbsar-0.9.11] startup
[1.148s] [ext: omni.usd.schema.sequence-2.2.1] startup
[1.154s] [ext: omni.usd.schema.flow-104.1.6] startup
[1.154s] [ext: omni.inspect-1.0.1] startup
[1.155s] [ext: omni.kit.widget.path_field-2.0.4] startup
[1.156s] [ext: omni.debugdraw-0.1.1] startup
[1.158s] [ext: omni.kit.notification_manager-1.0.5] startup
[1.161s] [ext: omni.graph.core-2.65.4] startup
[1.163s] [ext: omni.kit.widget.browser_bar-2.0.5] startup
[1.163s] [ext: omni.kit.widget.versioning-1.3.8] startup
[1.164s] [ext: omni.kit.widget.filebrowser-2.3.10] startup
[1.171s] [ext: omni.kit.search_core-1.0.2] startup
[1.172s] [ext: omni.hydra.pxr-1.1.2] startup
[1.176s] [ext: omni.kit.collaboration.channel_manager-1.0.9] startup
[1.177s] [ext: omni.kit.window.filepicker-2.7.15] startup
UsdE57FileFormat
[1.212s] [ext: omni.kit.menu.utils-1.4.7] startup
[1.217s] [ext: omni.kit.usd.layers-2.0.11] startup
[1.222s] [ext: omni.mdl-0.1.0] startup
[1.233s] [ext: omni.kit.window.file_importer-1.0.10] startup
[1.234s] [ext: omni.kit.window.content_browser_registry-0.0.1] startup
[1.234s] [ext: omni.kit.primitive.mesh-1.0.8] startup
[1.237s] [ext: omni.kit.material.library-1.3.21] startup
[1.240s] [ext: omni.kit.clipboard-1.0.0] startup
[1.240s] [ext: omni.kit.window.file_exporter-1.0.10] startup
[1.241s] [ext: omni.kit.stage_templates-1.1.13] startup
[1.242s] [ext: omni.kit.menu.create-1.0.8] startup
[1.243s] [ext: omni.ui_query-1.1.1] startup
[1.243s] [ext: omni.kit.context_menu-1.5.12] startup
[1.245s] [ext: omni.activity.core-1.0.1] startup
[1.247s] [ext: omni.kit.window.file-1.3.32] startup
[1.248s] [ext: omni.kit.window.drop_support-1.0.1] startup
[1.249s] [ext: omni.kit.ui_test-1.2.9] startup
[1.250s] [ext: omni.kit.widget.stage-2.7.24] startup
[1.252s] [ext: omni.kit.window.property-1.8.2] startup
[1.253s] [ext: omni.kit.window.content_browser-2.6.8] startup
[1.263s] [ext: omni.kit.usd_undo-0.1.2] startup
[1.264s] [ext: omni.graph.tools-1.17.2] startup
[1.273s] [ext: omni.hydra.engine.stats-1.0.0] startup
[1.275s] [ext: omni.kit.property.usd-3.18.17] startup
[1.280s] [ext: omni.graph-1.50.2] startup
[1.307s] [ext: omni.kit.hydra_texture-1.0.11] startup
[1.310s] [ext: omni.kit.viewport.registry-104.0.2] startup
[1.312s] [ext: omni.ui.scene-1.5.18] startup
[1.315s] [ext: omni.kit.widget.viewport-104.1.16] startup
[1.316s] [ext: omni.kit.viewport.legacy_gizmos-1.0.10] startup
[1.318s] [ext: omni.kit.widget.searchfield-1.0.10] startup
[1.319s] [ext: omni.kit.widget.graph-1.5.6-104_2] startup
[1.332s] [ext: omni.kit.viewport.window-104.1.23] startup
[1.341s] [ext: omni.kit.widget.prompt-1.0.5] startup
[1.342s] [ext: omni.kit.window.extensions-1.1.1] startup
[1.344s] [ext: omni.kit.widget.text_editor-1.0.2] startup
[1.345s] [ext: omni.kit.viewport.utility-1.0.14] startup
[1.345s] [ext: omni.kit.graph.delegate.default-1.0.18] startup
[1.347s] [ext: omni.kit.widget.settings-1.0.1] startup
[1.348s] [ext: omni.kit.graph.delegate.modern-1.6.5] startup
[1.349s] [ext: omni.kit.window.preferences-1.3.8] startup
[1.364s] [ext: omni.graph.ui-1.24.2] startup
[1.382s] [ext: omni.kit.graph.editor.core-1.4.7] startup
[1.384s] [ext: omni.convexdecomposition-104.2.4-5.1] startup
[1.385s] [ext: omni.kit.numpy.common-0.1.0] startup
[1.387s] [ext: omni.kvdb-0.0.0] startup
[1.388s] [ext: omni.kit.graph.widget.variables-2.0.4] startup
[1.389s] [ext: omni.usdphysics-104.2.4-5.1] startup
[1.390s] [ext: omni.localcache-0.0.0] startup
[1.391s] [ext: omni.kit.graph.usd.commands-1.2.0] startup
[1.392s] [ext: omni.kit.widget.imageview-1.0.3] startup
[1.392s] [ext: omni.physx-104.2.4-5.1] startup
[1.420s] [ext: omni.isaac.debug_draw-0.2.3] startup
[1.423s] [ext: omni.kit.window.quicksearch-2.3.3] startup
[1.425s] [ext: omni.isaac.dynamic_control-1.2.3] startup
[1.430s] [ext: omni.graph.examples.cpp-1.4.2] startup
[1.432s] [ext: omni.graph.window.core-1.43.3] startup
[1.437s] [ext: omni.isaac.version-1.0.0] startup
[1.437s] [ext: usdrt.scenegraph-4.3.2] startup
[1.448s] [ext: omni.kit.widgets.custom-1.0.4] startup
[1.452s] [ext: omni.graph.window.action-1.5.5] startup
[1.453s] [ext: omni.graph.nodes-1.48.3] startup
[1.460s] [ext: omni.anim.retarget.core-104.2.1] startup
[1.465s] [ext: omni.kit.widget.zoombar-1.0.4] startup
[1.466s] [ext: omni.kit.widget.toolbar-1.4.0] startup
[1.469s] [ext: omni.kit.manipulator.transform-104.6.12] startup
[1.469s] [ext: omni.anim.graph.core-104.2.1] startup
[1.473s] [ext: omni.kit.browser.core-2.2.2] startup
[1.476s] [ext: omni.kit.manipulator.tool.snap-1.2.4] startup
[1.479s] [ext: omni.curve.creator-104.1.2] startup
[1.481s] [ext: omni.physics.tensors-0.1.0] startup
[1.486s] [ext: omni.kit.browser.folder.core-1.7.3] startup
[1.488s] [ext: omni.kit.widget.stage_icons-1.0.2] startup
[1.488s] [ext: omni.scene.visualization.core-104.4.0] startup
[1.524s] [ext: omni.ramp-104.1.3] startup
[1.527s] [ext: omni.kit.window.stage-2.3.12] startup
[1.529s] [ext: omni.kit.manipulator.viewport-104.0.7] startup
[1.530s] [ext: omni.genproc.core-104.5.14] startup
[1.540s] [ext: omni.curve.manipulator-104.7.3] startup
[1.548s] [ext: omni.physx.tensors-0.1.0] startup
[1.552s] [ext: omni.command.usd-1.0.2] startup
[1.554s] [ext: omni.kit.browser.sample-1.2.5] startup
[1.555s] [ext: omni.graph.visualization.nodes-2.0.0] startup
[1.559s] [ext: omni.graph.io-1.2.5] startup
[1.562s] [ext: omni.graph.action-1.31.1] startup
[1.567s] [ext: omni.kit.window.cursor-1.1.1] startup
[1.567s] [ext: omni.kit.widget.spinner-1.0.4] startup
[1.568s] [ext: omni.kit.widget.searchable_combobox-1.0.4] startup
[1.568s] [ext: omni.graph.bundle.action-1.3.0] startup
[1.568s] [ext: omni.kit.viewport.menubar.core-104.4.3] startup
[1.578s] [ext: omni.anim.graph.ui-104.2.0] startup
[1.584s] [ext: omni.isaac.core-1.46.3] startup
[2.016s] [ext: omni.graph.scriptnode-0.10.0] startup
[2.017s] [ext: omni.warp-0.6.3] startup
Warp 0.6.3 initialized:
   CUDA Toolkit: 11.5, Driver: 12.2
   Devices:
     "cpu"    | x86_64
     "cuda:0" | NVIDIA GeForce RTX 4060 Ti (sm_89)
   Kernel cache: /home/betsi/.cache/warp/0.6.3
[2.150s] [ext: omni.syntheticdata-0.2.4] startup
2023-08-30 17:50:07 [2,144ms] [Warning] [omni.kit.viewport.menubar.core.menu_item.viewport_menu_item] ViewportMenuItem order argument is deprecated, use order_setting_path
[2.160s] [ext: omni.anim.graph.bundle-104.2.0] startup
[2.160s] [ext: omni.isaac.ui-0.8.0] startup
[2.162s] [ext: omni.isaac.lula-1.2.1] startup
[2.168s] [ext: omni.isaac.motion_planning-0.2.2] startup
[2.173s] [ext: omni.replicator.core-1.7.8] startup
2023-08-30 17:50:07 [2,207ms] [Warning] [omni.replicator.core.scripts.annotators] Annotator PostProcessDispatch is already registered, overwriting annotator template
[2.245s] [ext: omni.isaac.utils-0.2.4] startup
[2.247s] [ext: omni.isaac.surface_gripper-0.4.0] startup
[2.249s] [ext: omni.isaac.motion_generation-4.5.6] startup
[2.252s] [ext: omni.isaac.range_sensor-0.8.1] startup
[2.270s] [ext: omni.isaac.core_nodes-0.23.2] startup
[2.277s] [ext: omni.isaac.demos-0.3.3] startup
[2.284s] [ext: omni.isaac.sensor-5.6.3] startup
2023-08-30 17:50:07 [2,271ms] [Warning] [omni.ext.plugin] [ext: omni.isaac.sensor-5.6.3] Native plugin search dir contains several files: /home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/exts/omni.isaac.sensor/bin . It makes dir walk slow, replace with the exact path to the plugin instead of a wildcard.
[2.306s] [ext: omni.isaac.manipulators-1.1.0] startup
[2.307s] [ext: omni.isaac.quadruped-1.3.0] startup
[2.443s] [ext: omni.isaac.synthetic_utils-0.4.3] startup
[2.444s] [ext: omni.isaac.universal_robots-0.3.2] startup
[2.445s] [ext: omni.isaac.wheeled_robots-0.6.3] startup
[2.449s] [ext: omni.isaac.franka-0.4.0] startup
[2.449s] [ext: omni.isaac.dofbot-0.3.0] startup
[2.450s] [ext: omni.isaac.diff_usd-1.0.1] startup
[2.451s] [ext: omni.isaac.examples-1.5.6] startup
2023-08-30 17:50:07 [2,485ms] [Warning] [omni.isaac.core.utils.nucleus] /persistent/app/omniverse/mountedDrives setting not found
2023-08-30 17:50:07 [2,485ms] [Warning] [omni.client.plugin]  HTTP Client: provider_http: CC-493: Request through cache failed. Retrying without cache for http://omniverse-content-production.s3-us-west-2.amazonaws.com/.cloudfront.toml
2023-08-30 17:50:07 [2,485ms] [Warning] [omni.client.plugin]  HTTP Client: omniclient: CC-873: Bypassing cache until the application is restarted
2023-08-30 17:50:08 [2,879ms] [Warning] [omni.client.plugin]  HTTP Client: provider_http: CC-493: Request through cache failed. Retrying without cache for http://omniverse-content-production.s3-us-west-2.amazonaws.com/Assets/Isaac/2022.2.1/
[3.100s] [ext: omni.activity.pump-1.0.0] startup
[3.102s] [ext: omni.activity.usd_resolver-1.0.1] startup
[3.103s] [ext: omni.anim.skelJoint-104.2.22] startup
[3.105s] [ext: omni.isaac.examples_nodes-0.1.0] startup
[3.107s] [ext: omni.graph.window.generic-1.3.15] startup
[3.108s] [ext: omni.isaac.extension_templates-1.0.0] startup
[3.109s] [ext: omni.activity.ui-1.0.20] startup
[3.113s] [ext: omni.anim.retarget.ui-104.2.0] startup
[3.117s] [ext: omni.isaac.isaac_sensor-2.0.0] startup
2023-08-30 17:50:08 [3,104ms] [Warning] [omni.isaac.isaac_sensor] omni.isaac.isaac_sensor is deprecated and was renamed; use omni.isaac.sensor
[3.117s] [ext: omni.kit.profiler.window-2.0.5] startup
[3.161s] [ext: omni.isaac.kit-1.4.1] startup
[3.162s] [ext: omni.anim.retarget.bundle-104.2.0] startup
[3.162s] [ext: omni.activity.freeze_monitor-1.0.1] startup
[3.167s] [ext: omni.isaac.merge_mesh-0.1.2] startup
[3.167s] [ext: omni.isaac.mjcf-0.3.1] startup
[3.171s] [ext: omni.isaac.articulation_inspector-0.1.3] startup
[3.172s] [ext: omni.isaac.occupancy_map-0.2.7] startup
[3.179s] [ext: omni.isaac.shapenet-2.0.1] startup
[3.186s] [ext: omni.kit.hotkeys.core-1.0.8] startup
[3.191s] [ext: omni.kit.widget.live_session_management-1.1.3] startup
[3.192s] [ext: omni.isaac.synthetic_recorder-1.5.0] startup
[3.194s] [ext: omni.isaac.unit_converter-0.1.6] startup
[3.195s] [ext: omni.kit.widget.calendar-1.0.5] startup
[3.195s] [ext: omni.kit.ngsearch-0.0.10] startup
2023-08-30 17:50:08 [3,188ms] [Warning] [idl.telemetry.opentelemetry] opentelemetry package is not available, context propagation will be disabled
[3.211s] [ext: omni.kit.widget.highlight_label-1.0.0] startup
[3.211s] [ext: omni.kit.widget.layers-1.6.11] startup
[3.217s] [ext: omni.kit.menu.stage-1.2.1] startup
[3.217s] [ext: omni.kit.tool.collect-2.1.20] startup
[3.220s] [ext: omni.kit.widget.extended_searchfield-1.0.17] startup
[3.226s] [ext: omni.isaac.urdf-0.5.9] startup
[3.243s] [ext: omni.kit.actions.window-1.1.0] startup
[3.245s] [ext: omni.kit.property.layer-1.1.4] startup
[3.246s] [ext: omni.isaac.window.about-1.1.0] startup
[3.246s] [ext: omni.kit.browser.asset-1.2.3] startup
[3.247s] [ext: omni.kit.browser.deepsearch-1.0.20] startup
[3.250s] [ext: omni.kit.compatibility_checker-0.1.0] startup
[3.252s] [ext: omni.kit.hotkeys.window-1.1.3] startup
[3.254s] [ext: omni.kit.property.audio-1.0.6] startup
[3.255s] [ext: omni.kit.property.camera-1.0.3] startup
[3.256s] [ext: omni.kit.property.geometry-1.2.2] startup
[3.257s] [ext: omni.kit.property.light-1.0.6] startup
[3.258s] [ext: omni.hydra.scene_api-0.1.1] startup
[3.262s] [ext: omni.kit.tool.asset_importer-2.4.0] startup
[3.264s] [ext: omni.kit.property.material-1.8.19] startup
[3.265s] [ext: omni.services.facilities.base-1.0.2] startup
[3.265s] [ext: omni.kit.property.render-1.1.0] startup
[3.266s] [ext: omni.kit.property.skel-1.0.1] startup
[3.267s] [ext: omni.kit.property.transform-1.3.5] startup
[3.268s] [ext: omni.kit.importer.cad-0.3.4] startup
[3.295s] [ext: omni.isaac.gain_tuner-0.1.1] startup
[3.296s] [ext: omni.services.core-1.3.0] startup
[3.359s] [ext: omni.anim.curve-104.16.6] startup
[3.366s] [ext: omni.anim.shared-104.14.1] startup
[3.370s] [ext: omni.kit.property.bundle-1.2.6] startup
[3.371s] [ext: omni.services.transport.client.base-1.2.1] startup
[3.372s] [ext: omni.slangnode-104.2.3] startup
[3.378s] [ext: omni.kit.quicksearch.menu-0.8.7] startup
[3.379s] [ext: omni.isaac.asset_browser-0.2.4] startup
[3.380s] [ext: omni.anim.timeline-104.0.7] startup
[3.383s] [ext: omni.vdb_timesample_editor-0.1.5] startup
[3.385s] [ext: omni.services.client-0.4.0] startup
[3.385s] [ext: omni.kit.menu.aov-1.1.3] startup
[3.386s] [ext: omni.kit.selection-0.1.0] startup
[3.387s] [ext: omni.flowusd-104.2.4] startup
[3.398s] [ext: omni.services.transport.client.http_async-1.3.2] startup
[3.399s] [ext: omni.kit.core.collection-0.1.1] startup
[3.400s] [ext: omni.kit.menu.edit-1.1.6] startup
[3.401s] [ext: omni.isaac.physics_inspector-0.1.3] startup
[3.403s] [ext: omni.kit.menu.file-1.1.4] startup
[3.403s] [ext: omni.kit.pointclouds-0.0.16] startup
[3.405s] [ext: omni.services.starfleet.auth-0.1.4] startup
[3.409s] [ext: omni.kit.property.collection-0.1.10] startup
[3.409s] [ext: omni.kit.property.isaac-0.2.0] startup
[3.410s] [ext: omni.kit.property.sbsar-0.9.9] startup
[3.411s] [ext: omni.kit.quicksearch.actions-0.8.11] startup
[3.412s] [ext: omni.kit.quicksearch.commands-1.1.3] startup
[3.413s] [ext: omni.kit.quicksearch.hdri-0.8.11] startup
[3.413s] [ext: omni.kit.quicksearch.material-0.8.10] startup
[3.414s] [ext: semantics.schema.editor-0.3.3] startup
[3.419s] [ext: omni.kit.quicksearch.props-0.8.6] startup
[3.419s] [ext: omni.kit.quicksearch.select-0.8.3] startup
[3.420s] [ext: omni.genproc.ui-104.1.6] startup
[3.421s] [ext: omni.rtx.window.settings-0.6.2] startup
[3.425s] [ext: omni.services.transport.server.base-1.1.0] startup
[3.425s] [ext: omni.kit.scripting-104.2.2] startup
2023-08-30 17:50:08 [3,412ms] [Warning] [omni.ext.plugin] [ext: omni.kit.scripting-104.2.2] '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/extscache/omni.kit.scripting-104.2.2+104.2.lx64.r.cp37/bin' in '[[native.plugin]]' was not found.
[3.428s] [ext: omni.kit.quicksearch.settings-0.8.6] startup
[3.428s] [ext: omni.isaac.physics_utilities-0.1.1] startup
[3.430s] [ext: omni.genproc.bundle-104.0.1] startup
[3.430s] [ext: omni.kit.viewport.rtx-104.0.0] startup
[3.430s] [ext: omni.kit.agent-0.1.5] startup
[3.431s] [ext: omni.services.transport.server.http-1.1.2] startup
[3.437s] [ext: omni.kit.search.files-1.0.4] startup
[3.438s] [ext: omni.kit.stage_column.variant-1.0.9] startup
[3.440s] [ext: omni.kit.thumbnails.mdl-1.0.20] startup
[3.441s] [ext: omni.kit.widget.material_preview-1.0.7] startup
[3.442s] [ext: omni.kit.thumbnails.images-0.2.3] startup
[3.443s] [ext: omni.kit.thumbnails.usd-0.5.2] startup
[3.444s] [ext: omni.kit.manipulator.selector-1.0.1] startup
[3.445s] [ext: omni.kit.browser.material-1.3.3] startup
[3.446s] [ext: omni.kit.window.material_graph-1.6.15] startup
[3.451s] [ext: omni.kit.window.toolbar-1.4.0] startup
[3.452s] [ext: omni.kit.tool.asset_exporter-1.2.0] startup
[3.453s] [ext: omni.kit.viewport.menubar.display-104.1.11] startup
[3.454s] [ext: omni.physx.commands-104.2.4-5.1] startup
[3.457s] [ext: omni.kit.manipulator.camera-104.0.23] startup
[3.457s] [ext: omni.kit.tool.remove_unused.core-0.1.1] startup
[3.458s] [ext: omni.kit.window.material-1.1.3] startup
[3.460s] [ext: omni.kit.manipulator.prim-104.10.7] startup
[3.463s] [ext: omni.kit.manipulator.selection-104.0.6] startup
[3.463s] [ext: omni.kit.viewport.menubar.camera-104.1.9] startup
[3.465s] [ext: omni.physx.ui-104.2.4-5.1] startup
[3.500s] [ext: omni.kit.viewport.menubar.render-104.0.20] startup
[3.501s] [ext: omni.kit.viewport.menubar.settings-104.3.5] startup
[3.503s] [ext: omni.kit.tool.remove_unused.controller-0.1.2] startup
[3.503s] [ext: omni.hydra.pxr.settings-1.0.3] startup
[3.504s] [ext: omni.kit.usda_edit-1.1.10] startup
[3.560s] [ext: omni.kit.viewport.actions-104.0.3] startup
[3.562s] [ext: omni.kit.property.physx-0.1.0] startup
[3.569s] [ext: omni.physx.demos-104.2.4-5.1] startup
[3.572s] [ext: omni.kit.viewport.bundle-104.0.2] startup
[3.572s] [ext: omni.kit.viewport.menubar.lighting-104.0.9] startup
[3.573s] [ext: omni.kit.viewport.pxr-104.0.1] startup
[3.573s] [ext: omni.kit.viewport.ready-1.0.2] startup
[3.574s] [ext: omni.kit.viewport_widgets_manager-1.0.6] startup
[3.575s] [ext: omni.kit.widget.live-2.0.3] startup
[3.577s] [ext: omni.physx.camera-104.2.4-5.1] startup
[3.581s] [ext: omni.physx.cct-104.2.4-5.1] startup
[3.586s] [ext: omni.kit.mesh.raycast-104.3.2] startup
[3.590s] [ext: omni.kit.widget.collection-0.1.11] startup
[3.591s] [ext: omni.physx.supportui-104.2.4-5.1] startup
[3.600s] [ext: omni.physx.vehicle-104.2.4-5.1] startup
[3.607s] [ext: omni.kit.search.service-0.1.5] startup
[3.610s] [ext: omni.isaac.robot_description_editor-2.1.1] startup
[3.611s] [ext: omni.videoencoding-0.1.0] startup
[3.613s] [ext: omni.paint.system.core-104.5.8] startup
[3.661s] [ext: omni.kit.window.collection-0.1.11] startup
[3.662s] [ext: omni.kit.window.commands-0.2.4] startup
[3.663s] [ext: omni.iray.settings.core-0.6.4] startup
[3.665s] [ext: omni.kit.sequencer.usd-103.3.1] startup
[3.667s] [ext: omni.kit.capture.viewport-1.1.24] startup
[3.669s] [ext: omni.paint.system.ui-104.3.14] startup
[3.673s] [ext: omni.physx.bundle-104.2.4-5.1] startup
[3.673s] [ext: omni.physx.zerogravity-104.2.4-5.1] startup
[3.680s] [ext: omni.rtx.settings.core-0.5.8] startup
[3.685s] [ext: omni.kit.preferences.time-0.2.0] startup
[3.686s] [ext: omni.kit.property.sequence-0.2.0] startup
[3.687s] [ext: omni.kit.sequencer.core-103.3.0] startup
[3.688s] [ext: omni.kit.window.console-0.2.3] startup
[3.694s] [ext: omni.kit.window.imageviewer-1.0.6] startup
[3.696s] [ext: omni.paint.brush.scatter-104.2.12] startup
[3.699s] [ext: omni.kit.window.movie_capture-2.1.8] startup
[3.702s] [ext: omni.kit.window.privacy-0.1.0] startup
[3.703s] [ext: omni.kit.window.script_editor-1.7.2] startup
[3.704s] [ext: omni.kit.window.sequencer-103.3.4] startup
[3.716s] [ext: omni.particle.system.core-104.7.19] startup
[3.723s] [ext: omni.paint.brush.attributes-1.1.2] startup
[3.725s] [ext: omni.paint.brush.modify-104.3.2] startup
[3.728s] [ext: omni.paint.brush.scripting-104.7.0] startup
[3.732s] [ext: omni.paint.brush.select-104.3.2] startup
[3.736s] [ext: omni.scene.optimizer.core-104.1.5] startup
[3.739s] [ext: omni.kit.manipulator.tool.mesh_snap-1.4.2] startup
[3.748s] [ext: omni.graph.window.particle.system-104.5.3] startup
[3.750s] [ext: omni.particle.system.ui-104.5.1] startup
[3.758s] [ext: omni.kit.window.status_bar-0.1.5] startup
[3.760s] [ext: omni.kit.window.usd_paths-1.0.4] startup
[3.761s] [ext: omni.paint.system.bundle-104.8.26] startup
[3.761s] [ext: omni.scene.optimizer.ui-104.1.5] startup
[3.762s] [ext: omni.scene.visualization.ui-104.0.6] startup
[3.764s] [ext: omni.mdl.usd_converter-1.0.0] startup
MDL python binding about to load ...
MDL python binding loaded
[omni.mdl.usd_converter] MDL to USD converter startup
[3.765s] [ext: omni.particle.system.bundle-104.2.24] startup
[3.765s] [ext: omni.replicator.composer-1.2.10] startup
[3.767s] [ext: omni.replicator.isaac-1.7.4] startup
[3.775s] [ext: omni.resourcemonitor-1.0.0] startup
[3.779s] [ext: omni.scene.optimizer.bundle-104.1.5] startup
[3.779s] [ext: omni.scene.visualization.bundle-104.0.1] startup
[3.779s] [ext: omni.kit.stage.mdl_converter-1.0.1] startup
[3.780s] [ext: omni.services.usd-1.1.0] startup
[3.782s] [ext: omni.tools.array-104.0.12] startup
[3.787s] [ext: omni.tools.pivot-104.1.0] startup
[3.792s] [ext: omni.kit.widget.timeline-104.0.3] startup
[3.793s] [ext: omni.tools.randomizer-104.0.9] startup
[3.796s] [ext: omni.kit.quicklayout-1.1.1] startup
[3.797s] [ext: omni.kit.window.title-1.1.2] startup
[3.798s] [ext: omni.kit.stage_column.payload-1.0.8] startup
[3.799s] [ext: omni.isaac.scene_blox-0.1.0] startup
[3.799s] [ext: omni.isaac.cortex-0.3.2] startup
[3.799s] [ext: omni.anim.curve_editor-104.12.7] startup
[3.810s] [ext: omni.isaac.onshape-0.6.2] startup
[4.066s] [ext: omni.kit.window.stats-0.1.2] startup
[4.067s] [ext: omni.isaac.app.setup-0.8.1] startup
[4.069s] Isaac Sim Version: 2022.2.1-rc.14
[4.076s] [ext: omni.isaac.ros_bridge-1.11.2] startup
2023-08-30 17:50:09 [4,079ms] [Warning] [omni.isaac.ros_bridge.scripts.extension] ROS_MASTER_URI not set, using default, ROS_MASTER_URI=http://localhost:11311
[4.099s] Writing Isaac Sim icon file
[4.099s] [ext: omni.isaac.assets_check-0.3.2] startup
[4.104s] [ext: omni.isaac.sim.base-2022.2.1] startup
[4.104s] [ext: omni.isaac.sim-2022.2.1] startup
[4.308s] app ready
[6.867s] RTX ready
[6.870s] Isaac Sim App is loaded.
2023-08-30 17:50:17 [12,431ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-30@18:45:05'
2023-08-30 17:50:17 [12,431ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-30@18:45:05'
2023-08-30 17:50:17 [12,431ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/folder_256.png:2023-08-30@18:45:05'
2023-08-30 17:50:17 [12,431ms] [Warning] [omni.ui] omni::ui::GpuResourcesCache: trying to release non-existent cached GPU resource '/home/betsi/.local/share/ov/pkg/isaac_sim-2022.2.1/kit/exts/omni.kit.window.filepicker/data/thumbnails/unknown_file_256.png:2023-08-30@18:45:05'
2023-08-30 17:50:17 [12,493ms] [Warning] [omni.client.plugin]  Tick: authentication: Discovery(wss://localhost/omni/discovery): Error creating Api/Connection search: Not connected
2023-08-30 17:50:35 [30,214ms] [Error] [carb.graphics-vulkan.plugin] VkResult: ERROR_DEVICE_LOST
2023-08-30 17:50:35 [30,214ms] [Error] [carb.graphics-vulkan.plugin] submitToQueueCommon failed.
2023-08-30 17:50:35 [30,214ms] [Error] [gpu.foundation.plugin] A GPU crash occurred. Exiting the application...
Reasons for the failure: a device lost, out of memory, or an unexpected bug.
2023-08-30 17:50:40 [35,413ms] [Error] [carb.crashreporter-breakpad.plugin] crash detected
2023-08-30 17:50:40 [35,413ms] [Warning] [carb.crashreporter-breakpad.plugin] A crash has occurred.  If a debugger should be attached, please set the '/crashreporter/debuggerAttachTimeoutMs' setting to a timeout in milliseconds.  This can be used to allow the crash reporter to wait for up to that long for a debugger to attach before processing or sending the crash report.
2023-08-30 17:50:40 [35,413ms] [Warning] [carb.crashreporter-breakpad.plugin] compressing 3 files into '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/77c0ad13-117a-4487-df7c5487-0733aa35.dmp.zip' for upload.
2023-08-30 17:50:40 [35,413ms] [Warning] [carb.crashreporter-breakpad.plugin] failed to open the input file '/home/betsi/.nvidia-omniverse/logs/Kit/Isaac-Sim/2022.2/kit_20230830_195005.nv-gpudmp' for read.
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin] Uploading minidump: file:'/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/77c0ad13-117a-4487-df7c5487-0733aa35.dmp.zip' svr:'https://services.nvidia.com/submit'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata for upload:
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '77c0ad13-117a-4487-df7c5487-0733aa35'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1693417805'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '35'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   gpuCrash = '1'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.104'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 22.7326/31.0709GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-31-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 27941
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '4123034945337256787'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash report files for upload:
2023-08-30 17:50:40 [35,622ms] [Warning] [carb.crashreporter-breakpad.plugin]   upload_file_minidump = '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/77c0ad13-117a-4487-df7c5487-0733aa35.dmp.zip'
2023-08-30 17:50:43 [37,817ms] [Warning] [carb.crashreporter-breakpad.plugin] uploaded minidump: file: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/77c0ad13-117a-4487-df7c5487-0733aa35.dmp.zip', code:200, response:
2023-08-30 17:50:43 [37,817ms] [Warning] [carb.crashreporter-breakpad.plugin]     00000189095e18cb-22065f

2023-08-30 17:50:43 [37,817ms] [Warning] [carb.crashreporter-breakpad.plugin] deleting minidump: '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/77c0ad13-117a-4487-df7c5487-0733aa35.dmp.zip' (use setting "/crashreporter/preserveDump=true" to save).
2023-08-30 17:50:43 [37,817ms] [Error] [carb.crashreporter-breakpad.plugin] Wrote dump file '/home/betsi/.local/share/ov/data/Kit/Isaac-Sim/2022.2/77c0ad13-117a-4487-df7c5487-0733aa35.dmp.zip'
2023-08-30 17:50:43 [37,817ms] [Error] [carb.crashreporter-breakpad.plugin]     the dump file was deleted due to a successful upload.  Its originalsize was 503489 bytes and was readable.
2023-08-30 17:50:43 [37,818ms] [Fatal] [carb.crashreporter-breakpad.plugin] Crash detected in pid 6398 thread 6696
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin] Crash metadata:
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   CarbSdkVersion = '129.11+129.tc565.0f371ae5'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   DumpId = '77c0ad13-117a-4487-df7c5487-0733aa35'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   ProductName = 'OmniverseKit'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   RetryCount = '0'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   StartupTime = '1693417805'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   UploadSuccessful = '0'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   UptimeSeconds = '35'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   Version = '104.2+release.295.529af2e4.tc'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   appName = 'Isaac-Sim'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   appState = 'started'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   appVersion = '2022.2.1'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   autoloadExts = ''
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildBranch = 'release'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildCi = 'tc'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildHash = '529af2e4'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildId = '14001715'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMajor = '104'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMinor = '2'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildMr = '0'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildNumber = '295'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildPatch = '0'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   buildVersion = '104.2.0'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   environmentName = 'default'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   experience = 'Isaac Sim'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   gpuCrash = '1'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   kitRendererDriverVersion = '535.104'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommand = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   lastCommands = 'SetLightingMenuModeCommand(lighting_mode=,usd_context_name=)'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   memoryStats = '(avail/total) RAM: 22.7326/31.0709GB, Swap: 33.9101/33.9101GB, VM: 1.71799e+10/1.71799e+10GB'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   portableMode = '0'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   stageUrl = '/home/betsi/Documents/omniverse/cube.usd'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   systemInfo = '
|---------------------------------------------------------------------------------------------|
| Driver Version: 535.104.05    | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|---------------------------------------------------------------------------------------------|
| 0   | NVIDIA GeForce RTX 4060 Ti       | Yes: 0 |     | 16380   MB | 10de      | 0          |
|     |                                  |        |     |            | 2805      | 262da99c.. |
|=============================================================================================|
| OS: Linux betsi-station, Version: 6.2.0-31-generic
| XServer Vendor: The X.Org Foundation, XServer Version: 12101004 (1.21.1.4)
| Processor: AMD Ryzen 9 7900X3D 12-Core Processor           | Cores: Unknown | Logical: 24
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 31816 | Free Memory: 27941
| Total Page/Swap (MB): 34723 | Free Page/Swap: 34723
|---------------------------------------------------------------------------------------------|
'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   telemetrySessionId = '4123034945337256787'
2023-08-30 17:50:43 [37,818ms] [Warning] [carb.crashreporter-breakpad.plugin]   userId = 'lWv5b7pRdGiSaRVjEbFXKveSE66ugIsnZL2hh6ZArWM'
2023-08-30 17:50:43 [37,819ms] [Fatal] [carb.crashreporter-breakpad.plugin] Thread 6696 backtrace follows:
2023-08-30 17:50:43 [37,934ms] [Fatal] [carb.crashreporter-breakpad.plugin] 000: libc.so.6!__sigaction+0x50 (libc_sigaction.c:?)
2023-08-30 17:50:43 [38,004ms] [Fatal] [carb.crashreporter-breakpad.plugin] 001: libgpu.foundation.plugin.so!carbGetPluginDeps+0x2b3f (??:?)
2023-08-30 17:50:43 [38,075ms] [Fatal] [carb.crashreporter-breakpad.plugin] 002: libgpu.foundation.plugin.so!void std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, char const*, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, char const*, unsigned int>*, std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > > >, std::tuple<char const*, float, char const*, unsigned int>&&)+0x1168f (??:?)
2023-08-30 17:50:43 [38,145ms] [Fatal] [carb.crashreporter-breakpad.plugin] 003: libgpu.foundation.plugin.so!void std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > >::_M_realloc_insert<std::tuple<char const*, float, char const*, unsigned int> >(__gnu_cxx::__normal_iterator<std::tuple<char const*, float, char const*, unsigned int>*, std::vector<std::tuple<char const*, float, char const*, unsigned int>, std::allocator<std::tuple<char const*, float, char const*, unsigned int> > > >, std::tuple<char const*, float, char const*, unsigned int>&&)+0x1b9b9 (??:?)
2023-08-30 17:50:43 [38,214ms] [Fatal] [carb.crashreporter-breakpad.plugin] 004: libomni.kit.renderer.plugin.so!carbOnPluginPostShutdown+0x2af5 (??:?)
2023-08-30 17:50:43 [38,283ms] [Fatal] [carb.crashreporter-breakpad.plugin] 005: libomni.kit.renderer.plugin.so!carbOnPluginPostShutdown+0x2ca9 (??:?)
2023-08-30 17:50:43 [38,353ms] [Fatal] [carb.crashreporter-breakpad.plugin] 006: libomni.kit.renderer.plugin.so!std::__future_base::_State_baseV2::_M_is_deferred_future() const+0x8f (??:?)
2023-08-30 17:50:43 [38,424ms] [Fatal] [carb.crashreporter-breakpad.plugin] 007: libcarb.events.plugin.so!std::_Hashtable<unsigned long, unsigned long, std::allocator<unsigned long>, std::__detail::_Identity, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned long, false>*)+0x188c (??:?)
2023-08-30 17:50:43 [38,495ms] [Fatal] [carb.crashreporter-breakpad.plugin] 008: libcarb.events.plugin.so!std::_Hashtable<unsigned long, unsigned long, std::allocator<unsigned long>, std::__detail::_Identity, std::equal_to<unsigned long>, std::hash<unsigned long>, std::__detail::_Mod_range_hashing, std::__detail::_Default_ranged_hash, std::__detail::_Prime_rehash_policy, std::__detail::_Hashtable_traits<false, true, true> >::_M_insert_unique_node(unsigned long, unsigned long, std::__detail::_Hash_node<unsigned long, false>*)+0x2026 (??:?)
2023-08-30 17:50:43 [38,566ms] [Fatal] [carb.crashreporter-breakpad.plugin] 009: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::~_State_impl()+0x8ac (??:?)
2023-08-30 17:50:43 [38,637ms] [Fatal] [carb.crashreporter-breakpad.plugin] 010: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::~_State_impl()+0xe8e3 (??:?)
2023-08-30 17:50:43 [38,706ms] [Fatal] [carb.crashreporter-breakpad.plugin] 011: libomni.kit.loop-default.plugin.so!std::thread::_State_impl<std::thread::_Invoker<std::tuple<omni::kit::RunLoopThread::run()::{lambda()#1}> > >::_M_run()+0x1d (??:?)
2023-08-30 17:50:43 [38,778ms] [Fatal] [carb.crashreporter-breakpad.plugin] 012: libstdc++.so.6!std::error_code::default_error_condition() const+0x33 (??:?)
2023-08-30 17:50:44 [38,877ms] [Fatal] [carb.crashreporter-breakpad.plugin] 013: libc.so.6!pthread_condattr_setpshared+0x513 (./nptl/pthread_create.c:442)
2023-08-30 17:50:44 [38,978ms] [Fatal] [carb.crashreporter-breakpad.plugin] 014: libc.so.6!__xmknodat+0x230 (./misc/../sysdeps/unix/sysv/linux/x86_64/clone3.S:83)
Segmentation fault (core dumped)

Sheikh_Dawood · August 31, 2023, 3:34pm

Thanks for the update. It looks like you can now run Isaac Sim with the 535.104.05 drivers but crashes only when loading a USD file?
Which file is this and does it crash loading any usd?
Can you try run with the -v flag? There could be extra logging info that could help us determine the issue.

dave.vandermeer.001 · September 1, 2023, 4:12pm

Hi @Sheikh_Dawood ,

I can open Isaac SIm, I could do that already since the beginning of this thread.
I can even import basic geometry and even other USD files and I can save them. But as soon as I try to load an existing USD file, it crashes. And this is true for any USD file I try.

I have tried with the -v flag for more verbose output. Here is the content:

isaac.log (1.4 MB)

Sheikh_Dawood · September 5, 2023, 6:23pm

Hi Can you provide detailed steps on how you get the crash?

I did a simple test but opening Isaac Sim then go to the Content window then go to this file (while already having Nucleus installed)

omniverse://localhost/NVIDIA/Assets/Isaac/2022.2.1/Isaac/Environments/Simple_Room/simple_room.usd

Then double-click the USD file and it loads fine.

Sheikh_Dawood · September 5, 2023, 6:25pm

I think your repro case is only for USD files that has been saved by Isaac Sim 2022.2.1. There is a known crash only in Ubuntu when loading/saving USD with this version.

This issue is will be fixed in Isaac Sim 2023.1.0.

dave.vandermeer.001 · September 6, 2023, 5:19pm

To replicate it, I do the following:

I open Isaac Sim 2022.2.1 either directly through the terminal or through the GUI client. Then, I navigate with the file browser on the bottom section to my Documents folder and double click the USD file I want to open.

It also happens with an older USD file I have saved locally. It has been saved with Isaac Sim 2022.1.1 if I remember correctly.

I do not have the nucleus installed currently, but when I had it installed at the beginning of the thread, it was also not working. So currently, I do not use the nucleus to store the data.

I can imagine that the issue is related to the quite new GPU and will hopefully be fixed with Isaac Sim 2023.1.0
It is working fine with USD Composer 2023.

My current solution is to simply not use Omniverse and wait until Isaac Sim 2023.

dave.vandermeer.001 · September 21, 2023, 9:04pm

I find myself in a rather unexpected situation: It looks like the nvidia-driver-535 has removed itself automatically, for the second time already.

After rebooting the computer, after it was working fine, I now get messages that there are issues with the GPU drivers. When I want to check with nvidia-smi I get the following:

$ nvidia-smi
NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

Is this normal? Could this also be related to the issues I have with Omniverse?

Sheikh_Dawood · September 27, 2023, 4:35pm

I think this is normal when you have drivers installed using the .run installer and you did an update that modified the kernel. It just need a reinstall of the drivers.

Topic		Replies	Views
Isaac Sim 2022.2.1 stuck opening Hello World or any .USD saved file Isaac Sim	7	687	October 12, 2023
Isaac_sim crashed when I clicke "load world" in my extension Isaac Sim	2	694	May 30, 2023
Cannot open usd files Isaac Sim	7	667	September 12, 2023
Isaac sim 2023.1.1 with omniverse 1.9.11 on ubuntu 22.04 failed to launch Isaac Sim	1	150	July 16, 2024
Isaac sim container could not runheadless.native.sh Isaac Sim	2	365	November 29, 2023
Isaac sim unable to load after restart [ VkResult: ERROR_OUT_OF_DEVICE_MEMORY] Isaac Sim	7	711	January 22, 2024
Isaac Sim crashes when importing URDF with many links Isaac Sim	5	523	August 5, 2023
Isaac SIM in omniverse not launching Isaac Sim setup	62	9076	August 31, 2022
I started isaac-sim and got segmentation fault Isaac Sim ubuntu , isaac-sim-v4-2-0	2	106	November 3, 2024
Isaac Sim is not working in AWS cloud via NICE DCV Isaac Sim aws , isaacsim , nvidia-smi , cloud , isaac-sim-v4-2-0	6	62	November 21, 2024

Isaac Sim 2022.2.1 crashes after opening USD file

Related topics