Isaac Sim Install Issue: buildPipeline and shader loading failed

[user10385]

For background info, I’m running ubuntu 20.04 on a RTX 2070, with 8gb of ram, on driver version 50.86.01. Those all seem to be in line with the minimum specs, and compatible drivers. Nvidia-smi output pasted at the end.

When running isaac sim, it seems to mostly load, but freezes, and this error shows up on the console. Any clue how to solve?

2023-04-19 19:59:55 [10,885ms] [Error] [gpu.foundation.plugin] Cannot load shader file 'rtx/raytracing/Reflections.rgs.hlsl'.
2023-04-19 19:59:55 [10,885ms] [Error] [gpu.foundation.plugin] buildShaderAsync() failed: rtx/raytracing/Reflections.rgs.hlsl
2023-04-19 19:59:56 [11,837ms] [Error] [gpu.foundation.plugin] PsoRaytracing::buildPipeline and shader loading failed. RtxResult: 3, shaderHandle: 0x10000010e

For nvidia-smi,

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.86.01    Driver Version: 515.86.01    CUDA Version: 11.7     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0  On |                  N/A |
| 31%   55C    P2    50W / 185W |   5356MiB /  8192MiB |     21%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      1263      G   /usr/lib/xorg/Xorg                 62MiB |
|    0   N/A  N/A      1984      G   /usr/lib/xorg/Xorg                 68MiB |
|    0   N/A  N/A     77676      G   /usr/lib/xorg/Xorg                149MiB |
|    0   N/A  N/A     77817      G   /usr/bin/gnome-shell               45MiB |
|    0   N/A  N/A     78835      C   python3                          4411MiB |
|    0   N/A  N/A     79899      G   /usr/lib/firefox/firefox          155MiB |
|    0   N/A  N/A     80032      G   ...RendererForSitePerProcess       19MiB |
|    0   N/A  N/A     83430    C+G   ...saac_sim-2022.2.1/kit/kit      411MiB |
+-----------------------------------------------------------------------------+

and for nvidia-smi -L

GPU 0: NVIDIA GeForce RTX 2070

[rthaker]

Hi @user10385 - Can you update your drivers according to instructions provided in the doc: https://docs.omniverse.nvidia.com/app_isaacsim/app_isaacsim/requirements.html

Also, this thread might helpful to you:

Avoid repeated shader compilation

I am using my workstation installation with other users. It seems that every time a user launches a standalone python script, the others have to recompile ray tracing shader, hinted by the message Waiting for compilation of ray tracing shaders by GPU driver: 30 seconds so far … Even worse, I have to go through this process many times when debugging. I think it has something to do with how the compiled shader is cached but have no idea where the configuration is. What is the correct way to…

IsaacSim Startup problems | Ubuntu 22.04 | Waiting for compilation of ray tracing shaders by GPU driver

Hi @kruzland - Can you update the driver to recommended version ( 525.60.11) for linux and see if issue gets resolved? In addition this forum discussion might help you: Isaac Sim recompiling ray tracing shaders every time it is opened

[user10385]

@rthaker I updated the driver to 525.105.17 following the instructions in the installation guide. No change in error. Then, cleared shader cache with rm -r ~/.cache/ov/Kit/*. No change in error. Haven’t tried downgrading to 2022.2.0 Sim version. I have 32 G ram, and 8G VRAM so I seem to meet minimum spec. What else could be wrong?

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.105.17   Driver Version: 525.105.17   CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:01:00.0  On |                  N/A |
|  0%   46C    P8     2W / 185W |    844MiB /  8192MiB |      2%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      1247      G   /usr/lib/xorg/Xorg                 29MiB |
|    0   N/A  N/A      1977      G   /usr/lib/xorg/Xorg                110MiB |
|    0   N/A  N/A      2102      G   /usr/bin/gnome-shell               82MiB |
|    0   N/A  N/A      2978      G   ...RendererForSitePerProcess       39MiB |
|    0   N/A  N/A      3933    C+G   ...saac_sim-2022.2.1/kit/kit      420MiB |
|    0   N/A  N/A      4220      G   /usr/lib/firefox/firefox          145MiB |
+-----------------------------------------------------------------------------+

[Sheikh_Dawood]

Hi. Try removing the folders below:

/etc/vulkan/
/usr/share/vulkan/

Then resintall the latest 525 drivers.

[user10385]

@Sheikh_Dawood Did that, with sudo rm -rf /etc/vulkan/ and sudo rm -rf /usr/share/vulkan/ and reinstalled the driver, with no effect. Same error. Only change is my driver version is now 525.116.03.

Also tried deleting the shader cache and the vulkan folders, and then reinstalling, to no effect.

[Sheikh_Dawood]

Hi. Can you please share your Isaac Sim log file.

[user10385]

@Sheikh_Dawood

Here’s a log file from a run without clearing anything:
kit_20230505_101151.log (1.4 MB)

And I think this is one where I cleared the vulkan and cache folders:
kit_20230501_103142.log (1.4 MB)

[Sheikh_Dawood]

Thanks. Are you able to install and run Create and Code?

[Sheikh_Dawood]

Another thing to try is uninstall Isaac Sim, make sure this folder is empty or remove it.
~/.local/share/ov/pkg/isaac_sim-2022.2.1
Then re-install Isaac Sim and run.

[user10385]

It seems like I can run create and code, but they show

RTX Loading

In the viewport, and exit themselves after a bit. So I can’t actually use them. I’ll try re-installing.

[user10385]

@Sheikh_Dawood

Okay looks like I got a different error. Here’s the log from it. I couldn’t copy the error message because it closed the terminal.

kit_20230505_131219.log (1.7 MB)

[Sheikh_Dawood]

Hi. Are you able to run and older version of Isaac Sim or Create successfully?

[user10385]

After the last change, it started to work, so I’m able to run sim now.