Isaac Sim Failed to Run with `--no-opengl-files` during Driver Installation, while Abnormal Display Otherwise

Hi!

Description

I am using Isaac Sim after installing Nvidia driver 550.54 for my RTX 4050 laptop. But the display is abnormal with artifacts without --no-opengl-files when installing the driver. However, I cannot boot Isaac Sim if not installing opengl files. How should I solve this? Either by changing the current display to dGPU-only mode (which I tried but could not), or by booting the Isaac Sim with self-configured opengl settings?

Basic Config

Computer / System Environment: Lenovo Thinkbook 16 (Ultra 5)

Operating System: Ubuntu 20.04.6

GPU / GPU Driver: RTX4050 Laptop + NVIDIA-driver-550.54.14

Application(s) Used / Version Number: Isaac Sim 2023.1.1

Full log file (if applicable):

Install full nvidia-driver-550

Issue

Isaac Sim is running well, but the display shows artifacts with flittering blocks and latent colors around the cursor. I guess that might result from a hybrid GPU output mode.

Information

1. About Vulkan:

  • run vulkaninfo | grep GPU
\WARNING: [Loader Message] Code 0 : loader_scanned_icd_add: Driver /usr/lib/x86_64-linux-gnu/libvulkan_radeon.so supports Vulkan 1.2, but only supports loader interface version 4. Interface version 5 or newer required to support this version of Vulkan (Policy #LDP_DRIVER_7)
WARNING: [Loader Message] Code 0 : loader_scanned_icd_add: Driver /usr/lib/x86_64-linux-gnu/libvulkan_intel.so supports Vulkan 1.2, but only supports loader interface version 4. Interface version 5 or newer required to support this version of Vulkan (Policy #LDP_DRIVER_7)
WARNING: [Loader Message] Code 0 : loader_scanned_icd_add: Driver /usr/lib/x86_64-linux-gnu/libvulkan_lvp.so supports Vulkan 1.1, but only supports loader interface version 4. Interface version 5 or newer required to support this version of Vulkan (Policy #LDP_DRIVER_7)
WARNING: [Loader Message] Code 0 : Layer VK_LAYER_MESA_device_select uses API version 1.2 which is older than the application specified API version of 1.3. May cause issues.
MESA: warning: Driver does not support the 0x7d55 PCI ID.
WARNING: lavapipe is not a conformant vulkan implementation, testing use only.
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
		GPU id = 0 (NVIDIA GeForce RTX 4050 Laptop GPU)
		GPU id = 1 (llvmpipe (LLVM 12.0.0, 256 bits))
GPU id : 0 (NVIDIA GeForce RTX 4050 Laptop GPU):
GPU id : 1 (llvmpipe (LLVM 12.0.0, 256 bits)):
GPU0:
	deviceType        = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
	deviceName        = NVIDIA GeForce RTX 4050 Laptop GPU
GPU1:

  • run lspci | grep 7d55
VGA compatible controller: Intel Corporation Device 7d55 (rev 08)

2. X11 config file:

  • run cat /etc/X11/xorg.conf :
# nvidia-xconfig: X configuration file generated by nvidia-xconfig
# nvidia-xconfig:  version 550.54.14

Section "ServerLayout"
    Identifier     "Layout0"
    Screen      0  "Screen0" 0 0
    InputDevice    "Keyboard0" "CoreKeyboard"
    InputDevice    "Mouse0" "CorePointer"
    Option         "Xinerama" "0"
EndSection

Section "Files"
EndSection

Section "InputDevice"

    # generated from default
    Identifier     "Mouse0"
    Driver         "mouse"
    Option         "Protocol" "auto"
    Option         "Device" "/dev/psaux"
    Option         "Emulate3Buttons" "no"
    Option         "ZAxisMapping" "4 5"
EndSection

Section "InputDevice"

    # generated from default
    Identifier     "Keyboard0"
    Driver         "kbd"
EndSection

Section "Monitor"
    Identifier     "Monitor0"
    VendorName     "Unknown"
    ModelName      "Unknown"
    Option         "DPMS"
EndSection

Section "Device"
    Identifier     "Device0"
    Driver         "nvidia"
    VendorName     "NVIDIA Corporation"
    BoardName      "NVIDIA GeForce RTX 4050 Laptop GPU"
    BusID          "PCI:50:0:0"
EndSection

Section "Screen"
    Identifier     "Screen0"
    Device         "Device0"
    DefaultDepth    24
    Option         "AllowEmptyInitialConfiguration" "True"
    Option         "Stereo" "0"
    Option         "SLI" "Off"
    Option         "MultiGPU" "Off"
    Option         "BaseMosaic" "off"
    SubSection     "Display"
        Depth       24
    EndSubSection
EndSection

3. xrandr

  • after running prime-select nvidia successfully
  • running xrandr --listproviders still shows source-sink output with intel card
Providers: number : 2
Provider 0: id: 0x1b8 cap: 0x1, Source Output crtcs: 4 outputs: 1 associated providers: 1 name:NVIDIA-0
Provider 1: id: 0x66f cap: 0x2, Sink Output crtcs: 4 outputs: 5 associated providers: 1 name:modesetting

Install driver with --no-opengl-files flag

Issue

Display is fine, but the Isaac Sim seems rely on the opengl files to run.

Information

1. IsaacSim

  • Launch IsaacSim:
Failed to create any GPU devices, including an attempt with compatibility mode.
  • run isaac_sim.sh in .local:
MESA: warning: Driver does not support the 0x7d55 PCI ID.

|---------------------------------------------------------------------------------------------|
| Driver Version: 0             | Graphics API: Vulkan
|=============================================================================================|
| GPU | Name                             | Active | LDA | GPU Memory | Vendor-ID | LUID       |
|     |                                  |        |     |            | Device-ID | UUID       |
|     |                                  |        |     |            | Bus-ID    |            |
|=============================================================================================|
| OS: 20.04.6 LTS (Focal Fossa) ubuntu, Version: 20.04.6, Kernel: 6.7.9
| XServer Vendor: The X.Org Foundation, XServer Version: 12013000 (1.20.13.0)
| Processor: Intel(R) Core(TM) Ultra 5 125H | Cores: 14 | Logical: 14
|---------------------------------------------------------------------------------------------|
| Total Memory (MB): 15598 | Free Memory: 12067
| Total Page/Swap (MB): 2047 | Free Page/Swap: 2047
|---------------------------------------------------------------------------------------------|
2024-03-27 05:51:04 [588ms] [Error] [gpu.foundation.plugin] No device could be created. Some known system issues:
- The driver is not installed properly and requires a clean re-install.
- Your GPUs do not support RayTracing: DXR or Vulkan ray_tracing, or hardware is excluded due to performance.
- The driver cannot enumerate any GPU: driver, display, TCC mode or a docker issue. For Vulkan, test it with Vulkaninfo tool from Vulkan SDK, instead of nvidia-smi.
- For Ubuntu, it requires server-xorg-core 1.20.7+ and a display to work without --no-window.
- For Linux dockers, the setup is not complete. Install the latest driver, xServer and NVIDIA container runtime.

2024-03-27 05:51:04 [589ms] [Error] [omni.gpu_foundation_factory.plugin] Failed to create any GPU devices, including an attempt with compatibility mode.

Concerns

According to Isaac Sim official guidance, I should not install any Vulkan and Mesa utilities by myself. According to the hardware supplier, this device supports direct connection to dGPU without Optimus using the iGPU only if connecting with an integrated monitor, which I did. Nor was I able to disable the intel GPU to display only with Nvidia GPU, even using prime-select nvidia. I have checked some available troubleshooting, not to find a feasible solution.

I would appreciate it a lot if anyone could help me to solve this dilemma. Thanks!