Quadro RTX 4000 not detected with X16 on syslinux 5.15

Hi,

I use my Quadro RTX 4000 into an X10SRG-F motherboard.

The OS (Unraid Linux 5.15 kernel) doesn’t detect the card when PCI-e is set into x16. So I’ve set the PCI-e to x8 and after boot, my card is finally detected.

I did a test and replace my GPU with a GTX 1080 and set the PCI-e to x16. After boot, my card is detected. So my PCI-e slot isn’t damaged.

I checked my card with another board (and OS), and it does run with 16 lanes. So the card is functionnal.

I must mention that on my server MB, the OS boots with UEFI, Intel Virtualisation / Vt-d / ACPI / ASPM / x2apic are active, and the PCI-e can only boot with an EFI ROM. I’ve set now the power profile to “performance”.

I tried to set my MB in “Legacy/BIOS mode”, enabling CSM, disabling Vt-d, expect legacy ROM from PCI-e devices etc… But it didn’t work.

The only differences when the PCI-e is set to x8 or x16 is that the PCI-e seems to be “jumped” at the syslinux sequence as we can see in the syslogs files provided.

x16

May 22 21:39:51 rohrer-enard kernel: pci 0000:05:00.0: [8086:f1a8] type 00 class 0x010802
May 22 21:39:51 rohrer-enard kernel: pci 0000:05:00.0: reg 0x10: [mem 0xfb200000-0xfb203fff 64bit]
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:02.3: PCI bridge to [bus 05]
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:02.3:   bridge window [mem 0xfb200000-0xfb2fffff]
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:03.0: PCI bridge to [bus 06]
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:1c.0: PCI bridge to [bus 07]
May 22 21:39:51 rohrer-enard kernel: pci 0000:08:00.0: [1a03:1150] type 01 class 0x060400
May 22 21:39:51 rohrer-enard kernel: pci 0000:08:00.0: enabling Extended Tags
May 22 21:39:51 rohrer-enard kernel: pci 0000:08:00.0: supports D1 D2
May 22 21:39:51 rohrer-enard kernel: pci 0000:08:00.0: PME# supported from D0 D1 D2 D3hot D3cold
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:1c.2: PCI bridge to [bus 08-09]
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:1c.2:   bridge window [io  0xe000-0xefff]
May 22 21:39:51 rohrer-enard kernel: pci 0000:00:1c.2:   bridge window [mem 0xfa000000-0xfb0fffff]
May 22 21:39:51 rohrer-enard kernel: pci_bus 0000:09: extended config space not accessible

x8

May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: [10de:1eb1] type 00 class 0x030000
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: reg 0x14: [mem 0xffe0000000-0xffefffffff 64bit pref]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: reg 0x1c: [mem 0xfff0000000-0xfff1ffffff 64bit pref]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: reg 0x24: [io  0xe000-0xe07f]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: reg 0x30: [mem 0xfb000000-0xfb07ffff pref]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: PME# supported from D0 D3hot D3cold
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.0: 63.008 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x8 link at 0000:00:03.0 (capable of 126.016 Gb/s with 8.0 GT/s PCIe x16 link)
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.1: [10de:10f8] type 00 class 0x040300
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.1: reg 0x10: [mem 0xfb080000-0xfb083fff]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.2: [10de:1ad8] type 00 class 0x0c0330
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.2: reg 0x10: [mem 0xfff2000000-0xfff203ffff 64bit pref]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.2: reg 0x1c: [mem 0xfff2040000-0xfff204ffff 64bit pref]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.2: PME# supported from D0 D3hot D3cold
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.3: [10de:1ad9] type 00 class 0x0c8000
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.3: reg 0x10: [mem 0xfb084000-0xfb084fff]
May 22 20:16:21 rohrer-enard kernel: pci 0000:06:00.3: PME# supported from D0 D3hot D3cold
May 22 20:16:21 rohrer-enard kernel: pci 0000:00:03.0: PCI bridge to [bus 06]
May 22 20:16:21 rohrer-enard kernel: pci 0000:00:03.0:   bridge window [io  0xe000-0xefff]
May 22 20:16:21 rohrer-enard kernel: pci 0000:00:03.0:   bridge window [mem 0xfa000000-0xfb0fffff]
May 22 20:16:21 rohrer-enard kernel: pci 0000:00:03.0:   bridge window [mem 0xffe0000000-0xfff20fffff 64bit pref]
May 22 20:16:21 rohrer-enard kernel: pci 0000:00:03.2: PCI bridge to [bus 07]

Pcie device expected is pci 0000:06:00.0: [10de:1eb1]

My MB’s firmware is up-to-date, so I’d like to know if I need to insert some parameters to the syslinux sequence or if a config onto my motherboard need to be set to get my GPU detected with x16 lanes.

Thank you,
syslog.txt (220.4 KB)