SOLVED - RmInitAdapter failed! to load 530.41.03 (or any nvidia modules other than 450.236.01) Linux via ESXi 7.0u3 Passthrough PCI GTX 1650

This was solved! See 2nd post for solution.

Running ESXi 7.0u3 on Dell PowerEdge T320
EFI Secure Boot (Still occurs with unsigned modules and secure boot DISABLED. Also occurs in BIOS mode vs EFI.)
Ubuntu Server 22.04
NVIDIA GTX 1650
Guest OS: 20 CPU Cores, 32GB RAM

nvidia-bug-report crashes the system so I’ve put what I can below.

I was only able to get the following driver to work at all: nvidia-srv-450.236.01 (provided by ubuntu nvidia-driver-450-server)

I have tried at least every one of these drivers:

  • NVIDIA-Linux-x86_64-460.91.03.run*
  • NVIDIA-Linux-x86_64-470.141.03.run*
  • NVIDIA-Linux-x86_64-470.182.03.run*
  • NVIDIA-Linux-x86_64-510.108.03.run*
  • NVIDIA-Linux-x86_64-515.105.01.run*
  • NVIDIA-Linux-x86_64-515.43.04.run*
  • NVIDIA-Linux-x86_64-520.56.06.run*
  • NVIDIA-Linux-x86_64-525.116.04.run*
  • NVIDIA-Linux-x86_64-530.41.03.run*

Including these Ubuntu drivers:

  • nvidia-driver-525
  • nvidia-driver-470-server
  • nvidia-driver-515-server

nvidia-driver-450-server is the only working one.

Using any other driver from ubuntu or directly from NVIDIA causes things like RmInitAdapter failed! and the issues below. Problems occur regardless of modprobe config or VM advanced config options.

VM Advanced Options

hypervisor.cpuid.v0 = FALSE
pciPassthru0.msiEnabled = FALSE

Attempting to load any other driver than the 450 branch causes the following types of errors in dmesg and causes the system (both guest and host) to hang.

main dmesg error using 530.41.03

[   12.563607] nvidia: loading out-of-tree module taints kernel.
[   12.563675] nvidia: module license 'NVIDIA' taints kernel.
[   12.563678] Disabling lock debugging due to kernel taint
[   12.640711] nvidia-nvlink: Nvlink Core is being initialized, major device number 235

[   12.644992] nvidia 0000:0b:00.0: enabling device (0000 -> 0003)
[   12.648599] nvidia 0000:0b:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
[   12.699654] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  530.41.03  Thu Mar 16 19:48:20 UTC 2023
[   12.762447] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  530.41.03  Thu Mar 16 19:23:04 UTC 2023
[   12.871331] [drm] [nvidia-drm] [GPU ID 0x00000b00] Loading driver
[   12.972022] ACPI Warning: \_SB.PCI0.PE50.S1F0._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20210730/nsarguments-61)
[   13.732645] NVRM: GPU 0000:0b:00.0: RmInitAdapter failed! (0x26:0x56:1474)
[   13.732697] BUG: unable to handle page fault for address: 0000000000004628
[   13.732784] NVRM: GPU 0000:0b:00.0: rm_init_adapter failed, device minor number 0
[   13.732817] #PF: supervisor read access in kernel mode
[   13.733017] #PF: error_code(0x0000) - not-present page
[   13.733099] PGD 0 P4D 0
[   13.733143] Oops: 0000 [#1] SMP PTI
[   13.733202] CPU: 0 PID: 1202 Comm: nv_queue Tainted: P           O      5.15.0-71-generic #78-Ubuntu
[   13.733348] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.18227214.B64.2106252220 06/25/2021
[   13.733537] RIP: 0010:_nv010655rm+0x3b/0xb0 [nvidia]
[   13.735739] Code: e3 a1 dd 02 48 8b bb 68 01 00 00 e8 7f cc 5a 00 85 c0 74 0b 48 83 c4 08 5b 41 5c c3 0f 1f 00 44 89 e7 e8 98 67 b6 ff 48 89 c7 <8b> 80 28 46 00 00 83 f8 01 74 38 80 bf 71 07 00 00 00 74 49 80 bf
[   13.736034] RSP: 0018:ffffbb5540c7bdc8 EFLAGS: 00010246
[   13.736119] RAX: 0000000000000000 RBX: ffffa0159a659408 RCX: 0000000000000000
[   13.736233] RDX: ffffbb5541fc1008 RSI: 0000000000000000 RDI: 0000000000000000
[   13.736346] RBP: ffffa015a2056000 R08: 0000000000000000 R09: 0000000000000000
[   13.736460] R10: ffffbb5540c7be70 R11: c00c03afbfbfe201 R12: 0000000000000000
[   13.736573] R13: ffffbb5540c7bec8 R14: ffffa015992ebd28 R15: ffffa01587243240
[   13.736688] FS:  0000000000000000(0000) GS:ffffa01c9f800000(0000) knlGS:0000000000000000
[   13.736817] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   13.736909] CR2: 0000000000004628 CR3: 0000000122fea006 CR4: 00000000001706f0
[   13.737050] Call Trace:
[   13.739729]  <TASK>
[   13.739733]  ? rm_execute_work_item+0xed/0x130 [nvidia]
[   13.741662]  ? os_execute_work_item+0x69/0x90 [nvidia]
[   13.743771]  ? _main_loop+0x89/0x140 [nvidia]
[   13.745868]  ? nvidia_modeset_resume+0x30/0x30 [nvidia]
[   13.748064]  ? kthread+0x127/0x150
[   13.748125]  ? set_kthread_struct+0x50/0x50
[   13.748197]  ? ret_from_fork+0x1f/0x30
[   13.748266]  </TASK>
[   13.748301] Modules linked in: nvidia_drm(PO+) nvidia_modeset(PO) nvidia(PO) nls_iso8859_1 intel_rapl_msr vmw_balloon intel_rapl_common sb_edac rapl intel_cstate joydev input_leds serio_raw vmw_vmci mac_hid sch_fq_codel dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua msr ramoops reed_solomon pstore_blk pstore_
zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear vmwgfx ttm hid_generic drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops crc32_pclmu
l ghash_clmulni_intel cec usbhid aesni_intel mptspi mptscsih ahci rc_core mptbase crypto_simd cryptd psmouse drm hid vmxnet3 libahci scsi_transport_spi i2c_piix4 pata_acpi
[   13.749536] CR2: 0000000000004628
[   13.749590] ---[ end trace 4511c364921d51e4 ]---
[   13.860906] RIP: 0010:_nv010655rm+0x3b/0xb0 [nvidia]
[   13.862938] Code: e3 a1 dd 02 48 8b bb 68 01 00 00 e8 7f cc 5a 00 85 c0 74 0b 48 83 c4 08 5b 41 5c c3 0f 1f 00 44 89 e7 e8 98 67 b6 ff 48 89 c7 <8b> 80 28 46 00 00 83 f8 01 74 38 80 bf 71 07 00 00 00 74 49 80 bf
[   13.863223] RSP: 0018:ffffbb5540c7bdc8 EFLAGS: 00010246
[   13.863302] RAX: 0000000000000000 RBX: ffffa0159a659408 RCX: 0000000000000000
[   13.863447] RDX: ffffbb5541fc1008 RSI: 0000000000000000 RDI: 0000000000000000
[   13.866736] RBP: ffffa015a2056000 R08: 0000000000000000 R09: 0000000000000000
[   13.869988] R10: ffffbb5540c7be70 R11: c00c03afbfbfe201 R12: 0000000000000000
[   13.873260] R13: ffffbb5540c7bec8 R14: ffffa015992ebd28 R15: ffffa01587243240
[   13.876588] FS:  0000000000000000(0000) GS:ffffa01c9f800000(0000) knlGS:0000000000000000
[   13.879994] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   13.883434] CR2: 0000000000004628 CR3: 0000000122fea006 CR4: 00000000001706f0

full dmesg (abridged somewhat due to post limits, scroll to bottom of dmesg output for error)

[    0.501903] PCI: MMCONFIG for domain 0000 [bus 00-7f] at [mem 0xe0000000-0xe7ffffff] (base 0xe0000000)
[    0.510676] PCI: MMCONFIG at [mem 0xe0000000-0xe7ffffff] reserved in ACPI motherboard resources
[    0.510749] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.510757] PCI: Using E820 reservations for host bridge windows
[    0.515458] ACPI: Enabled 4 GPEs in block 00 to 0F
[    0.708134] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7f])
[    0.708165] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    0.710111] acpi PNP0A03:00: _OSC: platform does not support [AER LTR DPC]
[    0.712331] acpi PNP0A03:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability]
[    0.717217] PCI host bridge to bus 0000:00
[    0.717234] pci_bus 0000:00: root bus resource [bus 00-7f]
[    0.717246] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.717259] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.717272] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.717285] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000cbfff window]
[    0.717298] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000dbfff window]
[    0.717311] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000effff window]
[    0.717324] pci_bus 0000:00: root bus resource [mem 0xd2000000-0xe7ffffff window]
[    0.717337] pci_bus 0000:00: root bus resource [mem 0xf2300000-0xfebfffff window]
[    0.717350] pci_bus 0000:00: root bus resource [mem 0xfec10000-0xfed3ffff window]
[    0.717363] pci_bus 0000:00: root bus resource [mem 0xfed45000-0xfedfffff window]
[    0.717376] pci_bus 0000:00: root bus resource [mem 0xfef00000-0xffdfffff window]
[    0.717389] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xd1ffffff pref window]
[    0.717403] pci_bus 0000:00: root bus resource [mem 0xe8000000-0xf22fffff pref window]
[    0.718318] pci 0000:00:00.0: [8086:7190] type 00 class 0x060000
[    0.721810] pci 0000:00:01.0: [8086:7191] type 01 class 0x060400
[    0.724600] pci 0000:00:07.0: [8086:7110] type 00 class 0x060100
[    0.727907] pci 0000:00:07.1: [8086:7111] type 00 class 0x01018a
[    0.730515] pci 0000:00:07.1: reg 0x20: [io  0x2150-0x215f]
[    0.731562] pci 0000:00:07.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.731576] pci 0000:00:07.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.731586] pci 0000:00:07.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.731597] pci 0000:00:07.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.733617] pci 0000:00:07.3: [8086:7113] type 00 class 0x068000
[    0.734675] pci 0000:00:07.3: quirk: [io  0x0440-0x047f] claimed by PIIX4 ACPI
[    0.736328] pci 0000:00:07.7: [15ad:0740] type 00 class 0x088000
[    0.736649] pci 0000:00:07.7: reg 0x10: [io  0x0000-0x003f]
[    0.736880] pci 0000:00:07.7: reg 0x14: [mem 0x00000000-0x00001fff 64bit]
[    0.740069] pci 0000:00:0f.0: [15ad:0405] type 00 class 0x030000
[    0.742519] pci 0000:00:0f.0: reg 0x10: [io  0x2140-0x214f]
[    0.744687] pci 0000:00:0f.0: reg 0x14: [mem 0xe8000000-0xefffffff pref]
[    0.746515] pci 0000:00:0f.0: reg 0x18: [mem 0xf9000000-0xf97fffff]
[    0.754515] pci 0000:00:0f.0: reg 0x30: [mem 0xffff8000-0xffffffff pref]
[    0.754650] pci 0000:00:0f.0: BAR 1: assigned to efifb
[    0.754734] pci 0000:00:0f.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.757180] pci 0000:00:10.0: [1000:0030] type 00 class 0x010000
[    0.758514] pci 0000:00:10.0: reg 0x10: [io  0x2000-0x20ff]
[    0.760535] pci 0000:00:10.0: reg 0x14: [mem 0xffbc0000-0xffbdffff 64bit]
[    0.762041] pci 0000:00:10.0: reg 0x1c: [mem 0xffba0000-0xffbbffff 64bit]
[    0.764234] pci 0000:00:10.0: reg 0x30: [mem 0xffffc000-0xffffffff pref]
[    0.767214] pci 0000:00:11.0: [15ad:0790] type 01 class 0x060401
[    0.770804] pci 0000:00:15.0: [15ad:07a0] type 01 class 0x060400
[    0.772822] pci 0000:00:15.0: PME# supported from D0 D3hot D3cold
[    0.775362] pci 0000:00:15.1: [15ad:07a0] type 01 class 0x060400
[    0.777401] pci 0000:00:15.1: PME# supported from D0 D3hot D3cold
[    0.779908] pci 0000:00:15.2: [15ad:07a0] type 01 class 0x060400
[    0.781950] pci 0000:00:15.2: PME# supported from D0 D3hot D3cold
[    0.784451] pci 0000:00:15.3: [15ad:07a0] type 01 class 0x060400
[    0.786489] pci 0000:00:15.3: PME# supported from D0 D3hot D3cold
[    0.788969] pci 0000:00:15.4: [15ad:07a0] type 01 class 0x060400
[    0.791001] pci 0000:00:15.4: PME# supported from D0 D3hot D3cold
[    0.793541] pci 0000:00:15.5: [15ad:07a0] type 01 class 0x060400
[    0.795558] pci 0000:00:15.5: PME# supported from D0 D3hot D3cold
[    0.798097] pci 0000:00:15.6: [15ad:07a0] type 01 class 0x060400
[    0.800114] pci 0000:00:15.6: PME# supported from D0 D3hot D3cold
[    0.802642] pci 0000:00:15.7: [15ad:07a0] type 01 class 0x060400
[    0.804656] pci 0000:00:15.7: PME# supported from D0 D3hot D3cold
[    0.807180] pci 0000:00:16.0: [15ad:07a0] type 01 class 0x060400
[    0.809196] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    0.811729] pci 0000:00:16.1: [15ad:07a0] type 01 class 0x060400
[    0.813769] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[    0.816271] pci 0000:00:16.2: [15ad:07a0] type 01 class 0x060400
[    0.818311] pci 0000:00:16.2: PME# supported from D0 D3hot D3cold
[    0.820804] pci 0000:00:16.3: [15ad:07a0] type 01 class 0x060400
[    0.822839] pci 0000:00:16.3: PME# supported from D0 D3hot D3cold
[    0.825339] pci 0000:00:16.4: [15ad:07a0] type 01 class 0x060400
[    0.827369] pci 0000:00:16.4: PME# supported from D0 D3hot D3cold
[    0.829900] pci 0000:00:16.5: [15ad:07a0] type 01 class 0x060400
[    0.831908] pci 0000:00:16.5: PME# supported from D0 D3hot D3cold
[    0.834438] pci 0000:00:16.6: [15ad:07a0] type 01 class 0x060400
[    0.836441] pci 0000:00:16.6: PME# supported from D0 D3hot D3cold
[    0.838976] pci 0000:00:16.7: [15ad:07a0] type 01 class 0x060400
[    0.840994] pci 0000:00:16.7: PME# supported from D0 D3hot D3cold
[    0.843536] pci 0000:00:17.0: [15ad:07a0] type 01 class 0x060400
[    0.845557] pci 0000:00:17.0: PME# supported from D0 D3hot D3cold
[    0.848071] pci 0000:00:17.1: [15ad:07a0] type 01 class 0x060400
[    0.850112] pci 0000:00:17.1: PME# supported from D0 D3hot D3cold
[    0.852615] pci 0000:00:17.2: [15ad:07a0] type 01 class 0x060400
[    0.854657] pci 0000:00:17.2: PME# supported from D0 D3hot D3cold
[    0.857182] pci 0000:00:17.3: [15ad:07a0] type 01 class 0x060400
[    0.859203] pci 0000:00:17.3: PME# supported from D0 D3hot D3cold
[    0.861702] pci 0000:00:17.4: [15ad:07a0] type 01 class 0x060400
[    0.863743] pci 0000:00:17.4: PME# supported from D0 D3hot D3cold
[    0.866274] pci 0000:00:17.5: [15ad:07a0] type 01 class 0x060400
[    0.868274] pci 0000:00:17.5: PME# supported from D0 D3hot D3cold
[    0.870801] pci 0000:00:17.6: [15ad:07a0] type 01 class 0x060400
[    0.872816] pci 0000:00:17.6: PME# supported from D0 D3hot D3cold
[    0.875361] pci 0000:00:17.7: [15ad:07a0] type 01 class 0x060400
[    0.877376] pci 0000:00:17.7: PME# supported from D0 D3hot D3cold
[    0.879905] pci 0000:00:18.0: [15ad:07a0] type 01 class 0x060400
[    0.881919] pci 0000:00:18.0: PME# supported from D0 D3hot D3cold
[    0.884451] pci 0000:00:18.1: [15ad:07a0] type 01 class 0x060400
[    0.886488] pci 0000:00:18.1: PME# supported from D0 D3hot D3cold
[    0.888972] pci 0000:00:18.2: [15ad:07a0] type 01 class 0x060400
[    0.890998] pci 0000:00:18.2: PME# supported from D0 D3hot D3cold
[    0.893502] pci 0000:00:18.3: [15ad:07a0] type 01 class 0x060400
[    0.895534] pci 0000:00:18.3: PME# supported from D0 D3hot D3cold
[    0.898027] pci 0000:00:18.4: [15ad:07a0] type 01 class 0x060400
[    0.900066] pci 0000:00:18.4: PME# supported from D0 D3hot D3cold
[    0.902578] pci 0000:00:18.5: [15ad:07a0] type 01 class 0x060400
[    0.904596] pci 0000:00:18.5: PME# supported from D0 D3hot D3cold
[    0.907141] pci 0000:00:18.6: [15ad:07a0] type 01 class 0x060400
[    0.909153] pci 0000:00:18.6: PME# supported from D0 D3hot D3cold
[    0.911677] pci 0000:00:18.7: [15ad:07a0] type 01 class 0x060400
[    0.913692] pci 0000:00:18.7: PME# supported from D0 D3hot D3cold
[    0.914992] pci_bus 0000:01: extended config space not accessible
[    0.915230] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.915763] pci_bus 0000:02: extended config space not accessible
[    0.917993] acpiphp: Slot [32] registered
[    0.918126] acpiphp: Slot [33] registered
[    0.918254] acpiphp: Slot [34] registered
[    0.918396] acpiphp: Slot [35] registered
[    0.918531] acpiphp: Slot [36] registered
[    0.918657] acpiphp: Slot [37] registered
[    0.918778] acpiphp: Slot [38] registered
[    0.918899] acpiphp: Slot [39] registered
[    0.919019] acpiphp: Slot [40] registered
[    0.919139] acpiphp: Slot [41] registered
[    0.919268] acpiphp: Slot [42] registered
[    0.919391] acpiphp: Slot [43] registered
[    0.919512] acpiphp: Slot [44] registered
[    0.919632] acpiphp: Slot [45] registered
[    0.919753] acpiphp: Slot [46] registered
[    0.919874] acpiphp: Slot [47] registered
[    0.919994] acpiphp: Slot [48] registered
[    0.920121] acpiphp: Slot [49] registered
[    0.920253] acpiphp: Slot [50] registered
[    0.920375] acpiphp: Slot [51] registered
[    0.920531] acpiphp: Slot [52] registered
[    0.920657] acpiphp: Slot [53] registered
[    0.920778] acpiphp: Slot [54] registered
[    0.920905] acpiphp: Slot [55] registered
[    0.921027] acpiphp: Slot [56] registered
[    0.921149] acpiphp: Slot [57] registered
[    0.921273] acpiphp: Slot [58] registered
[    0.921394] acpiphp: Slot [59] registered
[    0.921515] acpiphp: Slot [60] registered
[    0.921642] acpiphp: Slot [61] registered
[    0.921764] acpiphp: Slot [62] registered
[    0.921885] acpiphp: Slot [63] registered
[    0.923200] pci 0000:02:00.0: [15ad:0774] type 00 class 0x0c0300
[    0.925991] pci 0000:02:00.0: reg 0x20: [io  0x1000-0x101f]
[    0.933042] pci 0000:02:01.0: [15ad:0770] type 00 class 0x0c0320
[    0.934368] pci 0000:02:01.0: reg 0x10: [mem 0xf9811000-0xf9811fff]
[    0.945801] pci 0000:02:03.0: [15ad:07e0] type 00 class 0x010601
[    0.952062] pci 0000:02:03.0: reg 0x24: [mem 0xf9810000-0xf9810fff]
[    0.952954] pci 0000:02:03.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[    0.953948] pci 0000:02:03.0: PME# supported from D3hot
[    0.958745] pci 0000:00:11.0: PCI bridge to [bus 02] (subtractive decode)
[    0.958807] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    0.958866] pci 0000:00:11.0:   bridge window [mem 0xf9800000-0xfa1fffff]
[    0.958971] pci 0000:00:11.0:   bridge window [mem 0xf0000000-0xf04fffff 64bit pref]
[    0.958985] pci 0000:00:11.0:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.958997] pci 0000:00:11.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.959010] pci 0000:00:11.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.959023] pci 0000:00:11.0:   bridge window [mem 0x000c4000-0x000cbfff window] (subtractive decode)
[    0.959035] pci 0000:00:11.0:   bridge window [mem 0x000d4000-0x000dbfff window] (subtractive decode)
[    0.959048] pci 0000:00:11.0:   bridge window [mem 0x000e4000-0x000effff window] (subtractive decode)
[    0.959061] pci 0000:00:11.0:   bridge window [mem 0xd2000000-0xe7ffffff window] (subtractive decode)
[    0.959074] pci 0000:00:11.0:   bridge window [mem 0xf2300000-0xfebfffff window] (subtractive decode)
[    0.959087] pci 0000:00:11.0:   bridge window [mem 0xfec10000-0xfed3ffff window] (subtractive decode)
[    0.959100] pci 0000:00:11.0:   bridge window [mem 0xfed45000-0xfedfffff window] (subtractive decode)
[    0.959113] pci 0000:00:11.0:   bridge window [mem 0xfef00000-0xffdfffff window] (subtractive decode)
[    0.959126] pci 0000:00:11.0:   bridge window [mem 0xc0000000-0xd1ffffff pref window] (subtractive decode)
[    0.959140] pci 0000:00:11.0:   bridge window [mem 0xe8000000-0xf22fffff pref window] (subtractive decode)
[    0.960330] pci 0000:03:00.0: [15ad:07b0] type 00 class 0x020000
[    0.960987] pci 0000:03:00.0: reg 0x10: [mem 0xfde13000-0xfde13fff]
[    0.961119] pci 0000:03:00.0: reg 0x14: [mem 0xfde12000-0xfde12fff]
[    0.961249] pci 0000:03:00.0: reg 0x18: [mem 0xfde10000-0xfde11fff]
[    0.961380] pci 0000:03:00.0: reg 0x1c: [io  0x4000-0x400f]
[    0.961782] pci 0000:03:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[    0.963020] pci 0000:03:00.0: supports D1 D2
[    0.963030] pci 0000:03:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.967843] pci 0000:03:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    0.968006] pci 0000:00:15.0: PCI bridge to [bus 03]
[    0.968066] pci 0000:00:15.0:   bridge window [io  0x4000-0x4fff]
[    0.968124] pci 0000:00:15.0:   bridge window [mem 0xfde00000-0xfdefffff]
[    0.969046] pci 0000:00:15.1: PCI bridge to [bus 04]
[    0.969157] pci 0000:00:15.1:   bridge window [mem 0xfdd00000-0xfddfffff]
[    0.969273] pci 0000:00:15.1:   bridge window [mem 0xf2200000-0xf22fffff 64bit pref]
[    0.970146] pci 0000:00:15.2: PCI bridge to [bus 05]
[    0.970251] pci 0000:00:15.2:   bridge window [mem 0xfdc00000-0xfdcfffff]
[    0.970357] pci 0000:00:15.2:   bridge window [mem 0xf2100000-0xf21fffff 64bit pref]
[    0.971254] pci 0000:00:15.3: PCI bridge to [bus 06]
[    0.971360] pci 0000:00:15.3:   bridge window [mem 0xfdb00000-0xfdbfffff]
[    0.971497] pci 0000:00:15.3:   bridge window [mem 0xf2000000-0xf20fffff 64bit pref]
[    0.972354] pci 0000:00:15.4: PCI bridge to [bus 07]
[    0.972505] pci 0000:00:15.4:   bridge window [mem 0xfda00000-0xfdafffff]
[    0.972615] pci 0000:00:15.4:   bridge window [mem 0xf1f00000-0xf1ffffff 64bit pref]
[    0.973512] pci 0000:00:15.5: PCI bridge to [bus 08]
[    0.973653] pci 0000:00:15.5:   bridge window [mem 0xfd900000-0xfd9fffff]
[    0.973762] pci 0000:00:15.5:   bridge window [mem 0xf1e00000-0xf1efffff 64bit pref]
[    0.974624] pci 0000:00:15.6: PCI bridge to [bus 09]
[    0.974735] pci 0000:00:15.6:   bridge window [mem 0xfd800000-0xfd8fffff]
[    0.974860] pci 0000:00:15.6:   bridge window [mem 0xf1d00000-0xf1dfffff 64bit pref]
[    0.975755] pci 0000:00:15.7: PCI bridge to [bus 0a]
[    0.975864] pci 0000:00:15.7:   bridge window [mem 0xfd700000-0xfd7fffff]
[    0.976003] pci 0000:00:15.7:   bridge window [mem 0xf1c00000-0xf1cfffff 64bit pref]
[    0.977635] pci 0000:0b:00.0: [10de:1f82] type 00 class 0x030000
[    0.978013] pci 0000:0b:00.0: reg 0x10: [mem 0xfb000000-0xfbffffff]
[    0.978251] pci 0000:0b:00.0: reg 0x14: [mem 0xc0000000-0xcfffffff 64bit pref]
[    0.978510] pci 0000:0b:00.0: reg 0x1c: [mem 0xd0000000-0xd1ffffff 64bit pref]
[    0.978654] pci 0000:0b:00.0: reg 0x24: [io  0x3000-0x307f]
[    0.980773] pci 0000:0b:00.0: PME# supported from D0 D3hot D3cold
[    0.986684] pci 0000:0b:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    0.986836] pci 0000:00:16.0: PCI bridge to [bus 0b]
[    0.986919] pci 0000:00:16.0:   bridge window [io  0x3000-0x3fff]
[    0.986978] pci 0000:00:16.0:   bridge window [mem 0xfb000000-0xfbffffff]
[    0.987084] pci 0000:00:16.0:   bridge window [mem 0xc0000000-0xd1ffffff 64bit pref]
[    0.987945] pci 0000:00:16.1: PCI bridge to [bus 0c]
[    0.988050] pci 0000:00:16.1:   bridge window [mem 0xfd600000-0xfd6fffff]
[    0.988155] pci 0000:00:16.1:   bridge window [mem 0xf1b00000-0xf1bfffff 64bit pref]
[    0.989029] pci 0000:00:16.2: PCI bridge to [bus 0d]
[    0.989133] pci 0000:00:16.2:   bridge window [mem 0xfd500000-0xfd5fffff]
[    0.989271] pci 0000:00:16.2:   bridge window [mem 0xf1a00000-0xf1afffff 64bit pref]
[    0.990136] pci 0000:00:16.3: PCI bridge to [bus 0e]
[    0.990240] pci 0000:00:16.3:   bridge window [mem 0xfd400000-0xfd4fffff]
[    0.990345] pci 0000:00:16.3:   bridge window [mem 0xf1900000-0xf19fffff 64bit pref]
[    0.991208] pci 0000:00:16.4: PCI bridge to [bus 0f]
[    0.991313] pci 0000:00:16.4:   bridge window [mem 0xfd300000-0xfd3fffff]
[    0.991417] pci 0000:00:16.4:   bridge window [mem 0xf1800000-0xf18fffff 64bit pref]
[    0.992518] pci 0000:00:16.5: PCI bridge to [bus 10]
[    0.992623] pci 0000:00:16.5:   bridge window [mem 0xfd200000-0xfd2fffff]
[    0.992727] pci 0000:00:16.5:   bridge window [mem 0xf1700000-0xf17fffff 64bit pref]
[    0.993558] pci 0000:00:16.6: PCI bridge to [bus 11]
[    0.993663] pci 0000:00:16.6:   bridge window [mem 0xfd100000-0xfd1fffff]
[    0.993768] pci 0000:00:16.6:   bridge window [mem 0xf1600000-0xf16fffff 64bit pref]
[    0.994693] pci 0000:00:16.7: PCI bridge to [bus 12]
[    0.994798] pci 0000:00:16.7:   bridge window [mem 0xfd000000-0xfd0fffff]
[    0.994946] pci 0000:00:16.7:   bridge window [mem 0xf1500000-0xf15fffff 64bit pref]
[    0.995833] pci 0000:00:17.0: PCI bridge to [bus 13]
[    0.995980] pci 0000:00:17.0:   bridge window [mem 0xfcf00000-0xfcffffff]
[    0.996084] pci 0000:00:17.0:   bridge window [mem 0xf1400000-0xf14fffff 64bit pref]
[    0.996953] pci 0000:00:17.1: PCI bridge to [bus 14]
[    0.997058] pci 0000:00:17.1:   bridge window [mem 0xfce00000-0xfcefffff]
[    0.997162] pci 0000:00:17.1:   bridge window [mem 0xf1300000-0xf13fffff 64bit pref]
[    0.998071] pci 0000:00:17.2: PCI bridge to [bus 15]
[    0.998176] pci 0000:00:17.2:   bridge window [mem 0xfcd00000-0xfcdfffff]
[    0.998280] pci 0000:00:17.2:   bridge window [mem 0xf1200000-0xf12fffff 64bit pref]
[    0.999183] pci 0000:00:17.3: PCI bridge to [bus 16]
[    0.999321] pci 0000:00:17.3:   bridge window [mem 0xfcc00000-0xfccfffff]
[    0.999429] pci 0000:00:17.3:   bridge window [mem 0xf1100000-0xf11fffff 64bit pref]
[    1.000291] pci 0000:00:17.4: PCI bridge to [bus 17]
[    1.000395] pci 0000:00:17.4:   bridge window [mem 0xfcb00000-0xfcbfffff]
[    1.000504] pci 0000:00:17.4:   bridge window [mem 0xf1000000-0xf10fffff 64bit pref]
[    1.001416] pci 0000:00:17.5: PCI bridge to [bus 18]
[    1.001556] pci 0000:00:17.5:   bridge window [mem 0xfca00000-0xfcafffff]
[    1.001660] pci 0000:00:17.5:   bridge window [mem 0xf0f00000-0xf0ffffff 64bit pref]
[    1.002528] pci 0000:00:17.6: PCI bridge to [bus 19]
[    1.002634] pci 0000:00:17.6:   bridge window [mem 0xfc900000-0xfc9fffff]
[    1.002738] pci 0000:00:17.6:   bridge window [mem 0xf0e00000-0xf0efffff 64bit pref]
[    1.003660] pci 0000:00:17.7: PCI bridge to [bus 1a]
[    1.003764] pci 0000:00:17.7:   bridge window [mem 0xfc800000-0xfc8fffff]
[    1.003897] pci 0000:00:17.7:   bridge window [mem 0xf0d00000-0xf0dfffff 64bit pref]
[    1.004759] pci 0000:00:18.0: PCI bridge to [bus 1b]
[    1.004863] pci 0000:00:18.0:   bridge window [mem 0xfc700000-0xfc7fffff]
[    1.004967] pci 0000:00:18.0:   bridge window [mem 0xf0c00000-0xf0cfffff 64bit pref]
[    1.005854] pci 0000:00:18.1: PCI bridge to [bus 1c]
[    1.005959] pci 0000:00:18.1:   bridge window [mem 0xfc600000-0xfc6fffff]
[    1.006063] pci 0000:00:18.1:   bridge window [mem 0xf0b00000-0xf0bfffff 64bit pref]
[    1.006955] pci 0000:00:18.2: PCI bridge to [bus 1d]
[    1.007127] pci 0000:00:18.2:   bridge window [mem 0xfc500000-0xfc5fffff]
[    1.007233] pci 0000:00:18.2:   bridge window [mem 0xf0a00000-0xf0afffff 64bit pref]
[    1.008105] pci 0000:00:18.3: PCI bridge to [bus 1e]
[    1.008210] pci 0000:00:18.3:   bridge window [mem 0xfc400000-0xfc4fffff]
[    1.008314] pci 0000:00:18.3:   bridge window [mem 0xf0900000-0xf09fffff 64bit pref]
[    1.009487] pci 0000:00:18.4: PCI bridge to [bus 1f]
[    1.009593] pci 0000:00:18.4:   bridge window [mem 0xfc300000-0xfc3fffff]
[    1.009697] pci 0000:00:18.4:   bridge window [mem 0xf0800000-0xf08fffff 64bit pref]
[    1.010529] pci 0000:00:18.5: PCI bridge to [bus 20]
[    1.010635] pci 0000:00:18.5:   bridge window [mem 0xfc200000-0xfc2fffff]
[    1.010739] pci 0000:00:18.5:   bridge window [mem 0xf0700000-0xf07fffff 64bit pref]
[    1.011611] pci 0000:00:18.6: PCI bridge to [bus 21]
[    1.011716] pci 0000:00:18.6:   bridge window [mem 0xfc100000-0xfc1fffff]
[    1.011820] pci 0000:00:18.6:   bridge window [mem 0xf0600000-0xf06fffff 64bit pref]
[    1.012649] pci 0000:00:18.7: PCI bridge to [bus 22]
[    1.012753] pci 0000:00:18.7:   bridge window [mem 0xfc000000-0xfc0fffff]
[    1.012857] pci 0000:00:18.7:   bridge window [mem 0xf0500000-0xf05fffff 64bit pref]
[    1.018454] ACPI: PCI: Interrupt link LNKA configured for IRQ 0
[    1.018463] ACPI: PCI: Interrupt link LNKA disabled
[    1.019107] ACPI: PCI: Interrupt link LNKB configured for IRQ 0
[    1.019115] ACPI: PCI: Interrupt link LNKB disabled
[    1.019732] ACPI: PCI: Interrupt link LNKC configured for IRQ 0
[    1.019740] ACPI: PCI: Interrupt link LNKC disabled
[    1.020353] ACPI: PCI: Interrupt link LNKD configured for IRQ 0
[    1.020361] ACPI: PCI: Interrupt link LNKD disabled
[    1.102539] iommu: Default domain type: Translated
[    1.102547] iommu: DMA domain TLB invalidation policy: lazy mode
[    1.103581] SCSI subsystem initialized
[    1.103703] libata version 3.00 loaded.
[    1.103703] pci 0000:00:0f.0: vgaarb: setting as boot VGA device
[    1.103703] pci 0000:00:0f.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    1.103703] pci 0000:0b:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    1.103703] pci 0000:00:0f.0: vgaarb: no bridge control possible
[    1.103703] pci 0000:0b:00.0: vgaarb: bridge control possible
[    1.103703] vgaarb: loaded
[    1.103703] ACPI: bus type USB registered
[    1.103703] usbcore: registered new interface driver usbfs
[    1.103703] usbcore: registered new interface driver hub
[    1.103703] usbcore: registered new device driver usb
[    1.103703] pps_core: LinuxPPS API ver. 1 registered
[    1.103703] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.103703] PTP clock support registered
[    1.103703] EDAC MC: Ver: 3.0.0
[    1.108225] Registered efivars operations
[    1.108225] NetLabel: Initializing
[    1.108225] NetLabel:  domain hash size = 128
[    1.108225] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    1.108225] NetLabel:  unlabeled traffic allowed by default
[    1.108225] PCI: Using ACPI for IRQ routing
[    1.123876] PCI: pci_cache_line_size set to 64 bytes
[    1.126225] e820: reserve RAM buffer [mem 0x0e402018-0x0fffffff]
[    1.126243] e820: reserve RAM buffer [mem 0x0e404018-0x0fffffff]
[    1.126256] e820: reserve RAM buffer [mem 0x0e407018-0x0fffffff]
[    1.126269] e820: reserve RAM buffer [mem 0x0e40a018-0x0fffffff]
[    1.126281] e820: reserve RAM buffer [mem 0x0efb0000-0x0fffffff]
[    1.126292] e820: reserve RAM buffer [mem 0x0efc2000-0x0fffffff]
[    1.126303] e820: reserve RAM buffer [mem 0x0fee6000-0x0fffffff]
[    1.127041] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
[    1.127124] hpet0: 16 comparators, 64-bit 14.318180 MHz counter
[    1.132981] clocksource: Switched to clocksource tsc-early
[    1.191560] VFS: Disk quotas dquot_6.6.0
[    1.191663] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.192236] AppArmor: AppArmor Filesystem Enabled
[    1.192315] pnp: PnP ACPI init
[    1.193227] pnp 00:00: disabling [io  0x0010-0x001f] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193247] pnp 00:00: disabling [io  0x0024-0x0025] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193264] pnp 00:00: disabling [io  0x0028-0x0029] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193280] pnp 00:00: disabling [io  0x002c-0x002d] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193296] pnp 00:00: disabling [io  0x002e-0x002f] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193312] pnp 00:00: disabling [io  0x0030-0x0031] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193328] pnp 00:00: disabling [io  0x0034-0x0035] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193343] pnp 00:00: disabling [io  0x0038-0x0039] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193359] pnp 00:00: disabling [io  0x003c-0x003d] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193378] pnp 00:00: disabling [io  0x0000-0x000f] because it overlaps 0000:00:07.7 BAR 0 [io  0x0000-0x003f]
[    1.193648] system 00:00: [io  0x0440-0x047f] has been reserved
[    1.193664] system 00:00: [io  0x5658-0x5659] has been reserved
[    1.193678] system 00:00: [io  0x5670] has been reserved
[    1.193690] system 00:00: [io  0x0cf0-0x0cf1] has been reserved
[    1.195686] system 00:04: [mem 0xfed00000-0xfed003ff] has been reserved
[    1.213425] system 00:05: [io  0x0400-0x041f] has been reserved
[    1.213441] system 00:05: [mem 0xe0000000-0xe7ffffff] has been reserved
[    1.213457] system 00:05: [mem 0xffc00000-0xffdfffff] could not be reserved
[    1.229272] pnp: PnP ACPI: found 6 devices
[    1.245708] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.246126] NET: Registered PF_INET protocol family
[    1.246705] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    1.252007] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    1.252284] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    1.252740] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    1.256589] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[    1.257423] TCP: Hash tables configured (established 262144 bind 65536)
[    1.257952] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear)
[    1.258532] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    1.259075] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    1.259852] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    1.259875] NET: Registered PF_XDP protocol family
[    1.259892] pci 0000:00:10.0: can't claim BAR 6 [mem 0xffffc000-0xffffffff pref]: no compatible bridge window
[    1.259911] pci 0000:02:03.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[    1.259926] pci 0000:03:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[    1.259967] pci 0000:00:15.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 03] add_size 200000 add_align 100000
[    1.259988] pci 0000:00:15.1: bridge window [io  0x1000-0x0fff] to [bus 04] add_size 1000
[    1.260005] pci 0000:00:15.2: bridge window [io  0x1000-0x0fff] to [bus 05] add_size 1000
[    1.260020] pci 0000:00:15.3: bridge window [io  0x1000-0x0fff] to [bus 06] add_size 1000
[    1.260036] pci 0000:00:15.4: bridge window [io  0x1000-0x0fff] to [bus 07] add_size 1000
[    1.260052] pci 0000:00:15.5: bridge window [io  0x1000-0x0fff] to [bus 08] add_size 1000
[    1.260067] pci 0000:00:15.6: bridge window [io  0x1000-0x0fff] to [bus 09] add_size 1000
[    1.260083] pci 0000:00:15.7: bridge window [io  0x1000-0x0fff] to [bus 0a] add_size 1000
[    1.260100] pci 0000:00:16.1: bridge window [io  0x1000-0x0fff] to [bus 0c] add_size 1000
[    1.260115] pci 0000:00:16.2: bridge window [io  0x1000-0x0fff] to [bus 0d] add_size 1000
[    1.260131] pci 0000:00:16.3: bridge window [io  0x1000-0x0fff] to [bus 0e] add_size 1000
[    1.260146] pci 0000:00:16.4: bridge window [io  0x1000-0x0fff] to [bus 0f] add_size 1000
[    1.260162] pci 0000:00:16.5: bridge window [io  0x1000-0x0fff] to [bus 10] add_size 1000
[    1.260178] pci 0000:00:16.6: bridge window [io  0x1000-0x0fff] to [bus 11] add_size 1000
[    1.260193] pci 0000:00:16.7: bridge window [io  0x1000-0x0fff] to [bus 12] add_size 1000
[    1.260209] pci 0000:00:17.0: bridge window [io  0x1000-0x0fff] to [bus 13] add_size 1000
[    1.260225] pci 0000:00:17.1: bridge window [io  0x1000-0x0fff] to [bus 14] add_size 1000
[    1.260241] pci 0000:00:17.2: bridge window [io  0x1000-0x0fff] to [bus 15] add_size 1000
[    1.260256] pci 0000:00:17.3: bridge window [io  0x1000-0x0fff] to [bus 16] add_size 1000
[    1.260272] pci 0000:00:17.4: bridge window [io  0x1000-0x0fff] to [bus 17] add_size 1000
[    1.260288] pci 0000:00:17.5: bridge window [io  0x1000-0x0fff] to [bus 18] add_size 1000
[    1.260303] pci 0000:00:17.6: bridge window [io  0x1000-0x0fff] to [bus 19] add_size 1000
[    1.260319] pci 0000:00:17.7: bridge window [io  0x1000-0x0fff] to [bus 1a] add_size 1000
[    1.260335] pci 0000:00:18.0: bridge window [io  0x1000-0x0fff] to [bus 1b] add_size 1000
[    1.260351] pci 0000:00:18.1: bridge window [io  0x1000-0x0fff] to [bus 1c] add_size 1000
[    1.260366] pci 0000:00:18.2: bridge window [io  0x1000-0x0fff] to [bus 1d] add_size 1000
[    1.260382] pci 0000:00:18.3: bridge window [io  0x1000-0x0fff] to [bus 1e] add_size 1000
[    1.260398] pci 0000:00:18.4: bridge window [io  0x1000-0x0fff] to [bus 1f] add_size 1000
[    1.260414] pci 0000:00:18.5: bridge window [io  0x1000-0x0fff] to [bus 20] add_size 1000
[    1.260429] pci 0000:00:18.6: bridge window [io  0x1000-0x0fff] to [bus 21] add_size 1000
[    1.260445] pci 0000:00:18.7: bridge window [io  0x1000-0x0fff] to [bus 22] add_size 1000
[    1.260576] clipped [mem size 0x00000000 64bit pref] to [mem size 0xfffffffffffc4000 64bit pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260596] clipped [mem size 0x00000000 64bit pref] to [mem size 0xfffffffffffd4000 64bit pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260613] clipped [mem size 0x00000000 64bit pref] to [mem size 0xfffffffffffe4000 64bit pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260647] clipped [mem size 0x00008000 64bit pref] to [mem size 0xfffffffffffcc000 64bit pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260665] clipped [mem size 0x00008000 64bit pref] to [mem size 0xfffffffffffdc000 64bit pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260682] clipped [mem size 0x0000c000 64bit pref] to [mem size 0xffffffffffff0000 64bit pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260702] pci 0000:00:15.0: BAR 15: assigned [mem 0xd2000000-0xd21fffff 64bit pref]
[    1.260723] clipped [mem size 0x00008000 pref] to [mem size 0xfffffffffffcc000 pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260740] clipped [mem size 0x00008000 pref] to [mem size 0xfffffffffffdc000 pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260757] clipped [mem size 0x0000c000 pref] to [mem size 0xffffffffffff0000 pref] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260776] pci 0000:00:10.0: BAR 6: assigned [mem 0xd2200000-0xd2203fff pref]
[    1.260795] clipped [mem size 0x00000000 64bit] to [mem size 0xfffffffffffc4000 64bit] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260812] clipped [mem size 0x00000000 64bit] to [mem size 0xfffffffffffd4000 64bit] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260828] clipped [mem size 0x00000000 64bit] to [mem size 0xfffffffffffe4000 64bit] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260859] clipped [mem size 0x00008000 64bit] to [mem size 0xfffffffffffcc000 64bit] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260875] clipped [mem size 0x00008000 64bit] to [mem size 0xfffffffffffdc000 64bit] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260892] clipped [mem size 0x0000c000 64bit] to [mem size 0xffffffffffff0000 64bit] for e820 entry [mem 0x000c0000-0x000fffff]
[    1.260911] pci 0000:00:07.7: BAR 1: assigned [mem 0xd2204000-0xd2205fff 64bit]
[    1.261133] pci 0000:00:15.1: BAR 13: assigned [io  0x6000-0x6fff]
[    1.261151] pci 0000:00:15.2: BAR 13: assigned [io  0x7000-0x7fff]
[    1.261168] pci 0000:00:15.3: BAR 13: assigned [io  0x8000-0x8fff]
[    1.261185] pci 0000:00:15.4: BAR 13: assigned [io  0x9000-0x9fff]
[    1.261203] pci 0000:00:15.5: BAR 13: assigned [io  0xa000-0xafff]
[    1.261220] pci 0000:00:15.6: BAR 13: assigned [io  0xb000-0xbfff]
[    1.261237] pci 0000:00:15.7: BAR 13: assigned [io  0xc000-0xcfff]
[    1.261254] pci 0000:00:16.1: BAR 13: assigned [io  0xd000-0xdfff]
[    1.261271] pci 0000:00:16.2: BAR 13: assigned [io  0xe000-0xefff]
[    1.261288] pci 0000:00:16.3: BAR 13: assigned [io  0xf000-0xffff]
[    1.261307] pci 0000:00:16.4: BAR 13: no space for [io  size 0x1000]
[    1.261320] pci 0000:00:16.4: BAR 13: failed to assign [io  size 0x1000]
[    1.261339] pci 0000:00:16.5: BAR 13: no space for [io  size 0x1000]
[    1.261351] pci 0000:00:16.5: BAR 13: failed to assign [io  size 0x1000]
[    1.261370] pci 0000:00:16.6: BAR 13: no space for [io  size 0x1000]
[    1.261382] pci 0000:00:16.6: BAR 13: failed to assign [io  size 0x1000]
[    1.261401] pci 0000:00:16.7: BAR 13: no space for [io  size 0x1000]
[    1.261413] pci 0000:00:16.7: BAR 13: failed to assign [io  size 0x1000]
[    1.261432] pci 0000:00:17.0: BAR 13: no space for [io  size 0x1000]
[    1.261444] pci 0000:00:17.0: BAR 13: failed to assign [io  size 0x1000]
[    1.261462] pci 0000:00:17.1: BAR 13: no space for [io  size 0x1000]
[    1.261474] pci 0000:00:17.1: BAR 13: failed to assign [io  size 0x1000]
[    1.261493] pci 0000:00:17.2: BAR 13: no space for [io  size 0x1000]
[    1.261505] pci 0000:00:17.2: BAR 13: failed to assign [io  size 0x1000]
[    1.261523] pci 0000:00:17.3: BAR 13: no space for [io  size 0x1000]
[    1.261535] pci 0000:00:17.3: BAR 13: failed to assign [io  size 0x1000]
[    1.261554] pci 0000:00:17.4: BAR 13: no space for [io  size 0x1000]
[    1.261566] pci 0000:00:17.4: BAR 13: failed to assign [io  size 0x1000]
[    1.261585] pci 0000:00:17.5: BAR 13: no space for [io  size 0x1000]
[    1.261596] pci 0000:00:17.5: BAR 13: failed to assign [io  size 0x1000]
[    1.261615] pci 0000:00:17.6: BAR 13: no space for [io  size 0x1000]
[    1.261627] pci 0000:00:17.6: BAR 13: failed to assign [io  size 0x1000]
[    1.261645] pci 0000:00:17.7: BAR 13: no space for [io  size 0x1000]
[    1.261657] pci 0000:00:17.7: BAR 13: failed to assign [io  size 0x1000]
[    1.261675] pci 0000:00:18.0: BAR 13: no space for [io  size 0x1000]
[    1.261687] pci 0000:00:18.0: BAR 13: failed to assign [io  size 0x1000]
[    1.261706] pci 0000:00:18.1: BAR 13: no space for [io  size 0x1000]
[    1.261718] pci 0000:00:18.1: BAR 13: failed to assign [io  size 0x1000]
[    1.261737] pci 0000:00:18.2: BAR 13: no space for [io  size 0x1000]
[    1.261749] pci 0000:00:18.2: BAR 13: failed to assign [io  size 0x1000]
[    1.261768] pci 0000:00:18.3: BAR 13: no space for [io  size 0x1000]
[    1.261780] pci 0000:00:18.3: BAR 13: failed to assign [io  size 0x1000]
[    1.261799] pci 0000:00:18.4: BAR 13: no space for [io  size 0x1000]
[    1.261811] pci 0000:00:18.4: BAR 13: failed to assign [io  size 0x1000]
[    1.261830] pci 0000:00:18.5: BAR 13: no space for [io  size 0x1000]
[    1.261842] pci 0000:00:18.5: BAR 13: failed to assign [io  size 0x1000]
[    1.261861] pci 0000:00:18.6: BAR 13: no space for [io  size 0x1000]
[    1.261873] pci 0000:00:18.6: BAR 13: failed to assign [io  size 0x1000]
[    1.261892] pci 0000:00:18.7: BAR 13: no space for [io  size 0x1000]
[    1.261903] pci 0000:00:18.7: BAR 13: failed to assign [io  size 0x1000]
[    1.261926] pci 0000:00:07.7: BAR 0: assigned [io  0x2400-0x243f]
[    1.262026] pci 0000:00:07.7: BAR 0: assigned [io  0x2400-0x243f]
[    1.262093] pci 0000:00:18.7: BAR 13: assigned [io  0x6000-0x6fff]
[    1.262111] pci 0000:00:18.6: BAR 13: assigned [io  0x7000-0x7fff]
[    1.262129] pci 0000:00:18.5: BAR 13: assigned [io  0x8000-0x8fff]
[    1.262147] pci 0000:00:18.4: BAR 13: assigned [io  0x9000-0x9fff]
[    1.262165] pci 0000:00:18.3: BAR 13: assigned [io  0xa000-0xafff]
[    1.262182] pci 0000:00:18.2: BAR 13: assigned [io  0xb000-0xbfff]
[    1.262200] pci 0000:00:18.1: BAR 13: assigned [io  0xc000-0xcfff]
[    1.262218] pci 0000:00:18.0: BAR 13: assigned [io  0xd000-0xdfff]
[    1.262236] pci 0000:00:17.7: BAR 13: assigned [io  0xe000-0xefff]
[    1.262254] pci 0000:00:17.6: BAR 13: assigned [io  0xf000-0xffff]
[    1.262273] pci 0000:00:17.5: BAR 13: no space for [io  size 0x1000]
[    1.262285] pci 0000:00:17.5: BAR 13: failed to assign [io  size 0x1000]
[    1.262304] pci 0000:00:17.4: BAR 13: no space for [io  size 0x1000]
[    1.262316] pci 0000:00:17.4: BAR 13: failed to assign [io  size 0x1000]
[    1.262335] pci 0000:00:17.3: BAR 13: no space for [io  size 0x1000]
[    1.262346] pci 0000:00:17.3: BAR 13: failed to assign [io  size 0x1000]
[    1.262365] pci 0000:00:17.2: BAR 13: no space for [io  size 0x1000]
[    1.262377] pci 0000:00:17.2: BAR 13: failed to assign [io  size 0x1000]
[    1.262397] pci 0000:00:17.1: BAR 13: no space for [io  size 0x1000]
[    1.262408] pci 0000:00:17.1: BAR 13: failed to assign [io  size 0x1000]
[    1.262428] pci 0000:00:17.0: BAR 13: no space for [io  size 0x1000]
[    1.262439] pci 0000:00:17.0: BAR 13: failed to assign [io  size 0x1000]
[    1.262458] pci 0000:00:16.7: BAR 13: no space for [io  size 0x1000]
[    1.262470] pci 0000:00:16.7: BAR 13: failed to assign [io  size 0x1000]
[    1.262489] pci 0000:00:16.6: BAR 13: no space for [io  size 0x1000]
[    1.262523] pci 0000:00:16.6: BAR 13: failed to assign [io  size 0x1000]
[    1.262543] pci 0000:00:16.5: BAR 13: no space for [io  size 0x1000]
[    1.262556] pci 0000:00:16.5: BAR 13: failed to assign [io  size 0x1000]
[    1.262575] pci 0000:00:16.4: BAR 13: no space for [io  size 0x1000]
[    1.262587] pci 0000:00:16.4: BAR 13: failed to assign [io  size 0x1000]
[    1.262606] pci 0000:00:16.3: BAR 13: no space for [io  size 0x1000]
[    1.262618] pci 0000:00:16.3: BAR 13: failed to assign [io  size 0x1000]
[    1.262636] pci 0000:00:16.2: BAR 13: no space for [io  size 0x1000]
[    1.262648] pci 0000:00:16.2: BAR 13: failed to assign [io  size 0x1000]
[    1.262667] pci 0000:00:16.1: BAR 13: no space for [io  size 0x1000]
[    1.262679] pci 0000:00:16.1: BAR 13: failed to assign [io  size 0x1000]
[    1.262698] pci 0000:00:15.7: BAR 13: no space for [io  size 0x1000]
[    1.262709] pci 0000:00:15.7: BAR 13: failed to assign [io  size 0x1000]
[    1.262728] pci 0000:00:15.6: BAR 13: no space for [io  size 0x1000]
[    1.262740] pci 0000:00:15.6: BAR 13: failed to assign [io  size 0x1000]
[    1.262759] pci 0000:00:15.5: BAR 13: no space for [io  size 0x1000]
[    1.262771] pci 0000:00:15.5: BAR 13: failed to assign [io  size 0x1000]
[    1.262789] pci 0000:00:15.4: BAR 13: no space for [io  size 0x1000]
[    1.262801] pci 0000:00:15.4: BAR 13: failed to assign [io  size 0x1000]
[    1.262820] pci 0000:00:15.3: BAR 13: no space for [io  size 0x1000]
[    1.262832] pci 0000:00:15.3: BAR 13: failed to assign [io  size 0x1000]
[    1.262851] pci 0000:00:15.2: BAR 13: no space for [io  size 0x1000]
[    1.262862] pci 0000:00:15.2: BAR 13: failed to assign [io  size 0x1000]
[    1.262881] pci 0000:00:15.1: BAR 13: no space for [io  size 0x1000]
[    1.262893] pci 0000:00:15.1: BAR 13: failed to assign [io  size 0x1000]
[    1.262915] pci 0000:00:01.0: PCI bridge to [bus 01]
[    1.263190] pci 0000:02:03.0: BAR 6: assigned [mem 0xf9800000-0xf980ffff pref]
[    1.263207] pci 0000:00:11.0: PCI bridge to [bus 02]
[    1.263243] pci 0000:00:11.0:   bridge window [io  0x1000-0x1fff]
[    1.263324] pci 0000:00:11.0:   bridge window [mem 0xf9800000-0xfa1fffff]
[    1.263385] pci 0000:00:11.0:   bridge window [mem 0xf0000000-0xf04fffff 64bit pref]
[    1.263494] pci 0000:03:00.0: BAR 6: assigned [mem 0xfde00000-0xfde0ffff pref]
[    1.263508] pci 0000:00:15.0: PCI bridge to [bus 03]
[    1.263543] pci 0000:00:15.0:   bridge window [io  0x4000-0x4fff]
[    1.263623] pci 0000:00:15.0:   bridge window [mem 0xfde00000-0xfdefffff]
[    1.263681] pci 0000:00:15.0:   bridge window [mem 0xd2000000-0xd21fffff 64bit pref]
[    1.263787] pci 0000:00:15.1: PCI bridge to [bus 04]
[    1.263867] pci 0000:00:15.1:   bridge window [mem 0xfdd00000-0xfddfffff]
[    1.263925] pci 0000:00:15.1:   bridge window [mem 0xf2200000-0xf22fffff 64bit pref]
[    1.264030] pci 0000:00:15.2: PCI bridge to [bus 05]
[    1.264110] pci 0000:00:15.2:   bridge window [mem 0xfdc00000-0xfdcfffff]
[    1.264169] pci 0000:00:15.2:   bridge window [mem 0xf2100000-0xf21fffff 64bit pref]
[    1.264273] pci 0000:00:15.3: PCI bridge to [bus 06]
[    1.264355] pci 0000:00:15.3:   bridge window [mem 0xfdb00000-0xfdbfffff]
[    1.264413] pci 0000:00:15.3:   bridge window [mem 0xf2000000-0xf20fffff 64bit pref]
[    1.264518] pci 0000:00:15.4: PCI bridge to [bus 07]
[    1.264597] pci 0000:00:15.4:   bridge window [mem 0xfda00000-0xfdafffff]
[    1.264655] pci 0000:00:15.4:   bridge window [mem 0xf1f00000-0xf1ffffff 64bit pref]
[    1.264759] pci 0000:00:15.5: PCI bridge to [bus 08]
[    1.264838] pci 0000:00:15.5:   bridge window [mem 0xfd900000-0xfd9fffff]
[    1.264896] pci 0000:00:15.5:   bridge window [mem 0xf1e00000-0xf1efffff 64bit pref]
[    1.265000] pci 0000:00:15.6: PCI bridge to [bus 09]
[    1.265079] pci 0000:00:15.6:   bridge window [mem 0xfd800000-0xfd8fffff]
[    1.265137] pci 0000:00:15.6:   bridge window [mem 0xf1d00000-0xf1dfffff 64bit pref]
[    1.265241] pci 0000:00:15.7: PCI bridge to [bus 0a]
[    1.265320] pci 0000:00:15.7:   bridge window [mem 0xfd700000-0xfd7fffff]
[    1.265381] pci 0000:00:15.7:   bridge window [mem 0xf1c00000-0xf1cfffff 64bit pref]
[    1.265486] pci 0000:00:16.0: PCI bridge to [bus 0b]
[    1.265520] pci 0000:00:16.0:   bridge window [io  0x3000-0x3fff]
[    1.265601] pci 0000:00:16.0:   bridge window [mem 0xfb000000-0xfbffffff]
[    1.265659] pci 0000:00:16.0:   bridge window [mem 0xc0000000-0xd1ffffff 64bit pref]
[    1.265764] pci 0000:00:16.1: PCI bridge to [bus 0c]
[    1.265844] pci 0000:00:16.1:   bridge window [mem 0xfd600000-0xfd6fffff]
[    1.265902] pci 0000:00:16.1:   bridge window [mem 0xf1b00000-0xf1bfffff 64bit pref]
[    1.266007] pci 0000:00:16.2: PCI bridge to [bus 0d]
[    1.266086] pci 0000:00:16.2:   bridge window [mem 0xfd500000-0xfd5fffff]
[    1.266144] pci 0000:00:16.2:   bridge window [mem 0xf1a00000-0xf1afffff 64bit pref]
[    1.266249] pci 0000:00:16.3: PCI bridge to [bus 0e]
[    1.266330] pci 0000:00:16.3:   bridge window [mem 0xfd400000-0xfd4fffff]
[    1.266388] pci 0000:00:16.3:   bridge window [mem 0xf1900000-0xf19fffff 64bit pref]
[    1.266492] pci 0000:00:16.4: PCI bridge to [bus 0f]
[    1.266592] pci 0000:00:16.4:   bridge window [mem 0xfd300000-0xfd3fffff]
[    1.266650] pci 0000:00:16.4:   bridge window [mem 0xf1800000-0xf18fffff 64bit pref]
[    1.266755] pci 0000:00:16.5: PCI bridge to [bus 10]
[    1.266835] pci 0000:00:16.5:   bridge window [mem 0xfd200000-0xfd2fffff]
[    1.266893] pci 0000:00:16.5:   bridge window [mem 0xf1700000-0xf17fffff 64bit pref]
[    1.266997] pci 0000:00:16.6: PCI bridge to [bus 11]
[    1.267076] pci 0000:00:16.6:   bridge window [mem 0xfd100000-0xfd1fffff]
[    1.267134] pci 0000:00:16.6:   bridge window [mem 0xf1600000-0xf16fffff 64bit pref]
[    1.267238] pci 0000:00:16.7: PCI bridge to [bus 12]
[    1.267317] pci 0000:00:16.7:   bridge window [mem 0xfd000000-0xfd0fffff]
[    1.267377] pci 0000:00:16.7:   bridge window [mem 0xf1500000-0xf15fffff 64bit pref]
[    1.267481] pci 0000:00:17.0: PCI bridge to [bus 13]
[    1.267560] pci 0000:00:17.0:   bridge window [mem 0xfcf00000-0xfcffffff]
[    1.267618] pci 0000:00:17.0:   bridge window [mem 0xf1400000-0xf14fffff 64bit pref]
[    1.267722] pci 0000:00:17.1: PCI bridge to [bus 14]
[    1.267801] pci 0000:00:17.1:   bridge window [mem 0xfce00000-0xfcefffff]
[    1.267859] pci 0000:00:17.1:   bridge window [mem 0xf1300000-0xf13fffff 64bit pref]
[    1.267964] pci 0000:00:17.2: PCI bridge to [bus 15]
[    1.268043] pci 0000:00:17.2:   bridge window [mem 0xfcd00000-0xfcdfffff]
[    1.268101] pci 0000:00:17.2:   bridge window [mem 0xf1200000-0xf12fffff 64bit pref]
[    1.268205] pci 0000:00:17.3: PCI bridge to [bus 16]
[    1.268285] pci 0000:00:17.3:   bridge window [mem 0xfcc00000-0xfccfffff]
[    1.268345] pci 0000:00:17.3:   bridge window [mem 0xf1100000-0xf11fffff 64bit pref]
[    1.268449] pci 0000:00:17.4: PCI bridge to [bus 17]
[    1.268528] pci 0000:00:17.4:   bridge window [mem 0xfcb00000-0xfcbfffff]
[    1.268586] pci 0000:00:17.4:   bridge window [mem 0xf1000000-0xf10fffff 64bit pref]
[    1.268692] pci 0000:00:17.5: PCI bridge to [bus 18]
[    1.268771] pci 0000:00:17.5:   bridge window [mem 0xfca00000-0xfcafffff]
[    1.268829] pci 0000:00:17.5:   bridge window [mem 0xf0f00000-0xf0ffffff 64bit pref]
[    1.268934] pci 0000:00:17.6: PCI bridge to [bus 19]
[    1.268969] pci 0000:00:17.6:   bridge window [io  0xf000-0xffff]
[    1.269049] pci 0000:00:17.6:   bridge window [mem 0xfc900000-0xfc9fffff]
[    1.269107] pci 0000:00:17.6:   bridge window [mem 0xf0e00000-0xf0efffff 64bit pref]
[    1.269211] pci 0000:00:17.7: PCI bridge to [bus 1a]
[    1.269246] pci 0000:00:17.7:   bridge window [io  0xe000-0xefff]
[    1.269326] pci 0000:00:17.7:   bridge window [mem 0xfc800000-0xfc8fffff]
[    1.269388] pci 0000:00:17.7:   bridge window [mem 0xf0d00000-0xf0dfffff 64bit pref]
[    1.269492] pci 0000:00:18.0: PCI bridge to [bus 1b]
[    1.269526] pci 0000:00:18.0:   bridge window [io  0xd000-0xdfff]
[    1.269606] pci 0000:00:18.0:   bridge window [mem 0xfc700000-0xfc7fffff]
[    1.269664] pci 0000:00:18.0:   bridge window [mem 0xf0c00000-0xf0cfffff 64bit pref]
[    1.269768] pci 0000:00:18.1: PCI bridge to [bus 1c]
[    1.269802] pci 0000:00:18.1:   bridge window [io  0xc000-0xcfff]
[    1.269883] pci 0000:00:18.1:   bridge window [mem 0xfc600000-0xfc6fffff]
[    1.269941] pci 0000:00:18.1:   bridge window [mem 0xf0b00000-0xf0bfffff 64bit pref]
[    1.270045] pci 0000:00:18.2: PCI bridge to [bus 1d]
[    1.270080] pci 0000:00:18.2:   bridge window [io  0xb000-0xbfff]
[    1.270161] pci 0000:00:18.2:   bridge window [mem 0xfc500000-0xfc5fffff]
[    1.270219] pci 0000:00:18.2:   bridge window [mem 0xf0a00000-0xf0afffff 64bit pref]
[    1.270324] pci 0000:00:18.3: PCI bridge to [bus 1e]
[    1.270360] pci 0000:00:18.3:   bridge window [io  0xa000-0xafff]
[    1.270441] pci 0000:00:18.3:   bridge window [mem 0xfc400000-0xfc4fffff]
[    1.270499] pci 0000:00:18.3:   bridge window [mem 0xf0900000-0xf09fffff 64bit pref]
[    1.270622] pci 0000:00:18.4: PCI bridge to [bus 1f]
[    1.270657] pci 0000:00:18.4:   bridge window [io  0x9000-0x9fff]
[    1.270737] pci 0000:00:18.4:   bridge window [mem 0xfc300000-0xfc3fffff]
[    1.270795] pci 0000:00:18.4:   bridge window [mem 0xf0800000-0xf08fffff 64bit pref]
[    1.270899] pci 0000:00:18.5: PCI bridge to [bus 20]
[    1.270934] pci 0000:00:18.5:   bridge window [io  0x8000-0x8fff]
[    1.271014] pci 0000:00:18.5:   bridge window [mem 0xfc200000-0xfc2fffff]
[    1.271073] pci 0000:00:18.5:   bridge window [mem 0xf0700000-0xf07fffff 64bit pref]
[    1.271178] pci 0000:00:18.6: PCI bridge to [bus 21]
[    1.271212] pci 0000:00:18.6:   bridge window [io  0x7000-0x7fff]
[    1.271293] pci 0000:00:18.6:   bridge window [mem 0xfc100000-0xfc1fffff]
[    1.271355] pci 0000:00:18.6:   bridge window [mem 0xf0600000-0xf06fffff 64bit pref]
[    1.271460] pci 0000:00:18.7: PCI bridge to [bus 22]
[    1.271494] pci 0000:00:18.7:   bridge window [io  0x6000-0x6fff]
[    1.271575] pci 0000:00:18.7:   bridge window [mem 0xfc000000-0xfc0fffff]
[    1.271633] pci 0000:00:18.7:   bridge window [mem 0xf0500000-0xf05fffff 64bit pref]
[    1.271738] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    1.271751] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    1.271763] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    1.271776] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000cbfff window]
[    1.271789] pci_bus 0000:00: resource 8 [mem 0x000d4000-0x000dbfff window]
[    1.271801] pci_bus 0000:00: resource 9 [mem 0x000e4000-0x000effff window]
[    1.271816] pci_bus 0000:00: resource 10 [mem 0xd2000000-0xe7ffffff window]
[    1.271833] pci_bus 0000:00: resource 11 [mem 0xf2300000-0xfebfffff window]
[    1.271849] pci_bus 0000:00: resource 12 [mem 0xfec10000-0xfed3ffff window]
[    1.271866] pci_bus 0000:00: resource 13 [mem 0xfed45000-0xfedfffff window]
[    1.271883] pci_bus 0000:00: resource 14 [mem 0xfef00000-0xffdfffff window]
[    1.271897] pci_bus 0000:00: resource 15 [mem 0xc0000000-0xd1ffffff pref window]
[    1.271910] pci_bus 0000:00: resource 16 [mem 0xe8000000-0xf22fffff pref window]
[    1.271925] pci_bus 0000:02: resource 0 [io  0x1000-0x1fff]
[    1.271937] pci_bus 0000:02: resource 1 [mem 0xf9800000-0xfa1fffff]
[    1.271949] pci_bus 0000:02: resource 2 [mem 0xf0000000-0xf04fffff 64bit pref]
[    1.271963] pci_bus 0000:02: resource 4 [io  0x0000-0x0cf7 window]
[    1.271975] pci_bus 0000:02: resource 5 [io  0x0d00-0xffff window]
[    1.271987] pci_bus 0000:02: resource 6 [mem 0x000a0000-0x000bffff window]
[    1.272000] pci_bus 0000:02: resource 7 [mem 0x000c4000-0x000cbfff window]
[    1.272012] pci_bus 0000:02: resource 8 [mem 0x000d4000-0x000dbfff window]
[    1.272025] pci_bus 0000:02: resource 9 [mem 0x000e4000-0x000effff window]
[    1.272038] pci_bus 0000:02: resource 10 [mem 0xd2000000-0xe7ffffff window]
[    1.272051] pci_bus 0000:02: resource 11 [mem 0xf2300000-0xfebfffff window]
[    1.272064] pci_bus 0000:02: resource 12 [mem 0xfec10000-0xfed3ffff window]
[    1.272077] pci_bus 0000:02: resource 13 [mem 0xfed45000-0xfedfffff window]
[    1.272091] pci_bus 0000:02: resource 14 [mem 0xfef00000-0xffdfffff window]
[    1.272104] pci_bus 0000:02: resource 15 [mem 0xc0000000-0xd1ffffff pref window]
[    1.272117] pci_bus 0000:02: resource 16 [mem 0xe8000000-0xf22fffff pref window]
[    1.272131] pci_bus 0000:03: resource 0 [io  0x4000-0x4fff]
[    1.272143] pci_bus 0000:03: resource 1 [mem 0xfde00000-0xfdefffff]
[    1.272155] pci_bus 0000:03: resource 2 [mem 0xd2000000-0xd21fffff 64bit pref]
[    1.272169] pci_bus 0000:04: resource 1 [mem 0xfdd00000-0xfddfffff]
[    1.272182] pci_bus 0000:04: resource 2 [mem 0xf2200000-0xf22fffff 64bit pref]
[    1.272195] pci_bus 0000:05: resource 1 [mem 0xfdc00000-0xfdcfffff]
[    1.272207] pci_bus 0000:05: resource 2 [mem 0xf2100000-0xf21fffff 64bit pref]
[    1.272221] pci_bus 0000:06: resource 1 [mem 0xfdb00000-0xfdbfffff]
[    1.272233] pci_bus 0000:06: resource 2 [mem 0xf2000000-0xf20fffff 64bit pref]
[    1.272247] pci_bus 0000:07: resource 1 [mem 0xfda00000-0xfdafffff]
[    1.272259] pci_bus 0000:07: resource 2 [mem 0xf1f00000-0xf1ffffff 64bit pref]
[    1.272272] pci_bus 0000:08: resource 1 [mem 0xfd900000-0xfd9fffff]
[    1.272285] pci_bus 0000:08: resource 2 [mem 0xf1e00000-0xf1efffff 64bit pref]
[    1.272298] pci_bus 0000:09: resource 1 [mem 0xfd800000-0xfd8fffff]
[    1.272311] pci_bus 0000:09: resource 2 [mem 0xf1d00000-0xf1dfffff 64bit pref]
[    1.272324] pci_bus 0000:0a: resource 1 [mem 0xfd700000-0xfd7fffff]
[    1.272336] pci_bus 0000:0a: resource 2 [mem 0xf1c00000-0xf1cfffff 64bit pref]
[    1.272350] pci_bus 0000:0b: resource 0 [io  0x3000-0x3fff]
[    1.272361] pci_bus 0000:0b: resource 1 [mem 0xfb000000-0xfbffffff]
[    1.272374] pci_bus 0000:0b: resource 2 [mem 0xc0000000-0xd1ffffff 64bit pref]
[    1.272387] pci_bus 0000:0c: resource 1 [mem 0xfd600000-0xfd6fffff]
[    1.272400] pci_bus 0000:0c: resource 2 [mem 0xf1b00000-0xf1bfffff 64bit pref]
[    1.272413] pci_bus 0000:0d: resource 1 [mem 0xfd500000-0xfd5fffff]
[    1.272425] pci_bus 0000:0d: resource 2 [mem 0xf1a00000-0xf1afffff 64bit pref]
[    1.272439] pci_bus 0000:0e: resource 1 [mem 0xfd400000-0xfd4fffff]
[    1.272451] pci_bus 0000:0e: resource 2 [mem 0xf1900000-0xf19fffff 64bit pref]
[    1.272465] pci_bus 0000:0f: resource 1 [mem 0xfd300000-0xfd3fffff]
[    1.272477] pci_bus 0000:0f: resource 2 [mem 0xf1800000-0xf18fffff 64bit pref]
[    1.272490] pci_bus 0000:10: resource 1 [mem 0xfd200000-0xfd2fffff]
[    1.272503] pci_bus 0000:10: resource 2 [mem 0xf1700000-0xf17fffff 64bit pref]
[    1.272516] pci_bus 0000:11: resource 1 [mem 0xfd100000-0xfd1fffff]
[    1.272528] pci_bus 0000:11: resource 2 [mem 0xf1600000-0xf16fffff 64bit pref]
[    1.272542] pci_bus 0000:12: resource 1 [mem 0xfd000000-0xfd0fffff]
[    1.272554] pci_bus 0000:12: resource 2 [mem 0xf1500000-0xf15fffff 64bit pref]
[    1.272568] pci_bus 0000:13: resource 1 [mem 0xfcf00000-0xfcffffff]
[    1.272580] pci_bus 0000:13: resource 2 [mem 0xf1400000-0xf14fffff 64bit pref]
[    1.272593] pci_bus 0000:14: resource 1 [mem 0xfce00000-0xfcefffff]
[    1.272606] pci_bus 0000:14: resource 2 [mem 0xf1300000-0xf13fffff 64bit pref]
[    1.272619] pci_bus 0000:15: resource 1 [mem 0xfcd00000-0xfcdfffff]
[    1.272632] pci_bus 0000:15: resource 2 [mem 0xf1200000-0xf12fffff 64bit pref]
[    1.272645] pci_bus 0000:16: resource 1 [mem 0xfcc00000-0xfccfffff]
[    1.272657] pci_bus 0000:16: resource 2 [mem 0xf1100000-0xf11fffff 64bit pref]
[    1.272671] pci_bus 0000:17: resource 1 [mem 0xfcb00000-0xfcbfffff]
[    1.272683] pci_bus 0000:17: resource 2 [mem 0xf1000000-0xf10fffff 64bit pref]
[    1.272697] pci_bus 0000:18: resource 1 [mem 0xfca00000-0xfcafffff]
[    1.272709] pci_bus 0000:18: resource 2 [mem 0xf0f00000-0xf0ffffff 64bit pref]
[    1.272722] pci_bus 0000:19: resource 0 [io  0xf000-0xffff]
[    1.272734] pci_bus 0000:19: resource 1 [mem 0xfc900000-0xfc9fffff]
[    1.272746] pci_bus 0000:19: resource 2 [mem 0xf0e00000-0xf0efffff 64bit pref]
[    1.272760] pci_bus 0000:1a: resource 0 [io  0xe000-0xefff]
[    1.272771] pci_bus 0000:1a: resource 1 [mem 0xfc800000-0xfc8fffff]
[    1.272783] pci_bus 0000:1a: resource 2 [mem 0xf0d00000-0xf0dfffff 64bit pref]
[    1.272797] pci_bus 0000:1b: resource 0 [io  0xd000-0xdfff]
[    1.272808] pci_bus 0000:1b: resource 1 [mem 0xfc700000-0xfc7fffff]
[    1.272821] pci_bus 0000:1b: resource 2 [mem 0xf0c00000-0xf0cfffff 64bit pref]
[    1.272834] pci_bus 0000:1c: resource 0 [io  0xc000-0xcfff]
[    1.272846] pci_bus 0000:1c: resource 1 [mem 0xfc600000-0xfc6fffff]
[    1.272858] pci_bus 0000:1c: resource 2 [mem 0xf0b00000-0xf0bfffff 64bit pref]
[    1.272871] pci_bus 0000:1d: resource 0 [io  0xb000-0xbfff]
[    1.272883] pci_bus 0000:1d: resource 1 [mem 0xfc500000-0xfc5fffff]
[    1.272895] pci_bus 0000:1d: resource 2 [mem 0xf0a00000-0xf0afffff 64bit pref]
[    1.272909] pci_bus 0000:1e: resource 0 [io  0xa000-0xafff]
[    1.272920] pci_bus 0000:1e: resource 1 [mem 0xfc400000-0xfc4fffff]
[    1.272933] pci_bus 0000:1e: resource 2 [mem 0xf0900000-0xf09fffff 64bit pref]
[    1.272946] pci_bus 0000:1f: resource 0 [io  0x9000-0x9fff]
[    1.272958] pci_bus 0000:1f: resource 1 [mem 0xfc300000-0xfc3fffff]
[    1.272970] pci_bus 0000:1f: resource 2 [mem 0xf0800000-0xf08fffff 64bit pref]
[    1.272983] pci_bus 0000:20: resource 0 [io  0x8000-0x8fff]
[    1.272995] pci_bus 0000:20: resource 1 [mem 0xfc200000-0xfc2fffff]
[    1.273007] pci_bus 0000:20: resource 2 [mem 0xf0700000-0xf07fffff 64bit pref]
[    1.273020] pci_bus 0000:21: resource 0 [io  0x7000-0x7fff]
[    1.273032] pci_bus 0000:21: resource 1 [mem 0xfc100000-0xfc1fffff]
[    1.273044] pci_bus 0000:21: resource 2 [mem 0xf0600000-0xf06fffff 64bit pref]
[    1.273058] pci_bus 0000:22: resource 0 [io  0x6000-0x6fff]
[    1.273069] pci_bus 0000:22: resource 1 [mem 0xfc000000-0xfc0fffff]
[    1.273082] pci_bus 0000:22: resource 2 [mem 0xf0500000-0xf05fffff 64bit pref]
[    1.274306] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    1.291030] pci 0000:02:00.0: quirk_usb_early_handoff+0x0/0x160 took 14862 usecs
[    1.306025] pci 0000:02:01.0: quirk_usb_early_handoff+0x0/0x160 took 14567 usecs
[    1.306329] pci 0000:0b:00.0: CLS mismatch (32 != 64), using 64 bytes
[    1.306401] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.306408] software IO TLB: mapped [mem 0x00000000bc000000-0x00000000c0000000] (64MB)
[    1.306705] Trying to unpack rootfs image as initramfs...
[    1.311794] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2298364cab5, max_idle_ns: 440795214892 ns
[    1.315534] clocksource: Switched to clocksource tsc
[    1.318930] Initialise system trusted keyrings
[    1.318963] Key type blacklist registered
[    1.319168] workingset: timestamp_bits=36 max_order=23 bucket_order=0
[    1.328391] zbud: loaded
[    1.329998] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    1.333487] fuse: init (API version 7.34)
[    1.334895] integrity: Platform Keyring initialized
[    1.360312] Key type asymmetric registered
[    1.360319] Asymmetric key parser 'x509' registered
[    1.360385] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    1.360633] io scheduler mq-deadline registered
[    1.364122] pcieport 0000:00:15.0: PME: Signaling with IRQ 24
[    1.364407] pcieport 0000:00:15.0: pciehp: Slot #160 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.366983] pcieport 0000:00:15.1: PME: Signaling with IRQ 25
[    1.367263] pcieport 0000:00:15.1: pciehp: Slot #161 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.369778] pcieport 0000:00:15.2: PME: Signaling with IRQ 26
[    1.370050] pcieport 0000:00:15.2: pciehp: Slot #162 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.372591] pcieport 0000:00:15.3: PME: Signaling with IRQ 27
[    1.372861] pcieport 0000:00:15.3: pciehp: Slot #163 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.375393] pcieport 0000:00:15.4: PME: Signaling with IRQ 28
[    1.375661] pcieport 0000:00:15.4: pciehp: Slot #164 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.378167] pcieport 0000:00:15.5: PME: Signaling with IRQ 29
[    1.378448] pcieport 0000:00:15.5: pciehp: Slot #165 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.381063] pcieport 0000:00:15.6: PME: Signaling with IRQ 30
[    1.381357] pcieport 0000:00:15.6: pciehp: Slot #166 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.383986] pcieport 0000:00:15.7: PME: Signaling with IRQ 31
[    1.384256] pcieport 0000:00:15.7: pciehp: Slot #167 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.386869] pcieport 0000:00:16.0: PME: Signaling with IRQ 32
[    1.387139] pcieport 0000:00:16.0: pciehp: Slot #192 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.389652] pcieport 0000:00:16.1: PME: Signaling with IRQ 33
[    1.389930] pcieport 0000:00:16.1: pciehp: Slot #193 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.392530] pcieport 0000:00:16.2: PME: Signaling with IRQ 34
[    1.392815] pcieport 0000:00:16.2: pciehp: Slot #194 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.395441] pcieport 0000:00:16.3: PME: Signaling with IRQ 35
[    1.395719] pcieport 0000:00:16.3: pciehp: Slot #195 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.398383] pcieport 0000:00:16.4: PME: Signaling with IRQ 36
[    1.398681] pcieport 0000:00:16.4: pciehp: Slot #196 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.401331] pcieport 0000:00:16.5: PME: Signaling with IRQ 37
[    1.401605] pcieport 0000:00:16.5: pciehp: Slot #197 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.404214] pcieport 0000:00:16.6: PME: Signaling with IRQ 38
[    1.404516] pcieport 0000:00:16.6: pciehp: Slot #198 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.407116] pcieport 0000:00:16.7: PME: Signaling with IRQ 39
[    1.407387] pcieport 0000:00:16.7: pciehp: Slot #199 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.409988] pcieport 0000:00:17.0: PME: Signaling with IRQ 40
[    1.410265] pcieport 0000:00:17.0: pciehp: Slot #224 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.412930] pcieport 0000:00:17.1: PME: Signaling with IRQ 41
[    1.413211] pcieport 0000:00:17.1: pciehp: Slot #225 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.415813] pcieport 0000:00:17.2: PME: Signaling with IRQ 42
[    1.416083] pcieport 0000:00:17.2: pciehp: Slot #226 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.418811] pcieport 0000:00:17.3: PME: Signaling with IRQ 43
[    1.419085] pcieport 0000:00:17.3: pciehp: Slot #227 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.421632] pcieport 0000:00:17.4: PME: Signaling with IRQ 44
[    1.421901] pcieport 0000:00:17.4: pciehp: Slot #228 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.424531] pcieport 0000:00:17.5: PME: Signaling with IRQ 45
[    1.424809] pcieport 0000:00:17.5: pciehp: Slot #229 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.427399] pcieport 0000:00:17.6: PME: Signaling with IRQ 46
[    1.427678] pcieport 0000:00:17.6: pciehp: Slot #230 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.430246] pcieport 0000:00:17.7: PME: Signaling with IRQ 47
[    1.430542] pcieport 0000:00:17.7: pciehp: Slot #231 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.433123] pcieport 0000:00:18.0: PME: Signaling with IRQ 48
[    1.433402] pcieport 0000:00:18.0: pciehp: Slot #256 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.436013] pcieport 0000:00:18.1: PME: Signaling with IRQ 49
[    1.436290] pcieport 0000:00:18.1: pciehp: Slot #257 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.438925] pcieport 0000:00:18.2: PME: Signaling with IRQ 50
[    1.439203] pcieport 0000:00:18.2: pciehp: Slot #258 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.441773] pcieport 0000:00:18.3: PME: Signaling with IRQ 51
[    1.442051] pcieport 0000:00:18.3: pciehp: Slot #259 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.444666] pcieport 0000:00:18.4: PME: Signaling with IRQ 52
[    1.444936] pcieport 0000:00:18.4: pciehp: Slot #260 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.447541] pcieport 0000:00:18.5: PME: Signaling with IRQ 53
[    1.447811] pcieport 0000:00:18.5: pciehp: Slot #261 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.450364] pcieport 0000:00:18.6: PME: Signaling with IRQ 54
[    1.450659] pcieport 0000:00:18.6: pciehp: Slot #262 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.453451] pcieport 0000:00:18.7: PME: Signaling with IRQ 55
[    1.453721] pcieport 0000:00:18.7: pciehp: Slot #263 AttnBtn+ PwrCtrl+ MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ IbPresDis- LLActRep+
[    1.455537] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.456967] ACPI: AC: AC Adapter [ACAD] (on-line)
[    1.457290] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    1.457458] ACPI: button: Power Button [PWRF]
[    1.465725] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    1.478839] Linux agpgart interface v0.103
[    1.479307] agpgart-intel 0000:00:00.0: Intel 440BX Chipset
[    1.481796] agpgart-intel 0000:00:00.0: AGP aperture is 256M @ 0x0
[    1.502203] loop: module loaded
[    1.503001] ata_piix 0000:00:07.1: version 2.13
[    1.505068] scsi host0: ata_piix
[    1.505937] scsi host1: ata_piix
[    1.506113] ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0x2150 irq 14
[    1.506123] ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0x2158 irq 15
[    1.507004] tun: Universal TUN/TAP device driver, 1.6
[    1.507245] PPP generic driver version 2.4.2
[    1.507615] VFIO - User Level meta-driver version: 0.3
[    1.507947] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.507961] ehci-pci: EHCI PCI platform driver
[    1.515630] ehci-pci 0000:02:01.0: EHCI Host Controller
[    1.515656] ehci-pci 0000:02:01.0: new USB bus registered, assigned bus number 1
[    1.516232] ehci-pci 0000:02:01.0: irq 19, io mem 0xf9811000
[    1.530642] ehci-pci 0000:02:01.0: USB 2.0 started, EHCI 1.00
[    1.530884] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15
[    1.530901] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.530914] usb usb1: Product: EHCI Host Controller
[    1.530923] usb usb1: Manufacturer: Linux 5.15.0-71-generic ehci_hcd
[    1.530934] usb usb1: SerialNumber: 0000:02:01.0
[    1.531494] hub 1-0:1.0: USB hub found
[    1.531525] hub 1-0:1.0: 6 ports detected
[    1.532447] ehci-platform: EHCI generic platform driver
[    1.532484] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.532496] ohci-pci: OHCI PCI platform driver
[    1.532554] ohci-platform: OHCI generic platform driver
[    1.532585] uhci_hcd: USB Universal Host Controller Interface driver
[    1.540220] uhci_hcd 0000:02:00.0: UHCI Host Controller
[    1.540250] uhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 2
[    1.540362] uhci_hcd 0000:02:00.0: detected 2 ports
[    1.540722] uhci_hcd 0000:02:00.0: irq 18, io base 0x00001000
[    1.541081] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.15
[    1.541097] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.541109] usb usb2: Product: UHCI Host Controller
[    1.541119] usb usb2: Manufacturer: Linux 5.15.0-71-generic uhci_hcd
[    1.541130] usb usb2: SerialNumber: 0000:02:00.0
[    1.541657] hub 2-0:1.0: USB hub found
[    1.541686] hub 2-0:1.0: 2 ports detected
[    1.542655] i8042: PNP: PS/2 Controller [PNP0303:KBC,PNP0f13:MOUS] at 0x60,0x64 irq 1,12
[    1.544504] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.544526] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.545264] mousedev: PS/2 mouse device common for all mice
[    1.548696] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    1.549360] rtc_cmos 00:01: registered as rtc0
[    1.549599] rtc_cmos 00:01: setting system clock to 2023-05-14T12:05:47 UTC (1684065947)
[    1.549875] rtc_cmos 00:01: alarms up to one month, y3k, 242 bytes nvram
[    1.549922] i2c_dev: i2c /dev entries driver
[    1.550020] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    1.550131] device-mapper: uevent: version 1.0.3
[    1.550433] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com

[    3.401805] AppArmor: AppArmor sha1 policy hashing enabled
[    3.402181] integrity: Loading X.509 certificate: UEFI:db
[    3.402484] integrity: Loaded X.509 cert 'VMware, Inc.: 4ad8ba0472073d28127706ddc6ccb9050441bbc7'
[    3.402488] integrity: Loading X.509 certificate: UEFI:db
[    3.402877] integrity: Loaded X.509 cert 'VMware, Inc.: VMware Secure Boot Signing: 04597f3e1ffb240bba0ff0f05d5eb05f3e15f6d7'
[    3.402881] integrity: Loading X.509 certificate: UEFI:db
[    3.402928] integrity: Loaded X.509 cert 'Microsoft Corporation UEFI CA 2011: 13adbf4309bd82709c8cd54f316ed522988a1bd4'
[    3.402931] integrity: Loading X.509 certificate: UEFI:db
[    3.402974] integrity: Loaded X.509 cert 'Microsoft Windows Production PCA 2011: a92902398e16c49778cd90f99e4f9ae17c55af53'
[    3.403680] integrity: Loading X.509 certificate: UEFI:MokListRT (MOKvar table)
[    3.404067] integrity: Loaded X.509 cert 'Canonical Ltd. Master Certificate Authority: ad91990bc22ab1f517048c23b6655a268e345a63'
[    3.404071] integrity: Loading X.509 certificate: UEFI:MokListRT (MOKvar table)
[    3.404447] integrity: Loaded X.509 cert 'nvidia-installer generated signing key: 3c6bfe1e32db696d3de447831dd2951283babdba'
[    3.404450] integrity: Loading X.509 certificate: UEFI:MokListRT (MOKvar table)
[    3.404829] integrity: Loaded X.509 cert 'fetch Secure Boot Module Signature key: b07e2a26d5b66a4c4ae8ad23e83401ebdd3d01fa'
[    3.404832] integrity: Loading X.509 certificate: UEFI:MokListRT (MOKvar table)
[    3.405209] integrity: Loaded X.509 cert 'fetch Secure Boot Module Signature key: 34e50fdf5e2abafc0adf94e038de39f6086d69ba'
[    3.405212] integrity: Loading X.509 certificate: UEFI:MokListRT (MOKvar table)
[    3.405599] integrity: Loaded X.509 cert 'nvidia-installer generated signing key: 3d40428b2701270fed63535fcda076a683ec5b8b'
[    3.405605] ima: No TPM chip found, activating TPM-bypass!
[    3.405610] Loading compiled-in module X.509 certificates
[    3.406798] Loaded X.509 cert 'Build time autogenerated kernel key: 2f86ddc308e15dc6b50c79b07e2324bbca0a5704'
[    3.406804] ima: Allocated hash algorithm: sha1
[    3.406828] ima: No architecture policies found
[    3.406845] evm: Initialising EVM extended attributes:
[    3.406847] evm: security.selinux
[    3.406850] evm: security.SMACK64
[    3.406852] evm: security.SMACK64EXEC
[    3.406854] evm: security.SMACK64TRANSMUTE
[    3.406856] evm: security.SMACK64MMAP
[    3.406858] evm: security.apparmor
[    3.406860] evm: security.ima
[    3.406862] evm: security.capability
[    3.406865] evm: HMAC attrs: 0x1
[    3.407435] PM:   Magic number: 7:829:76
[    3.407584] memory memory233: hash matches
[    3.408663] RAS: Correctable Errors collector initialized.
[    3.408669] Lockdown: swapper/0: hibernation is restricted; see man kernel_lockdown.7
[    3.413172] Freeing unused decrypted memory: 2036K
[    3.414188] Freeing unused kernel image (initmem) memory: 3244K
[    3.434569] Write protecting the kernel read-only data: 30720k
[    3.435932] Freeing unused kernel image (text/rodata gap) memory: 2036K
[    3.436574] Freeing unused kernel image (rodata/data gap) memory: 1448K
[    3.523508] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    3.523513] x86/mm: Checking user space page tables
[    3.602690] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    3.602699] Run /init as init process
[    3.602702]   with arguments:
[    3.602705]     /init
[    3.602707]     splash
[    3.602710]   with environment:
[    3.602712]     HOME=/
[    3.602714]     TERM=linux
[    3.602717]     BOOT_IMAGE=/vmlinuz-5.15.0-71-generic
[    3.921783] piix4_smbus 0000:00:07.3: SMBus base address uninitialized - upgrade BIOS or use force_addr=0xaddr
[    3.921799] fbcon: Taking over console
[    3.921895] cryptd: max_cpu_qlen set to 1000
[    3.922142] Console: switching to colour frame buffer device 128x48
[    3.922763] VMware vmxnet3 virtual NIC driver - version 1.6.0.0-k-NAPI
[    3.922898] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
[    3.922940] vmxnet3 0000:03:00.0: enabling device (0000 -> 0003)
[    3.923709] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[    3.928022] vmxnet3 0000:03:00.0: # of Tx queues : 8, # of Rx queues : 8

[    4.531362] vmxnet3 0000:03:00.0 ens160: renamed from eth0
[    4.539321] input: VMware VMware Virtual USB Mouse as /devices/pci0000:00/0000:00:11.0/0000:02:00.0/usb2/2-1/2-1:1.0/0003:0E0F:0003.0001/input/input5

[    4.859690] sr 2:0:0:0: Attached scsi CD-ROM sr0
[    4.859862] sr 2:0:0:0: Attached scsi generic sg0 type 5
[    4.886299] Console: switching to colour dummy device 80x25
[    4.886399] vmwgfx 0000:00:0f.0: vgaarb: deactivate vga console
[    4.889891] [TTM] Zone  kernel: Available graphics memory: 16435748 KiB
[    4.889896] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
[    4.889944] vmwgfx 0000:00:0f.0: [drm] FIFO at 0x00000000f9000000 size is 8192 kiB
[    4.889972] vmwgfx 0000:00:0f.0: [drm] VRAM at 0x00000000e8000000 size is 131072 kiB
[    4.889992] vmwgfx 0000:00:0f.0: [drm] Running on SVGA version 2.
[    4.890008] vmwgfx 0000:00:0f.0: [drm] DMA map mode: Caching DMA mappings.
[    4.890168] vmwgfx 0000:00:0f.0: [drm] Legacy memory limits: VRAM = 4096 kB, FIFO = 256 kB, surface = 0 kB
[    4.890175] vmwgfx 0000:00:0f.0: [drm] MOB limits: max mob size = 131072 kB, max mob pages = 12288
[    4.890187] vmwgfx 0000:00:0f.0: [drm] Capabilities: rect copy, cursor, cursor bypass, cursor bypass 2, 8bit emulation, alpha cursor, extended fifo, multimon, pitchlock, irq mask, display topology, gmr, traces, gmr2, screen object 2, command buffers, command buffers 2, gbobject, dx, hp cmd queue, no bb restrictio
n, cap2 register,
[    4.890196] vmwgfx 0000:00:0f.0: [drm] Capabilities2: grow otable, intra surface copy,
[    4.890201] vmwgfx 0000:00:0f.0: [drm] Max GMR ids is 64
[    4.890205] vmwgfx 0000:00:0f.0: [drm] Max number of GMR pages is 65536
[    4.890209] vmwgfx 0000:00:0f.0: [drm] Maximum display memory size is 16384 kiB
[    4.899029] vmwgfx 0000:00:0f.0: [drm] Screen Target display unit initialized
[    4.900223] vmwgfx 0000:00:0f.0: [drm] Fifo max 0x00040000 min 0x00001000 cap 0x0000077f
[    4.901349] vmwgfx 0000:00:0f.0: [drm] Using command buffers with DMA pool.
[    4.901361] vmwgfx 0000:00:0f.0: [drm] Available shader model: Legacy.
[    4.902966] fbcon: svgadrmfb (fb0) is primary device
[    4.903919] Console: switching to colour frame buffer device 128x48

[   10.138138] vmw_vmci 0000:00:07.7: enabling device (0000 -> 0003)
[   10.153960] vmw_vmci 0000:00:07.7: Using capabilities 0xc
[   10.187581] Guest personality initialized and is active
[   10.205028] VMCI host device registered (name=vmci, major=10, minor=123)
[   10.205039] Initialized host personality
[   10.586348] RAPL PMU: API unit is 2^-32 Joules, 0 fixed counters, 10737418240 ms ovfl timer
[   10.660015] EDAC sbridge: Seeking for: PCI ID 8086:0ea0
[   10.660046] EDAC sbridge:  Ver: 1.1.2
[   10.940016] EXT4-fs (sdd2): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[   11.164956] EXT4-fs (sdb1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[   12.563607] nvidia: loading out-of-tree module taints kernel.
[   12.563675] nvidia: module license 'NVIDIA' taints kernel.
[   12.563678] Disabling lock debugging due to kernel taint
[   12.640711] nvidia-nvlink: Nvlink Core is being initialized, major device number 235

[   12.644992] nvidia 0000:0b:00.0: enabling device (0000 -> 0003)
[   12.648599] nvidia 0000:0b:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
[   12.699654] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  530.41.03  Thu Mar 16 19:48:20 UTC 2023
[   12.762447] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  530.41.03  Thu Mar 16 19:23:04 UTC 2023
[   12.871331] [drm] [nvidia-drm] [GPU ID 0x00000b00] Loading driver
[   12.972022] ACPI Warning: \_SB.PCI0.PE50.S1F0._DSM: Argument #4 type mismatch - Found [Buffer], ACPI requires [Package] (20210730/nsarguments-61)
[   13.732645] NVRM: GPU 0000:0b:00.0: RmInitAdapter failed! (0x26:0x56:1474)
[   13.732697] BUG: unable to handle page fault for address: 0000000000004628
[   13.732784] NVRM: GPU 0000:0b:00.0: rm_init_adapter failed, device minor number 0
[   13.732817] #PF: supervisor read access in kernel mode
[   13.733017] #PF: error_code(0x0000) - not-present page
[   13.733099] PGD 0 P4D 0
[   13.733143] Oops: 0000 [#1] SMP PTI
[   13.733202] CPU: 0 PID: 1202 Comm: nv_queue Tainted: P           O      5.15.0-71-generic #78-Ubuntu
[   13.733348] Hardware name: VMware, Inc. VMware7,1/440BX Desktop Reference Platform, BIOS VMW71.00V.18227214.B64.2106252220 06/25/2021
[   13.733537] RIP: 0010:_nv010655rm+0x3b/0xb0 [nvidia]
[   13.735739] Code: e3 a1 dd 02 48 8b bb 68 01 00 00 e8 7f cc 5a 00 85 c0 74 0b 48 83 c4 08 5b 41 5c c3 0f 1f 00 44 89 e7 e8 98 67 b6 ff 48 89 c7 <8b> 80 28 46 00 00 83 f8 01 74 38 80 bf 71 07 00 00 00 74 49 80 bf
[   13.736034] RSP: 0018:ffffbb5540c7bdc8 EFLAGS: 00010246
[   13.736119] RAX: 0000000000000000 RBX: ffffa0159a659408 RCX: 0000000000000000
[   13.736233] RDX: ffffbb5541fc1008 RSI: 0000000000000000 RDI: 0000000000000000
[   13.736346] RBP: ffffa015a2056000 R08: 0000000000000000 R09: 0000000000000000
[   13.736460] R10: ffffbb5540c7be70 R11: c00c03afbfbfe201 R12: 0000000000000000
[   13.736573] R13: ffffbb5540c7bec8 R14: ffffa015992ebd28 R15: ffffa01587243240
[   13.736688] FS:  0000000000000000(0000) GS:ffffa01c9f800000(0000) knlGS:0000000000000000
[   13.736817] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   13.736909] CR2: 0000000000004628 CR3: 0000000122fea006 CR4: 00000000001706f0
[   13.737050] Call Trace:
[   13.739729]  <TASK>
[   13.739733]  ? rm_execute_work_item+0xed/0x130 [nvidia]
[   13.741662]  ? os_execute_work_item+0x69/0x90 [nvidia]
[   13.743771]  ? _main_loop+0x89/0x140 [nvidia]
[   13.745868]  ? nvidia_modeset_resume+0x30/0x30 [nvidia]
[   13.748064]  ? kthread+0x127/0x150
[   13.748125]  ? set_kthread_struct+0x50/0x50
[   13.748197]  ? ret_from_fork+0x1f/0x30
[   13.748266]  </TASK>
[   13.748301] Modules linked in: nvidia_drm(PO+) nvidia_modeset(PO) nvidia(PO) nls_iso8859_1 intel_rapl_msr vmw_balloon intel_rapl_common sb_edac rapl intel_cstate joydev input_leds serio_raw vmw_vmci mac_hid sch_fq_codel dm_multipath scsi_dh_rdac scsi_dh_emc scsi_dh_alua msr ramoops reed_solomon pstore_blk pstore_
zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear vmwgfx ttm hid_generic drm_kms_helper syscopyarea sysfillrect sysimgblt crct10dif_pclmul fb_sys_fops crc32_pclmu
l ghash_clmulni_intel cec usbhid aesni_intel mptspi mptscsih ahci rc_core mptbase crypto_simd cryptd psmouse drm hid vmxnet3 libahci scsi_transport_spi i2c_piix4 pata_acpi
[   13.749536] CR2: 0000000000004628
[   13.749590] ---[ end trace 4511c364921d51e4 ]---
[   13.860906] RIP: 0010:_nv010655rm+0x3b/0xb0 [nvidia]
[   13.862938] Code: e3 a1 dd 02 48 8b bb 68 01 00 00 e8 7f cc 5a 00 85 c0 74 0b 48 83 c4 08 5b 41 5c c3 0f 1f 00 44 89 e7 e8 98 67 b6 ff 48 89 c7 <8b> 80 28 46 00 00 83 f8 01 74 38 80 bf 71 07 00 00 00 74 49 80 bf
[   13.863223] RSP: 0018:ffffbb5540c7bdc8 EFLAGS: 00010246
[   13.863302] RAX: 0000000000000000 RBX: ffffa0159a659408 RCX: 0000000000000000
[   13.863447] RDX: ffffbb5541fc1008 RSI: 0000000000000000 RDI: 0000000000000000
[   13.866736] RBP: ffffa015a2056000 R08: 0000000000000000 R09: 0000000000000000
[   13.869988] R10: ffffbb5540c7be70 R11: c00c03afbfbfe201 R12: 0000000000000000
[   13.873260] R13: ffffbb5540c7bec8 R14: ffffa015992ebd28 R15: ffffa01587243240
[   13.876588] FS:  0000000000000000(0000) GS:ffffa01c9f800000(0000) knlGS:0000000000000000
[   13.879994] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   13.883434] CR2: 0000000000004628 CR3: 0000000122fea006 CR4: 00000000001706f0
[   38.778806] EXT4-fs (sdc): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[   38.851102] audit: type=1400 audit(1684065984.799:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=1311 comm="apparmor_parser"
[   38.852419] audit: type=1400 audit(1684065984.799:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=1314 comm="apparmor_parser"
[   38.852670] audit: type=1400 audit(1684065984.799:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=1314 comm="apparmor_parser"
[   38.852918] audit: type=1400 audit(1684065984.799:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=1314 comm="apparmor_parser"
[   38.853171] audit: type=1400 audit(1684065984.799:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=1312 comm="apparmor_parser"
[   38.853426] audit: type=1400 audit(1684065984.799:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=1312 comm="apparmor_parser"
[   38.860968] audit: type=1400 audit(1684065984.807:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=1316 comm="apparmor_parser"
[   38.861251] audit: type=1400 audit(1684065984.807:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=1316 comm="apparmor_parser"
[   38.863595] audit: type=1400 audit(1684065984.811:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="tcpdump" pid=1315 comm="apparmor_parser"
[   38.870530] audit: type=1400 audit(1684065984.815:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=1313 comm="apparmor_parser"
[   38.907538] NET: Registered PF_VSOCK protocol family
[   38.960127] vmxnet3 0000:03:00.0 ens160: intr type 3, mode 0, 9 vectors allocated
[   38.966552] vmxnet3 0000:03:00.0 ens160: NIC Link is Up 10000 Mbps

/etc/modprobe.d/nvidia.conf

options nvidia NVreg_EnablePCIeGen3=1
options nvidia NVreg_EnableGpuFirmware=0
options nvidia NVreg_OpenRmEnableUnsupportedGpus=1

lspci -vv

0b:00.0 VGA compatible controller: NVIDIA Corporation TU117 [GeForce GTX 1650] (rev a1) (prog-if 00 [VGA controller])
        DeviceName: pciPassthru0
        Subsystem: Gigabyte Technology Co., Ltd TU117 [GeForce GTX 1650]
        Physical Slot: 192
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Interrupt: pin A routed to IRQ 255
        Region 0: Memory at fb000000 (32-bit, non-prefetchable) [disabled] [size=16M]
        Region 1: Memory at c0000000 (64-bit, prefetchable) [disabled] [size=256M]
        Region 3: Memory at d0000000 (64-bit, prefetchable) [disabled] [size=32M]
        Region 5: I/O ports at 3000 [disabled] [size=128]
        Capabilities: [60] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [78] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE- FLReset- SlotPowerLimit 0.000W
                DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
                        RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 128 bytes
                DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 5GT/s, Width x32, ASPM L0s, Exit Latency L0s <64ns
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s (ok), Width x32 (ok)
                        TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR-
                         10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
                         EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
                         FRS- TPHComp- ExtTPHComp-
                         AtomicOpsCap: 32bit- 64bit- 128bitCAS-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled,
                         AtomicOpsCtl: ReqEn-
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
                         EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
                         Retimer- 2Retimers- CrosslinkRes: unsupported
        Capabilities: [100 v1] Virtual Channel
                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                Arb:    Fixed- WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
                        Status: NegoPending- InProgress-
        Capabilities: [250 v1] Latency Tolerance Reporting
                Max snoop latency: 0ns
                Max no snoop latency: 0ns
        Capabilities: [258 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=255us PortTPowerOnTime=10us
                L1SubCtl1: PCI-PM_L1.2- PCI-PM_L1.1- ASPM_L1.2- ASPM_L1.1-
                           T_CommonMode=0us LTR1.2_Threshold=0ns
                L1SubCtl2: T_PwrOn=10us
        Capabilities: [128 v1] Power Budgeting <?>
        Capabilities: [420 v2] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
                AERCap: First Error Pointer: 00, ECRCGenCap- ECRCGenEn- ECRCChkCap- ECRCChkEn-
                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
                HeaderLog: 00000000 00000000 00000000 00000000
        Capabilities: [600 v1] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
        Capabilities: [900 v1] Secondary PCI Express
                LnkCtl3: LnkEquIntrruptEn- PerformEqu-
                LaneErrStat: 0
        Capabilities: [bb0 v1] Physical Resizable BAR
                <error in resizable BAR: num_bars=0 is out of specification>
        Kernel modules: nvidiafb, nouveau

dmesg and console error screenshots




ESXi PCI

Also don’t know if it will help at all, but here’s some working outputs of nvidia-smi using the only working 450 driver:
2023-05-14 06_00_14-NVIDIA GTX 1650 Fails to load modules other than 450.119 on ESXi Passthrough PCI
2023-05-14 06_45_44-fetch@fetch_ ~

Looks like I was able to answer my own question. I hope this helps someone in the future.

The solution
You need to use open NVIDIA drivers. To do this, pick the version you want to use from the NVIDIA website, then to install it properly, run the following:

sudo ./NVIDIA-Linux-x86_64-525.116.04.run -m=kernel-open
sudo update-initramfs -u
sudo reboot

The critical part is the -m=kernel-open part.

I used 525.116.04 but I have confidence it will work for ANY supported version.

I’m also going to include my purge all NVIDIA drivers script here for anyone who wants to ensure they do this with a clean install on Ubuntu:

purge-nvidia.sh (run this BEFORE any new driver install)

sudo nvidia-uninstall
sudo apt purge -y '^nvidia-*' '^libnvidia-*'
sudo rm -r /var/lib/dkms/nvidia
sudo apt -y autoremove
sudo update-initramfs -c -k `uname -r`
sudo update-grub2
read -p "Press any key to reboot... " -n1 -s
sudo reboot

My now working nvidia-smi

fetch@fetch:~$ nvidia-smi
Sun May 14 10:14:10 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 525.116.04   Driver Version: 525.116.04   CUDA Version: 12.0     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  Off  | 00000000:0B:00.0 Off |                  N/A |
| 52%   52C    P2    N/A /  75W |    582MiB /  4096MiB |      5%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A      4911      C   ...diaserver/Plex Transcoder      578MiB |
+-----------------------------------------------------------------------------+
1 Like

Hello furrious,

Thank you for sharing. I’m expericing the same error as yours when I use the proprietary drivers. However, after trying to use kernal-open option, the driver stopped crashing, but I get No devices were found when i use nvidia-smi.
In the dmesg, I got the error:
Open nvidia.ko is only ready for use on Data Center GPUs. To force use of Open nvidia.ko on other GPUs, see the ‘OpenRmEnableUnsupportedGpus’ kernel module parameter described in the README

Do you have any idea how to deal with this? Thank you!

I’m using esxi 8.0 on dell r7525, with RTX TITAN passthough

Now seems I solved my problem too, as per Nvidia-smi "No devices were found" - VMWare ESXI Ubuntu Server 20.04.03 with RTX3070 - #40 by LionelDerBoven