I have an older Intel dual Xeon server that I’ve been running for more than a decade, most recently running proxmox, and want to set up to run LLM’s on Virtual Machines. I have another new AMD build running proxmox, and was running with this same 4070, and it was working. Bought a new 5070 for the server, and couldn’t get it to be recognized by the intel server, so swapped them around and put the known working GPU into the Intel server(the 5070 is recognized by the AMD system). I’ve followed the instructions from Proxmox for enabling GPUs, updating grub, and modules, iommu is enabled, but no nvidia devices are detected in dmesg, and driver 570 install says there’s no board recognized. It’s also not found in lspci or pvesh.
Grub changes "intel_iommu=on iommu=pt "
I also tried it with:
"intel_iommu=on iommu=pt pcie_acs_override= downstream,multifunction nofb nomodeset "
Module:
vfio
vfio_iommu_type1
vfio_pci
And I do see the vfio settings in lsmod
I recently(before any of this) updated the servers BIOS to the latest Nov 2019 bios available. There’s no SR-IOV setting in BIOS.
It is now running in UEFI bios mode, I changed from legacy yesterday.
When I tested the 5070, the various LED’s did light up.
Oh, this server has dual 800Watt PS’s, and I have a 4x8 power adapter with 4 6pin power cables plugged in which gives me the same 12 pwr and gnd wires as 3 8pin connectors would, it should have plenty of power to at least start.
Link to MB Docs
I’m not sure if this helps, but I thought I would include it. I’ve been looking for pci devices with 0000:02, cause those are from the gpu, and hadn’t seen any, but I was grepping dmesg, and found these:
root@maelstrom:/etc# dmesg |grep 0000:02
[ 0.970308] pci 0000:02:08.0: [8086:1d3f] type 01 class 0x060400 PCIe Switch Downstream Port
[ 0.970336] pci 0000:02:08.0: PCI bridge to [bus 03]
[ 0.970340] pci 0000:02:08.0: bridge window [io 0x8000-0x8fff]
[ 0.970352] pci 0000:02:08.0: bridge window [mem 0x38ffff000000-0x38ffff8fffff 64bit pref]
[ 0.970413] pci 0000:02:08.0: PME# supported from D0 D3hot D3cold
[ 0.970926] pci 0000:02:08.0: PCI bridge to [bus 03]
[ 1.031301] pci 0000:02:08.0: PCI bridge to [bus 03]
[ 1.031305] pci 0000:02:08.0: bridge window [io 0x8000-0x8fff]
[ 1.031312] pci 0000:02:08.0: bridge window [mem 0x38ffff000000-0x38ffff8fffff 64bit pref]
[ 1.031466] pci_bus 0000:02: resource 0 [io 0x8000-0x8fff]
[ 1.031468] pci_bus 0000:02: resource 2 [mem 0x38ffff000000-0x38ffff8fffff 64bit pref]
[ 1.065465] pci 0000:02:08.0: Adding to iommu group 36