Nvidia-smi "No devices were found" - VMWare ESXI Ubuntu Server 20.04.03 with RTX3070

UPDATE (again): I installed Proxmox, spun up an Ubuntu Server VM, passed through the card and installed drivers and it works. It seems like the issue is either 100% on Vmware ESXi or Supermicro motherboard/ESXi combination.