NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running

I’ve setup a VM on XCP-NG with a P1000 passed through at to an Ubuntu Server 22.04 VM. I can confirm that the VM can see the gpu with lspci

00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II]
00:01.2 USB controller: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] (rev 01)
00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 01)
00:02.0 VGA compatible controller: Device 1234:1111
00:03.0 SCSI storage controller: XenSource, Inc. Xen Platform Device (rev 01)
00:05.0 VGA compatible controller: NVIDIA Corporation GP107GL [Quadro P1000] (rev a1)

I have installed the nvidia 535 server drivers successfully. However, when I run nvidia-smi, I get the following (after rebooting):

NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

I’ve attached the log file. If there is any more information I can provide, please let me know!

nvidia-bug-report.log.gz (37.6 KB)