Nvidia-smi GPU No longer found after reboot - Ubuntu 22.04 VM

I had checked nvidia-smi the other day and everything looked great, I got output and everything. Yesterday evening I rebooted the VM for some updates (Ubuntu 22.04.01) and now when I do nvidia-smi it says nothing is found and I’m confused as heck as to what’s going on. I’ve tried uninstalling, rebooting, reinstalling drivers from the 470, 515, 520, and 525 family of drivers.
GPU in question is a P4000 that’s passed through to a single Ubuntu VM.
sudo dmesg | grep NVRM
[ 4.080953] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 525.60.11 Wed Nov 23 23:04:03 UTC 2022
[ 16.102564] NVRM: GPU 0000:0b:00.0: RmInitAdapter failed! (0x23:0xffff:1417)
[ 16.102636] NVRM: GPU 0000:0b:00.0: rm_init_adapter failed, device minor number 0
[ 16.228998] NVRM: GPU 0000:0b:00.0: RmInitAdapter failed! (0x23:0xffff:1417)
[ 16.229061] NVRM: GPU 0000:0b:00.0: rm_init_adapter failed, device minor number 0

nvidia-bug-report.log.gz (289.5 KB)

Apparently I needed to reboot the ESXi host, not sure exactly what happened and why a VM reboot triggered this issue but for now it seems to have fixed itself.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.