Well… the modeset = 0 got rid of that error, which probably makes sense since I’m not doing framebuffer/console/graphics at all.
However, nvidia-smi doesn’t see my device still.
Still getting multiple of these, before and after the nvidia-drm says it’s loading.
[ 5.926110] NVRM: GPU 0000:00:0c.0: RmInitAdapter failed! (0x23:0xffff:1574)
[ 5.926126] NVRM: GPU 0000:00:0c.0: rm_init_adapter failed, device minor number 0
Tried adding options nvidia NVreg_OpenRmEnableUnsupportedGpus=1 suggested in Nvidia-smi "No devices were found" - VMWare ESXI Ubuntu Server 20.04.03 with RTX3070 - #40 by LionelDerBoven , but no change.
I now tried rebooting the whole thing, and it seems to now be working. I wonder if there was some kind of something stuck, and needed a full reset of the GPU shrug I really hope that doesn’t happen regularly.