I digged around a bit and it seems nvidia has indeed changed again the pass-through requirements for the Ada gen, without official notice. Please see this for a solution:
https://forums.developer.nvidia.com/t/passthrough-rtx-6000-ada-to-proxmox-vm-linux-driver-crash-follow-up-better-solution/258997