I’m having the same issue that you have. Seems like every driver release after 550 has regression that causes crashes and freezes in my laptop with RTX2060.
As a workaround I uninstalled nvidia-driver-550, nvidia-driver-580 and all related packages, removed noble-updates in /etc/apt/sources.list.d/ubuntu.sources, reinstalled nvidia-driver-550 which installs 550.144.03-0ubuntu0.24.04.1 and then froze the following packages with apt-mark so that they aren’t updated until a fixed driver version is released, and re-enabled noble-updates repository
sudo apt-mark hold libnvidia-cfg1-550 libnvidia-common-550 libnvidia-compute-550 libnvidia-decode-550 libnvidia-encode-550 libnvidia-extra-550 libnvidia-fbc1-550 libnvidia-gl-550 nvidia-compute-utils-550 nvidia-dkms-550 nvidia-driver-550 nvidia-kernel-common-550 nvidia-kernel-source-550 nvidia-utils-550 xserver-xorg-video-nvidia-550
Edit: for reference, I’m having the issue on Ubuntu 24.04 with X11