Very interesting, is there a safe way to do so? I believe in this case the offending nvidia-settings package is 510.47.03-0ubuntu1.
To be clear I also set my Nvidia X Server Settings to the default Ubuntu version which happens to be exactly that one (510.47.03-0ubuntu1), simply because I liked the option to set performance mode. See this post for a more comprehensive context.
UPDATE
I went on and unhold the Nvidia X Server Settings, run sudo apt upgrade so that also this tool matches the Drivers and Toolkit distro and, finally, re-run sudo apt-get install cuda. This time I was prompted with the following
The following packages were automatically installed and are no longer required:
cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaio1 libcacard0 libdaxctl1 libdecor-0-0 libdecor-0-plugin-1-cairo libfdt1 libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libiscsi7 libndctl6 libpmem1 libpmemobj1 libqrencode4 librados2
librbd1 libsdl2-2.0-0 libspice-server1 liburing2 libusbredirparser1 libvirglrenderer1 msr-tools ovmf pass qemu-block-extra qemu-system-common qemu-system-data qemu-system-gui qemu-system-x86 qemu-utils qrencode seabios tree uidmap xclip
Use 'sudo apt autoremove' to remove them.
The following additional packages will be installed:
cuda-12-1 cuda-demo-suite-12-1 cuda-drivers cuda-drivers-530 cuda-runtime-12-1
The following NEW packages will be installed:
cuda cuda-12-1 cuda-demo-suite-12-1 cuda-drivers cuda-drivers-530 cuda-runtime-12-1
0 upgraded, 6 newly installed, 0 to remove and 0 not upgraded.
Need to get 3,991 kB of archives.
After this operation, 12.9 MB of additional disk space will be used.
Do you want to continue? [Y/n] Y
As you can see I proceed to install the missing dependencies, but still get some hanging packages/libraries which I’m not entirely sure if it’s safe to remove. Let me know, thanks again!