I use cuda-repo-debian11-12-0-local_12.0.0-525.60.13-1_amd64.deb downloaded from CUDA Toolkit 12.3 Update 1 Downloads | NVIDIA Developer.
This link points to the CUDA Toolkit installation packages
libcudadebugger.so is a part of Nvidia GPU Driver package (e.g. Linux x64 (AMD64/EM64T) Display Driver | 525.60.11 | Linux 64-bit | NVIDIA )
E.g. for Arch Linux (Can't use Cuda-gdb) the distro GPU driver installer package re-packs the official Nvidia GPU driver package (https://github.com/archlinux/svntogit-packages/blob/packages/nvidia-utils/trunk/PKGBUILD ), so their installer has to be updated every time we add/remove files from the GPU Driver.
Assuming that Debian follows similar approach (rather then using the official Nvidia GPU driver package directly), the Debian packages would have to be updated as well.