A Debian 12 NVIDIA GPU is not supported by any driver. How could the GPU be used? GPU enablement depends on whether the Graphics card supports NVIDIA drivers. A GPU graphics card doesn’t seem to support any Nvidia driver. Command output:
nvidia-detect
Detected NVIDIA GPUs:
06:00.0 3D controller [0302]: NVIDIA Corporation GA100 [A100 PCIe 80GB] [10de:20b5] (rev a1)
Checking card: NVIDIA Corporation GA100 [A100 PCIe 80GB] (rev a1)
Uh oh. Your card is not supported by any driver version up to 555.42.06.
A newer driver may add support for your card.
Newer driver releases may be available in backports, unstable or experimental.
Two Nvidia drivers listed as supported don’t get loaded on reboot and restart as well. Driver Details | NVIDIA and Driver Details | NVIDIA
Similar message about not being supported. Thanks.
You didnt say what you cpu architecture was, but a manual driver search on the Nvidia site suggested this for Debian 12 64bit and an A100:
Linux 64-bit Debian 12
Data Center Driver for Debian 12
Driver Version:570.124.06
CUDA Toolkit:12.8
Release Date:2025 March 3
File Size:570.53 MB
Have you tried that one? Other recent posts relate to ubuntu 20.04 but contain info sources you might find useful
Yes, the driver gets installed but doesn’t get loaded as well as indicated by lsmod.
Image
Debian 12 x64 (bookworm)
6 CPU cores
60 GB memory
1400 GB storage
GPU
1/2 NVIDIA A100 PCIe, 40 GB VRAM
lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description: Debian GNU/Linux 12 (bookworm)
Release: 12
Codename: bookworm
lspci | grep -i nvidia
06:00.0 3D controller: NVIDIA Corporation GA100 [A100 PCIe 80GB] (rev a1)
uname -r
6.1.0-31-amd64
sudo dmesg | grep Linux
[ 0.000000] Linux version 6.1.0-31-amd64
(debian-kernel@lists.debian.org) (gcc-12 (Debian
12.2.0-14) 12.2.0, GNU ld (GNU Binutils for
Debian) 2.40) #1 SMP PREEMPT_DYNAMIC Debian
6.1.128-1 (2025-02-07)
[ 0.090606] TOMOYO Linux initialized
[ 1.652767] pps_core: LinuxPPS API ver. 1
registered
[ 2.143726] Linux agpgart interface v0.103
[ 2.493122] usb usb1: Manufacturer: Linux
6.1.0-31-amd64 xhci-hcd
[ 2.493538] usb usb2: Manufacturer: Linux
6.1.0-31-amd64 xhci-hcd
nvidia-smi
NVIDIA-SMI has failed because it couldn’t communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.
No kernel modules are in use on the GPU device.
sudo lspci -v -s 06:00.0
06:00.0 3D controller: NVIDIA Corporation GA100 [A100 PCIe 80GB] (rev a1)
Subsystem: NVIDIA Corporation GA100 [A100 PCIe 80GB]
Physical Slot: 0-5
Flags: fast devsel
Memory at 82000000 (32-bit, non-prefetchable) [size=256K]
Memory at 1000000000 (64-bit, prefetchable) [size=4G]
Memory at 80000000 (64-bit, non-prefetchable) [size=32M]
Capabilities: [d0] Vendor Specific Information: Len=1b <?>
Capabilities: [7c] MSI-X: Enable- Count=3 Masked-
Kernel modules: nouveau, nvidia_drm, nvidia
did you read this:
what command did you use to install the driver?
Have seen people with new cards and new drivers have problems with old kernels and yours looks old to me.
If all else fails, what you may need to do is find the newest driver your kernel will work with, but is the oldest your card will work with. This will be boring but a binary chop might help!
Thanks. Shall update after trying your suggestion.