I followed the installation instructions here
To install CUDA 12.5, and while Debian’s “nvidia-cuda-toolkit/stable,now 11.8.89~11.8.0-5~deb12u1 amd64” package works fine, the nvidia provided package fails with “unknown error” on every API call, as per the title.
I’ve tried both the open and closed source driver, both deb (local) and deb (network)
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 555.42.06 Driver Version: 555.42.06 CUDA Version: 12.5 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 3060 ... On | 00000000:01:00.0 Off | N/A |
| N/A 48C P0 30W / 80W | 16MiB / 6144MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 1893 G /usr/lib/xorg/Xorg 4MiB |
+-----------------------------------------------------------------------------------------+
apt search cuda | grep installed
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
cuda-cccl-12-5/unknown,now 12.5.39-1 amd64 [installed,automatic]
cuda-command-line-tools-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-compiler-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-crt-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-cudart-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-cudart-dev-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-cuobjdump-12-5/unknown,now 12.5.39-1 amd64 [installed,automatic]
cuda-cupti-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-cupti-dev-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-cuxxfilt-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-documentation-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-driver-dev-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-drivers/unknown,now 555.42.06-1 amd64 [installed]
cuda-drivers-555/unknown,now 555.42.06-1 amd64 [installed,automatic]
cuda-gdb-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-libraries-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-libraries-dev-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-nsight-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nsight-compute-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-nsight-systems-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-nvcc-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvdisasm-12-5/unknown,now 12.5.39-1 amd64 [installed,automatic]
cuda-nvml-dev-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvprof-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvprune-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvrtc-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvrtc-dev-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvtx-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvvm-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-nvvp-12-5/unknown,now 12.5.82-1 amd64 [installed,automatic]
cuda-opencl-12-5/unknown,now 12.5.39-1 amd64 [installed,automatic]
cuda-opencl-dev-12-5/unknown,now 12.5.39-1 amd64 [installed,automatic]
cuda-profiler-api-12-5/unknown,now 12.5.39-1 amd64 [installed,automatic]
cuda-repo-debian12-12-5-local/now 12.5.1-555.42.06-1 amd64 [installed,local]
cuda-sanitizer-12-5/unknown,now 12.5.81-1 amd64 [installed,automatic]
cuda-toolkit-12-5/unknown,now 12.5.1-1 amd64 [installed]
cuda-toolkit-12-5-config-common/unknown,now 12.5.82-1 all [installed,automatic]
cuda-toolkit-12-config-common/unknown,now 12.5.82-1 all [installed,automatic]
cuda-toolkit-config-common/unknown,now 12.5.82-1 all [installed,automatic]
cuda-tools-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
cuda-visual-tools-12-5/unknown,now 12.5.1-1 amd64 [installed,automatic]
libcuda1/unknown,now 555.42.06-1 amd64 [installed,automatic]
libcuda1-i386/unknown,now 555.42.06-1 i386 [installed,automatic]
libcudadebugger1/unknown,now 555.42.06-1 amd64 [installed,automatic]
libcufile-12-5/unknown,now 1.10.1.7-1 amd64 [installed,automatic]
libcusolver-12-5/unknown,now 11.6.3.83-1 amd64 [installed,automatic]
libcusolver-dev-12-5/unknown,now 11.6.3.83-1 amd64 [installed,automatic]
libnvcuvid1/unknown,now 555.42.06-1 amd64 [installed,automatic]
libnvidia-nvvm4/unknown,now 555.42.06-1 amd64 [installed,automatic]
libnvidia-ptxjitcompiler1/unknown,now 555.42.06-1 amd64 [installed,automatic]
libnvoptix1/unknown,now 555.42.06-1 amd64 [installed,automatic]
nsight-compute-2024.2.1/unknown,now 2024.2.1.2-1 amd64 [installed,automatic]
nvidia-cuda-mps/unknown,now 555.42.06-1 amd64 [installed,automatic]
#include <cuda_runtime.h>
#include <iostream>
int main() {
int deviceCount;
std::cout << cudaGetErrorString(cudaGetDeviceCount(&deviceCount));
}
outputs
unknown error