No libcudart.so.12 with cuda-toolkit

I installed cuda-toolkit on Ubuntu 22.04.2 and amd64:

paul@desktop:~$ apt search cuda-toolkit
Sorting... Done
Full Text Search... Done
nvidia-cuda-toolkit/jammy,now 11.5.1-1ubuntu1 amd64 [installed]
  NVIDIA CUDA development toolkit

nvidia-cuda-toolkit-doc/jammy,jammy,now 11.5.1-1ubuntu1 all [installed,automatic]
  NVIDIA CUDA and OpenCL documentation

nvidia-cuda-toolkit-gcc/jammy 11.5.1-1ubuntu1 amd64
  NVIDIA CUDA development toolkit (GCC compatibility)

CUDA 12010 is available:

| NVIDIA-SMI 525.105.17   Driver Version: 525.105.17   CUDA Version: 12.0     |

CuPy is looking for libcudart.so.12, which is not present. How should I get it? Wasn’t cuda-toolkit supposed to install it?

You have Cuda 11.5 installed, which installs libcudart.so.11.5. You will need to upgrade to Cuda Toolkit 12.

Why nvidia-smi shows CUDA Version: 12.0? Is the driver using its own version of Cuda, independent of cuda-toolkit?

nvidia-smi is installed/updated along with the driver package. The version of Cuda displayed in nvidia-smi is the version that was used to compile the driver and nvidia-smi.

Perhaps when you installed Cuda 11.5, you had updated to a later driver, (11.5.0 ships with 495.29.05), and so during toolkit install, the packaged driver would have been ignored in favour of the newer version.

1 Like

Thank you. I installed cuda-toolkit-12-1 from https://developer.nvidia.com/cuda-downloads