Hi,
I’m a newbie . I have Linux ubuntu LTS 24.04 (6.8.0-36-generic) , RTX4090, NVIDIA-SMI 550.90.07 Driver Version: 550.90.07 CUDA Version: 12.4 . I’m trying to build llama.cpp for GPU acceleration. which version of CUDA development kit should I install? 12.4? I’m afraid Installing the nvidia-cuda-toolkit
using apt
can it potentially conflict with existing CUDA installations or drivers ? Thank you