We are already using NVIDIA RTX A5000 GPU in one of our workstation with CUDA 11.6 version.
We are planning to have one more workstation with GeForce RTX 4060 Ti GPU.
I was trying to understand if 4060 Ti GPU’s CUDA version is compatible with A5000’s. Then I came to know about Compute Capability of GPUs from here. And I got compute capability vs CUDA support from here. Which shows this.
So,
As per my understanding,
NVIDIA RTX A5000 has compute capability of 8.6 (Ampere architecture) and hence supports CUDA 11.0 to 12.2
and
Nvidia GeForce RTX 4060 Ti has compute capability of 8.9 (Ada Lovelace architecture) and hence supports CUDA versions 11.8 to 12.2. (No support of 11.0 to 11.7.1).
Perhaps what is confusing, is that the Toolkit SDK numbers are not a continuous sequence - you can find the list here. Compute Capability is separate from the Toolkit SDK number and indicates a hardware version.
There is no 11.9 Toolkit, so the first one to support it is 11.8 and another page you may find useful, with the same chart, is here.