The easiest way (my opinion, of course) to set up an older version of CUDA is to strictly follow the compatibility matrix given in the linux install guide for the version of CUDA you are trying to use.
https://developer.nvidia.com/cuda-toolkit-archive
This means starting with a compatible (listed) linux distro.
And it’s OK to have a newer driver. Don’t be confused about what nvidia-smi reports:
https://stackoverflow.com/questions/53422407/different-cuda-versions-shown-by-nvcc-and-nvidia-smi
it does not report your installed CUDA toolkit version. It reports something else, and as long as you have a new enough driver, what it reports does not matter.