We operate a HPC cluster with many, many, many nodes and Nvidia GPUs.
For installing nodes (OS as well as libs) we maintain local mirrors (yum/deb/you-name-it).
We currently have some scripts that scrape  using lftp to create a local mirror that is accessible from our cluster. This is done both to save our time and your bandwidth.
This is currently broken because the directory listing at  is incomplete.
E.g. the the repodata folder  exists, but is not listed in the index page .
It also seems that many rpms and other files are missing in the index. Possibly they exist, but if they are not listed in the directory indexes lftp (or wget or whatever) can not retrieve them.
Could you please check why the yum repos resp. the directory listings are incomplete? This could be caused by wrong file permissions, e.g. the webserver does not have permission to read the folders/files.
If at all possible could you setup a rsync server? This would make every large-scale-customers life much easier as the keep-the-nvidia-repo up2date process could be trivially automated.