Failed to download artifacts from https://developer.download.nvidia.com/ (Mirror sync in progress?)

Accelerated Computing CUDA CUDA Setup and Installation
1

Hi there,

I hope this is the right channel to communicate this, looks like the nvidia download mirrors are broken.

Failed to fetch https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/Packages.gz  File has unexpected size (1127072 != 1126689). Mirror sync in progress? [IP: 152.195.19.142 443]
   Hashes of expected file:
    - Filesize:1126689 [weak]
    - SHA256:7cee2584ca6d97b2f07018ba4f9c3c473fb4e299ed170968a1f8c99c090cc59f
    - SHA1:4ee24fac5518a3fcc3702590a0dab32c95484c54 [weak]
    - MD5Sum:593faff511765d11055c9919bf2e3bf8 [weak]
   Release file created at: Thu, 17 Aug 2023 19:03:05 +0000
E: Some index files failed to download. They have been ignored, or old ones used instead.
[ 2023-08-18 02:24:46,829.829 ] WARNING | instance_ops.py:exec_script:297 - Host[26.0.139.249], script [00.install.custom.packages.compute.sh], stdout: Selecting previously unselected package packages-microsoft-prod. (Reading database ... 155493 files and directories currently installed.) Preparing to unpack packages-microsoft-prod.deb ... Unpacking packages-microsoft-prod (1.0-ubuntu20.04.1) ... Setting up packages-microsoft-prod (1.0-ubuntu20.04.1) ... Hit:1 https://nvidia.github.io/libnvidia-container/stable/ubuntu18.04/amd64 InRelease Hit:2 https://nvidia.github.io/nvidia-container-runtime/stable/ubuntu18.04/amd64 InRelease Hit:3 https://nvidia.github.io/nvidia-docker/ubuntu18.04/amd64 InRelease Get:4 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64 InRelease [1581 B] Get:5 https://packages.microsoft.com/ubuntu/20.04/prod focal InRelease [3611 B] Hit:6 https://fsx-lustre-client-repo.s3.amazonaws.com/ubuntu focal InRelease Get:7 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64 Packages [1127 kB] Err:7 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64 Packages File has unexpected size (1127072 != 1126689). Mirror sync in progress? [IP: 152.195.19.142 443] Hashes of expected file: - Filesize:1126689 [weak] - SHA256:7cee2584ca6d97b2f07018ba4f9c3c473fb4e299ed170968a1f8c99c090cc59f - SHA1:4ee24fac5518a3fcc3702590a0dab32c95484c54 [weak] - MD5Sum:593faff511765d11055c9919bf2e3bf8 [weak] Release file created at: Thu, 17 Aug 2023 19:03:05 +0000 Hit:8 http://security.ubuntu.com/ubuntu focal-security InRelease Get:9 https://packages.microsoft.com/ubuntu/20.04/prod focal/main arm64 Packages [46.2 kB] Get:10 https://packages.microsoft.com/ubuntu/20.04/prod focal/main armhf Packages [16.0 kB] Get:11 https://packages.microsoft.com/ubuntu/20.04/prod focal/main amd64 Packages [222 kB] Get:12 https://packages.microsoft.com/ubuntu/20.04/prod focal/main all Packages [2586 B] Hit:13 http://us-west-2.ec2.archive.ubuntu.com/ubuntu focal InRelease Get:14 http://us-west-2.ec2.archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] Get:15 http://us-west-2.ec2.archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] Get:16 http://us-west-2.ec2.archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2767 kB] Get:17 http://us-west-2.ec2.archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1101 kB] Fetched 4382 kB in 6s (785 kB/s) Reading package lists... stderr: + set -e + main ++ date '+%Y-%m-%d %H:%M:%S' + echo '[INFO][2023-08-18 02:24:38] 00.install.custom.packages.compute.sh: START' [INFO][2023-08-18 02:24:38] 00.install.custom.packages.compute.sh: START + installCustom + wget https://packages.microsoft.com/config/ubuntu/20.04/packages-microsoft-prod.deb -O packages-microsoft-prod.deb --2023-08-18 02:24:38-- https://packages.microsoft.com/config/ubuntu/20.04/packages-microsoft-prod.deb Resolving packages.microsoft.com (packages.microsoft.com)... 13.93.224.173 Connecting to packages.microsoft.com (packages.microsoft.com)|13.93.224.173|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 3690 (3.6K) [application/octet-stream] Saving to: ‘packages-microsoft-prod.deb’ 0K ... 100% 1.51G=0s 2023-08-18 02:24:38 (1.51 GB/s) - ‘packages-microsoft-prod.deb’ saved [3690/3690] + sudo dpkg -i packages-microsoft-prod.deb + rm packages-microsoft-prod.deb + sudo apt-get -q -o DPkg::Lock::Timeout=240 update E: Failed to fetch https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/Packages.gz File has unexpected size (1127072 != 1126689). Mirror sync in progress? [IP: 152.195.19.142 443] Hashes of expected file: - Filesize:1126689 [weak] - SHA256:7cee2584ca6d97b2f07018ba4f9c3c473fb4e299ed170968a1f8c99c090cc59f - SHA1:4ee24fac5518a3fcc3702590a0dab32c95484c54 [weak] - MD5Sum:593faff511765d11055c9919bf2e3bf8 [weak] Release file created at: Thu, 17 Aug 2023 19:03:05 +0000 E: Some index files failed to download. They have been ignored, or old ones used instead.

Looks like the fix has to be on the nvidia side.

3 Likes
2

I have the same issue.

2 Likes
3

same issue when build docker image

1 Like
4

I faced the same issue. What solved it for me was to do rm /etc/apt/sources.list.d/cuda.list before any apt command.

RUN rm /etc/apt/sources.list.d/cuda.list \
    && apt-get update \
    && ...
1 Like
5

thanks, that worked ! 🙏

2 Likes
6

Thanks a lot for this! worked for me too

7

Thanks… works

8

The metadata mismatch issue is now resolved.
See also Unable to add apt repo - Mirror sync in progress