Unable to access CUDA repo from CUDA L4t docker container

I’m having the same issue as @jcwscience. @marcel22 I have plenty of space on my Jetson and am running into the same issue.

as @gshiva5 mentioned above, you can remove the offending repo by deleting the file in /etc/apt/sources.list.d/... (and then adding the correct repo instead).

Are the repos mentioned by @marcel22 not correct for the latest Jetson OS with JetPack 5.0.2?

Did you remove the “cuda-internal” repos that came with the container originally? As long as they are present, apt update will fail.

@ahjg confirmed, i did

Hi,

Could you share which platform you use?

Here is the WAR for JetPack 5.0.2:

Xavier or XavierNX

$ rm /etc/apt/sources.list.d/*
$ echo "deb https://repo.download.nvidia.com/jetson/common r35.1 main" > /etc/apt/sources.list.d/nvidia-l4t-apt-source.list
$ echo "deb https://repo.download.nvidia.com/jetson/t194 r35.1 main" >> /etc/apt/sources.list.d/nvidia-l4t-apt-source.list
$ apt update

Orin

$ rm /etc/apt/sources.list.d/*
$ echo "deb https://repo.download.nvidia.com/jetson/common r35.1 main" > /etc/apt/sources.list.d/nvidia-l4t-apt-source.list
$ echo "deb https://repo.download.nvidia.com/jetson/t234 r35.1 main" >> /etc/apt/sources.list.d/nvidia-l4t-apt-source.list
$ apt update

Thanks

Hello, I’m on the Orin. According to Getting Started with Jetson AGX Orin Developer Kit | NVIDIA Developer I shouldn’t update to r35.1 main. I did that last week and it didn’t work out: after a sudo apt dist-upgrade I couldn’t reboot.

W: Failed to fetch http://cuda-internal.nvidia.com/release-candidates/kitpicks/cuda-r11-4-tegra/11.4.14/011/repos/l4t/arm64/InRelease  Could not resolve 'cuda-internal.nvidia.com'
W: Some index files failed to download. They have been ignored, or old ones used instead.

If I had access to cuda-internal.nvidia.com that would seem a problem…

Hi,

Please remove the source list as below:

$ rm /etc/apt/sources.list.d/*

So apt won’t access the cuda-internal.nvidia.com anymore.
Thanks.

Done. Now I can’t upgrade NVIDIA packages though. What sources.list does NVIDIA publish for users?

Hi,

Please follow the command on Sep 8 to add the URL.

Please noted that the comment is for JetPack 5.0.2 environment.
If you are using another JetPack, please modify it correspondingly.

Thanks.

Understood. This is in direct conflict with NVIDIA’s Orin documentation– see Step 2, “Attention”. Changing apt sources to match what your instruction makes the Orin unbootable.

Hi,

The document is for the native Orin environment.
However, here is the package source list inside the container.
It’s expected that the OS version between native and container is already aligned.

Thanks.

Hello, I’ve commented out the NVIDIA’s deb servers. Not I can’t upgrade NVIDIA packages (NVIDIA repos aren’t updated with apt update).

Hi,

Do you run the apt update inside the container or natively on the Jetson?
If within the container, do you use JetPack 5.0.2 (r35.1) for both environments?

More, please share all the configure files under the /etc/apt/sources.list.d/ with us.
Thanks.

Hello, and sorry for the delay! You can find that exact information in the link I sent earlier, the documentation for setting up your Orin.

I followed NVIDIA’s instructions so mine are no different.

>> ls /etc/apt/sources.list.d/
>> nvidia-l4t-apt-source.list
>> cat /etc/apt/sources.list.d/nvidia-l4t-apt-source.list
# SPDX-FileCopyrightText: Copyright (c) 2019-2021 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
# SPDX-License-Identifier: LicenseRef-NvidiaProprietary
#
# NVIDIA CORPORATION, its affiliates and licensors retain all intellectual
# property and proprietary rights in and to this material, related
# documentation and any modifications thereto. Any use, reproduction,
# disclosure or distribution of this material and related documentation
# without an express license agreement from NVIDIA CORPORATION or
# its affiliates is strictly prohibited.

deb https://repo.download.nvidia.com/jetson/common r34.1 main
deb https://repo.download.nvidia.com/jetson/t234 r34.1 main

Hi,

The OS version you used in the source list is r34.1.
Do you use JetPack 5.0.1 DP?

Since we already release GA software for Orin, could you upgrade your environment to JetPack 5.0.2?
Then give nvcr.io/nvidia/r8.4.1-runtime or nvcr.io/nvidia/r8.4.1.5-devel a try.

Thanks.

I tried Jetpack 5.0.2 while waiting for your response, but the repos

deb https://repo.download.nvidia.com/jetson/common r34.1 main
deb https://repo.download.nvidia.com/jetson/t234 r34.1 main

Threw a “no release candidate” error during apt update.

Please keep this thread open for the next, at least, 9 days until I’m able to re-image the Orin.

Hi,

For JetPack 5.0.2, please use r35.1.

Thanks.

Tried that and ran into:

W: Failed to fetch http://cuda-internal.nvidia.com/release-candidates/kitpicks/cuda-r11-4-tegra/11.4.14/011/repos/l4t/arm64/InRelease  
Could not resolve 'cuda-internal.nvidia.com'

I see a lot of other people are running into this, but there is not a solution posted, the threads are just closed. The nvcr.io/nvidia/l4t-cuda:11.4.14-runtime and nvcr.io/nvidia/l4t-cuda:10.2.460-runtimeare different in more than just version, for example nvcc isn’t installed with the 11.4 runtime and it is with the 10.2. Is there a different container I should have migrated to when upgrading from JetPack 4.6 to JetPack 5.0.x?