Apt install cuda-profiler-api-11-4 failed

chllcy · June 23, 2022, 11:31am

sudo apt-get install -y nvidia-cuda
Reading package lists… Done
Building dependency tree
Reading state information… Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
nvidia-cuda : Depends: cuda-toolkit-11-4 (= 11.4.14-1) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

sudo apt-get install -y cuda-toolkit-11-4
Reading package lists… Done
Building dependency tree
Reading state information… Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
cuda-toolkit-11-4 : Depends: cuda-libraries-dev-11-4 (>= 11.4.14) but it is not going to be installed
Depends: cuda-tools-11-4 (>= 11.4.14) but it is not going to be installed
Depends: cuda-samples-11-4 (>= 11.4.239) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

sudo apt-get install -y cuda-libraries-dev-11-4
Reading package lists… Done
Building dependency tree
Reading state information… Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
cuda-libraries-dev-11-4 : Depends: cuda-profiler-api-11-4 (>= 11.4.239) but it is not installable
E: Unable to correct problems, you have held broken packages.

sudo apt-get install -y cuda-profiler-api-11-4
Reading package lists… Done
Building dependency tree
Reading state information… Done
Package cuda-profiler-api-11-4 is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package ‘cuda-profiler-api-11-4’ has no installation candidate

Index can’t find cuda-profiler-api-11-4

tony-persea · June 24, 2022, 1:28am

I have an Orin in exactly the same state, and did the exact same series of apt commands to try to get to the root cause… no solution yet, but Unable to locate package nvidia-jetpack on Orin devkit - #14 by carolyuu looks like it might be helpful except for the fact that I’m not physically in the same building as the Orin and can’t plug into the USB.

AastaLLL · June 24, 2022, 2:25am

Hi,

We are checking this issue internally.
For now, could you use the container shared in the below comment which has the CUDA toolkit installed?

Thanks.

tony-persea · June 24, 2022, 3:20pm

I think I have some info for you that could help your investigation. I was digging a bit more into it this morning.

A new version of the metadata for cuda-libraries-dev-11-4 seems to have been released with the same version number but with cuda-profiler-api-11-4 added to the list of dependencies. One of my colleagues has an Orin that has nvidia-jetpack installed correctly. Look at these two entries:

orin@orinagx4496:~$ apt show cuda-libraries-dev-11-4 -a
Package: cuda-libraries-dev-11-4
Version: 11.4.14-1
Priority: optional
Section: multiverse/devel
Maintainer: cudatools <cudatools@nvidia.com>
Installed-Size: 7,168 B
Depends: cuda-cudart-dev-11-4 (>= 11.4.243), cuda-cccl-11-4 (>= 11.4.222), cuda-profiler-api-11-4 (>= 11.4.239), cuda-driver-dev-11-4 (>= 11.4.243), cuda-nvrtc-dev-11-4 (>= 11.4.239), libcublas-dev-11-4 (>= 11.6.6.23), libcufft-dev-11-4 (>= 10.6.0.143), libcudla-dev-11-4 (>= 11.4.239), libcurand-dev-11-4 (>= 10.2.5.238), libcusolver-dev-11-4 (>= 11.2.0.238), libcusparse-dev-11-4 (>= 11.6.0.238), libnpp-dev-11-4 (>= 11.4.0.228)
Download-Size: 2,552 B
APT-Sources: https://repo.download.nvidia.com/jetson/common r34.1/main arm64 Packages
Description: CUDA Libraries 11.4 development meta-package
 Meta-package containing all available library development packages.
 Does not depend on the NVIDIA driver packages.

Package: cuda-libraries-dev-11-4
Version: 11.4.14-1
Status: install ok installed
Priority: optional
Section: multiverse/devel
Maintainer: cudatools <cudatools@nvidia.com>
Installed-Size: 7,168 B
Depends: cuda-cudart-dev-11-4 (>= 11.4.167), cuda-cccl-11-4 (>= 11.4.167), cuda-driver-dev-11-4 (>= 11.4.167), cuda-nvrtc-dev-11-4 (>= 11.4.166), libcublas-dev-11-4 (>= 11.6.5.24), libcufft-dev-11-4 (>= 10.6.0.71), libcudla-dev-11-4 (>= 11.4.168), libcurand-dev-11-4 (>= 10.2.5.165), libcusolver-dev-11-4 (>= 11.2.0.165), libcusparse-dev-11-4 (>= 11.6.0.165), libnpp-dev-11-4 (>= 11.4.0.155)
Download-Size: unknown
APT-Manual-Installed: no
APT-Sources: /var/lib/dpkg/status
Description: CUDA Libraries 11.4 development meta-package
 Meta-package containing all available library development packages.
 Does not depend on the NVIDIA driver packages.

The bottom one is the one that he installed a few days ago, the top one is the one currently offered in the apt repo (verified with curl https://repo.download.nvidia.com/jetson/common/dists/r34.1/main/binary-arm64/Packages | less). They’re both listed as 11.4.14-1 but have different dependencies.

tony-persea · June 24, 2022, 3:22pm

Oh… this is so exceptionally dirty…

I went and edited /var/lib/apt/lists/repo.download.nvidia.com_jetson_common_dists_r34.1_main_binary-arm64_Packages and removed the cuda-profiler-api-11-4 dependency from cuda-libraries-dev-11-4. apt install nvidia-jetpack seems to be proceeding as expected… we’ll see if it it works when I’m done.

tony-persea · June 24, 2022, 3:38pm

Ohhhh that didn’t work.

 cuda-libraries-dev-11-4 depends on cuda-profiler-api-11-4 (>= 11.4.239); however:
  Package cuda-profiler-api-11-4 is not installed.            
                                                                                                                                                                                                           
dpkg: error processing package cuda-libraries-dev-11-4 (--configure):
 dependency problems - leaving unconfigured

Edit: As far as using the container goes, our system also relies on getting images from a camera that’s attached to a Mellanox NIC that does RDMA. I suspect that won’t work from inside a container.

AastaLLL · June 27, 2022, 6:06am

Hi,

Really thanks for this information.
We are checking this issue internally.

Thanks.

AastaLLL · June 28, 2022, 3:10am

Hi,

The issue is fixed.
Please try the CUDA installation again.

Thanks.

tony-persea · June 28, 2022, 2:08pm

Worked great! Thanks!

bbullas · June 28, 2022, 6:17pm

I am also getting this error.

This is on a fresh install with SDKManager on the ODIN. if you then do an apt upgrade, you get the following:

root@ubuntu:/home/aerium# apt-upgrade
bash: apt-upgrade: command not found
root@ubuntu:/home/aerium# apt upgrade
Reading package lists... Done
Building dependency tree       
Reading state information... Done
![Screenshot from 2022-06-28 12-15-33|690x388](upload://syaX34SfcDKW6QtP6byI0jiWXWc.jpeg)

You might want to run 'apt --fix-broken install' to correct these.
The following packages have unmet dependencies:
 cuda-libraries-dev-11-4 : Depends: cuda-profiler-api-11-4 (>= 11.4.239) but it is not installed
E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution).

also to note, the Ubuntu Software Updater also returns a broken status:
see uploaded file

also to note apt install is now no longer working because of this issue.

d.petkovsek · June 28, 2022, 9:56pm

This is probably going to be resolved by someone who is in control of the .deb packages. However, I have found a solution.

There was a similar issue on stack overflow for fixing an old cuda instillation on x86 I found a while back but lost the link :(

Try this:

sudo apt --fix-broken install -o Dpkg::Options::="--force-overwrite"

AastaLLL · June 29, 2022, 2:08am

Hi, d.petkovsek
Thanks for this information.

Hi, bbullas
Please let us know if the issue remains after applying the fix-broken command.

Thanks.

xiongding · June 29, 2022, 3:24am

thanks for your comment, it works !

bob3u3p3 · June 29, 2022, 11:53pm

not fixed for Xavier NX Dev Kit.

AastaLLL · June 30, 2022, 3:46am

Hi, bob3u3p3

Could you share the log about the failure?
Thanks.

bbullas · June 30, 2022, 3:21pm

Yes the following command has fixed the issue :)

apt --fix-broken install -o Dpkg::Options::="--force-overwrite"

bob3u3p3 · June 30, 2022, 8:12pm

Steps:
Loaded new image and upgraded the OS to make sure it is up to date. Also removed clutter.
Loaded the CUDA utilities using SDKManager
executed sudo apt-upgrade.
Log File:
Script started on 2022-06-30 13:59:09-06:00 [TERM=“xterm-256color” TTY=“/dev/pts/0” COLUMNS=“108” LINES=“78”]
sudo apt update

0% [Working]e[0m

Hit:1 https://repo.download.nvidia.com/jetson/common r34.1 InRelease
Hit:2 Index of /ubuntu-ports focal InRelease
Hit:3 https://repo.download.nvidia.com/jetson/t194 r34.1 InRelease
Hit:4 Index of /ubuntu-ports focal-updates InRelease
Hit:5 Index of /ubuntu-ports focal-backports InRelease
Hit:6 Index of /ubuntu-ports focal-security InRelease

Reading package lists… Done
Reading state information… Done

6 packages can be upgraded. Run ‘apt list --upgradable’ to see them.
apt upgrade

Reading package lists… Done

Building dependency tree

Reading state information… Done

Calculating upgrade… Done

The following package was automatically installed and is no longer required:
cuda-nvprof-11-4
Use ‘sudo apt autoremove’ to remove it.
The following NEW packages will be installed:
cuda-profiler-api-11-4
The following packages will be upgraded:
cuda-command-line-tools-11-4 cuda-compiler-11-4 cuda-libraries-11-4 cuda-libraries-dev-11-4
cuda-toolkit-11-4 cuda-visual-tools-11-4
6 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 34.6 kB of archives.
After this operation, 90.1 kB of additional disk space will be used.
Do you want to continue? [Y/n] y
Get:1 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-command-line-tools-11-4 arm64 11.4.14-1 [2,478 B]
Get:2 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-compiler-11-4 arm64 11.4.14-1 [2,440 B]
Get:3 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-libraries-11-4 arm64 11.4.14-1 [2,512 B]
Get:4 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-profiler-api-11-4 arm64 11.4.239-1 [18.6 kB]
Get:5 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-libraries-dev-11-4 arm64 11.4.14-1 [2,552 B]
Get:6 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-toolkit-11-4 arm64 11.4.14-1 [3,204 B]
Get:7 https://repo.download.nvidia.com/jetson/common r34.1/main arm64 cuda-visual-tools-11-4 arm64 11.4.14-1 [2,856 B]
100% [Working]e[0m

Fetched 34.6 kB in 0s (92.5 kB/s)
debconf: delaying package configuration, since apt-utils is not installed

(Reading database … 100%
(Reading database … 159428 files and directories currently installed.)
Preparing to unpack …/0-cuda-command-line-tools-11-4_11.4.14-1_arm64.deb …
Unpacking cuda-command-line-tools-11-4 (11.4.14-1) over (11.4.14-1) …
Unpacking cuda-compiler-11-4 (11.4.14-1) over (11.4.14-1) …
Unpacking cuda-libraries-11-4 (11.4.14-1) over (11.4.14-1) …
Unpacking cuda-profiler-api-11-4 (11.4.239-1) …
e[1mdpkg:e[0m error processing archive /tmp/apt-dpkg-install-Dmtuud/3-cuda-profiler-api-11-4_11.4.239-1_arm64.deb (–unpack):
trying to overwrite ‘/usr/local/cuda-11.4/targets/aarch64-linux/include/cudaProfiler.h’, which is also in package cuda-nvprof-11-4 11.4.166-1
Unpacking cuda-libraries-dev-11-4 (11.4.14-1) over (11.4.14-1) …
Unpacking cuda-toolkit-11-4 (11.4.14-1) over (11.4.14-1) …
Unpacking cuda-visual-tools-11-4 (11.4.14-1) over (11.4.14-1) …
Errors were encountered while processing:
/tmp/apt-dpkg-install-Dmtuud/3-cuda-profiler-api-11-4_11.4.239-1_arm64.deb

Sub-process /usr/bin/dpkg returned an error code (1)e[0m
exit

Script done on 2022-06-30 14:00:11-06:00 [COMMAND_EXIT_CODE=“100”]

bob3u3p3 · June 30, 2022, 8:18pm

Also, apt update says all packages are up to date
apt upgrade returns this error:
bob@ubuntu:~/Desktop$ sudo apt upgrade

Reading package lists… Done
Building dependency tree
Reading state information… Done
You might want to run ‘apt --fix-broken install’ to correct these.
The following packages have unmet dependencies:
cuda-libraries-dev-11-4 : Depends: cuda-profiler-api-11-4 (>= 11.4.239) but it is not installed
E: Unmet dependencies. Try ‘apt --fix-broken install’ with no packages (or specify a solution).
bob@ubuntu:~/Desktop$ exit

–fix-broken install does not fix the error

bob3u3p3 · June 30, 2022, 8:22pm

Also, the update built into the OS reports the same error

AastaLLL · July 1, 2022, 1:55am

Hi,

Seems some issues occur in the cache .deb file below:
Could you go to the folder and delete the package manually and try it again?

/tmp/apt-dpkg-install-Dmtuud/3-cuda-profiler-api-11-4_11.4.239-1_arm64.deb

Thanks.