if the instance include NVIDIA GPU, please install the corresponding driver. In “Supported Products” part of this link, you can get the supported GPU name.
Good, on the new (now correct g4dn.xlarge) instance I got all these warnings in a row, but in the end it looks like the drivers are installed correctly. I think the warnings are related to the missing desktop X. Can you confirm?
ubuntu@ip-xx.xx.xx.xx:~$ sudo apt-get install libnvinfer8=8.6.1.6-1+cuda12.0 libnvinfer-plugin8=8.6.1.6-1+cuda12.0 libnvparsers8=8.6.1.6-1+cuda12.0 libnvonnxparsers8=8.6.1.6-1+cuda12.0 libnvinfer-bin=8.6.1.6-1+cuda12.0 libnvinfer-dev=8.6.1.6-1+cuda12.0 libnvinfer-plugin-dev=8.6.1.6-1+cuda12.0 libnvparsers-dev=8.6.1.6-1+cuda12.0 libnvonnxparsers-dev=8.6.1.6-1+cuda12.0 libnvinfer-samples=8.6.1.6-1+cuda12.0 libcudnn8=8.9.4.25-1+cuda12.2 libcudnn8-dev=8.9.4.25-1+cuda12.2
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
libnvinfer-dev : Depends: libnvinfer-headers-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed
libnvinfer-plugin-dev : Depends: libnvinfer-headers-plugin-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed
libnvinfer-samples : Depends: libnvinfer-lean-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
libnvinfer-lean-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
Depends: libnvinfer-dispatch-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
libnvinfer-dispatch-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
Depends: libnvinfer-vc-plugin-dev (= 8.6.1.6-1+cuda12.0) but 10.0.0.6-1+cuda12.4 is to be installed or
libnvinfer-vc-plugin-dev-cross-amd64 (= 8.6.1.6-1+cuda12.0) but it is not installable
E: Unable to correct problems, you have held broken packages.
ubuntu@ip-xx.xx.xx.xx:~$
Any suggestions? Instance is Ubuntu 22.04.4 LTS (GNU/Linux 6.5.0-1014-aws x86_64)
Looks like I managed to install TensorRT by splitting up the monster install command into separate installs. Then, when a dependency problem arises, solve this first and try again.
It is a recursive-iterative process, but in the end it works