Jetpack 5.0.2 libnvToolsExt.so missing for pytorch

Robotics & Edge Computing Jetson & Embedded Systems Jetson Xavier NX
1

Hello,

I installed Jetpack 5.0.2 Runtime and the Jetson SDK Components with the SDK Manager. Afterwards I followed the guide to install pytorch. When I import pytorch i get the following error:

nvidia@linux:~$ python3
Python 3.8.10 (default, May 26 2023, 14:05:08)
[GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/nvidia/.local/lib/python3.8/site-packages/torch/__init__.py", line 191, in <module>
    _load_global_deps()
  File "/home/nvidia/.local/lib/python3.8/site-packages/torch/__init__.py", line 153, in _load_global_deps
    ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
  File "/usr/lib/python3.8/ctypes/__init__.py", line 373, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libnvToolsExt.so.1: cannot open shared object file: No such file or directory

Note that I got an error while installing pytorch with pip:

WARNING: The scripts pip, pip3, pip3.10 and pip3.8 are installed in '/home/nvidia/.local/bin' which is not on PATH.

ERROR: Invalid requirement:  'LD_LIBRARY_PATH=/usr/lib/llvm-8/lib:/usr/local/cuda-11.4/lib64:'
Hint: It looks like a path. File 'LD_LIBRARY_PATH=/usr/lib/llvm-8/lib:/usr/local/cuda-11.4/lib64:' does not exist.

When using ls -la /usr/local/cuda-11.4/lib64/I get the following libraries:

lrwxrwxrwx 1 root root        24 May  4  2022 libcublasLt.so.11 -> libcublasLt.so.11.6.6.23
-rw-r--r-- 1 root root 371512864 May  4  2022 libcublasLt.so.11.6.6.23
lrwxrwxrwx 1 root root        22 May  4  2022 libcublas.so.11 -> libcublas.so.11.6.6.23
-rw-r--r-- 1 root root 168021872 May  4  2022 libcublas.so.11.6.6.23
-rw-r--r-- 1 root root    796212 May 11  2022 libcudadevrt.a
lrwxrwxrwx 1 root root        17 May 11  2022 libcudart.so -> libcudart.so.11.0
lrwxrwxrwx 1 root root        21 May 11  2022 libcudart.so.11.0 -> libcudart.so.11.4.243
-rw-r--r-- 1 root root    670808 May 11  2022 libcudart.so.11.4.243
-rw-r--r-- 1 root root   1078022 May 11  2022 libcudart_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libcudla.so -> libcudla.so.1
lrwxrwxrwx 1 root root        17 May  4  2022 libcudla.so.1 -> libcudla.so.1.0.0
-rw-r--r-- 1 root root    171592 May  4  2022 libcudla.so.1.0.0
lrwxrwxrwx 1 root root        22 May  4  2022 libcufft.so.10 -> libcufft.so.10.6.0.143
-rw-r--r-- 1 root root 174702496 May  4  2022 libcufft.so.10.6.0.143
lrwxrwxrwx 1 root root        23 May  4  2022 libcufftw.so.10 -> libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root    740776 May  4  2022 libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root     33242 May 11  2022 libculibos.a
lrwxrwxrwx 1 root root        23 May  4  2022 libcurand.so.10 -> libcurand.so.10.2.5.238
-rw-r--r-- 1 root root  77786240 May  4  2022 libcurand.so.10.2.5.238
lrwxrwxrwx 1 root root        27 May  4  2022 libcusolverMg.so.11 -> libcusolverMg.so.11.2.0.238
-rw-r--r-- 1 root root 258839792 May  4  2022 libcusolverMg.so.11.2.0.238
lrwxrwxrwx 1 root root        25 May  4  2022 libcusolver.so.11 -> libcusolver.so.11.2.0.238
-rw-r--r-- 1 root root 218556608 May  4  2022 libcusolver.so.11.2.0.238
lrwxrwxrwx 1 root root        25 May  4  2022 libcusparse.so.11 -> libcusparse.so.11.6.0.238
-rw-r--r-- 1 root root 230611448 May  4  2022 libcusparse.so.11.6.0.238
lrwxrwxrwx 1 root root        21 May  4  2022 libnppc.so.11 -> libnppc.so.11.4.0.228
-rw-r--r-- 1 root root   1564840 May  4  2022 libnppc.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppial.so.11 -> libnppial.so.11.4.0.228
-rw-r--r-- 1 root root  13533736 May  4  2022 libnppial.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppicc.so.11 -> libnppicc.so.11.4.0.228
-rw-r--r-- 1 root root   6509104 May  4  2022 libnppicc.so.11.4.0.228
lrwxrwxrwx 1 root root        24 May  4  2022 libnppidei.so.11 -> libnppidei.so.11.4.0.228
-rw-r--r-- 1 root root   9937808 May  4  2022 libnppidei.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnppif.so.11 -> libnppif.so.11.4.0.228
-rw-r--r-- 1 root root  79115976 May  4  2022 libnppif.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnppig.so.11 -> libnppig.so.11.4.0.228
-rw-r--r-- 1 root root  34841224 May  4  2022 libnppig.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnppim.so.11 -> libnppim.so.11.4.0.228
-rw-r--r-- 1 root root   8880704 May  4  2022 libnppim.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppist.so.11 -> libnppist.so.11.4.0.228
-rw-r--r-- 1 root root  34354008 May  4  2022 libnppist.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppisu.so.11 -> libnppisu.so.11.4.0.228
-rw-r--r-- 1 root root    658520 May  4  2022 libnppisu.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppitc.so.11 -> libnppitc.so.11.4.0.228
-rw-r--r-- 1 root root   4551016 May  4  2022 libnppitc.so.11.4.0.228
lrwxrwxrwx 1 root root        21 May  4  2022 libnpps.so.11 -> libnpps.so.11.4.0.228
-rw-r--r-- 1 root root  18404344 May  4  2022 libnpps.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnvblas.so.11 -> libnvblas.so.11.6.6.23
-rw-r--r-- 1 root root    712192 May  4  2022 libnvblas.so.11.6.6.23
lrwxrwxrwx 1 root root        29 May  4  2022 libnvrtc-builtins.so.11.4 -> libnvrtc-builtins.so.11.4.239
-rw-r--r-- 1 root root   6883128 May  4  2022 libnvrtc-builtins.so.11.4.239
lrwxrwxrwx 1 root root        20 May  4  2022 libnvrtc.so.11.2 -> libnvrtc.so.11.4.239
-rw-r--r-- 1 root root  40962912 May  4  2022 libnvrtc.so.11.4.239
drwxr-xr-x 2 root root      4096 Jun 26 08:01 stubs

The libnvToolExt.so is missing. Should that not be installed with the SDK Components?

3

Hi,

PyTorch and JetPack have some dependencies.
If JetPack 5.0.2 is used, please install the package listed in the below link:
https://developer.download.nvidia.com/compute/redist/jp/v502/pytorch/

Thanks.

4

The solution was to NOT install Jetpack 5.0.2 Runtime but the regular version.

lrwxrwxrwx 1 root root        17 May  4  2022 libcublasLt.so -> libcublasLt.so.11
lrwxrwxrwx 1 root root        24 May  4  2022 libcublasLt.so.11 -> libcublasLt.so.11.6.6.23
-rw-r--r-- 1 root root 371512864 May  4  2022 libcublasLt.so.11.6.6.23
-rw-r--r-- 1 root root 502851398 May  4  2022 libcublasLt_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libcublas.so -> libcublas.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libcublas.so.11 -> libcublas.so.11.6.6.23
-rw-r--r-- 1 root root 168021872 May  4  2022 libcublas.so.11.6.6.23
-rw-r--r-- 1 root root 212415888 May  4  2022 libcublas_static.a
-rw-r--r-- 1 root root    796212 May 11  2022 libcudadevrt.a
lrwxrwxrwx 1 root root        17 May 11  2022 libcudart.so -> libcudart.so.11.0
lrwxrwxrwx 1 root root        21 May 11  2022 libcudart.so.11.0 -> libcudart.so.11.4.243
-rw-r--r-- 1 root root    670808 May 11  2022 libcudart.so.11.4.243
-rw-r--r-- 1 root root   1078022 May 11  2022 libcudart_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libcudla.so -> libcudla.so.1
lrwxrwxrwx 1 root root        17 May  4  2022 libcudla.so.1 -> libcudla.so.1.0.0
-rw-r--r-- 1 root root    171592 May  4  2022 libcudla.so.1.0.0
lrwxrwxrwx 1 root root        14 May  4  2022 libcufft.so -> libcufft.so.10
lrwxrwxrwx 1 root root        22 May  4  2022 libcufft.so.10 -> libcufft.so.10.6.0.143
-rw-r--r-- 1 root root 174702496 May  4  2022 libcufft.so.10.6.0.143
-rw-r--r-- 1 root root 215629076 May  4  2022 libcufft_static.a
-rw-r--r-- 1 root root 187336040 May  4  2022 libcufft_static_nocallback.a
lrwxrwxrwx 1 root root        15 May  4  2022 libcufftw.so -> libcufftw.so.10
lrwxrwxrwx 1 root root        23 May  4  2022 libcufftw.so.10 -> libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root    740776 May  4  2022 libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root     30202 May  4  2022 libcufftw_static.a
-rw-r--r-- 1 root root   1436538 May  4  2022 libcufilt.a
-rw-r--r-- 1 root root     33242 May 11  2022 libculibos.a
lrwxrwxrwx 1 root root        16 May  4  2022 libcupti.so -> libcupti.so.11.4
lrwxrwxrwx 1 root root        20 May  4  2022 libcupti.so.11.4 -> libcupti.so.2021.2.2
-rw-r--r-- 1 root root   5782696 May  4  2022 libcupti.so.2021.2.2
lrwxrwxrwx 1 root root        15 May  4  2022 libcurand.so -> libcurand.so.10
lrwxrwxrwx 1 root root        23 May  4  2022 libcurand.so.10 -> libcurand.so.10.2.5.238
-rw-r--r-- 1 root root  77786240 May  4  2022 libcurand.so.10.2.5.238
-rw-r--r-- 1 root root  77745886 May  4  2022 libcurand_static.a
lrwxrwxrwx 1 root root        19 May  4  2022 libcusolverMg.so -> libcusolverMg.so.11
lrwxrwxrwx 1 root root        27 May  4  2022 libcusolverMg.so.11 -> libcusolverMg.so.11.2.0.238
-rw-r--r-- 1 root root 258839792 May  4  2022 libcusolverMg.so.11.2.0.238
lrwxrwxrwx 1 root root        17 May  4  2022 libcusolver.so -> libcusolver.so.11
lrwxrwxrwx 1 root root        25 May  4  2022 libcusolver.so.11 -> libcusolver.so.11.2.0.238
-rw-r--r-- 1 root root 218556608 May  4  2022 libcusolver.so.11.2.0.238
-rw-r--r-- 1 root root 211452066 May  4  2022 libcusolver_static.a
lrwxrwxrwx 1 root root        17 May  4  2022 libcusparse.so -> libcusparse.so.11
lrwxrwxrwx 1 root root        25 May  4  2022 libcusparse.so.11 -> libcusparse.so.11.6.0.238
-rw-r--r-- 1 root root 230611448 May  4  2022 libcusparse.so.11.6.0.238
-rw-r--r-- 1 root root 256717656 May  4  2022 libcusparse_static.a
-rw-r--r-- 1 root root  15858550 May  4  2022 liblapack_static.a
-rw-r--r-- 1 root root    909274 May  4  2022 libmetis_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libnppc.so -> libnppc.so.11
lrwxrwxrwx 1 root root        21 May  4  2022 libnppc.so.11 -> libnppc.so.11.4.0.228
-rw-r--r-- 1 root root   1564840 May  4  2022 libnppc.so.11.4.0.228
-rw-r--r-- 1 root root     26846 May  4  2022 libnppc_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppial.so -> libnppial.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppial.so.11 -> libnppial.so.11.4.0.228
-rw-r--r-- 1 root root  13533736 May  4  2022 libnppial.so.11.4.0.228
-rw-r--r-- 1 root root  15378762 May  4  2022 libnppial_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppicc.so -> libnppicc.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppicc.so.11 -> libnppicc.so.11.4.0.228
-rw-r--r-- 1 root root   6509104 May  4  2022 libnppicc.so.11.4.0.228
-rw-r--r-- 1 root root   6290884 May  4  2022 libnppicc_static.a
lrwxrwxrwx 1 root root        16 May  4  2022 libnppidei.so -> libnppidei.so.11
lrwxrwxrwx 1 root root        24 May  4  2022 libnppidei.so.11 -> libnppidei.so.11.4.0.228
-rw-r--r-- 1 root root   9937808 May  4  2022 libnppidei.so.11.4.0.228
-rw-r--r-- 1 root root  11478698 May  4  2022 libnppidei_static.a
lrwxrwxrwx 1 root root        14 May  4  2022 libnppif.so -> libnppif.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnppif.so.11 -> libnppif.so.11.4.0.228
-rw-r--r-- 1 root root  79115976 May  4  2022 libnppif.so.11.4.0.228
-rw-r--r-- 1 root root  82495146 May  4  2022 libnppif_static.a
lrwxrwxrwx 1 root root        14 May  4  2022 libnppig.so -> libnppig.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnppig.so.11 -> libnppig.so.11.4.0.228
-rw-r--r-- 1 root root  34841224 May  4  2022 libnppig.so.11.4.0.228
-rw-r--r-- 1 root root  36462618 May  4  2022 libnppig_static.a
lrwxrwxrwx 1 root root        14 May  4  2022 libnppim.so -> libnppim.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnppim.so.11 -> libnppim.so.11.4.0.228
-rw-r--r-- 1 root root   8880704 May  4  2022 libnppim.so.11.4.0.228
-rw-r--r-- 1 root root   8057652 May  4  2022 libnppim_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppist.so -> libnppist.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppist.so.11 -> libnppist.so.11.4.0.228
-rw-r--r-- 1 root root  34354008 May  4  2022 libnppist.so.11.4.0.228
-rw-r--r-- 1 root root  36021764 May  4  2022 libnppist_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppisu.so -> libnppisu.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppisu.so.11 -> libnppisu.so.11.4.0.228
-rw-r--r-- 1 root root    658520 May  4  2022 libnppisu.so.11.4.0.228
-rw-r--r-- 1 root root     11458 May  4  2022 libnppisu_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppitc.so -> libnppitc.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppitc.so.11 -> libnppitc.so.11.4.0.228
-rw-r--r-- 1 root root   4551016 May  4  2022 libnppitc.so.11.4.0.228
-rw-r--r-- 1 root root   3593810 May  4  2022 libnppitc_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libnpps.so -> libnpps.so.11
lrwxrwxrwx 1 root root        21 May  4  2022 libnpps.so.11 -> libnpps.so.11.4.0.228
-rw-r--r-- 1 root root  18404344 May  4  2022 libnpps.so.11.4.0.228
-rw-r--r-- 1 root root  18499880 May  4  2022 libnpps_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnvblas.so -> libnvblas.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnvblas.so.11 -> libnvblas.so.11.6.6.23
-rw-r--r-- 1 root root    712192 May  4  2022 libnvblas.so.11.6.6.23
-rw-r--r-- 1 root root  14228496 May  4  2022 libnvperf_host.so
-rw-r--r-- 1 root root   2209064 May  4  2022 libnvperf_target.so
-rw-r--r-- 1 root root  18399504 May  4  2022 libnvptxcompiler_static.a
lrwxrwxrwx 1 root root        25 May  4  2022 libnvrtc-builtins.so -> libnvrtc-builtins.so.11.4
lrwxrwxrwx 1 root root        29 May  4  2022 libnvrtc-builtins.so.11.4 -> libnvrtc-builtins.so.11.4.239
-rw-r--r-- 1 root root   6883128 May  4  2022 libnvrtc-builtins.so.11.4.239
lrwxrwxrwx 1 root root        16 May  4  2022 libnvrtc.so -> libnvrtc.so.11.2
lrwxrwxrwx 1 root root        20 May  4  2022 libnvrtc.so.11.2 -> libnvrtc.so.11.4.239
-rw-r--r-- 1 root root  40962912 May  4  2022 libnvrtc.so.11.4.239
lrwxrwxrwx 1 root root        18 May  4  2022 libnvToolsExt.so -> libnvToolsExt.so.1
lrwxrwxrwx 1 root root        22 May  4  2022 libnvToolsExt.so.1 -> libnvToolsExt.so.1.0.0
-rw-r--r-- 1 root root     44088 May  4  2022 libnvToolsExt.so.1.0.0
drwxr-xr-x 2 root root      4096 Jun 27 16:00 stubs

That means that the claims here that the runtime version only does not include samples and documentation is wrong.

5

Hi,

Could you share more info about this issue?
The runtime package doesn’t include the header/sample/document.

Thanks.

6

Hi,

I first installed Jetpack 5.0.2 Runtime (rev 2) with the SDK Manager. As you can see in my first post there where less .so files in /usr/local/cuda-11.4/lib64/. When installing the regular Jetpack 5.0.2 there are more .so files and the required libnvToolsExt.so included (see my second post). I installed pytorch 1.13.0 following the guide as shown in the first post. Maybe a package is missing in the Runtime version that includes the libnvToolsExt.so?

7

Hi,

The runtime package only contains the essential library.
Thanks.

9

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.