Jetpack 5.0.2 libnvToolsExt.so missing for pytorch

Hello,

I installed Jetpack 5.0.2 Runtime and the Jetson SDK Components with the SDK Manager. Afterwards I followed the guide to install pytorch. When I import pytorch i get the following error:

nvidia@linux:~$ python3
Python 3.8.10 (default, May 26 2023, 14:05:08)
[GCC 9.4.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import torch
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/nvidia/.local/lib/python3.8/site-packages/torch/__init__.py", line 191, in <module>
    _load_global_deps()
  File "/home/nvidia/.local/lib/python3.8/site-packages/torch/__init__.py", line 153, in _load_global_deps
    ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
  File "/usr/lib/python3.8/ctypes/__init__.py", line 373, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libnvToolsExt.so.1: cannot open shared object file: No such file or directory

Note that I got an error while installing pytorch with pip:

WARNING: The scripts pip, pip3, pip3.10 and pip3.8 are installed in '/home/nvidia/.local/bin' which is not on PATH.

ERROR: Invalid requirement:  'LD_LIBRARY_PATH=/usr/lib/llvm-8/lib:/usr/local/cuda-11.4/lib64:'
Hint: It looks like a path. File 'LD_LIBRARY_PATH=/usr/lib/llvm-8/lib:/usr/local/cuda-11.4/lib64:' does not exist.

When using ls -la /usr/local/cuda-11.4/lib64/I get the following libraries:

lrwxrwxrwx 1 root root        24 May  4  2022 libcublasLt.so.11 -> libcublasLt.so.11.6.6.23
-rw-r--r-- 1 root root 371512864 May  4  2022 libcublasLt.so.11.6.6.23
lrwxrwxrwx 1 root root        22 May  4  2022 libcublas.so.11 -> libcublas.so.11.6.6.23
-rw-r--r-- 1 root root 168021872 May  4  2022 libcublas.so.11.6.6.23
-rw-r--r-- 1 root root    796212 May 11  2022 libcudadevrt.a
lrwxrwxrwx 1 root root        17 May 11  2022 libcudart.so -> libcudart.so.11.0
lrwxrwxrwx 1 root root        21 May 11  2022 libcudart.so.11.0 -> libcudart.so.11.4.243
-rw-r--r-- 1 root root    670808 May 11  2022 libcudart.so.11.4.243
-rw-r--r-- 1 root root   1078022 May 11  2022 libcudart_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libcudla.so -> libcudla.so.1
lrwxrwxrwx 1 root root        17 May  4  2022 libcudla.so.1 -> libcudla.so.1.0.0
-rw-r--r-- 1 root root    171592 May  4  2022 libcudla.so.1.0.0
lrwxrwxrwx 1 root root        22 May  4  2022 libcufft.so.10 -> libcufft.so.10.6.0.143
-rw-r--r-- 1 root root 174702496 May  4  2022 libcufft.so.10.6.0.143
lrwxrwxrwx 1 root root        23 May  4  2022 libcufftw.so.10 -> libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root    740776 May  4  2022 libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root     33242 May 11  2022 libculibos.a
lrwxrwxrwx 1 root root        23 May  4  2022 libcurand.so.10 -> libcurand.so.10.2.5.238
-rw-r--r-- 1 root root  77786240 May  4  2022 libcurand.so.10.2.5.238
lrwxrwxrwx 1 root root        27 May  4  2022 libcusolverMg.so.11 -> libcusolverMg.so.11.2.0.238
-rw-r--r-- 1 root root 258839792 May  4  2022 libcusolverMg.so.11.2.0.238
lrwxrwxrwx 1 root root        25 May  4  2022 libcusolver.so.11 -> libcusolver.so.11.2.0.238
-rw-r--r-- 1 root root 218556608 May  4  2022 libcusolver.so.11.2.0.238
lrwxrwxrwx 1 root root        25 May  4  2022 libcusparse.so.11 -> libcusparse.so.11.6.0.238
-rw-r--r-- 1 root root 230611448 May  4  2022 libcusparse.so.11.6.0.238
lrwxrwxrwx 1 root root        21 May  4  2022 libnppc.so.11 -> libnppc.so.11.4.0.228
-rw-r--r-- 1 root root   1564840 May  4  2022 libnppc.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppial.so.11 -> libnppial.so.11.4.0.228
-rw-r--r-- 1 root root  13533736 May  4  2022 libnppial.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppicc.so.11 -> libnppicc.so.11.4.0.228
-rw-r--r-- 1 root root   6509104 May  4  2022 libnppicc.so.11.4.0.228
lrwxrwxrwx 1 root root        24 May  4  2022 libnppidei.so.11 -> libnppidei.so.11.4.0.228
-rw-r--r-- 1 root root   9937808 May  4  2022 libnppidei.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnppif.so.11 -> libnppif.so.11.4.0.228
-rw-r--r-- 1 root root  79115976 May  4  2022 libnppif.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnppig.so.11 -> libnppig.so.11.4.0.228
-rw-r--r-- 1 root root  34841224 May  4  2022 libnppig.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnppim.so.11 -> libnppim.so.11.4.0.228
-rw-r--r-- 1 root root   8880704 May  4  2022 libnppim.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppist.so.11 -> libnppist.so.11.4.0.228
-rw-r--r-- 1 root root  34354008 May  4  2022 libnppist.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppisu.so.11 -> libnppisu.so.11.4.0.228
-rw-r--r-- 1 root root    658520 May  4  2022 libnppisu.so.11.4.0.228
lrwxrwxrwx 1 root root        23 May  4  2022 libnppitc.so.11 -> libnppitc.so.11.4.0.228
-rw-r--r-- 1 root root   4551016 May  4  2022 libnppitc.so.11.4.0.228
lrwxrwxrwx 1 root root        21 May  4  2022 libnpps.so.11 -> libnpps.so.11.4.0.228
-rw-r--r-- 1 root root  18404344 May  4  2022 libnpps.so.11.4.0.228
lrwxrwxrwx 1 root root        22 May  4  2022 libnvblas.so.11 -> libnvblas.so.11.6.6.23
-rw-r--r-- 1 root root    712192 May  4  2022 libnvblas.so.11.6.6.23
lrwxrwxrwx 1 root root        29 May  4  2022 libnvrtc-builtins.so.11.4 -> libnvrtc-builtins.so.11.4.239
-rw-r--r-- 1 root root   6883128 May  4  2022 libnvrtc-builtins.so.11.4.239
lrwxrwxrwx 1 root root        20 May  4  2022 libnvrtc.so.11.2 -> libnvrtc.so.11.4.239
-rw-r--r-- 1 root root  40962912 May  4  2022 libnvrtc.so.11.4.239
drwxr-xr-x 2 root root      4096 Jun 26 08:01 stubs

The libnvToolExt.so is missing. Should that not be installed with the SDK Components?

Hi,

PyTorch and JetPack have some dependencies.
If JetPack 5.0.2 is used, please install the package listed in the below link:
https://developer.download.nvidia.com/compute/redist/jp/v502/pytorch/

Thanks.

The solution was to NOT install Jetpack 5.0.2 Runtime but the regular version.

lrwxrwxrwx 1 root root        17 May  4  2022 libcublasLt.so -> libcublasLt.so.11
lrwxrwxrwx 1 root root        24 May  4  2022 libcublasLt.so.11 -> libcublasLt.so.11.6.6.23
-rw-r--r-- 1 root root 371512864 May  4  2022 libcublasLt.so.11.6.6.23
-rw-r--r-- 1 root root 502851398 May  4  2022 libcublasLt_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libcublas.so -> libcublas.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libcublas.so.11 -> libcublas.so.11.6.6.23
-rw-r--r-- 1 root root 168021872 May  4  2022 libcublas.so.11.6.6.23
-rw-r--r-- 1 root root 212415888 May  4  2022 libcublas_static.a
-rw-r--r-- 1 root root    796212 May 11  2022 libcudadevrt.a
lrwxrwxrwx 1 root root        17 May 11  2022 libcudart.so -> libcudart.so.11.0
lrwxrwxrwx 1 root root        21 May 11  2022 libcudart.so.11.0 -> libcudart.so.11.4.243
-rw-r--r-- 1 root root    670808 May 11  2022 libcudart.so.11.4.243
-rw-r--r-- 1 root root   1078022 May 11  2022 libcudart_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libcudla.so -> libcudla.so.1
lrwxrwxrwx 1 root root        17 May  4  2022 libcudla.so.1 -> libcudla.so.1.0.0
-rw-r--r-- 1 root root    171592 May  4  2022 libcudla.so.1.0.0
lrwxrwxrwx 1 root root        14 May  4  2022 libcufft.so -> libcufft.so.10
lrwxrwxrwx 1 root root        22 May  4  2022 libcufft.so.10 -> libcufft.so.10.6.0.143
-rw-r--r-- 1 root root 174702496 May  4  2022 libcufft.so.10.6.0.143
-rw-r--r-- 1 root root 215629076 May  4  2022 libcufft_static.a
-rw-r--r-- 1 root root 187336040 May  4  2022 libcufft_static_nocallback.a
lrwxrwxrwx 1 root root        15 May  4  2022 libcufftw.so -> libcufftw.so.10
lrwxrwxrwx 1 root root        23 May  4  2022 libcufftw.so.10 -> libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root    740776 May  4  2022 libcufftw.so.10.6.0.143
-rw-r--r-- 1 root root     30202 May  4  2022 libcufftw_static.a
-rw-r--r-- 1 root root   1436538 May  4  2022 libcufilt.a
-rw-r--r-- 1 root root     33242 May 11  2022 libculibos.a
lrwxrwxrwx 1 root root        16 May  4  2022 libcupti.so -> libcupti.so.11.4
lrwxrwxrwx 1 root root        20 May  4  2022 libcupti.so.11.4 -> libcupti.so.2021.2.2
-rw-r--r-- 1 root root   5782696 May  4  2022 libcupti.so.2021.2.2
lrwxrwxrwx 1 root root        15 May  4  2022 libcurand.so -> libcurand.so.10
lrwxrwxrwx 1 root root        23 May  4  2022 libcurand.so.10 -> libcurand.so.10.2.5.238
-rw-r--r-- 1 root root  77786240 May  4  2022 libcurand.so.10.2.5.238
-rw-r--r-- 1 root root  77745886 May  4  2022 libcurand_static.a
lrwxrwxrwx 1 root root        19 May  4  2022 libcusolverMg.so -> libcusolverMg.so.11
lrwxrwxrwx 1 root root        27 May  4  2022 libcusolverMg.so.11 -> libcusolverMg.so.11.2.0.238
-rw-r--r-- 1 root root 258839792 May  4  2022 libcusolverMg.so.11.2.0.238
lrwxrwxrwx 1 root root        17 May  4  2022 libcusolver.so -> libcusolver.so.11
lrwxrwxrwx 1 root root        25 May  4  2022 libcusolver.so.11 -> libcusolver.so.11.2.0.238
-rw-r--r-- 1 root root 218556608 May  4  2022 libcusolver.so.11.2.0.238
-rw-r--r-- 1 root root 211452066 May  4  2022 libcusolver_static.a
lrwxrwxrwx 1 root root        17 May  4  2022 libcusparse.so -> libcusparse.so.11
lrwxrwxrwx 1 root root        25 May  4  2022 libcusparse.so.11 -> libcusparse.so.11.6.0.238
-rw-r--r-- 1 root root 230611448 May  4  2022 libcusparse.so.11.6.0.238
-rw-r--r-- 1 root root 256717656 May  4  2022 libcusparse_static.a
-rw-r--r-- 1 root root  15858550 May  4  2022 liblapack_static.a
-rw-r--r-- 1 root root    909274 May  4  2022 libmetis_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libnppc.so -> libnppc.so.11
lrwxrwxrwx 1 root root        21 May  4  2022 libnppc.so.11 -> libnppc.so.11.4.0.228
-rw-r--r-- 1 root root   1564840 May  4  2022 libnppc.so.11.4.0.228
-rw-r--r-- 1 root root     26846 May  4  2022 libnppc_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppial.so -> libnppial.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppial.so.11 -> libnppial.so.11.4.0.228
-rw-r--r-- 1 root root  13533736 May  4  2022 libnppial.so.11.4.0.228
-rw-r--r-- 1 root root  15378762 May  4  2022 libnppial_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppicc.so -> libnppicc.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppicc.so.11 -> libnppicc.so.11.4.0.228
-rw-r--r-- 1 root root   6509104 May  4  2022 libnppicc.so.11.4.0.228
-rw-r--r-- 1 root root   6290884 May  4  2022 libnppicc_static.a
lrwxrwxrwx 1 root root        16 May  4  2022 libnppidei.so -> libnppidei.so.11
lrwxrwxrwx 1 root root        24 May  4  2022 libnppidei.so.11 -> libnppidei.so.11.4.0.228
-rw-r--r-- 1 root root   9937808 May  4  2022 libnppidei.so.11.4.0.228
-rw-r--r-- 1 root root  11478698 May  4  2022 libnppidei_static.a
lrwxrwxrwx 1 root root        14 May  4  2022 libnppif.so -> libnppif.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnppif.so.11 -> libnppif.so.11.4.0.228
-rw-r--r-- 1 root root  79115976 May  4  2022 libnppif.so.11.4.0.228
-rw-r--r-- 1 root root  82495146 May  4  2022 libnppif_static.a
lrwxrwxrwx 1 root root        14 May  4  2022 libnppig.so -> libnppig.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnppig.so.11 -> libnppig.so.11.4.0.228
-rw-r--r-- 1 root root  34841224 May  4  2022 libnppig.so.11.4.0.228
-rw-r--r-- 1 root root  36462618 May  4  2022 libnppig_static.a
lrwxrwxrwx 1 root root        14 May  4  2022 libnppim.so -> libnppim.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnppim.so.11 -> libnppim.so.11.4.0.228
-rw-r--r-- 1 root root   8880704 May  4  2022 libnppim.so.11.4.0.228
-rw-r--r-- 1 root root   8057652 May  4  2022 libnppim_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppist.so -> libnppist.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppist.so.11 -> libnppist.so.11.4.0.228
-rw-r--r-- 1 root root  34354008 May  4  2022 libnppist.so.11.4.0.228
-rw-r--r-- 1 root root  36021764 May  4  2022 libnppist_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppisu.so -> libnppisu.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppisu.so.11 -> libnppisu.so.11.4.0.228
-rw-r--r-- 1 root root    658520 May  4  2022 libnppisu.so.11.4.0.228
-rw-r--r-- 1 root root     11458 May  4  2022 libnppisu_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnppitc.so -> libnppitc.so.11
lrwxrwxrwx 1 root root        23 May  4  2022 libnppitc.so.11 -> libnppitc.so.11.4.0.228
-rw-r--r-- 1 root root   4551016 May  4  2022 libnppitc.so.11.4.0.228
-rw-r--r-- 1 root root   3593810 May  4  2022 libnppitc_static.a
lrwxrwxrwx 1 root root        13 May  4  2022 libnpps.so -> libnpps.so.11
lrwxrwxrwx 1 root root        21 May  4  2022 libnpps.so.11 -> libnpps.so.11.4.0.228
-rw-r--r-- 1 root root  18404344 May  4  2022 libnpps.so.11.4.0.228
-rw-r--r-- 1 root root  18499880 May  4  2022 libnpps_static.a
lrwxrwxrwx 1 root root        15 May  4  2022 libnvblas.so -> libnvblas.so.11
lrwxrwxrwx 1 root root        22 May  4  2022 libnvblas.so.11 -> libnvblas.so.11.6.6.23
-rw-r--r-- 1 root root    712192 May  4  2022 libnvblas.so.11.6.6.23
-rw-r--r-- 1 root root  14228496 May  4  2022 libnvperf_host.so
-rw-r--r-- 1 root root   2209064 May  4  2022 libnvperf_target.so
-rw-r--r-- 1 root root  18399504 May  4  2022 libnvptxcompiler_static.a
lrwxrwxrwx 1 root root        25 May  4  2022 libnvrtc-builtins.so -> libnvrtc-builtins.so.11.4
lrwxrwxrwx 1 root root        29 May  4  2022 libnvrtc-builtins.so.11.4 -> libnvrtc-builtins.so.11.4.239
-rw-r--r-- 1 root root   6883128 May  4  2022 libnvrtc-builtins.so.11.4.239
lrwxrwxrwx 1 root root        16 May  4  2022 libnvrtc.so -> libnvrtc.so.11.2
lrwxrwxrwx 1 root root        20 May  4  2022 libnvrtc.so.11.2 -> libnvrtc.so.11.4.239
-rw-r--r-- 1 root root  40962912 May  4  2022 libnvrtc.so.11.4.239
lrwxrwxrwx 1 root root        18 May  4  2022 libnvToolsExt.so -> libnvToolsExt.so.1
lrwxrwxrwx 1 root root        22 May  4  2022 libnvToolsExt.so.1 -> libnvToolsExt.so.1.0.0
-rw-r--r-- 1 root root     44088 May  4  2022 libnvToolsExt.so.1.0.0
drwxr-xr-x 2 root root      4096 Jun 27 16:00 stubs

That means that the claims here that the runtime version only does not include samples and documentation is wrong.

Hi,

Could you share more info about this issue?
The runtime package doesn’t include the header/sample/document.

Thanks.

Hi,

I first installed Jetpack 5.0.2 Runtime (rev 2) with the SDK Manager. As you can see in my first post there where less .so files in /usr/local/cuda-11.4/lib64/. When installing the regular Jetpack 5.0.2 there are more .so files and the required libnvToolsExt.so included (see my second post). I installed pytorch 1.13.0 following the guide as shown in the first post. Maybe a package is missing in the Runtime version that includes the libnvToolsExt.so?

Hi,

The runtime package only contains the essential library.
Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.