Installing and Running TensorRT for Tensorflow 2.0 on Jetson Nano

I want to install a stable TensorRT for Python.

OS Image: Jetson Nano 2GB Developer Kit
Jetpack #: R32 (release), REVISION: 7.4, GCID: 33514132, BOARD: t210ref, EABI: aarch64, DATE: Fri Jun 9 04:25:08 UTC 2023
CUDA version (nvidia-cuda): 4.6.4-b39
Tensorrt version (tensorrt): 8.2.1.9-1+cuda10.2

Most of what I have read states that TensorRT is already installed, but when I try to use

pip install tensorrt

I get the following error:

I am genuinely stuck since threads/articles involving TensorRT are like years old.

Hi,

Please use following command instead.

$ sudo apt install python3-libnvinfer python3-libnvinfer-dev

Thanks.

Thanks for reaching out @AastaLLL.

python3-libnvinfer and python3-libnvinfer-dev is already installed on my Jetson Nano device.

Here are the packages that I have installed that has ‘cuda’

Hi,

So you should able to use TensorRT with Python.
Do you meet any issues when using it?

Thanks.

Unfortunately, yes. Here is the full error stack trace when I use pip install tensorrt when using a Python3.8 virtual environment:

WARNING: Ignoring invalid distribution -ip (/home/insect2scan/Documents/env/lib/python3.8/site-packages)
WARNING: Ignoring invalid distribution -yqt5 (/home/insect2scan/Documents/env/lib/python3.8/site-packages)
Collecting tensorrt
  Using cached tensorrt-8.6.1.post1.tar.gz (18 kB)
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: tensorrt
  Building wheel for tensorrt (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [70 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build/lib
      creating build/lib/tensorrt
      copying tensorrt/__init__.py -> build/lib/tensorrt
      running egg_info
      writing tensorrt.egg-info/PKG-INFO
      writing dependency_links to tensorrt.egg-info/dependency_links.txt
      writing requirements to tensorrt.egg-info/requires.txt
      writing top-level names to tensorrt.egg-info/top_level.txt
      reading manifest file 'tensorrt.egg-info/SOURCES.txt'
      adding license file 'LICENSE.txt'
      writing manifest file 'tensorrt.egg-info/SOURCES.txt'
      /home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
        warnings.warn(
      installing to build/bdist.linux-aarch64/wheel
      running install
      WARNING: Ignoring invalid distribution -ip (/home/insect2scan/Documents/env/lib/python3.8/site-packages)
      WARNING: Ignoring invalid distribution -yqt5 (/home/insect2scan/Documents/env/lib/python3.8/site-packages)
      Looking in indexes: https://pypi.org/simple, https://pypi.nvidia.com
      ERROR: Could not find a version that satisfies the requirement tensorrt_libs==8.6.1 (from versions: 9.0.0.post11.dev1, 9.0.0.post12.dev1, 9.0.1.post11.dev4, 9.0.1.post12.dev4)
      ERROR: No matching distribution found for tensorrt_libs==8.6.1
      WARNING: Ignoring invalid distribution -ip (/home/insect2scan/Documents/env/lib/python3.8/site-packages)
      WARNING: Ignoring invalid distribution -yqt5 (/home/insect2scan/Documents/env/lib/python3.8/site-packages)
      Looking in indexes: https://pypi.org/simple, https://pypi.nvidia.com
      ERROR: Could not find a version that satisfies the requirement tensorrt_libs==8.6.1 (from versions: 9.0.0.post11.dev1, 9.0.0.post12.dev1, 9.0.1.post11.dev4, 9.0.1.post12.dev4)
      ERROR: No matching distribution found for tensorrt_libs==8.6.1
      Traceback (most recent call last):
        File "/tmp/pip-install-fv3bija7/tensorrt_96f8964cb7a640deb372746d7494c93d/setup.py", line 40, in run_pip_command
          return call_func([sys.executable, "-m", "pip"] + args, env=env)
        File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
          raise CalledProcessError(retcode, cmd)
      subprocess.CalledProcessError: Command '['/home/insect2scan/Documents/env/bin/python3.8', '-m', 'pip', 'install', '--extra-index-url', 'https://pypi.nvidia.com', 'tensorrt_libs==8.6.1', 'tensorrt_bindings==8.6.1']' returned non-zero exit status 1.
      
      During handling of the above exception, another exception occurred:
      
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-fv3bija7/tensorrt_96f8964cb7a640deb372746d7494c93d/setup.py", line 110, in <module>
          setup(
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/__init__.py", line 87, in setup
          return distutils.core.setup(**attrs)
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
          return run_commands(dist)
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
          dist.run_commands()
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 968, in run_commands
          self.run_command(cmd)
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/wheel/bdist_wheel.py", line 399, in run
          self.run_command("install")
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 319, in run_command
          self.distribution.run_command(command)
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/dist.py", line 1217, in run_command
          super().run_command(command)
        File "/home/insect2scan/Documents/env/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 987, in run_command
          cmd_obj.run()
        File "/tmp/pip-install-fv3bija7/tensorrt_96f8964cb7a640deb372746d7494c93d/setup.py", line 62, in run
          run_pip_command(
        File "/tmp/pip-install-fv3bija7/tensorrt_96f8964cb7a640deb372746d7494c93d/setup.py", line 56, in run_pip_command
          return call_func([pip_path] + args, env=env)
        File "/usr/lib/python3.8/subprocess.py", line 364, in check_call
          raise CalledProcessError(retcode, cmd)
      subprocess.CalledProcessError: Command '['/home/insect2scan/Documents/env/bin/pip', 'install', '--extra-index-url', 'https://pypi.nvidia.com', 'tensorrt_libs==8.6.1', 'tensorrt_bindings==8.6.1']' returned non-zero exit status 1.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for tensorrt
  Running setup.py clean for tensorrt
Failed to build tensorrt
ERROR: Could not build wheels for tensorrt, which is required to install pyproject.toml-based projects

It was the same error as before (since the two packages are already installed)

Hi,

Please remove the TensorRT 8.6 package/cache first.
The latest TensorRT version supports Nano is only 8.2.

Thanks.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.