TensorRT

Description

yolo export model=/home/mic-733ao/data/verilyvision/VV_Por/lpr-exat-exit/models/plate-recognition/plate-number/plateOCR.pt format=engine device=0

Ultralytics YOLOV8.0.150 @ python-3.8.10 torch-2.0.0+nv23.05 CUDA:0 (Orin,62795MiB)
YOLOV8m summary (fused): 218 layers, 25871026 parameters, 0 gradients
PyTorch: starting from ‘/home/mic-733ao/data/verilyvision/VV_Por/lpr-exat-exit/models/plate-recognition/plate-number/plate0cR.pt’ with input shape (1, 3, 640, 640) BCHW and output shape(s)(1, 58, 8400) (49.6 MB)

requtrements: Ultralytics requirement [‘nvidia-tensorrt’] not found, attempting Autoupdate…

ERROR: could not find a version that satisfies the requirement nvidia-tensorrt (from versions: none)

ERROR: No matching distribution found for nvidia-tensorrt

TensorRT: export failure 3.1s: No module named ‘tensorrt’
Traceback (most recent call last):
File “/home/mic-733ao/data/verilyvision/V_por/lpr-exat-exit/lpr/lib/Python3.8/site-packages/ultralytics/engine/exporter.py”, line 540, in export_engine
import tensorrt as trt # noqa
ModuleNotFoundError: No module named ‘tensorrt’

Environment

tensorflow==2.9.1+nv22.6
torch==2.0.0+nv23.5
torchvision==0.15.1
ultralytics==8.0.150

Jetpack 5.1.1
CUDA 11.4.315
TensorRT 5.1.1

However, when I run dpkg-query -W tensorrt, it show like tensorrt 8.5.2.2-1+cuda11.4

Hi,

Please check if you have installed the TensorRT Python package:

$ sudo apt install python3-libnvinfer*

Thanks.