I start my work from Nvidia recommend docker image ‘nvcr.io/nvidia/tensorrt:21.11-py3’ , then upgrade to tensorrt 8.2.1 by following the instruction from Installation Guide :: NVIDIA Deep Learning TensorRT Documentation
then reinstall the latest pycuda, but I still don’t have the EngineInspector API in my tensorrt python API.
could anyone can help?
I need the EngineInspector API to insight the quantized engine of tensorrt.
>>> import tensorrt as trt >>> dir(trt.EngineInspector) Traceback (most recent call last): File "<stdin>", line 1, in <module> AttributeError: module 'tensorrt' has no attribute 'EngineInspector'
TensorRT Version: 8.2.1
GPU Type: GTX2070
Nvidia Driver Version: 470.74
CUDA Version: 11.4
CUDNN Version: UNK
Operating System + Version: ubuntu18.04
Python Version (if applicable): 3.8
TensorFlow Version (if applicable):
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):
Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)
- Exact steps/commands to build your repro
- Exact steps/commands to run your repro
- Full traceback of errors encountered