unable to do inference with tensorrt engine

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Hi,

While doing inference I get the following error

[TensorRT] WARNING: Current optimization profile is: 0. Please ensure there are no enqueued operations pending in this context prior to switching profiles
[TensorRT] ERROR: Parameter check failed at: engine.cpp::enqueue::298, condition: bindings[x] != nullptr

I get output as “[0. 0. 0. … 0. 0. 0.]” (all zero values)

How to solve this error? I am using TensorRT-7.0.0.11

2

Hi,

Could you please share the script and model file so we can help better?
Also, can you provide details on the platforms you are using:
o Linux distro and version
o GPU type
o Nvidia driver version
o CUDA version
o CUDNN version
o Python version [if using python]
o Tensorflow and PyTorch version
o TensorRT version

Thanks