Cannot deserialize plugin since corresponding IPluginCreator not found in Plugin Registry

AI & Data Science Deep Learning (Training & Inference) TensorRT
, ,
1

Description

I created an onnx model with TAO and want to make inference using tensorRT.

Then, I am using this same notebook here to try it out.

After running this last piece of code:

print("Running TensorRT inference for FCN-ResNet50")
with load_engine(engine_file) as engine:
    infer(engine, input_file, output_file)

I get this error:

[03/08/2024-12:57:08] [TRT] [E] 3: getPluginCreator could not find plugin: ProposalDynamic version: 1
[03/08/2024-12:57:08] [TRT] [E] 1: [pluginV2Runner.cpp::load::303] Error Code 1: Serialization (Serialization assertion creator failed.Cannot deserialize plugin since corresponding IPluginCreator not found in Plugin Registry)

The ProposalDynamic plugin is a custom plugin from TensorRT and it should work out of the box as of my understanding because I am running a running a TensorRT engine (that is already familier with such custom plugins).

What I am missing?