Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?"

AI & Data Science Deep Learning (Training & Inference) TensorRT
#1

Description

trtexec couldn’t find my Layernorm plugin when I was building the engine.

image
image1047×345 12.9 KB 


trtexec --explicitBatch --plugins=LayerNormPlugin.so --minShapes=hyps_pad_sos_eos:1x10x64,encoder_out:1x16x256,encoder_out_lens:1,hyps_lens_sos:1x10,ctc_score:1x10 --optShapes=hyps_pad_sos_eos:4x10x64,encoder_out:4x64x256,encoder_out_lens:4,hyps_lens_sos:4x10,ctc_score:4x10 --maxShapes=hyps_pad_sos_eos:64x10x64,encoder_out:64x256x256,encoder_out_lens:64,hyps_lens_sos:64x10,ctc_score:64x10 --onnx=decoder-surgeon.onnx --saveEngine=decoder.plan

Environment

TensorRT Version: 8.2
GPU Type: T4
Nvidia Driver Version: 470
CUDA Version: 11.4

#2

Hi,
Please refer to below links related custom plugin implementation and sample:

While IPluginV2 and IPluginV2Ext interfaces are still supported for backward compatibility with TensorRT 5.1 and 6.0.x respectively, however, we recommend that you write new plugins or refactor existing ones to target the IPluginV2DynamicExt or IPluginV2IOExt interfaces instead.

Thanks!

#4

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.