How to add a custom plugin to tensorrt library?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Since TensorRT open source for parser and plugin, I think there is a way to register a custom Plugin to tensorrt library.

I used to use IPluginFactory, don’t know what the different with IPluginCreator, could you explain it?

Additionly, I don’t found any docment or sample to register a custom Plugin to tensorrt library, could you provide some?

wish for your help~

2

Hi,

Please refer to below documentation:
https://docs.nvidia.com/deeplearning/sdk/tensorrt-archived/tensorrt-700/tensorrt-developer-guide/index.html#iplugincreator
https://docs.nvidia.com/deeplearning/sdk/tensorrt-archived/tensorrt-700/tensorrt-developer-guide/index.html#extending

Also, please refer to below samples related to custom plugin implementation:
https://github.com/NVIDIA/TensorRT/tree/07ed9b57b1ff7c24664388e5564b17f7ce2873e5/samples/opensource/sampleUffPluginV2Ext
https://github.com/NVIDIA/TensorRT/tree/77af534c21b7e1bfa322ccbab028477be4c56eb3/plugin/skipLayerNormPlugin
https://github.com/NVIDIA/TensorRT/tree/77af534c21b7e1bfa322ccbab028477be4c56eb3/plugin/fcPlugin

Thanks