Using Tensorrt Batched NMS Plugin with SCRFD Model - Insightface

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

How to use BatchedNMS_TRT plugin in a SCRFD model (scrfd_500m) ?

Screenshot 2023-06-13 134439
Screenshot 2023-06-13 134439678×521 28.5 KB

Environment

TensorRT Version: 8.6
GPU Type: NVidia A100
Nvidia Driver Version: 530
CUDA Version: 12.1
CUDNN Version:
Operating System + Version: Ubuntu 18.04.5 LTS
Python Version (if applicable): Python 3.7.10
TensorFlow Version (if applicable):
PyTorch Version (if applicable): 1.9.0

Relevant Files

scrfd_500m.onnx (2.2 MB)

2

Hi,
Please refer to below links related custom plugin implementation and sample:

While IPluginV2 and IPluginV2Ext interfaces are still supported for backward compatibility with TensorRT 5.1 and 6.0.x respectively, however, we recommend that you write new plugins or refactor existing ones to target the IPluginV2DynamicExt or IPluginV2IOExt interfaces instead.

Thanks!