Using Tensorrt Batched NMS Plugin with SCRFD Model - Insightface

abhishek44choudhary · June 13, 2023, 8:24am

Description

How to use BatchedNMS_TRT plugin in a SCRFD model (scrfd_500m) ?

Environment

TensorRT Version: 8.6
GPU Type: NVidia A100
Nvidia Driver Version: 530
CUDA Version: 12.1
CUDNN Version:
Operating System + Version: Ubuntu 18.04.5 LTS
Python Version (if applicable): Python 3.7.10
TensorFlow Version (if applicable):
PyTorch Version (if applicable): 1.9.0

Relevant Files

scrfd_500m.onnx (2.2 MB)

AakankshaS · June 14, 2023, 4:07am

Hi,
Please refer to below links related custom plugin implementation and sample:

While IPluginV2 and IPluginV2Ext interfaces are still supported for backward compatibility with TensorRT 5.1 and 6.0.x respectively, however, we recommend that you write new plugins or refactor existing ones to target the IPluginV2DynamicExt or IPluginV2IOExt interfaces instead.

Thanks!

Topic		Replies	Views
Efficient NMS plugin to TensorRT engine at runtime TensorRT	4	6743	May 17, 2022
How to add BatchedNMSDynamic_TRT Plugin to a ONNX model? TensorRT	1	502	April 27, 2023
Is there any usage example of TensorRT Plugins such as bertQKVToContextPlugin? TensorRT	5	643	February 8, 2023
Onnx to tensorrt plugin for NonMaxSuppression TensorRT tensorrt , tensorflow	1	2503	April 26, 2020
getPluginCreator could not find plugin BatchedNMS_TRT version 1 TensorRT	5	4015	December 23, 2020
ONNX Plugin Layer implements TensorRT	11	1915	January 12, 2021
Can I connect BatchedNMSPlugin to deserialized trt engine? TensorRT	3	1957	November 8, 2019
Assertion failed: *tensor = importer_ctx->network()->addInput( input.name().c_str(), trt_dtype, trt_dims) TensorRT tensorrt	15	924	June 24, 2022
Custom plugin supporting int8 I/O type check fail TensorRT	2	548	May 26, 2023
Could not find any supported formats consistent with input/output data types TensorRT	1	855	April 11, 2023

Using Tensorrt Batched NMS Plugin with SCRFD Model - Insightface

Description

Environment

Relevant Files

Related topics