TensorRT Plugin data access

alvern · April 27, 2021, 10:22am

Hello,
I’m currently working with a ssd-type caffe network and trying to optimize dataflow (w/o modifying network structure) using custom layer plugins. I’m wondering - is there any possibility to get data pointer inside the layer plugin for network input image, so in detection_output plugin i could return detected objects with an images, cropped from original image (along with coordinates and confidences)?

TensorRT Version: 7.0.0.11
GPU Type: RTX 2070
CUDA Version: 10.2
CUDNN Version: 7.5.0.56
Thank you!

SunilJB · April 28, 2021, 9:07am

Hi,
Please refer to below links related custom plugin implementation and sample:
https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/sampleOnnxMnistCoordConvAC

Thanks

Topic		Replies	Views
Onnx to tensorrt plugin for NonMaxSuppression TensorRT tensorrt , tensorflow	1	2503	April 26, 2020
A qustion about custom layer plugin when i use onnx parser TensorRT	3	400	April 6, 2021
Tensorrt 7 - Best Practice for implementing plugin that supports both FP16 and Fp32 TensorRT	1	459	August 16, 2022
Adding Tensorrt Plugin to Deserialized Engine TensorRT	4	644	March 5, 2021
QLinearConv implementation in TensorRT and onnx model conversion TensorRT tensorrt	1	718	November 27, 2020
Tensorrt has incorrect output for networks with custom plugins TensorRT	1	367	March 31, 2023
Is it possible to add TensorRT plugin into FasterTransformer Decoder and Decoding TensorRT tensorrt	4	780	September 30, 2021
How to redefine DetectionOutput layer for SSD in TensorRT？ TensorRT	5	1361	October 12, 2021
Custom TensorRT Container TensorRT tensorrt	2	450	May 10, 2021
How to use shape tensor in custom plugin? TensorRT tensorrt	4	1142	July 27, 2020

TensorRT Plugin data access

Related topics