Is there any usage example of TensorRT Plugins such as bertQKVToContextPlugin?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

I want to use this plugin in my tensorrt engine. But there is no example which I can refer to.

Environment

nvidia docker container 23.01

Relevant Files

2

Hi,

Please refer to the following sample and developer guide for more details.

Thank you.

3

Thank you for your reply! Where can I get the data folder with mnist_with_coordconv.onnx file in the first sample sampleOnnxMnistCoordConvAC?

4

Please refer,

image
image2559×446 59.8 KB

10

Thank you!

11

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.