Tensor RT supports caffe model layers

Autonomous Machines Jetson & Embedded Systems Jetson TX1
21

Hi xushen,

There is no clear plan for supporting SSD with TensorRT.
But TensorRT2.1 has custom API(IPlugin) for the user to implement their layers and bind it into inferencing flow.

Please check FCPlugin sample for more details.

22

Hi, I got a problem, I implemented my custom layer following the sampleFasterRCNN sample and official tutorials. But when I execute the program, I got an error: Could not parse layer type “Permute”, and permute_param. I’m still confused about how is the program able to parse unsupported layers and determine whether to use custom plugins or supported layers. Could you please share the faster_rcnn_test_iplugin.prototxt for a reference?

23

Hi,

FasterRCNN prototxt is located at:
/usr/src/tensorrt/data/faster-rcnn/faster_rcnn_test_iplugin.prototxt.

layer {
   bottom: "rpn_cls_score"
   top: "rpn_cls_score_reshape"
   name: "ReshapeCTo2"            <b><- string parsed by plugin API</b>
   type: "IPlugin"
}
24

Thanks very much, it works!
But another issue is that when I try to create a cudaEngine based on the network with plugin layer, the buildCudaEngine() function returns “resources.cpp (57) - Cuda Error in gieCudaMalloc: 2”, the wired thing is that this error raises even before configure() and getWorkspaceSize() of my plugin layer are called, any suggestions ?

25

Hi,

May I know the batch-size you used? Guess this issue is related to memory.

Thanks.

26

Yes, it’s the batch size issue, it works!

27

Hi,

We have written a face-recognition sample to demonstrate TensorRT2.1 Plugin API.
Please check this GitHub for more details:

28

@AastaLLL

I have a quick question.
In the TensorRT samples, the input size in faster_rcnn_test_iplugin.prototxt is 375 x 500.

However, all .prototxt file on GitHub - rbgirshick/py-faster-rcnn: Faster R-CNN (Python implementation) -- see https://github.com/ShaoqingRen/faster_rcnn for the official MATLAB version are 224 x 224.
Ex.
py-faster-rcnn/test.prototxt at master · rbgirshick/py-faster-rcnn · GitHub

How did you generate faster_rcnn_test_iplugin.prototxt? and how did you train the Faster RCNN Caffe model?

Thanks!