I’ve been using Theano extensively and I now wanted to use my trained Theano models along with TensorRT in order to improve performance. As this article suggests: GIE supports networks trained using popular neural network frameworks including Caffe, Theano, Torch and Tensorflow.
The problem is I have no clue on how to do this and I cannot find any documentation for this or anything at all, actually. TensorRT is a big black box for me at this point.
Where can I get the interface documentation, samples, and other useful help?