Tensorrt tensorflow

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
1

Hello, I am trying to apply tensorrt to our trained model.
Our model was trained on Tensorflow and had custom layer.

  1. As I refer to tutorial and search this topic on internet, there is no example for applying tensorrt to tensorflow custom layer. Is it impossible for me to apply tensorrt to our model based on tensorflow?
  2. Is the plugin layer only supported on caffe framework? If so, Can you guide me to apply tensorrt our trained model based on tensorflow even if it has custom layer?
2

Hi,

To create TensorRT engine, it’s required to convert TensorFlow model into UFF format first.
Currently, our plugin API only support caffe parser, not available for UFF parser.

Thanks.