I’ve tried to convert my graph to INT8 in TF-TRT. Here is my stack trace:
TensorRT node TRTEngineOp_0 added for segment 0 consisting of 3 nodes failed: Invalid argument: Validation failed for TensorRTInputPH_0 and input slot 0: Input tensor with shape [?,?,?,3] has an unknown non-batch dimension at dim 1. Fallback to TF...
However it converts fine to FP16. Do I have to set the dimensions in order for the graph to convert? Do you have any documentation for this?