I know that Tile op in ONNX converts into Slice op in TensorRT.
When exporting ONNX model to TRT engine, it seems we don’t support Tile operator that has BOOL type input and output. Instead of giving a readable error, it throws an exception.
import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).
2) Try running your model with trtexec command. https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/trtexec
In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging
Thanks!
Hi, here is a tiny file that contains about only the tile op. To reproduce we have to disable Myelin. My original model is too big and inconvenient to upload. I found in my origin model, The BOOL type Tile is not clustered into Myelin Node and thows error. When trying to reproduce using the minimum subgraph, I found there are no errors when all nodes can be clustered into Myelin Node.
I’m using TRT8.0, and the error should be:
[TensorRT] ERROR: 2: [optimizer.cpp::getFormatRequirements::3600] Error Code 2: Internal Error (Assertion !n->candidateRequirements.empty() failed.no supported formats)
thanks very much.
Actually I have an opensource version of TensorRT8.0, now I have modified slice.cu and sliceBuilder.cpp to get the BOOL type slice supported.
Out of Myelin graph the types seem to be not fully supported, for example Less Op seems to have similiar problem.