Would you mind to share your model for us checking.
Our parser doesn’t support some new layer like FusedBatchNormV3.
But this layer is similar to the original FusedBatchNorm op and can be forward to use FusedBatchNorm in an uff format.
If you can replace warning operation with a supported one, plugin implementation is not necessary.
Just wanted to let you know that I’ve sent a direct message with more context into what I have tried so far. Is there an email that you can share, for me to share a .pb file of the model?
Hi AastaLLL, I work with Qsu who asked this question initially. We are following up on this thread to see if DS 5.0 solves the issue about not being able to create a TensorRT engine for our model due to the padding layers?
From what I understand, DS 5.0 made updates to support more functionality from TensorFlow regarding the file format. Did this also fix the layer compatibility so that DS 5.0 or TensorRT could take in our NasNet model. Please advise. Thanks!
Thank you, Aasta. Please let me know if you find that the NasNet-based model is compatible now with DS 5.0 / the upgraded TensorRT v7.1? Feel free to PM me.
Just test your NasNet with TensorRT7.1 but meet the same error again:
----------------------------------------------------------------
Input filename: mec_model_d2.onnx
ONNX IR version: 0.0.6
Opset version: 8
Producer name: tf2onnx
Producer version: 1.5.5
Domain:
Model version: 0
Doc string:
----------------------------------------------------------------
[06/05/2020-05:16:12] [W] [TRT] onnx2trt_utils.cpp:217: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
ERROR: builtin_op_importers.cpp:2160 In function importPad:
[8] Assertion failed: convertOnnxPadding(onnxPadding, &begPadding, &endPadding) && "This version of TensorRT only supports padding on the outer two dimensions!"
[06/05/2020-05:16:12] [E] Failed to parse onnx file
[06/05/2020-05:16:12] [E] Parsing model failed
[06/05/2020-05:16:12] [E] Engine creation failed
[06/05/2020-05:16:12] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=mec_model_d2.onnx
I am facing the same problem when i try to convert MobileArcFaceNet to TR. Is there any solution yet? I am using TRT 7.1.3 and Deepstream 5.0.
Thanks a lot.