Uff parser exception

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Description

Uff conversion fails with the following error for a Bi-LSTM. Is this issue addressed yet? I see it posted many times with no clear solution.

Traceback (most recent call last):
  File "/usr/local/bin/convert-to-uff", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.6/dist-packages/uff/bin/convert_to_uff.py", line 139, in main
    debug_mode=args.debug
  File "/usr/local/lib/python3.6/dist-packages/uff/converters/tensorflow/conversion_helpers.py", line 276, in from_tensorflow_frozen_model
    return from_tensorflow(graphdef, output_nodes, preprocessor, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/uff/converters/tensorflow/conversion_helpers.py", line 225, in from_tensorflow
    debug_mode=debug_mode)
  File "/usr/local/lib/python3.6/dist-packages/uff/converters/tensorflow/converter.py", line 141, in convert_tf2uff_graph
    uff_graph, input_replacements, debug_mode=debug_mode)
  File "/usr/local/lib/python3.6/dist-packages/uff/converters/tensorflow/converter.py", line 126, in convert_tf2uff_node
    op, name, tf_node, inputs, uff_graph, tf_nodes=tf_nodes, debug_mode=debug_mode)
  File "/usr/local/lib/python3.6/dist-packages/uff/converters/tensorflow/converter.py", line 94, in convert_layer
    return cls.registry_[op](name, tf_node, inputs, uff_graph, **kwargs)
  File "/usr/local/lib/python3.6/dist-packages/uff/converters/tensorflow/converter_functions.py", line 356, in convert_transpose
    raise UffException("Transpose permutation has op " + str(tf_permutation_node.op) + ", expected Const. Only constant permuations are supported in UFF.")
uff.model.exceptions.UffException: Transpose permutation has op ConcatV2, expected Const. Only constant permuations are supported in UFF.

Environment

TensorRT Version: 7.1.3
GPU Type: TitanX
Nvidia Driver Version: 450.51.06
CUDA Version: 11.0
CUDNN Version: 8
Operating System + Version: Ubuntu 18.04
Python Version (if applicable): 3.6.9
TensorFlow Version (if applicable): 1.15
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag): nvcr.io/nvidia/tensorrt:20.08-py3

Unable to share the model, but the error seems to happen with the ConcatV2 operator of TensorFlow.

2

Hi @aravind.anantha,
UFF parser has been deprecated from TRT 7onwards, hence we recommend you to try the ONNX parser.

Thanks!