Error converting gru model to TRT engine

I am trying to convert a keras GRU model to onnx and onnx to trt. but i am getting this error when converting from onnx to trt.

&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=onnx_model.onnx --saveEngine=model.trt --explicitBatch
[10/23/2021-11:55:13] [I] === Model Options ===
[10/23/2021-11:55:13] [I] Format: ONNX
[10/23/2021-11:55:13] [I] Model: onnx_model.onnx
[10/23/2021-11:55:13] [I] Output:
[10/23/2021-11:55:13] [I] === Build Options ===
[10/23/2021-11:55:13] [I] Max batch: explicit
[10/23/2021-11:55:13] [I] Workspace: 16 MB
[10/23/2021-11:55:13] [I] minTiming: 1
[10/23/2021-11:55:13] [I] avgTiming: 8
[10/23/2021-11:55:13] [I] Precision: FP32
[10/23/2021-11:55:13] [I] Calibration: 
[10/23/2021-11:55:13] [I] Safe mode: Disabled
[10/23/2021-11:55:13] [I] Save engine: model.trt
[10/23/2021-11:55:13] [I] Load engine: 
[10/23/2021-11:55:13] [I] Builder Cache: Enabled
[10/23/2021-11:55:13] [I] NVTX verbosity: 0
[10/23/2021-11:55:13] [I] Inputs format: fp32:CHW
[10/23/2021-11:55:13] [I] Outputs format: fp32:CHW
[10/23/2021-11:55:13] [I] Input build shapes: model
[10/23/2021-11:55:13] [I] Input calibration shapes: model
[10/23/2021-11:55:13] [I] === System Options ===
[10/23/2021-11:55:13] [I] Device: 0
[10/23/2021-11:55:13] [I] DLACore: 
[10/23/2021-11:55:13] [I] Plugins:
[10/23/2021-11:55:13] [I] === Inference Options ===
[10/23/2021-11:55:13] [I] Batch: Explicit
[10/23/2021-11:55:13] [I] Input inference shapes: model
[10/23/2021-11:55:13] [I] Iterations: 10
[10/23/2021-11:55:13] [I] Duration: 3s (+ 200ms warm up)
[10/23/2021-11:55:13] [I] Sleep time: 0ms
[10/23/2021-11:55:13] [I] Streams: 1
[10/23/2021-11:55:13] [I] ExposeDMA: Disabled
[10/23/2021-11:55:13] [I] Spin-wait: Disabled
[10/23/2021-11:55:13] [I] Multithreading: Disabled
[10/23/2021-11:55:13] [I] CUDA Graph: Disabled
[10/23/2021-11:55:13] [I] Skip inference: Disabled
[10/23/2021-11:55:13] [I] Inputs:
[10/23/2021-11:55:13] [I] === Reporting Options ===
[10/23/2021-11:55:13] [I] Verbose: Disabled
[10/23/2021-11:55:13] [I] Averages: 10 inferences
[10/23/2021-11:55:13] [I] Percentile: 99
[10/23/2021-11:55:13] [I] Dump output: Disabled
[10/23/2021-11:55:13] [I] Profile: Disabled
[10/23/2021-11:55:13] [I] Export timing to JSON file: 
[10/23/2021-11:55:13] [I] Export output to JSON file: 
[10/23/2021-11:55:13] [I] Export profile to JSON file: 
[10/23/2021-11:55:13] [I] 
----------------------------------------------------------------
Input filename:   onnx_model.onnx
ONNX IR version:  0.0.4
Opset version:    9
Producer name:    tf2onnx
Producer version: 1.9.2
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
[10/23/2021-11:55:18] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/23/2021-11:55:18] [W] [TRT] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[10/23/2021-11:55:18] [W] Dynamic dimensions required for input: input_1, but no shapes were provided. Automatically overriding shape to: 1x30x7
[10/23/2021-11:55:18] [E] [TRT] Repeated layer name: while/split_1 (layers must have distinct names)
[10/23/2021-11:55:18] [E] [TRT] Network validation failed.
[10/23/2021-11:55:18] [E] Engine creation failed
[10/23/2021-11:55:18] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=onnx_model.onnx --saveEngine=model.trt --explicitBatch

i looked into the model summary and there were no layers named while/split_1.

The model summary looks like this

Model: "model"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
input_1 (InputLayer)         [(None, 30, 7)]           0         
_________________________________________________________________
gru (GRU)                    (None, 30, 7)             336       
_________________________________________________________________
dropout (Dropout)            (None, 30, 7)             0         
_________________________________________________________________
flatten (Flatten)            (None, 210)               0         
_________________________________________________________________
dense (Dense)                (None, 7)                 1477      
=================================================================
Total params: 1,813
Trainable params: 1,813
Non-trainable params: 0
_________________________________________________________________

the conversion script from keras to onnx and onnx to trt are in this drive folder nvpost - Google Drive

My main aim is to get this keras model converted to trt.
why is it caused and how to resolve this ?

Environment

TensorRT Version: 7.3.1
Operating System + Version:jetpack 4.5.1 rev1
Python Version 3.6:

Hi,
Request you to share the ONNX model and the script if not shared already so that we can assist you better.
Alongside you can try few things:
https://docs.nvidia.com/deeplearning/tensorrt/quick-start-guide/index.html#onnx-export

  1. validating your model with the below snippet

check_model.py

import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).
2) Try running your model with trtexec command.
https://github.com/NVIDIA/TensorRT/tree/master/samples/opensource/trtexec
In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging
Thanks!

datakalp@datakalp-desktop:~/nvpost$ trtexec --onnx=onnx_model.onnx --verbose
&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=onnx_model.onnx --verbose
[10/25/2021-12:18:52] [I] === Model Options ===
[10/25/2021-12:18:52] [I] Format: ONNX
[10/25/2021-12:18:52] [I] Model: onnx_model.onnx
[10/25/2021-12:18:52] [I] Output:
[10/25/2021-12:18:52] [I] === Build Options ===
[10/25/2021-12:18:52] [I] Max batch: 1
[10/25/2021-12:18:52] [I] Workspace: 16 MB
[10/25/2021-12:18:52] [I] minTiming: 1
[10/25/2021-12:18:52] [I] avgTiming: 8
[10/25/2021-12:18:52] [I] Precision: FP32
[10/25/2021-12:18:52] [I] Calibration: 
[10/25/2021-12:18:52] [I] Safe mode: Disabled
[10/25/2021-12:18:52] [I] Save engine: 
[10/25/2021-12:18:52] [I] Load engine: 
[10/25/2021-12:18:52] [I] Builder Cache: Enabled
[10/25/2021-12:18:52] [I] NVTX verbosity: 0
[10/25/2021-12:18:52] [I] Inputs format: fp32:CHW
[10/25/2021-12:18:52] [I] Outputs format: fp32:CHW
[10/25/2021-12:18:52] [I] Input build shapes: model
[10/25/2021-12:18:52] [I] Input calibration shapes: model
[10/25/2021-12:18:52] [I] === System Options ===
[10/25/2021-12:18:52] [I] Device: 0
[10/25/2021-12:18:52] [I] DLACore: 
[10/25/2021-12:18:52] [I] Plugins:
[10/25/2021-12:18:52] [I] === Inference Options ===
[10/25/2021-12:18:52] [I] Batch: 1
[10/25/2021-12:18:52] [I] Input inference shapes: model
[10/25/2021-12:18:52] [I] Iterations: 10
[10/25/2021-12:18:52] [I] Duration: 3s (+ 200ms warm up)
[10/25/2021-12:18:52] [I] Sleep time: 0ms
[10/25/2021-12:18:52] [I] Streams: 1
[10/25/2021-12:18:52] [I] ExposeDMA: Disabled
[10/25/2021-12:18:52] [I] Spin-wait: Disabled
[10/25/2021-12:18:52] [I] Multithreading: Disabled
[10/25/2021-12:18:52] [I] CUDA Graph: Disabled
[10/25/2021-12:18:52] [I] Skip inference: Disabled
[10/25/2021-12:18:52] [I] Inputs:
[10/25/2021-12:18:52] [I] === Reporting Options ===
[10/25/2021-12:18:52] [I] Verbose: Enabled
[10/25/2021-12:18:52] [I] Averages: 10 inferences
[10/25/2021-12:18:52] [I] Percentile: 99
[10/25/2021-12:18:52] [I] Dump output: Disabled
[10/25/2021-12:18:52] [I] Profile: Disabled
[10/25/2021-12:18:52] [I] Export timing to JSON file: 
[10/25/2021-12:18:52] [I] Export output to JSON file: 
[10/25/2021-12:18:52] [I] Export profile to JSON file: 
[10/25/2021-12:18:52] [I] 
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Proposal version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Split version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
----------------------------------------------------------------
Input filename:   onnx_model.onnx
ONNX IR version:  0.0.4
Opset version:    9
Producer name:    tf2onnx
Producer version: 1.9.2
Domain:           
Model version:    0
Doc string:       
----------------------------------------------------------------
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Split version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_1 with dtype: float32, dimensions: (-1, 30, 7)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_1 for ONNX tensor: input_1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/gru/PartitionedCall/while/maximum_iterations:0
[10/25/2021-12:18:54] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/25/2021-12:18:54] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[10/25/2021-12:18:54] [W] [TRT] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/gru/PartitionedCall/time:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/gru/PartitionedCall/strided_slice__18
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/dense/MatMul/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/dense/BiasAdd/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__77
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__76
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__39
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__38
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Func/model/gru/PartitionedCall/input/_3:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Func/model/gru/PartitionedCall/input/_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/model/gru/PartitionedCall/unstack-folded-1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/model/gru/PartitionedCall/unstack-folded-0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/Shape [Shape]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/Shape [Shape] inputs: [input_1 -> (-1, 30, 7)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/Shape for ONNX node: model/gru/Shape
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/Shape:0 for ONNX tensor: model/gru/Shape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/Shape [Shape] outputs: [model/gru/Shape:0 -> (3)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/Shape__21 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/Shape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/Shape__21 [Cast] inputs: [model/gru/Shape:0 -> (3)], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: int32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/Shape__21 for ONNX node: model/gru/Shape__21
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/Shape__21:0 for ONNX tensor: model/gru/Shape__21:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/Shape__21 [Cast] outputs: [model/gru/Shape__21:0 -> (3)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/strided_slice [Slice]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/Shape__21:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/strided_slice [Slice] inputs: [model/gru/Shape__21:0 -> (3)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/strided_slice for ONNX node: model/gru/strided_slice
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/strided_slice:0 for ONNX tensor: model/gru/strided_slice:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/strided_slice [Slice] outputs: [model/gru/strided_slice:0 -> (1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/PartitionedCall/transpose [Transpose]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/PartitionedCall/transpose [Transpose] inputs: [input_1 -> (-1, 30, 7)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/PartitionedCall/transpose for ONNX node: model/gru/PartitionedCall/transpose
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/transpose:0 for ONNX tensor: model/gru/PartitionedCall/transpose:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/PartitionedCall/transpose [Transpose] outputs: [model/gru/PartitionedCall/transpose:0 -> (30, -1, 7)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while_cond_655_while/Less [Less]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__76
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__77
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while_cond_655_while/Less [Less] inputs: [const_fold_opt__76 -> ()], [const_fold_opt__77 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while_cond_655_while/Less for ONNX node: while_cond_655_while/Less
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_cond_655_while/Less:0 for ONNX tensor: while_cond_655_while/Less:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while_cond_655_while/Less [Less] outputs: [while_cond_655_while/Less:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/zeros/packed_Concat__25 [Concat]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/strided_slice:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__39
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/zeros/packed_Concat__25 [Concat] inputs: [model/gru/strided_slice:0 -> (1)], [const_fold_opt__39 -> (1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/zeros/packed_Concat__25 for ONNX node: model/gru/zeros/packed_Concat__25
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/zeros/packed_Concat__25:0 for ONNX tensor: model/gru/zeros/packed_Concat__25:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/zeros/packed_Concat__25 [Concat] outputs: [model/gru/zeros/packed_Concat__25:0 -> (2)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/zeros__26 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/zeros/packed_Concat__25:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/zeros__26 [Cast] inputs: [model/gru/zeros/packed_Concat__25:0 -> (2)], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: int32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/zeros__26 for ONNX node: model/gru/zeros__26
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/zeros__26:0 for ONNX tensor: model/gru/zeros__26:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/zeros__26 [Cast] outputs: [model/gru/zeros__26:0 -> (2)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/zeros [ConstantOfShape]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/zeros__26:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/zeros [ConstantOfShape] inputs: [model/gru/zeros__26:0 -> (2)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/zeros for ONNX node: model/gru/zeros
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/zeros:0 for ONNX tensor: model/gru/zeros:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/zeros [ConstantOfShape] outputs: [model/gru/zeros:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/PartitionedCall/while_loop [Loop]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/while/maximum_iterations:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_cond_655_while/Less:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/time:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/zeros:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/strided_slice__18
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: Func/model/gru/PartitionedCall/input/_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/model/gru/PartitionedCall/unstack-folded-0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: Func/model/gru/PartitionedCall/input/_3:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/model/gru/PartitionedCall/unstack-folded-1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/PartitionedCall/while_loop [Loop] inputs: [model/gru/PartitionedCall/while/maximum_iterations:0 -> ()], [while_cond_655_while/Less:0 -> ()], [model/gru/PartitionedCall/time:0 -> ()], [model/gru/zeros:0 -> (-1, -1)], [model/gru/PartitionedCall/strided_slice__18 -> ()], [Func/model/gru/PartitionedCall/input/_2:0 -> (7, 21)], [ConstantFolding/model/gru/PartitionedCall/unstack-folded-0:0 -> (21)], [Func/model/gru/PartitionedCall/input/_3:0 -> (7, 21)], [ConstantFolding/model/gru/PartitionedCall/unstack-folded-1:0 -> (21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_while_loop_counter:0 for ONNX tensor: while_while_loop_counter:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond__27:0 for ONNX tensor: cond__27:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_placeholder:0 for ONNX tensor: while_placeholder:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_placeholder_2:0 for ONNX tensor: while_placeholder_2:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_strided_slice_0:0 for ONNX tensor: while_strided_slice_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_matmul_kernel_0:0 for ONNX tensor: while_matmul_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_biasadd_unstack_0:0 for ONNX tensor: while_biasadd_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_matmul_1_recurrent_kernel_0:0 for ONNX tensor: while_matmul_1_recurrent_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_biasadd_1_unstack_0:0 for ONNX tensor: while_biasadd_1_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/PartitionedCall/while_loop for ONNX node: model/gru/PartitionedCall/while_loop
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: while/sub/x:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: while/add_4/y:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_4 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add_4/y:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_4 [Add] inputs: [while_placeholder:0 -> ()], [while/add_4/y:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_4 for ONNX node: while/add_4
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Identity_2:0 for ONNX tensor: while/Identity_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_4 [Add] outputs: [while/Identity_2:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/TensorArrayV2Read/TensorListGetItem [Gather]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/transpose:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/TensorArrayV2Read/TensorListGetItem [Gather] inputs: [model/gru/PartitionedCall/transpose:0 -> (30, -1, 7)], [while_placeholder:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/TensorArrayV2Read/TensorListGetItem for ONNX node: while/TensorArrayV2Read/TensorListGetItem
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/TensorArrayV2Read/TensorListGetItem:0 for ONNX tensor: while/TensorArrayV2Read/TensorListGetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/TensorArrayV2Read/TensorListGetItem [Gather] outputs: [while/TensorArrayV2Read/TensorListGetItem:0 -> (-1, 7)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/MatMul_1 [MatMul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_matmul_1_recurrent_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/MatMul_1 [MatMul] inputs: [while_placeholder_2:0 -> (-1, -1)], [while_matmul_1_recurrent_kernel_0:0 -> (7, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/MatMul_1 for ONNX node: while/MatMul_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/MatMul_1:0 for ONNX tensor: while/MatMul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/MatMul_1 [MatMul] outputs: [while/MatMul_1:0 -> (-1, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/MatMul [MatMul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/TensorArrayV2Read/TensorListGetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_matmul_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/MatMul [MatMul] inputs: [while/TensorArrayV2Read/TensorListGetItem:0 -> (-1, 7)], [while_matmul_kernel_0:0 -> (7, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/MatMul for ONNX node: while/MatMul
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/MatMul:0 for ONNX tensor: while/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/MatMul [MatMul] outputs: [while/MatMul:0 -> (-1, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/BiasAdd_1 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/MatMul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_biasadd_1_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/BiasAdd_1 [Add] inputs: [while/MatMul_1:0 -> (-1, 21)], [while_biasadd_1_unstack_0:0 -> (21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/BiasAdd_1 for ONNX node: while/BiasAdd_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/BiasAdd_1:0 for ONNX tensor: while/BiasAdd_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/BiasAdd_1 [Add] outputs: [while/BiasAdd_1:0 -> (-1, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/split_1 [Split]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/BiasAdd_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/split_1 [Split] inputs: [while/BiasAdd_1:0 -> (-1, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split_1 for ONNX node: while/split_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split_1 for ONNX node: while/split_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split_1 for ONNX node: while/split_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split_1:0 for ONNX tensor: while/split_1:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split_1:1 for ONNX tensor: while/split_1:1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split_1:2 for ONNX tensor: while/split_1:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/split_1 [Split] outputs: [while/split_1:0 -> (-1, -1)], [while/split_1:1 -> (-1, -1)], [while/split_1:2 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/BiasAdd [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_biasadd_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/BiasAdd [Add] inputs: [while/MatMul:0 -> (-1, 21)], [while_biasadd_unstack_0:0 -> (21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/BiasAdd for ONNX node: while/BiasAdd
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/BiasAdd:0 for ONNX tensor: while/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/BiasAdd [Add] outputs: [while/BiasAdd:0 -> (-1, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/split [Split]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/split [Split] inputs: [while/BiasAdd:0 -> (-1, 21)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split for ONNX node: while/split
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split for ONNX node: while/split
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split for ONNX node: while/split
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split:0 for ONNX tensor: while/split:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split:1 for ONNX tensor: while/split:1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split:2 for ONNX tensor: while/split:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/split [Split] outputs: [while/split:0 -> (-1, -1)], [while/split:1 -> (-1, -1)], [while/split:2 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_1 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split:1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split_1:1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_1 [Add] inputs: [while/split:1 -> (-1, -1)], [while/split_1:1 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_1 for ONNX node: while/add_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/add_1:0 for ONNX tensor: while/add_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_1 [Add] outputs: [while/add_1:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Sigmoid_1 [Sigmoid]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Sigmoid_1 [Sigmoid] inputs: [while/add_1:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Sigmoid_1 for ONNX node: while/Sigmoid_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Sigmoid_1:0 for ONNX tensor: while/Sigmoid_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Sigmoid_1 [Sigmoid] outputs: [while/Sigmoid_1:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/mul [Mul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Sigmoid_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split_1:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/mul [Mul] inputs: [while/Sigmoid_1:0 -> (-1, -1)], [while/split_1:2 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/mul for ONNX node: while/mul
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/mul:0 for ONNX tensor: while/mul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/mul [Mul] outputs: [while/mul:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_2 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/mul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_2 [Add] inputs: [while/split:2 -> (-1, -1)], [while/mul:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_2 for ONNX node: while/add_2
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/add_2:0 for ONNX tensor: while/add_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_2 [Add] outputs: [while/add_2:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Tanh [Tanh]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Tanh [Tanh] inputs: [while/add_2:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Tanh for ONNX node: while/Tanh
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Tanh:0 for ONNX tensor: while/Tanh:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Tanh [Tanh] outputs: [while/Tanh:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add [Add] inputs: [while/split:0 -> (-1, -1)], [while/split_1:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add for ONNX node: while/add
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/add:0 for ONNX tensor: while/add:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add [Add] outputs: [while/add:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Sigmoid [Sigmoid]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Sigmoid [Sigmoid] inputs: [while/add:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Sigmoid for ONNX node: while/Sigmoid
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Sigmoid:0 for ONNX tensor: while/Sigmoid:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Sigmoid [Sigmoid] outputs: [while/Sigmoid:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/sub [Sub]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/sub/x:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Sigmoid:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/sub [Sub] inputs: [while/sub/x:0 -> ()], [while/Sigmoid:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/sub for ONNX node: while/sub
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/sub:0 for ONNX tensor: while/sub:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/sub [Sub] outputs: [while/sub:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/mul_2 [Mul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/sub:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Tanh:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/mul_2 [Mul] inputs: [while/sub:0 -> (-1, -1)], [while/Tanh:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/mul_2 for ONNX node: while/mul_2
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/mul_2:0 for ONNX tensor: while/mul_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/mul_2 [Mul] outputs: [while/mul_2:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/mul_1 [Mul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Sigmoid:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/mul_1 [Mul] inputs: [while/Sigmoid:0 -> (-1, -1)], [while_placeholder_2:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/mul_1 for ONNX node: while/mul_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/mul_1:0 for ONNX tensor: while/mul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/mul_1 [Mul] outputs: [while/mul_1:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_3 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/mul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/mul_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_3 [Add] inputs: [while/mul_1:0 -> (-1, -1)], [while/mul_2:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_3 for ONNX node: while/add_3
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/TensorArrayV2Write/TensorListSetItem:0 for ONNX tensor: while/TensorArrayV2Write/TensorListSetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_3 [Add] outputs: [while/TensorArrayV2Write/TensorListSetItem:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Identity_4 [Identity]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/TensorArrayV2Write/TensorListSetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Identity_4 [Identity] inputs: [while/TensorArrayV2Write/TensorListSetItem:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Identity_4 for ONNX node: while/Identity_4
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Identity_4:0 for ONNX tensor: while/Identity_4:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Identity_4 [Identity] outputs: [while/Identity_4:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: cond___while/Less__20 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_strided_slice_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: cond___while/Less__20 [Cast] inputs: [while_strided_slice_0:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: cond___while/Less__20 for ONNX node: cond___while/Less__20
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond___while/Less__20:0 for ONNX tensor: cond___while/Less__20:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: cond___while/Less__20 [Cast] outputs: [cond___while/Less__20:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: cond___while/Less__19 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Identity_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: cond___while/Less__19 [Cast] inputs: [while/Identity_2:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: cond___while/Less__19 for ONNX node: cond___while/Less__19
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond___while/Less__19:0 for ONNX tensor: cond___while/Less__19:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: cond___while/Less__19 [Cast] outputs: [cond___while/Less__19:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: cond___while/Less [Less]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: cond___while/Less__19:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: cond___while/Less__20:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: cond___while/Less [Less] inputs: [cond___while/Less__19:0 -> ()], [cond___while/Less__20:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: cond___while/Less for ONNX node: cond___while/Less
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond___while/Identity_graph_outputs_Identity__14:0 for ONNX tensor: cond___while/Identity_graph_outputs_Identity__14:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: cond___while/Less [Less] outputs: [cond___while/Identity_graph_outputs_Identity__14:0 -> ()], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while/Identity_2:0, found matching tensor: while/Identity_2:0, with shape: ()
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while/Identity_4:0, found matching tensor: while/Identity_4:0, with shape: (-1, -1)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_strided_slice_0:0, found matching tensor: while_strided_slice_0:0, with shape: ()
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_matmul_kernel_0:0, found matching tensor: while_matmul_kernel_0:0, with shape: (7, 21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_biasadd_unstack_0:0, found matching tensor: while_biasadd_unstack_0:0, with shape: (21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_matmul_1_recurrent_kernel_0:0, found matching tensor: while_matmul_1_recurrent_kernel_0:0, with shape: (7, 21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_biasadd_1_unstack_0:0, found matching tensor: while_biasadd_1_unstack_0:0, with shape: (21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1735: For scan output: while/TensorArrayV2Write/TensorListSetItem:0, found matching tensor: while/TensorArrayV2Write/TensorListSetItem:0, with shape: (-1, -1)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:0 for ONNX tensor: model/gru/PartitionedCall/while_loop:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:1 for ONNX tensor: model/gru/PartitionedCall/while_loop:1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:2 for ONNX tensor: model/gru/PartitionedCall/while_loop:2
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:3 for ONNX tensor: model/gru/PartitionedCall/while_loop:3
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:4 for ONNX tensor: model/gru/PartitionedCall/while_loop:4
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:5 for ONNX tensor: model/gru/PartitionedCall/while_loop:5
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:6 for ONNX tensor: model/gru/PartitionedCall/while_loop:6
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:7 for ONNX tensor: model/gru/PartitionedCall/while_loop:7
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/PartitionedCall/while_loop [Loop] outputs: [model/gru/PartitionedCall/while_loop:0 -> ()], [model/gru/PartitionedCall/while_loop:1 -> (-1, -1)], [model/gru/PartitionedCall/while_loop:2 -> ()], [model/gru/PartitionedCall/while_loop:3 -> (7, 21)], [model/gru/PartitionedCall/while_loop:4 -> (21)], [model/gru/PartitionedCall/while_loop:5 -> (7, 21)], [model/gru/PartitionedCall/while_loop:6 -> (21)], [model/gru/PartitionedCall/while_loop:7 -> (-1, -1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/PartitionedCall/transpose_1 [Transpose]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/while_loop:7
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/PartitionedCall/transpose_1 [Transpose] inputs: [model/gru/PartitionedCall/while_loop:7 -> (-1, -1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/PartitionedCall/transpose_1 for ONNX node: model/gru/PartitionedCall/transpose_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/transpose_1:0 for ONNX tensor: model/gru/PartitionedCall/transpose_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/PartitionedCall/transpose_1 [Transpose] outputs: [model/gru/PartitionedCall/transpose_1:0 -> (-1, -1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/flatten/Reshape [Reshape]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/transpose_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__38
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/flatten/Reshape [Reshape] inputs: [model/gru/PartitionedCall/transpose_1:0 -> (-1, -1, -1)], [const_fold_opt__38 -> (2)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/flatten/Reshape for ONNX node: model/flatten/Reshape
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/flatten/Reshape:0 for ONNX tensor: model/flatten/Reshape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/flatten/Reshape [Reshape] outputs: [model/flatten/Reshape:0 -> (-1, 210)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/dense/MatMul [MatMul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/flatten/Reshape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/MatMul/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/dense/MatMul [MatMul] inputs: [model/flatten/Reshape:0 -> (-1, 210)], [model/dense/MatMul/ReadVariableOp:0 -> (210, 7)], 
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:2053: GEMM: using FC layer instead of MM because all criteria were met.
[10/25/2021-12:18:54] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (_, 210), unsqueezing to: (_, _, _, _)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/dense/MatMul for ONNX node: model/dense/MatMul
[10/25/2021-12:18:54] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (_, 7, 1, 1), squeezing to: (_, _)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/dense/MatMul:0 for ONNX tensor: model/dense/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/dense/MatMul [MatMul] outputs: [model/dense/MatMul:0 -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/dense/BiasAdd [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/BiasAdd/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/dense/BiasAdd [Add] inputs: [model/dense/MatMul:0 -> (-1, -1)], [model/dense/BiasAdd/ReadVariableOp:0 -> (7)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/dense/BiasAdd for ONNX node: model/dense/BiasAdd
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/dense/BiasAdd:0 for ONNX tensor: model/dense/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/dense/BiasAdd [Add] outputs: [model/dense/BiasAdd:0 -> (-1, 7)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/dense/Softmax [Softmax]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/dense/Softmax [Softmax] inputs: [model/dense/BiasAdd:0 -> (-1, 7)], 
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/dense/Softmax for ONNX node: model/dense/Softmax
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: dense_1 for ONNX tensor: dense
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/dense/Softmax [Softmax] outputs: [dense -> (-1, -1)], 
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:507: Marking dense_1 as output: dense
 ----- Parsing of ONNX model onnx_model.onnx is Done ---- 
[10/25/2021-12:18:54] [E] [TRT] Repeated layer name: while/split_1 (layers must have distinct names)
[10/25/2021-12:18:54] [E] [TRT] Network validation failed.
[10/25/2021-12:18:54] [E] Engine creation failed
[10/25/2021-12:18:54] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=onnx_model.onnx --verbose

This is the output from trtexec with verbose

i ran

import sys
import onnx
filename = "onnx_model.onnx"
model = onnx.load(filename)
onnx.checker.check_model(model).

and there was no output i assume its fine but is it?

In addition i have uploaded the .onnx file on the same drive to which the link is provided in my previous post

Hi,

We tried building engine using onnx model shared. We are facing following error on TensorRT version 8.2 EA.

10/25/2021-11:03:19] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 365 MiB, GPU 510 MiB
[10/25/2021-11:03:19] [E] Error[4]: [graphShapeAnalyzer.cpp::processCheck::582] Error Code 4: Internal Error (model/gru/PartitionedCall/while_loop:7: tensor volume exceeds (2^31)-1, dimensions are [2147483647,1,7])
[10/25/2021-11:03:19] [E] Error[2]: [builder.cpp::buildSerializedNetwork::561] Error Code 2: Internal Error (Assertion enginePtr != nullptr failed. )
[10/25/2021-11:03:19] [E] Engine could not be created from network
[10/25/2021-11:03:19] [E] Building engine failed
[10/25/2021-11:03:19] [E] Failed to create engine from model.
[10/25/2021-11:03:19] [E] Engine set up failed

Hope following may help you.

Thank you.