datakalp@datakalp-desktop:~/nvpost$ trtexec --onnx=onnx_model.onnx --verbose
&&&& RUNNING TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=onnx_model.onnx --verbose
[10/25/2021-12:18:52] [I] === Model Options ===
[10/25/2021-12:18:52] [I] Format: ONNX
[10/25/2021-12:18:52] [I] Model: onnx_model.onnx
[10/25/2021-12:18:52] [I] Output:
[10/25/2021-12:18:52] [I] === Build Options ===
[10/25/2021-12:18:52] [I] Max batch: 1
[10/25/2021-12:18:52] [I] Workspace: 16 MB
[10/25/2021-12:18:52] [I] minTiming: 1
[10/25/2021-12:18:52] [I] avgTiming: 8
[10/25/2021-12:18:52] [I] Precision: FP32
[10/25/2021-12:18:52] [I] Calibration:
[10/25/2021-12:18:52] [I] Safe mode: Disabled
[10/25/2021-12:18:52] [I] Save engine:
[10/25/2021-12:18:52] [I] Load engine:
[10/25/2021-12:18:52] [I] Builder Cache: Enabled
[10/25/2021-12:18:52] [I] NVTX verbosity: 0
[10/25/2021-12:18:52] [I] Inputs format: fp32:CHW
[10/25/2021-12:18:52] [I] Outputs format: fp32:CHW
[10/25/2021-12:18:52] [I] Input build shapes: model
[10/25/2021-12:18:52] [I] Input calibration shapes: model
[10/25/2021-12:18:52] [I] === System Options ===
[10/25/2021-12:18:52] [I] Device: 0
[10/25/2021-12:18:52] [I] DLACore:
[10/25/2021-12:18:52] [I] Plugins:
[10/25/2021-12:18:52] [I] === Inference Options ===
[10/25/2021-12:18:52] [I] Batch: 1
[10/25/2021-12:18:52] [I] Input inference shapes: model
[10/25/2021-12:18:52] [I] Iterations: 10
[10/25/2021-12:18:52] [I] Duration: 3s (+ 200ms warm up)
[10/25/2021-12:18:52] [I] Sleep time: 0ms
[10/25/2021-12:18:52] [I] Streams: 1
[10/25/2021-12:18:52] [I] ExposeDMA: Disabled
[10/25/2021-12:18:52] [I] Spin-wait: Disabled
[10/25/2021-12:18:52] [I] Multithreading: Disabled
[10/25/2021-12:18:52] [I] CUDA Graph: Disabled
[10/25/2021-12:18:52] [I] Skip inference: Disabled
[10/25/2021-12:18:52] [I] Inputs:
[10/25/2021-12:18:52] [I] === Reporting Options ===
[10/25/2021-12:18:52] [I] Verbose: Enabled
[10/25/2021-12:18:52] [I] Averages: 10 inferences
[10/25/2021-12:18:52] [I] Percentile: 99
[10/25/2021-12:18:52] [I] Dump output: Disabled
[10/25/2021-12:18:52] [I] Profile: Disabled
[10/25/2021-12:18:52] [I] Export timing to JSON file:
[10/25/2021-12:18:52] [I] Export output to JSON file:
[10/25/2021-12:18:52] [I] Export profile to JSON file:
[10/25/2021-12:18:52] [I]
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Proposal version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::Split version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[10/25/2021-12:18:52] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
----------------------------------------------------------------
Input filename: onnx_model.onnx
ONNX IR version: 0.0.4
Opset version: 9
Producer name: tf2onnx
Producer version: 1.9.2
Domain:
Model version: 0
Doc string:
----------------------------------------------------------------
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::Split version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:202: Adding network input: input_1 with dtype: float32, dimensions: (-1, 30, 7)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: input_1 for ONNX tensor: input_1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/gru/PartitionedCall/while/maximum_iterations:0
[10/25/2021-12:18:54] [W] [TRT] onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[10/25/2021-12:18:54] [V] [TRT] onnx2trt_utils.cpp:236: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647
[10/25/2021-12:18:54] [W] [TRT] onnx2trt_utils.cpp:246: One or more weights outside the range of INT32 was clamped
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/gru/PartitionedCall/time:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/gru/PartitionedCall/strided_slice__18
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/dense/MatMul/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: model/dense/BiasAdd/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__77
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__76
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__39
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__38
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Func/model/gru/PartitionedCall/input/_3:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: Func/model/gru/PartitionedCall/input/_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/model/gru/PartitionedCall/unstack-folded-1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/model/gru/PartitionedCall/unstack-folded-0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/Shape [Shape]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/Shape [Shape] inputs: [input_1 -> (-1, 30, 7)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/Shape for ONNX node: model/gru/Shape
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/Shape:0 for ONNX tensor: model/gru/Shape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/Shape [Shape] outputs: [model/gru/Shape:0 -> (3)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/Shape__21 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/Shape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/Shape__21 [Cast] inputs: [model/gru/Shape:0 -> (3)],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: int32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/Shape__21 for ONNX node: model/gru/Shape__21
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/Shape__21:0 for ONNX tensor: model/gru/Shape__21:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/Shape__21 [Cast] outputs: [model/gru/Shape__21:0 -> (3)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/strided_slice [Slice]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/Shape__21:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/strided_slice [Slice] inputs: [model/gru/Shape__21:0 -> (3)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/strided_slice for ONNX node: model/gru/strided_slice
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/strided_slice:0 for ONNX tensor: model/gru/strided_slice:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/strided_slice [Slice] outputs: [model/gru/strided_slice:0 -> (1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/PartitionedCall/transpose [Transpose]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/PartitionedCall/transpose [Transpose] inputs: [input_1 -> (-1, 30, 7)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/PartitionedCall/transpose for ONNX node: model/gru/PartitionedCall/transpose
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/transpose:0 for ONNX tensor: model/gru/PartitionedCall/transpose:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/PartitionedCall/transpose [Transpose] outputs: [model/gru/PartitionedCall/transpose:0 -> (30, -1, 7)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while_cond_655_while/Less [Less]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__76
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__77
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while_cond_655_while/Less [Less] inputs: [const_fold_opt__76 -> ()], [const_fold_opt__77 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while_cond_655_while/Less for ONNX node: while_cond_655_while/Less
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_cond_655_while/Less:0 for ONNX tensor: while_cond_655_while/Less:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while_cond_655_while/Less [Less] outputs: [while_cond_655_while/Less:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/zeros/packed_Concat__25 [Concat]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/strided_slice:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__39
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/zeros/packed_Concat__25 [Concat] inputs: [model/gru/strided_slice:0 -> (1)], [const_fold_opt__39 -> (1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/zeros/packed_Concat__25 for ONNX node: model/gru/zeros/packed_Concat__25
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/zeros/packed_Concat__25:0 for ONNX tensor: model/gru/zeros/packed_Concat__25:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/zeros/packed_Concat__25 [Concat] outputs: [model/gru/zeros/packed_Concat__25:0 -> (2)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/zeros__26 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/zeros/packed_Concat__25:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/zeros__26 [Cast] inputs: [model/gru/zeros/packed_Concat__25:0 -> (2)],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: int32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/zeros__26 for ONNX node: model/gru/zeros__26
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/zeros__26:0 for ONNX tensor: model/gru/zeros__26:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/zeros__26 [Cast] outputs: [model/gru/zeros__26:0 -> (2)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/zeros [ConstantOfShape]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/zeros__26:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/zeros [ConstantOfShape] inputs: [model/gru/zeros__26:0 -> (2)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/zeros for ONNX node: model/gru/zeros
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/zeros:0 for ONNX tensor: model/gru/zeros:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/zeros [ConstantOfShape] outputs: [model/gru/zeros:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/PartitionedCall/while_loop [Loop]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/while/maximum_iterations:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_cond_655_while/Less:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/time:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/zeros:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/strided_slice__18
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: Func/model/gru/PartitionedCall/input/_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/model/gru/PartitionedCall/unstack-folded-0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: Func/model/gru/PartitionedCall/input/_3:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: ConstantFolding/model/gru/PartitionedCall/unstack-folded-1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/PartitionedCall/while_loop [Loop] inputs: [model/gru/PartitionedCall/while/maximum_iterations:0 -> ()], [while_cond_655_while/Less:0 -> ()], [model/gru/PartitionedCall/time:0 -> ()], [model/gru/zeros:0 -> (-1, -1)], [model/gru/PartitionedCall/strided_slice__18 -> ()], [Func/model/gru/PartitionedCall/input/_2:0 -> (7, 21)], [ConstantFolding/model/gru/PartitionedCall/unstack-folded-0:0 -> (21)], [Func/model/gru/PartitionedCall/input/_3:0 -> (7, 21)], [ConstantFolding/model/gru/PartitionedCall/unstack-folded-1:0 -> (21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_while_loop_counter:0 for ONNX tensor: while_while_loop_counter:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond__27:0 for ONNX tensor: cond__27:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_placeholder:0 for ONNX tensor: while_placeholder:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_placeholder_2:0 for ONNX tensor: while_placeholder_2:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_strided_slice_0:0 for ONNX tensor: while_strided_slice_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_matmul_kernel_0:0 for ONNX tensor: while_matmul_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_biasadd_unstack_0:0 for ONNX tensor: while_biasadd_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_matmul_1_recurrent_kernel_0:0 for ONNX tensor: while_matmul_1_recurrent_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while_biasadd_1_unstack_0:0 for ONNX tensor: while_biasadd_1_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/PartitionedCall/while_loop for ONNX node: model/gru/PartitionedCall/while_loop
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: while/sub/x:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:90: Importing initializer: while/add_4/y:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_4 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add_4/y:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_4 [Add] inputs: [while_placeholder:0 -> ()], [while/add_4/y:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_4 for ONNX node: while/add_4
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Identity_2:0 for ONNX tensor: while/Identity_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_4 [Add] outputs: [while/Identity_2:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/TensorArrayV2Read/TensorListGetItem [Gather]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/transpose:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/TensorArrayV2Read/TensorListGetItem [Gather] inputs: [model/gru/PartitionedCall/transpose:0 -> (30, -1, 7)], [while_placeholder:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:986: Using Gather axis: 0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/TensorArrayV2Read/TensorListGetItem for ONNX node: while/TensorArrayV2Read/TensorListGetItem
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/TensorArrayV2Read/TensorListGetItem:0 for ONNX tensor: while/TensorArrayV2Read/TensorListGetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/TensorArrayV2Read/TensorListGetItem [Gather] outputs: [while/TensorArrayV2Read/TensorListGetItem:0 -> (-1, 7)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/MatMul_1 [MatMul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_matmul_1_recurrent_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/MatMul_1 [MatMul] inputs: [while_placeholder_2:0 -> (-1, -1)], [while_matmul_1_recurrent_kernel_0:0 -> (7, 21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/MatMul_1 for ONNX node: while/MatMul_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/MatMul_1:0 for ONNX tensor: while/MatMul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/MatMul_1 [MatMul] outputs: [while/MatMul_1:0 -> (-1, 21)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/MatMul [MatMul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/TensorArrayV2Read/TensorListGetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_matmul_kernel_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/MatMul [MatMul] inputs: [while/TensorArrayV2Read/TensorListGetItem:0 -> (-1, 7)], [while_matmul_kernel_0:0 -> (7, 21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/MatMul for ONNX node: while/MatMul
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/MatMul:0 for ONNX tensor: while/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/MatMul [MatMul] outputs: [while/MatMul:0 -> (-1, 21)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/BiasAdd_1 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/MatMul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_biasadd_1_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/BiasAdd_1 [Add] inputs: [while/MatMul_1:0 -> (-1, 21)], [while_biasadd_1_unstack_0:0 -> (21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/BiasAdd_1 for ONNX node: while/BiasAdd_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/BiasAdd_1:0 for ONNX tensor: while/BiasAdd_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/BiasAdd_1 [Add] outputs: [while/BiasAdd_1:0 -> (-1, 21)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/split_1 [Split]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/BiasAdd_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/split_1 [Split] inputs: [while/BiasAdd_1:0 -> (-1, 21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split_1 for ONNX node: while/split_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split_1 for ONNX node: while/split_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split_1 for ONNX node: while/split_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split_1:0 for ONNX tensor: while/split_1:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split_1:1 for ONNX tensor: while/split_1:1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split_1:2 for ONNX tensor: while/split_1:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/split_1 [Split] outputs: [while/split_1:0 -> (-1, -1)], [while/split_1:1 -> (-1, -1)], [while/split_1:2 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/BiasAdd [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_biasadd_unstack_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/BiasAdd [Add] inputs: [while/MatMul:0 -> (-1, 21)], [while_biasadd_unstack_0:0 -> (21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/BiasAdd for ONNX node: while/BiasAdd
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/BiasAdd:0 for ONNX tensor: while/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/BiasAdd [Add] outputs: [while/BiasAdd:0 -> (-1, 21)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/split [Split]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/split [Split] inputs: [while/BiasAdd:0 -> (-1, 21)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split for ONNX node: while/split
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split for ONNX node: while/split
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/split for ONNX node: while/split
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split:0 for ONNX tensor: while/split:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split:1 for ONNX tensor: while/split:1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/split:2 for ONNX tensor: while/split:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/split [Split] outputs: [while/split:0 -> (-1, -1)], [while/split:1 -> (-1, -1)], [while/split:2 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_1 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split:1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split_1:1
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_1 [Add] inputs: [while/split:1 -> (-1, -1)], [while/split_1:1 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_1 for ONNX node: while/add_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/add_1:0 for ONNX tensor: while/add_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_1 [Add] outputs: [while/add_1:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Sigmoid_1 [Sigmoid]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Sigmoid_1 [Sigmoid] inputs: [while/add_1:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Sigmoid_1 for ONNX node: while/Sigmoid_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Sigmoid_1:0 for ONNX tensor: while/Sigmoid_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Sigmoid_1 [Sigmoid] outputs: [while/Sigmoid_1:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/mul [Mul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Sigmoid_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split_1:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/mul [Mul] inputs: [while/Sigmoid_1:0 -> (-1, -1)], [while/split_1:2 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/mul for ONNX node: while/mul
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/mul:0 for ONNX tensor: while/mul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/mul [Mul] outputs: [while/mul:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_2 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split:2
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/mul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_2 [Add] inputs: [while/split:2 -> (-1, -1)], [while/mul:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_2 for ONNX node: while/add_2
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/add_2:0 for ONNX tensor: while/add_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_2 [Add] outputs: [while/add_2:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Tanh [Tanh]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Tanh [Tanh] inputs: [while/add_2:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Tanh for ONNX node: while/Tanh
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Tanh:0 for ONNX tensor: while/Tanh:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Tanh [Tanh] outputs: [while/Tanh:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/split_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add [Add] inputs: [while/split:0 -> (-1, -1)], [while/split_1:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add for ONNX node: while/add
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/add:0 for ONNX tensor: while/add:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add [Add] outputs: [while/add:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Sigmoid [Sigmoid]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/add:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Sigmoid [Sigmoid] inputs: [while/add:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Sigmoid for ONNX node: while/Sigmoid
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Sigmoid:0 for ONNX tensor: while/Sigmoid:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Sigmoid [Sigmoid] outputs: [while/Sigmoid:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/sub [Sub]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/sub/x:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Sigmoid:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/sub [Sub] inputs: [while/sub/x:0 -> ()], [while/Sigmoid:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/sub for ONNX node: while/sub
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/sub:0 for ONNX tensor: while/sub:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/sub [Sub] outputs: [while/sub:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/mul_2 [Mul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/sub:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Tanh:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/mul_2 [Mul] inputs: [while/sub:0 -> (-1, -1)], [while/Tanh:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/mul_2 for ONNX node: while/mul_2
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/mul_2:0 for ONNX tensor: while/mul_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/mul_2 [Mul] outputs: [while/mul_2:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/mul_1 [Mul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Sigmoid:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_placeholder_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/mul_1 [Mul] inputs: [while/Sigmoid:0 -> (-1, -1)], [while_placeholder_2:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/mul_1 for ONNX node: while/mul_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/mul_1:0 for ONNX tensor: while/mul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/mul_1 [Mul] outputs: [while/mul_1:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/add_3 [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/mul_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/mul_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/add_3 [Add] inputs: [while/mul_1:0 -> (-1, -1)], [while/mul_2:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/add_3 for ONNX node: while/add_3
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/TensorArrayV2Write/TensorListSetItem:0 for ONNX tensor: while/TensorArrayV2Write/TensorListSetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/add_3 [Add] outputs: [while/TensorArrayV2Write/TensorListSetItem:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: while/Identity_4 [Identity]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/TensorArrayV2Write/TensorListSetItem:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: while/Identity_4 [Identity] inputs: [while/TensorArrayV2Write/TensorListSetItem:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: while/Identity_4 for ONNX node: while/Identity_4
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: while/Identity_4:0 for ONNX tensor: while/Identity_4:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: while/Identity_4 [Identity] outputs: [while/Identity_4:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: cond___while/Less__20 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while_strided_slice_0:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: cond___while/Less__20 [Cast] inputs: [while_strided_slice_0:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: cond___while/Less__20 for ONNX node: cond___while/Less__20
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond___while/Less__20:0 for ONNX tensor: cond___while/Less__20:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: cond___while/Less__20 [Cast] outputs: [cond___while/Less__20:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: cond___while/Less__19 [Cast]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: while/Identity_2:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: cond___while/Less__19 [Cast] inputs: [while/Identity_2:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:320: Casting to type: float32
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: cond___while/Less__19 for ONNX node: cond___while/Less__19
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond___while/Less__19:0 for ONNX tensor: cond___while/Less__19:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: cond___while/Less__19 [Cast] outputs: [cond___while/Less__19:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: cond___while/Less [Less]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: cond___while/Less__19:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: cond___while/Less__20:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: cond___while/Less [Less] inputs: [cond___while/Less__19:0 -> ()], [cond___while/Less__20:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: cond___while/Less for ONNX node: cond___while/Less
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: cond___while/Identity_graph_outputs_Identity__14:0 for ONNX tensor: cond___while/Identity_graph_outputs_Identity__14:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: cond___while/Less [Less] outputs: [cond___while/Identity_graph_outputs_Identity__14:0 -> ()],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while/Identity_2:0, found matching tensor: while/Identity_2:0, with shape: ()
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while/Identity_4:0, found matching tensor: while/Identity_4:0, with shape: (-1, -1)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_strided_slice_0:0, found matching tensor: while_strided_slice_0:0, with shape: ()
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_matmul_kernel_0:0, found matching tensor: while_matmul_kernel_0:0, with shape: (7, 21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_biasadd_unstack_0:0, found matching tensor: while_biasadd_unstack_0:0, with shape: (21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_matmul_1_recurrent_kernel_0:0, found matching tensor: while_matmul_1_recurrent_kernel_0:0, with shape: (7, 21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1722: For state variable output: while_biasadd_1_unstack_0:0, found matching tensor: while_biasadd_1_unstack_0:0, with shape: (21)
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:1735: For scan output: while/TensorArrayV2Write/TensorListSetItem:0, found matching tensor: while/TensorArrayV2Write/TensorListSetItem:0, with shape: (-1, -1)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:0 for ONNX tensor: model/gru/PartitionedCall/while_loop:0
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:1 for ONNX tensor: model/gru/PartitionedCall/while_loop:1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:2 for ONNX tensor: model/gru/PartitionedCall/while_loop:2
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:3 for ONNX tensor: model/gru/PartitionedCall/while_loop:3
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:4 for ONNX tensor: model/gru/PartitionedCall/while_loop:4
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:5 for ONNX tensor: model/gru/PartitionedCall/while_loop:5
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:6 for ONNX tensor: model/gru/PartitionedCall/while_loop:6
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/while_loop:7 for ONNX tensor: model/gru/PartitionedCall/while_loop:7
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/PartitionedCall/while_loop [Loop] outputs: [model/gru/PartitionedCall/while_loop:0 -> ()], [model/gru/PartitionedCall/while_loop:1 -> (-1, -1)], [model/gru/PartitionedCall/while_loop:2 -> ()], [model/gru/PartitionedCall/while_loop:3 -> (7, 21)], [model/gru/PartitionedCall/while_loop:4 -> (21)], [model/gru/PartitionedCall/while_loop:5 -> (7, 21)], [model/gru/PartitionedCall/while_loop:6 -> (21)], [model/gru/PartitionedCall/while_loop:7 -> (-1, -1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/gru/PartitionedCall/transpose_1 [Transpose]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/while_loop:7
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/gru/PartitionedCall/transpose_1 [Transpose] inputs: [model/gru/PartitionedCall/while_loop:7 -> (-1, -1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/gru/PartitionedCall/transpose_1 for ONNX node: model/gru/PartitionedCall/transpose_1
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/gru/PartitionedCall/transpose_1:0 for ONNX tensor: model/gru/PartitionedCall/transpose_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/gru/PartitionedCall/transpose_1 [Transpose] outputs: [model/gru/PartitionedCall/transpose_1:0 -> (-1, -1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/flatten/Reshape [Reshape]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/gru/PartitionedCall/transpose_1:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__38
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/flatten/Reshape [Reshape] inputs: [model/gru/PartitionedCall/transpose_1:0 -> (-1, -1, -1)], [const_fold_opt__38 -> (2)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/flatten/Reshape for ONNX node: model/flatten/Reshape
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/flatten/Reshape:0 for ONNX tensor: model/flatten/Reshape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/flatten/Reshape [Reshape] outputs: [model/flatten/Reshape:0 -> (-1, 210)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/dense/MatMul [MatMul]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/flatten/Reshape:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/MatMul/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/dense/MatMul [MatMul] inputs: [model/flatten/Reshape:0 -> (-1, 210)], [model/dense/MatMul/ReadVariableOp:0 -> (210, 7)],
[10/25/2021-12:18:54] [V] [TRT] builtin_op_importers.cpp:2053: GEMM: using FC layer instead of MM because all criteria were met.
[10/25/2021-12:18:54] [V] [TRT] onnx2trt_utils.cpp:1793: Original shape: (_, 210), unsqueezing to: (_, _, _, _)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/dense/MatMul for ONNX node: model/dense/MatMul
[10/25/2021-12:18:54] [V] [TRT] onnx2trt_utils.cpp:1641: Original shape: (_, 7, 1, 1), squeezing to: (_, _)
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/dense/MatMul:0 for ONNX tensor: model/dense/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/dense/MatMul [MatMul] outputs: [model/dense/MatMul:0 -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/dense/BiasAdd [Add]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/MatMul:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/BiasAdd/ReadVariableOp:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/dense/BiasAdd [Add] inputs: [model/dense/MatMul:0 -> (-1, -1)], [model/dense/BiasAdd/ReadVariableOp:0 -> (7)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/dense/BiasAdd for ONNX node: model/dense/BiasAdd
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: model/dense/BiasAdd:0 for ONNX tensor: model/dense/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/dense/BiasAdd [Add] outputs: [model/dense/BiasAdd:0 -> (-1, 7)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:103: Parsing node: model/dense/Softmax [Softmax]
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:119: Searching for input: model/dense/BiasAdd:0
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:125: model/dense/Softmax [Softmax] inputs: [model/dense/BiasAdd:0 -> (-1, 7)],
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:141: Registering layer: model/dense/Softmax for ONNX node: model/dense/Softmax
[10/25/2021-12:18:54] [V] [TRT] ImporterContext.hpp:116: Registering tensor: dense_1 for ONNX tensor: dense
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:179: model/dense/Softmax [Softmax] outputs: [dense -> (-1, -1)],
[10/25/2021-12:18:54] [V] [TRT] ModelImporter.cpp:507: Marking dense_1 as output: dense
----- Parsing of ONNX model onnx_model.onnx is Done ----
[10/25/2021-12:18:54] [E] [TRT] Repeated layer name: while/split_1 (layers must have distinct names)
[10/25/2021-12:18:54] [E] [TRT] Network validation failed.
[10/25/2021-12:18:54] [E] Engine creation failed
[10/25/2021-12:18:54] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec # /usr/src/tensorrt/bin/trtexec --onnx=onnx_model.onnx --verbose
This is the output from trtexec with verbose
i ran
import sys
import onnx
filename = "onnx_model.onnx"
model = onnx.load(filename)
onnx.checker.check_model(model).
and there was no output i assume its fine but is it?
In addition i have uploaded the .onnx file on the same drive to which the link is provided in my previous post