********************************************** OUTPUT_1 with OSS LIBRARY TRT 7.0.0 ********************************************** &&&& RUNNING TensorRT.trtexec # ./out/trtexec --onnx=/home/Username/Downloads/onnx_models/model_wolstm.onnx --shapes=input_3:1x200x200x3 --verbose [06/23/2020-11:16:38] [I] === Model Options === [06/23/2020-11:16:38] [I] Format: ONNX [06/23/2020-11:16:38] [I] Model: /home/Username/Downloads/onnx_models/model_wolstm.onnx [06/23/2020-11:16:38] [I] Output: [06/23/2020-11:16:38] [I] === Build Options === [06/23/2020-11:16:38] [I] Max batch: explicit [06/23/2020-11:16:38] [I] Workspace: 16 MB [06/23/2020-11:16:38] [I] minTiming: 1 [06/23/2020-11:16:38] [I] avgTiming: 8 [06/23/2020-11:16:38] [I] Precision: FP32 [06/23/2020-11:16:38] [I] Calibration: [06/23/2020-11:16:38] [I] Safe mode: Disabled [06/23/2020-11:16:38] [I] Save engine: [06/23/2020-11:16:38] [I] Load engine: [06/23/2020-11:16:38] [I] Inputs format: fp32:CHW [06/23/2020-11:16:38] [I] Outputs format: fp32:CHW [06/23/2020-11:16:38] [I] Input build shape: input_3=1x200x200x3+1x200x200x3+1x200x200x3 [06/23/2020-11:16:38] [I] === System Options === [06/23/2020-11:16:38] [I] Device: 0 [06/23/2020-11:16:38] [I] DLACore: [06/23/2020-11:16:38] [I] Plugins: [06/23/2020-11:16:38] [I] === Inference Options === [06/23/2020-11:16:38] [I] Batch: Explicit [06/23/2020-11:16:38] [I] Iterations: 10 [06/23/2020-11:16:38] [I] Duration: 3s (+ 200ms warm up) [06/23/2020-11:16:38] [I] Sleep time: 0ms [06/23/2020-11:16:38] [I] Streams: 1 [06/23/2020-11:16:38] [I] ExposeDMA: Disabled [06/23/2020-11:16:38] [I] Spin-wait: Disabled [06/23/2020-11:16:38] [I] Multithreading: Disabled [06/23/2020-11:16:38] [I] CUDA Graph: Disabled [06/23/2020-11:16:38] [I] Skip inference: Disabled [06/23/2020-11:16:38] [I] Inputs: [06/23/2020-11:16:38] [I] === Reporting Options === [06/23/2020-11:16:38] [I] Verbose: Enabled [06/23/2020-11:16:38] [I] Averages: 10 inferences [06/23/2020-11:16:38] [I] Percentile: 99 [06/23/2020-11:16:38] [I] Dump output: Disabled [06/23/2020-11:16:38] [I] Profile: Disabled [06/23/2020-11:16:38] [I] Export timing to JSON file: [06/23/2020-11:16:38] [I] Export output to JSON file: [06/23/2020-11:16:38] [I] Export profile to JSON file: [06/23/2020-11:16:38] [I] [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::GridAnchor_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::NMS_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::Reorg_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::Region_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::PriorBox_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::Normalize_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::RPROI_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::BatchedNMS_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::FlattenConcat_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::CropAndResize [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::Proposal [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::BatchTilePlugin_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::DetectionLayer_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::ProposalLayer_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::PyramidROIAlign_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::ResizeNearest_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::SpecialSlice_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::InstanceNormalization_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::GenerateDetection_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::MultilevelProposeROI_TRT [06/23/2020-11:16:38] [V] [TRT] Plugin creator registration succeeded - ::MultilevelCropAndResize_TRT ---------------------------------------------------------------- Input filename: /home/Username/Downloads/onnx_models/model_wolstm.onnx ONNX IR version: 0.0.5 Opset version: 10 Producer name: tf2onnx Producer version: 1.6.0 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::GridAnchor_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::NMS_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Reorg_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Region_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::PriorBox_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Normalize_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::RPROI_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::BatchedNMS_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::FlattenConcat_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::CropAndResize [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Proposal [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::BatchTilePlugin_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::DetectionLayer_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::ProposalLayer_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::PyramidROIAlign_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::ResizeNearest_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::SpecialSlice_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::InstanceNormalization_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::GenerateDetection_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::MultilevelProposeROI_TRT [06/23/2020-11:16:39] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::MultilevelCropAndResize_TRT [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:203: Adding network input: input_2:0 with dtype: float32, dimensions: (-1, 32, 128, 1) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: input_2:0 for ONNX tensor: input_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here keras_learning_phase:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here trip_count__99 [06/23/2020-11:16:39] [W] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:230: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/23/2020-11:16:39] [W] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:240: One or more weights outside the range of INT32 was clamped [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here new_shape__861 [06/23/2020-11:16:39] [W] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/free:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/axes:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/Reshape_1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/Const_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_9/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_9/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_8/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_8/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_7/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_7/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_13/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_13/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_12/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_12/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_11/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_11/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_10/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_10/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here const_slice__534 [06/23/2020-11:16:39] [W] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here const_slice__386 [06/23/2020-11:16:39] [W] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here const_fold_opt__1001 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/while/strided_slice_3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/while/strided_slice_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/while/strided_slice_1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/while/strided_slice:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/while/add_8/y:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/while/Const_6:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/forward_lstm_2_1/time:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/backward_lstm_2_1/while/strided_slice_3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/backward_lstm_2_1/while/strided_slice_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/backward_lstm_2_1/while/strided_slice_1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/backward_lstm_2_1/while/strided_slice:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_2/backward_lstm_2_1/while/clip_by_value_2/y:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice_3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice_1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/Const_3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice_3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice_1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/clip_by_value/Minimum/y:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_5/moving_variance:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_5/moving_mean:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_5/batchnorm/mul/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_5/batchnorm/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_4/moving_variance:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_4/moving_mean:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_4/batchnorm/mul/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_4/batchnorm/add/y:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_4/batchnorm/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_3/moving_variance:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_3/moving_mean:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_3/gamma:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_3/beta:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_2/moving_variance:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_2/moving_mean:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_2/gamma:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_2/beta:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-3:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-1:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-0:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_7/BiasAdd__279 [Reshape] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: input_2:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: new_shape__861 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_7/BiasAdd__279 [Reshape] inputs: [input_2:0 -> (-1, 32, 128, 1)], [new_shape__861 -> (4)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_7/BiasAdd__279 for ONNX node: conv2d_7/BiasAdd__279 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_7/BiasAdd__279:0 for ONNX tensor: conv2d_7/BiasAdd__279:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_7/BiasAdd__279 [Reshape] outputs: [conv2d_7/BiasAdd__279:0 -> (-1, 1, 32, 128)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_7/BiasAdd [Conv] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_7/BiasAdd__279:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_7/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_7/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_7/BiasAdd [Conv] inputs: [conv2d_7/BiasAdd__279:0 -> (-1, 1, 32, 128)], [conv2d_7/Conv2D/ReadVariableOp:0 -> (64, 1, 3, 3)], [conv2d_7/BiasAdd/ReadVariableOp:0 -> (64)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 1, 32, 128) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 64, 32, 128) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_7/BiasAdd for ONNX node: conv2d_7/BiasAdd [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_7/BiasAdd:0 for ONNX tensor: conv2d_7/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_7/BiasAdd [Conv] outputs: [conv2d_7/BiasAdd:0 -> (-1, 64, 32, 128)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_7/Relu [Relu] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_7/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_7/Relu [Relu] inputs: [conv2d_7/BiasAdd:0 -> (-1, 64, 32, 128)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_7/Relu for ONNX node: conv2d_7/Relu [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_7/Relu:0 for ONNX tensor: conv2d_7/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_7/Relu [Relu] outputs: [conv2d_7/Relu:0 -> (-1, 64, 32, 128)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: max_pooling2d_4/MaxPool [MaxPool] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_7/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: max_pooling2d_4/MaxPool [MaxPool] inputs: [conv2d_7/Relu:0 -> (-1, 64, 32, 128)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: max_pooling2d_4/MaxPool for ONNX node: max_pooling2d_4/MaxPool [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: max_pooling2d_4/MaxPool:0 for ONNX tensor: max_pooling2d_4/MaxPool:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: max_pooling2d_4/MaxPool [MaxPool] outputs: [max_pooling2d_4/MaxPool:0 -> (-1, 64, 16, 64)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_8/BiasAdd [Conv] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: max_pooling2d_4/MaxPool:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_8/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_8/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_8/BiasAdd [Conv] inputs: [max_pooling2d_4/MaxPool:0 -> (-1, 64, 16, 64)], [conv2d_8/Conv2D/ReadVariableOp:0 -> (128, 64, 3, 3)], [conv2d_8/BiasAdd/ReadVariableOp:0 -> (128)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 64, 16, 64) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 128, 16, 64) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_8/BiasAdd for ONNX node: conv2d_8/BiasAdd [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_8/BiasAdd:0 for ONNX tensor: conv2d_8/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_8/BiasAdd [Conv] outputs: [conv2d_8/BiasAdd:0 -> (-1, 128, 16, 64)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_8/Relu [Relu] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_8/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_8/Relu [Relu] inputs: [conv2d_8/BiasAdd:0 -> (-1, 128, 16, 64)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_8/Relu for ONNX node: conv2d_8/Relu [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_8/Relu:0 for ONNX tensor: conv2d_8/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_8/Relu [Relu] outputs: [conv2d_8/Relu:0 -> (-1, 128, 16, 64)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: max_pooling2d_5/MaxPool [MaxPool] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_8/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: max_pooling2d_5/MaxPool [MaxPool] inputs: [conv2d_8/Relu:0 -> (-1, 128, 16, 64)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: max_pooling2d_5/MaxPool for ONNX node: max_pooling2d_5/MaxPool [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: max_pooling2d_5/MaxPool:0 for ONNX tensor: max_pooling2d_5/MaxPool:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: max_pooling2d_5/MaxPool [MaxPool] outputs: [max_pooling2d_5/MaxPool:0 -> (-1, 128, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_9/BiasAdd [Conv] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: max_pooling2d_5/MaxPool:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_9/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_9/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_9/BiasAdd [Conv] inputs: [max_pooling2d_5/MaxPool:0 -> (-1, 128, 8, 32)], [conv2d_9/Conv2D/ReadVariableOp:0 -> (256, 128, 3, 3)], [conv2d_9/BiasAdd/ReadVariableOp:0 -> (256)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 128, 8, 32) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 256, 8, 32) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_9/BiasAdd for ONNX node: conv2d_9/BiasAdd [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_9/BiasAdd:0 for ONNX tensor: conv2d_9/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_9/BiasAdd [Conv] outputs: [conv2d_9/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_9/Relu [Relu] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_9/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_9/Relu [Relu] inputs: [conv2d_9/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_9/Relu for ONNX node: conv2d_9/Relu [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_9/Relu:0 for ONNX tensor: conv2d_9/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_9/Relu [Relu] outputs: [conv2d_9/Relu:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_10/BiasAdd [Conv] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_9/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_10/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_10/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_10/BiasAdd [Conv] inputs: [conv2d_9/Relu:0 -> (-1, 256, 8, 32)], [conv2d_10/Conv2D/ReadVariableOp:0 -> (256, 256, 3, 3)], [conv2d_10/BiasAdd/ReadVariableOp:0 -> (256)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 256, 8, 32) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 256, 8, 32) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_10/BiasAdd for ONNX node: conv2d_10/BiasAdd [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_10/BiasAdd:0 for ONNX tensor: conv2d_10/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_10/BiasAdd [Conv] outputs: [conv2d_10/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_10/Relu [Relu] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_10/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_10/Relu [Relu] inputs: [conv2d_10/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_10/Relu for ONNX node: conv2d_10/Relu [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_10/Relu:0 for ONNX tensor: conv2d_10/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_10/Relu [Relu] outputs: [conv2d_10/Relu:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: max_pooling2d_6/MaxPool [MaxPool] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_10/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: max_pooling2d_6/MaxPool [MaxPool] inputs: [conv2d_10/Relu:0 -> (-1, 256, 8, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: max_pooling2d_6/MaxPool for ONNX node: max_pooling2d_6/MaxPool [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: max_pooling2d_6/MaxPool:0 for ONNX tensor: max_pooling2d_6/MaxPool:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: max_pooling2d_6/MaxPool [MaxPool] outputs: [max_pooling2d_6/MaxPool:0 -> (-1, 256, 4, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_11/BiasAdd [Conv] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: max_pooling2d_6/MaxPool:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_11/Conv2D/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_11/BiasAdd/ReadVariableOp:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_11/BiasAdd [Conv] inputs: [max_pooling2d_6/MaxPool:0 -> (-1, 256, 4, 32)], [conv2d_11/Conv2D/ReadVariableOp:0 -> (512, 256, 3, 3)], [conv2d_11/BiasAdd/ReadVariableOp:0 -> (512)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 256, 4, 32) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 512, 4, 32) [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_11/BiasAdd for ONNX node: conv2d_11/BiasAdd [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_11/BiasAdd:0 for ONNX tensor: conv2d_11/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_11/BiasAdd [Conv] outputs: [conv2d_11/BiasAdd:0 -> (-1, 512, 4, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_11/Relu [Relu] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_11/BiasAdd:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_11/Relu [Relu] inputs: [conv2d_11/BiasAdd:0 -> (-1, 512, 4, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_11/Relu for ONNX node: conv2d_11/Relu [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_11/Relu:0 for ONNX tensor: conv2d_11/Relu:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_11/Relu [Relu] outputs: [conv2d_11/Relu:0 -> (-1, 512, 4, 32)], [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: batch_normalization_2/cond_If__117 [If] [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: keras_learning_phase:0 [06/23/2020-11:16:39] [V] [TRT] /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: batch_normalization_2/cond_If__117 [If] inputs: [keras_learning_phase:0 -> ()], While parsing node number 14 [If -> "batch_normalization_2/cond/Merge:0"]: --- Begin node --- input: "keras_learning_phase:0" output: "batch_normalization_2/cond/Merge:0" name: "batch_normalization_2/cond_If__117" op_type: "If" attribute { name: "then_branch" g { node { input: "conv2d_11/Relu:0" input: "batch_normalization_2/gamma:0" input: "batch_normalization_2/beta:0" input: "batch_normalization_2/cond/FusedBatchNormV3__315" input: "batch_normalization_2/cond/FusedBatchNormV3__316" output: "batch_normalization_2/cond/FusedBatchNormV3:0" name: "batch_normalization_2/cond/FusedBatchNormV3" op_type: "BatchNormalization" attribute { name: "epsilon" f: 0.001 type: FLOAT } domain: "" } node { input: "batch_normalization_2/cond/FusedBatchNormV3:0" output: "sub_graph_ending_node_Identity__118:0" name: "batch_normalization_2/cond/FusedBatchNormV3__313" op_type: "Transpose" attribute { name: "perm" ints: 0 ints: 2 ints: 3 ints: 1 type: INTS } } name: "tf2onnx" initializer { dims: 512 data_type: 1 name: "batch_normalization_2/cond/FusedBatchNormV3__316" raw_data: "..." } initializer { dims: 512 data_type: 1 name: "batch_normalization_2/cond/FusedBatchNormV3__315" raw_data: "..." } doc_string: "graph for batch_normalization_2/cond_If__117 then_branch" output { name: "sub_graph_ending_node_Identity__118:0" type { tensor_type { elem_type: 1 shape { dim { dim_param: "unk__2411" } dim { dim_param: "unk__2412" } dim { dim_param: "unk__2413" } dim { dim_param: "unk__2414" } } } } } } type: GRAPH } attribute { name: "else_branch" g { node { input: "conv2d_11/Relu:0" input: "batch_normalization_2/gamma:0" input: "batch_normalization_2/beta:0" input: "batch_normalization_2/moving_mean:0" input: "batch_normalization_2/moving_variance:0" output: "batch_normalization_2/cond/FusedBatchNormV3_1:0" name: "batch_normalization_2/cond/FusedBatchNormV3_1" op_type: "BatchNormalization" attribute { name: "epsilon" f: 0.001 type: FLOAT } domain: "" } node { input: "batch_normalization_2/cond/FusedBatchNormV3_1:0" output: "sub_graph_ending_node_Identity__119:0" name: "batch_normalization_2/cond/FusedBatchNormV3_1__319" op_type: "Transpose" attribute { name: "perm" ints: 0 ints: 2 ints: 3 ints: 1 type: INTS } } name: "tf2onnx" doc_string: "graph for batch_normalization_2/cond_If__117 else_branch" output { name: "sub_graph_ending_node_Identity__119:0" type { tensor_type { elem_type: 1 shape { dim { dim_param: "unk__2415" } dim { dim_param: "unk__2416" } dim { dim_param: "unk__2417" } dim { dim_param: "unk__2418" } } } } } } type: GRAPH } domain: "" --- End node --- ERROR: /home/Username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:134 In function parseGraph: [8] No importer registered for op: really ?If [06/23/2020-11:16:39] [E] Failed to parse onnx file [06/23/2020-11:16:39] [E] Parsing model failed [06/23/2020-11:16:39] [E] Engine creation failed [06/23/2020-11:16:39] [E] Engine set up failed &&&& FAILED TensorRT.trtexec # ./out/trtexec --onnx=/home/Username/Downloads/onnx_models/model_wolstm.onnx --shapes=input_3:1x200x200x3 --verbose ********************************************** OUTPUT_2 with TRT 7.1.0 ********************************************** [06/23/2020-11:17:51] [I] === Model Options === [06/23/2020-11:17:51] [I] Format: ONNX [06/23/2020-11:17:51] [I] Model: /home/Username/Downloads/onnx_models/model_wolstm.onnx [06/23/2020-11:17:51] [I] Output: [06/23/2020-11:17:51] [I] === Build Options === [06/23/2020-11:17:51] [I] Max batch: explicit [06/23/2020-11:17:51] [I] Workspace: 16 MB [06/23/2020-11:17:51] [I] minTiming: 1 [06/23/2020-11:17:51] [I] avgTiming: 8 [06/23/2020-11:17:51] [I] Precision: FP32 [06/23/2020-11:17:51] [I] Calibration: [06/23/2020-11:17:51] [I] Safe mode: Disabled [06/23/2020-11:17:51] [I] Save engine: [06/23/2020-11:17:51] [I] Load engine: [06/23/2020-11:17:51] [I] Inputs format: fp32:CHW [06/23/2020-11:17:51] [I] Outputs format: fp32:CHW [06/23/2020-11:17:51] [I] Input build shape: input_3=1x200x200x3+1x200x200x3+1x200x200x3 [06/23/2020-11:17:51] [I] === System Options === [06/23/2020-11:17:51] [I] Device: 0 [06/23/2020-11:17:51] [I] DLACore: [06/23/2020-11:17:51] [I] Plugins: [06/23/2020-11:17:51] [I] === Inference Options === [06/23/2020-11:17:51] [I] Batch: Explicit [06/23/2020-11:17:51] [I] Iterations: 10 [06/23/2020-11:17:51] [I] Duration: 3s (+ 200ms warm up) [06/23/2020-11:17:51] [I] Sleep time: 0ms [06/23/2020-11:17:51] [I] Streams: 1 [06/23/2020-11:17:51] [I] ExposeDMA: Disabled [06/23/2020-11:17:51] [I] Spin-wait: Disabled [06/23/2020-11:17:51] [I] Multithreading: Disabled [06/23/2020-11:17:51] [I] CUDA Graph: Disabled [06/23/2020-11:17:51] [I] Skip inference: Disabled [06/23/2020-11:17:51] [I] Inputs: [06/23/2020-11:17:51] [I] === Reporting Options === [06/23/2020-11:17:51] [I] Verbose: Enabled [06/23/2020-11:17:51] [I] Averages: 10 inferences [06/23/2020-11:17:51] [I] Percentile: 99 [06/23/2020-11:17:51] [I] Dump output: Disabled [06/23/2020-11:17:51] [I] Profile: Disabled [06/23/2020-11:17:51] [I] Export timing to JSON file: [06/23/2020-11:17:51] [I] Export output to JSON file: [06/23/2020-11:17:51] [I] Export profile to JSON file: [06/23/2020-11:17:51] [I] [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::GridAnchor_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::NMS_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::Reorg_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::Region_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::PriorBox_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::Normalize_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::RPROI_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::BatchedNMS_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::FlattenConcat_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::CropAndResize [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::Proposal [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::BatchTilePlugin_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::DetectionLayer_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::ProposalLayer_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::PyramidROIAlign_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::ResizeNearest_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::SpecialSlice_TRT [06/23/2020-11:17:51] [V] [TRT] Plugin creator registration succeeded - ::InstanceNormalization_TRT ---------------------------------------------------------------- Input filename: /home/Username/Downloads/onnx_models/model_wolstm.onnx ONNX IR version: 0.0.5 Opset version: 10 Producer name: tf2onnx Producer version: 1.6.0 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::NMS_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::Reorg_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::Region_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::Normalize_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::RPROI_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::CropAndResize [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::Proposal [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT [06/23/2020-11:17:53] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:205: Adding network input: input_2:0 with dtype: float32, dimensions: (-1, 32, 128, 1) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: input_2:0 for ONNX tensor: input_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: trip_count__99 [06/23/2020-11:17:53] [W] [TRT] onnx2trt_utils.cpp:217: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/23/2020-11:17:53] [V] [TRT] onnx2trt_utils.cpp:233: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/23/2020-11:17:53] [W] [TRT] onnx2trt_utils.cpp:243: One or more weights outside the range of INT32 was clamped [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: new_shape__861 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: dense/Tensordot/free:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: dense/Tensordot/axes:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: dense/Tensordot/Reshape_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: dense/Tensordot/Const_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: dense/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_9/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_9/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_8/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_8/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_7/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_7/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_13/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_13/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_12/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_12/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_11/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_11/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_10/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: conv2d_10/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_slice__534 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: const_fold_opt__1001 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/while/strided_slice_3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/while/strided_slice_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/while/strided_slice_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/while/strided_slice:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/while/add_8/y:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/while/Const_6:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/forward_lstm_2_1/time:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/backward_lstm_2_1/while/strided_slice_3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/backward_lstm_2_1/while/strided_slice_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/backward_lstm_2_1/while/strided_slice_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/backward_lstm_2_1/while/strided_slice:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_2/backward_lstm_2_1/while/clip_by_value_2/y:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/forward_lstm_1_1/while/strided_slice_3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/forward_lstm_1_1/while/strided_slice_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/forward_lstm_1_1/while/strided_slice_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/forward_lstm_1_1/while/strided_slice:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/forward_lstm_1_1/while/Const_3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/backward_lstm_1_1/while/strided_slice_3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/backward_lstm_1_1/while/strided_slice_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/backward_lstm_1_1/while/strided_slice_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/backward_lstm_1_1/while/strided_slice:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: bidirectional_1/backward_lstm_1_1/while/clip_by_value/Minimum/y:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_5/moving_variance:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_5/moving_mean:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_5/batchnorm/mul/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_5/batchnorm/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_4/moving_variance:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_4/moving_mean:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_4/batchnorm/mul/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_4/batchnorm/add/y:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_4/batchnorm/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_3/moving_variance:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_3/moving_mean:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_3/gamma:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_3/beta:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_2/moving_variance:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_2/moving_mean:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_2/gamma:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: batch_normalization_2/beta:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split_1-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/forward_lstm_2_1/while/split-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split_1-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_2/backward_lstm_2_1/while/split-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-3:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:90: Importing initializer: ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-0:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_7/BiasAdd__279 [Reshape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: input_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: new_shape__861 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_7/BiasAdd__279 [Reshape] inputs: [input_2:0 -> (-1, 32, 128, 1)], [new_shape__861 -> (4)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_7/BiasAdd__279 for ONNX node: conv2d_7/BiasAdd__279 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_7/BiasAdd__279:0 for ONNX tensor: conv2d_7/BiasAdd__279:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_7/BiasAdd__279 [Reshape] outputs: [conv2d_7/BiasAdd__279:0 -> (-1, 1, 32, 128)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_7/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_7/BiasAdd__279:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_7/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_7/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_7/BiasAdd [Conv] inputs: [conv2d_7/BiasAdd__279:0 -> (-1, 1, 32, 128)], [conv2d_7/Conv2D/ReadVariableOp:0 -> (64, 1, 3, 3)], [conv2d_7/BiasAdd/ReadVariableOp:0 -> (64)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 1, 32, 128) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 64, 32, 128) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_7/BiasAdd for ONNX node: conv2d_7/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_7/BiasAdd:0 for ONNX tensor: conv2d_7/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_7/BiasAdd [Conv] outputs: [conv2d_7/BiasAdd:0 -> (-1, 64, 32, 128)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_7/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_7/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_7/Relu [Relu] inputs: [conv2d_7/BiasAdd:0 -> (-1, 64, 32, 128)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_7/Relu for ONNX node: conv2d_7/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_7/Relu:0 for ONNX tensor: conv2d_7/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_7/Relu [Relu] outputs: [conv2d_7/Relu:0 -> (-1, 64, 32, 128)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: max_pooling2d_4/MaxPool [MaxPool] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_7/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: max_pooling2d_4/MaxPool [MaxPool] inputs: [conv2d_7/Relu:0 -> (-1, 64, 32, 128)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: max_pooling2d_4/MaxPool for ONNX node: max_pooling2d_4/MaxPool [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: max_pooling2d_4/MaxPool:0 for ONNX tensor: max_pooling2d_4/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: max_pooling2d_4/MaxPool [MaxPool] outputs: [max_pooling2d_4/MaxPool:0 -> (-1, 64, 16, 64)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_8/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: max_pooling2d_4/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_8/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_8/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_8/BiasAdd [Conv] inputs: [max_pooling2d_4/MaxPool:0 -> (-1, 64, 16, 64)], [conv2d_8/Conv2D/ReadVariableOp:0 -> (128, 64, 3, 3)], [conv2d_8/BiasAdd/ReadVariableOp:0 -> (128)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 64, 16, 64) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 128, 16, 64) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_8/BiasAdd for ONNX node: conv2d_8/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_8/BiasAdd:0 for ONNX tensor: conv2d_8/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_8/BiasAdd [Conv] outputs: [conv2d_8/BiasAdd:0 -> (-1, 128, 16, 64)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_8/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_8/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_8/Relu [Relu] inputs: [conv2d_8/BiasAdd:0 -> (-1, 128, 16, 64)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_8/Relu for ONNX node: conv2d_8/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_8/Relu:0 for ONNX tensor: conv2d_8/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_8/Relu [Relu] outputs: [conv2d_8/Relu:0 -> (-1, 128, 16, 64)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: max_pooling2d_5/MaxPool [MaxPool] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_8/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: max_pooling2d_5/MaxPool [MaxPool] inputs: [conv2d_8/Relu:0 -> (-1, 128, 16, 64)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: max_pooling2d_5/MaxPool for ONNX node: max_pooling2d_5/MaxPool [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: max_pooling2d_5/MaxPool:0 for ONNX tensor: max_pooling2d_5/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: max_pooling2d_5/MaxPool [MaxPool] outputs: [max_pooling2d_5/MaxPool:0 -> (-1, 128, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_9/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: max_pooling2d_5/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_9/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_9/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_9/BiasAdd [Conv] inputs: [max_pooling2d_5/MaxPool:0 -> (-1, 128, 8, 32)], [conv2d_9/Conv2D/ReadVariableOp:0 -> (256, 128, 3, 3)], [conv2d_9/BiasAdd/ReadVariableOp:0 -> (256)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 128, 8, 32) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 256, 8, 32) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_9/BiasAdd for ONNX node: conv2d_9/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_9/BiasAdd:0 for ONNX tensor: conv2d_9/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_9/BiasAdd [Conv] outputs: [conv2d_9/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_9/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_9/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_9/Relu [Relu] inputs: [conv2d_9/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_9/Relu for ONNX node: conv2d_9/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_9/Relu:0 for ONNX tensor: conv2d_9/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_9/Relu [Relu] outputs: [conv2d_9/Relu:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_10/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_9/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_10/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_10/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_10/BiasAdd [Conv] inputs: [conv2d_9/Relu:0 -> (-1, 256, 8, 32)], [conv2d_10/Conv2D/ReadVariableOp:0 -> (256, 256, 3, 3)], [conv2d_10/BiasAdd/ReadVariableOp:0 -> (256)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 256, 8, 32) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 256, 8, 32) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_10/BiasAdd for ONNX node: conv2d_10/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_10/BiasAdd:0 for ONNX tensor: conv2d_10/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_10/BiasAdd [Conv] outputs: [conv2d_10/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_10/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_10/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_10/Relu [Relu] inputs: [conv2d_10/BiasAdd:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_10/Relu for ONNX node: conv2d_10/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_10/Relu:0 for ONNX tensor: conv2d_10/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_10/Relu [Relu] outputs: [conv2d_10/Relu:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: max_pooling2d_6/MaxPool [MaxPool] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_10/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: max_pooling2d_6/MaxPool [MaxPool] inputs: [conv2d_10/Relu:0 -> (-1, 256, 8, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: max_pooling2d_6/MaxPool for ONNX node: max_pooling2d_6/MaxPool [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: max_pooling2d_6/MaxPool:0 for ONNX tensor: max_pooling2d_6/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: max_pooling2d_6/MaxPool [MaxPool] outputs: [max_pooling2d_6/MaxPool:0 -> (-1, 256, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_11/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: max_pooling2d_6/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_11/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_11/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_11/BiasAdd [Conv] inputs: [max_pooling2d_6/MaxPool:0 -> (-1, 256, 4, 32)], [conv2d_11/Conv2D/ReadVariableOp:0 -> (512, 256, 3, 3)], [conv2d_11/BiasAdd/ReadVariableOp:0 -> (512)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 256, 4, 32) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 512, 4, 32) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_11/BiasAdd for ONNX node: conv2d_11/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_11/BiasAdd:0 for ONNX tensor: conv2d_11/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_11/BiasAdd [Conv] outputs: [conv2d_11/BiasAdd:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_11/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_11/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_11/Relu [Relu] inputs: [conv2d_11/BiasAdd:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_11/Relu for ONNX node: conv2d_11/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_11/Relu:0 for ONNX tensor: conv2d_11/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_11/Relu [Relu] outputs: [conv2d_11/Relu:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: batch_normalization_2/cond_If__117 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: batch_normalization_2/cond_If__117 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: batch_normalization_2/cond/FusedBatchNormV3_1 [BatchNormalization] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_11/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_2/gamma:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_2/beta:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_2/moving_mean:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_2/moving_variance:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: batch_normalization_2/cond/FusedBatchNormV3_1 [BatchNormalization] inputs: [conv2d_11/Relu:0 -> (-1, 512, 4, 32)], [batch_normalization_2/gamma:0 -> (512)], [batch_normalization_2/beta:0 -> (512)], [batch_normalization_2/moving_mean:0 -> (512)], [batch_normalization_2/moving_variance:0 -> (512)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: batch_normalization_2/cond/FusedBatchNormV3_1 for ONNX node: batch_normalization_2/cond/FusedBatchNormV3_1 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: batch_normalization_2/cond/FusedBatchNormV3_1:0 for ONNX tensor: batch_normalization_2/cond/FusedBatchNormV3_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: batch_normalization_2/cond/FusedBatchNormV3_1 [BatchNormalization] outputs: [batch_normalization_2/cond/FusedBatchNormV3_1:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: batch_normalization_2/cond/FusedBatchNormV3_1__319 [Transpose] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_2/cond/FusedBatchNormV3_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: batch_normalization_2/cond/FusedBatchNormV3_1__319 [Transpose] inputs: [batch_normalization_2/cond/FusedBatchNormV3_1:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: batch_normalization_2/cond/FusedBatchNormV3_1__319 for ONNX node: batch_normalization_2/cond/FusedBatchNormV3_1__319 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__119:0 for ONNX tensor: sub_graph_ending_node_Identity__119:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: batch_normalization_2/cond/FusedBatchNormV3_1__319 [Transpose] outputs: [sub_graph_ending_node_Identity__119:0 -> (-1, 4, 32, 512)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: batch_normalization_2/cond_If__117 for ONNX node: batch_normalization_2/cond_If__117 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: batch_normalization_2/cond/Merge:0 for ONNX tensor: batch_normalization_2/cond/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: batch_normalization_2/cond_If__117 [If] outputs: [batch_normalization_2/cond/Merge:0 -> (-1, 4, 32, 512)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_12/BiasAdd__321 [Transpose] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_2/cond/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_12/BiasAdd__321 [Transpose] inputs: [batch_normalization_2/cond/Merge:0 -> (-1, 4, 32, 512)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_12/BiasAdd__321 for ONNX node: conv2d_12/BiasAdd__321 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_12/BiasAdd__321:0 for ONNX tensor: conv2d_12/BiasAdd__321:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_12/BiasAdd__321 [Transpose] outputs: [conv2d_12/BiasAdd__321:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_12/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_12/BiasAdd__321:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_12/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_12/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_12/BiasAdd [Conv] inputs: [conv2d_12/BiasAdd__321:0 -> (-1, 512, 4, 32)], [conv2d_12/Conv2D/ReadVariableOp:0 -> (512, 512, 3, 3)], [conv2d_12/BiasAdd/ReadVariableOp:0 -> (512)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 512, 4, 32) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (3, 3), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 512, 4, 32) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_12/BiasAdd for ONNX node: conv2d_12/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_12/BiasAdd:0 for ONNX tensor: conv2d_12/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_12/BiasAdd [Conv] outputs: [conv2d_12/BiasAdd:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_12/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_12/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_12/Relu [Relu] inputs: [conv2d_12/BiasAdd:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_12/Relu for ONNX node: conv2d_12/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_12/Relu:0 for ONNX tensor: conv2d_12/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_12/Relu [Relu] outputs: [conv2d_12/Relu:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: batch_normalization_3/cond_If__136 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: batch_normalization_3/cond_If__136 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: batch_normalization_3/cond/FusedBatchNormV3_1 [BatchNormalization] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_12/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_3/gamma:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_3/beta:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_3/moving_mean:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_3/moving_variance:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: batch_normalization_3/cond/FusedBatchNormV3_1 [BatchNormalization] inputs: [conv2d_12/Relu:0 -> (-1, 512, 4, 32)], [batch_normalization_3/gamma:0 -> (512)], [batch_normalization_3/beta:0 -> (512)], [batch_normalization_3/moving_mean:0 -> (512)], [batch_normalization_3/moving_variance:0 -> (512)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: batch_normalization_3/cond/FusedBatchNormV3_1 for ONNX node: batch_normalization_3/cond/FusedBatchNormV3_1 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: batch_normalization_3/cond/FusedBatchNormV3_1:0 for ONNX tensor: batch_normalization_3/cond/FusedBatchNormV3_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: batch_normalization_3/cond/FusedBatchNormV3_1 [BatchNormalization] outputs: [batch_normalization_3/cond/FusedBatchNormV3_1:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: batch_normalization_3/cond/FusedBatchNormV3_1__336 [Transpose] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_3/cond/FusedBatchNormV3_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: batch_normalization_3/cond/FusedBatchNormV3_1__336 [Transpose] inputs: [batch_normalization_3/cond/FusedBatchNormV3_1:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: batch_normalization_3/cond/FusedBatchNormV3_1__336 for ONNX node: batch_normalization_3/cond/FusedBatchNormV3_1__336 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__138:0 for ONNX tensor: sub_graph_ending_node_Identity__138:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: batch_normalization_3/cond/FusedBatchNormV3_1__336 [Transpose] outputs: [sub_graph_ending_node_Identity__138:0 -> (-1, 4, 32, 512)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: batch_normalization_3/cond_If__136 for ONNX node: batch_normalization_3/cond_If__136 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: batch_normalization_3/cond/Merge:0 for ONNX tensor: batch_normalization_3/cond/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: batch_normalization_3/cond_If__136 [If] outputs: [batch_normalization_3/cond/Merge:0 -> (-1, 4, 32, 512)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: max_pooling2d_7/MaxPool__338 [Transpose] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: batch_normalization_3/cond/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: max_pooling2d_7/MaxPool__338 [Transpose] inputs: [batch_normalization_3/cond/Merge:0 -> (-1, 4, 32, 512)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: max_pooling2d_7/MaxPool__338 for ONNX node: max_pooling2d_7/MaxPool__338 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: max_pooling2d_7/MaxPool__338:0 for ONNX tensor: max_pooling2d_7/MaxPool__338:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: max_pooling2d_7/MaxPool__338 [Transpose] outputs: [max_pooling2d_7/MaxPool__338:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: max_pooling2d_7/MaxPool [MaxPool] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: max_pooling2d_7/MaxPool__338:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: max_pooling2d_7/MaxPool [MaxPool] inputs: [max_pooling2d_7/MaxPool__338:0 -> (-1, 512, 4, 32)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: max_pooling2d_7/MaxPool for ONNX node: max_pooling2d_7/MaxPool [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: max_pooling2d_7/MaxPool:0 for ONNX tensor: max_pooling2d_7/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: max_pooling2d_7/MaxPool [MaxPool] outputs: [max_pooling2d_7/MaxPool:0 -> (-1, 512, 2, 32)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_13/BiasAdd [Conv] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: max_pooling2d_7/MaxPool:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_13/Conv2D/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_13/BiasAdd/ReadVariableOp:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_13/BiasAdd [Conv] inputs: [max_pooling2d_7/MaxPool:0 -> (-1, 512, 2, 32)], [conv2d_13/Conv2D/ReadVariableOp:0 -> (512, 512, 2, 2)], [conv2d_13/BiasAdd/ReadVariableOp:0 -> (512)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:446: Convolution input dimensions: (-1, 512, 2, 32) [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:528: Using kernel: (2, 2), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:529: Convolution output dimensions: (-1, 512, 1, 31) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_13/BiasAdd for ONNX node: conv2d_13/BiasAdd [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_13/BiasAdd:0 for ONNX tensor: conv2d_13/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_13/BiasAdd [Conv] outputs: [conv2d_13/BiasAdd:0 -> (-1, 512, 1, 31)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_13/Relu [Relu] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_13/BiasAdd:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_13/Relu [Relu] inputs: [conv2d_13/BiasAdd:0 -> (-1, 512, 1, 31)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_13/Relu for ONNX node: conv2d_13/Relu [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_13/Relu:0 for ONNX tensor: conv2d_13/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_13/Relu [Relu] outputs: [conv2d_13/Relu:0 -> (-1, 512, 1, 31)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: lambda_2/Squeeze [Squeeze] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_13/Relu:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: lambda_2/Squeeze [Squeeze] inputs: [conv2d_13/Relu:0 -> (-1, 512, 1, 31)], [06/23/2020-11:17:53] [V] [TRT] onnx2trt_utils.cpp:1430: Original shape: (_, 512, 1, 31), squeezing to: (_, _, _) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: lambda_2/Squeeze for ONNX node: lambda_2/Squeeze [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: lambda_2/Squeeze:0 for ONNX tensor: lambda_2/Squeeze:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: lambda_2/Squeeze [Squeeze] outputs: [lambda_2/Squeeze:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: conv2d_13/BiasAdd__347 [Transpose] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: lambda_2/Squeeze:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: conv2d_13/BiasAdd__347 [Transpose] inputs: [lambda_2/Squeeze:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: conv2d_13/BiasAdd__347 for ONNX node: conv2d_13/BiasAdd__347 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: conv2d_13/BiasAdd__347:0 for ONNX tensor: conv2d_13/BiasAdd__347:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: conv2d_13/BiasAdd__347 [Transpose] outputs: [conv2d_13/BiasAdd__347:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/transpose [Transpose] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_13/BiasAdd__347:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/transpose [Transpose] inputs: [conv2d_13/BiasAdd__347:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/transpose for ONNX node: bidirectional_1/forward_lstm_1_1/transpose [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/transpose:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/transpose:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/transpose [Transpose] outputs: [bidirectional_1/forward_lstm_1_1/transpose:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/strided_slice_2 [Slice] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/transpose:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__534 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/strided_slice_2 [Slice] inputs: [bidirectional_1/forward_lstm_1_1/transpose:0 -> (-1, -1, -1)], [const_slice__386 -> (1)], [const_slice__534 -> (1)], [const_slice__386 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/strided_slice_2 for ONNX node: bidirectional_1/backward_lstm_1_1/strided_slice_2 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/strided_slice_2:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/strided_slice_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/strided_slice_2 [Slice] outputs: [bidirectional_1/backward_lstm_1_1/strided_slice_2:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/strided_slice_2__352 [Squeeze] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/strided_slice_2:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/strided_slice_2__352 [Squeeze] inputs: [bidirectional_1/backward_lstm_1_1/strided_slice_2:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] onnx2trt_utils.cpp:1430: Original shape: (_, _, _), squeezing to: (_, _) [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/strided_slice_2__352 for ONNX node: bidirectional_1/forward_lstm_1_1/strided_slice_2__352 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/strided_slice_2__352:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/strided_slice_2__352:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/strided_slice_2__352 [Squeeze] outputs: [bidirectional_1/forward_lstm_1_1/strided_slice_2__352:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/ones_like/Shape [Shape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/strided_slice_2__352:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/ones_like/Shape [Shape] inputs: [bidirectional_1/forward_lstm_1_1/strided_slice_2__352:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/ones_like/Shape for ONNX node: bidirectional_1/backward_lstm_1_1/ones_like/Shape [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/ones_like/Shape:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/ones_like/Shape:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/ones_like/Shape [Shape] outputs: [bidirectional_1/backward_lstm_1_1/ones_like/Shape:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401 [Cast] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/ones_like/Shape:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401 [Cast] inputs: [bidirectional_1/backward_lstm_1_1/ones_like/Shape:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:318: Casting to type: int32 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401 for ONNX node: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401 [Cast] outputs: [bidirectional_1/backward_lstm_1_1/ones_like/Shape__401:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/ones_like__355 [Cast] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/ones_like/Shape__401:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/ones_like__355 [Cast] inputs: [bidirectional_1/backward_lstm_1_1/ones_like/Shape__401:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:318: Casting to type: int32 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/ones_like__355 for ONNX node: bidirectional_1/forward_lstm_1_1/ones_like__355 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/ones_like__355:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/ones_like__355:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/ones_like__355 [Cast] outputs: [bidirectional_1/forward_lstm_1_1/ones_like__355:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/ones_like [ConstantOfShape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like__355:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/ones_like [ConstantOfShape] inputs: [bidirectional_1/forward_lstm_1_1/ones_like__355:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/ones_like for ONNX node: bidirectional_1/forward_lstm_1_1/ones_like [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/ones_like:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/ones_like [ConstantOfShape] outputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_If__164 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_If__164 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: sub_graph_ending_node_Identity__166 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: sub_graph_ending_node_Identity__166 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: sub_graph_ending_node_Identity__166 for ONNX node: sub_graph_ending_node_Identity__166 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__166:0 for ONNX tensor: sub_graph_ending_node_Identity__166:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: sub_graph_ending_node_Identity__166 [Identity] outputs: [sub_graph_ending_node_Identity__166:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_If__164 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_If__164 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/cond/Merge:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/cond/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_If__164 [If] outputs: [bidirectional_1/forward_lstm_1_1/cond/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_3_If__143 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_3_If__143 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_3_Identity__139 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_3_Identity__139 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_3_Identity__139 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_3_Identity__139 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__145:0 for ONNX tensor: sub_graph_ending_node_Identity__145:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_3_Identity__139 [Identity] outputs: [sub_graph_ending_node_Identity__145:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_3_If__143 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_3_If__143 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/cond_3/Merge:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/cond_3/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_3_If__143 [If] outputs: [bidirectional_1/forward_lstm_1_1/cond_3/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_2_If__150 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_2_If__150 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_2_Identity__146 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_2_Identity__146 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_2_Identity__146 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_2_Identity__146 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__152:0 for ONNX tensor: sub_graph_ending_node_Identity__152:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_2_Identity__146 [Identity] outputs: [sub_graph_ending_node_Identity__152:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_2_If__150 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_2_If__150 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/cond_2/Merge:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/cond_2/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_2_If__150 [If] outputs: [bidirectional_1/forward_lstm_1_1/cond_2/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_1_If__157 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_1_If__157 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/cond_1_Identity__153 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/cond_1_Identity__153 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_1_Identity__153 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_1_Identity__153 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__159:0 for ONNX tensor: sub_graph_ending_node_Identity__159:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_1_Identity__153 [Identity] outputs: [sub_graph_ending_node_Identity__159:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/cond_1_If__157 for ONNX node: bidirectional_1/forward_lstm_1_1/cond_1_If__157 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/cond_1/Merge:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/cond_1/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/cond_1_If__157 [If] outputs: [bidirectional_1/forward_lstm_1_1/cond_1/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_If__192 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_If__192 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_Identity__188 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_Identity__188 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_Identity__188 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_Identity__188 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__194:0 for ONNX tensor: sub_graph_ending_node_Identity__194:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_Identity__188 [Identity] outputs: [sub_graph_ending_node_Identity__194:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_If__192 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_If__192 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/cond/Merge:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/cond/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_If__192 [If] outputs: [bidirectional_1/backward_lstm_1_1/cond/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_3_If__171 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_3_If__171 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_3_Identity__169 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_3_Identity__169 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_3_Identity__169 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_3_Identity__169 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__173:0 for ONNX tensor: sub_graph_ending_node_Identity__173:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_3_Identity__169 [Identity] outputs: [sub_graph_ending_node_Identity__173:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_3_If__171 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_3_If__171 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/cond_3/Merge:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/cond_3/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_3_If__171 [If] outputs: [bidirectional_1/backward_lstm_1_1/cond_3/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_2_If__178 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_2_If__178 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_2_Identity__176 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_2_Identity__176 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_2_Identity__176 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_2_Identity__176 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__180:0 for ONNX tensor: sub_graph_ending_node_Identity__180:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_2_Identity__176 [Identity] outputs: [sub_graph_ending_node_Identity__180:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_2_If__178 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_2_If__178 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/cond_2/Merge:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/cond_2/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_2_If__178 [If] outputs: [bidirectional_1/backward_lstm_1_1/cond_2/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_1_If__185 [If] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: keras_learning_phase:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_1_If__185 [If] inputs: [keras_learning_phase:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/cond_1_Identity__183 [Identity] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/ones_like:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/cond_1_Identity__183 [Identity] inputs: [bidirectional_1/forward_lstm_1_1/ones_like:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_1_Identity__183 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_1_Identity__183 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: sub_graph_ending_node_Identity__187:0 for ONNX tensor: sub_graph_ending_node_Identity__187:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_1_Identity__183 [Identity] outputs: [sub_graph_ending_node_Identity__187:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/cond_1_If__185 for ONNX node: bidirectional_1/backward_lstm_1_1/cond_1_If__185 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/cond_1/Merge:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/cond_1/Merge:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/cond_1_If__185 [If] outputs: [bidirectional_1/backward_lstm_1_1/cond_1/Merge:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/Shape_1 [Shape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/transpose:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/Shape_1 [Shape] inputs: [bidirectional_1/forward_lstm_1_1/transpose:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/Shape_1 for ONNX node: bidirectional_1/backward_lstm_1_1/Shape_1 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/Shape_1:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/Shape_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/Shape_1 [Shape] outputs: [bidirectional_1/backward_lstm_1_1/Shape_1:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/Shape_1__423 [Cast] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/Shape_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/Shape_1__423 [Cast] inputs: [bidirectional_1/backward_lstm_1_1/Shape_1:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:318: Casting to type: int32 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/Shape_1__423 for ONNX node: bidirectional_1/backward_lstm_1_1/Shape_1__423 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/Shape_1__423:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/Shape_1__423:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/Shape_1__423 [Cast] outputs: [bidirectional_1/backward_lstm_1_1/Shape_1__423:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/strided_slice_1 [Slice] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/Shape_1__423:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__534 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/strided_slice_1 [Slice] inputs: [bidirectional_1/backward_lstm_1_1/Shape_1__423:0 -> (3)], [const_slice__386 -> (1)], [const_slice__534 -> (1)], [const_slice__386 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/strided_slice_1 for ONNX node: bidirectional_1/forward_lstm_1_1/strided_slice_1 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/strided_slice_1:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/strided_slice_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/strided_slice_1 [Slice] outputs: [bidirectional_1/forward_lstm_1_1/strided_slice_1:0 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/strided_slice_1__380 [Squeeze] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/strided_slice_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/strided_slice_1__380 [Squeeze] inputs: [bidirectional_1/forward_lstm_1_1/strided_slice_1:0 -> (1)], [06/23/2020-11:17:53] [V] [TRT] onnx2trt_utils.cpp:1430: Original shape: (1,), squeezing to: () [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/strided_slice_1__380 for ONNX node: bidirectional_1/forward_lstm_1_1/strided_slice_1__380 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/strided_slice_1__380:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/strided_slice_1__380:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/strided_slice_1__380 [Squeeze] outputs: [bidirectional_1/forward_lstm_1_1/strided_slice_1__380:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429 [Cast] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/strided_slice_1__380:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429 [Cast] inputs: [bidirectional_1/forward_lstm_1_1/strided_slice_1__380:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:318: Casting to type: float32 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429 for ONNX node: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429:0 for ONNX tensor: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429 [Cast] outputs: [copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: copy__7/bidirectional_1/forward_lstm_1_1/while/Less [Less] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_2/backward_lstm_2_1/while/clip_by_value_2/y:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: copy__7/bidirectional_1/forward_lstm_1_1/while/Less [Less] inputs: [bidirectional_2/backward_lstm_2_1/while/clip_by_value_2/y:0 -> ()], [copy__78/bidirectional_1/backward_lstm_1_1/while/Less__429:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: copy__7/bidirectional_1/forward_lstm_1_1/while/Less for ONNX node: copy__7/bidirectional_1/forward_lstm_1_1/while/Less [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: copy__7/bidirectional_1/forward_lstm_1_1/while/Less:0 for ONNX tensor: copy__7/bidirectional_1/forward_lstm_1_1/while/Less:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: copy__7/bidirectional_1/forward_lstm_1_1/while/Less [Less] outputs: [copy__7/bidirectional_1/forward_lstm_1_1/while/Less:0 -> ()], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434 [Shape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/transpose:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434 [Shape] inputs: [bidirectional_1/forward_lstm_1_1/transpose:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434 for ONNX node: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434 [Shape] outputs: [bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437 [Gather] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437 [Gather] inputs: [bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 -> (3)], [const_slice__386 -> (1)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:978: Using Gather axis: 0 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437 for ONNX node: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437 [Gather] outputs: [bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437:0 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436 [Gather] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__534 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436 [Gather] inputs: [bidirectional_1/backward_lstm_1_1/ReverseV2_Shape__434:0 -> (3)], [const_slice__534 -> (1)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:978: Using Gather axis: 0 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436 for ONNX node: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436 [Gather] outputs: [bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436:0 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/Shape [Shape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: conv2d_13/BiasAdd__347:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/Shape [Shape] inputs: [conv2d_13/BiasAdd__347:0 -> (-1, -1, -1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/Shape for ONNX node: bidirectional_1/forward_lstm_1_1/Shape [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/Shape:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/Shape:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/Shape [Shape] outputs: [bidirectional_1/forward_lstm_1_1/Shape:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/Shape__440 [Cast] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/Shape:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/Shape__440 [Cast] inputs: [bidirectional_1/forward_lstm_1_1/Shape:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:318: Casting to type: int32 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/Shape__440 for ONNX node: bidirectional_1/backward_lstm_1_1/Shape__440 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/Shape__440:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/Shape__440:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/Shape__440 [Cast] outputs: [bidirectional_1/backward_lstm_1_1/Shape__440:0 -> (3)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/strided_slice [Slice] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/Shape__440:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__534 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_slice__386 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/strided_slice [Slice] inputs: [bidirectional_1/backward_lstm_1_1/Shape__440:0 -> (3)], [const_slice__386 -> (1)], [const_slice__534 -> (1)], [const_slice__386 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/strided_slice for ONNX node: bidirectional_1/forward_lstm_1_1/strided_slice [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/strided_slice:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/strided_slice:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/strided_slice [Slice] outputs: [bidirectional_1/forward_lstm_1_1/strided_slice:0 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447 [Concat] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/strided_slice:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: const_fold_opt__1001 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447 [Concat] inputs: [bidirectional_1/forward_lstm_1_1/strided_slice:0 -> (1)], [const_fold_opt__1001 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447 for ONNX node: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447:0 for ONNX tensor: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447 [Concat] outputs: [bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/zeros_1__391 [Cast] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/zeros_1__391 [Cast] inputs: [bidirectional_1/backward_lstm_1_1/zeros_1/packed_Concat__447:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] builtin_op_importers.cpp:318: Casting to type: int32 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/zeros_1__391 for ONNX node: bidirectional_1/forward_lstm_1_1/zeros_1__391 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/zeros_1__391:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/zeros_1__391:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/zeros_1__391 [Cast] outputs: [bidirectional_1/forward_lstm_1_1/zeros_1__391:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/forward_lstm_1_1/zeros_1 [ConstantOfShape] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/zeros_1__391:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/forward_lstm_1_1/zeros_1 [ConstantOfShape] inputs: [bidirectional_1/forward_lstm_1_1/zeros_1__391:0 -> (2)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: bidirectional_1/forward_lstm_1_1/zeros_1 for ONNX node: bidirectional_1/forward_lstm_1_1/zeros_1 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: bidirectional_1/forward_lstm_1_1/zeros_1:0 for ONNX tensor: bidirectional_1/forward_lstm_1_1/zeros_1:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: bidirectional_1/forward_lstm_1_1/zeros_1 [ConstantOfShape] outputs: [bidirectional_1/forward_lstm_1_1/zeros_1:0 -> (-1, -1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: Expand__438 [Expand] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: Expand__438 [Expand] inputs: [bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__437:0 -> (1)], [bidirectional_1/backward_lstm_1_1/ReverseV2_Gather__436:0 -> (1)], [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:122: Registering layer: Expand__438 for ONNX node: Expand__438 [06/23/2020-11:17:53] [V] [TRT] ImporterContext.hpp:97: Registering tensor: Expand__438:0 for ONNX tensor: Expand__438:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:182: Expand__438 [Expand] outputs: [Expand__438:0 -> (-1)], [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:103: Parsing node: bidirectional_1/backward_lstm_1_1/ReverseV2_ReverseSequence__439 [ReverseSequence] [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: bidirectional_1/forward_lstm_1_1/transpose:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:119: Searching for input: Expand__438:0 [06/23/2020-11:17:53] [V] [TRT] ModelImporter.cpp:125: bidirectional_1/backward_lstm_1_1/ReverseV2_ReverseSequence__439 [ReverseSequence] inputs: [bidirectional_1/forward_lstm_1_1/transpose:0 -> (-1, -1, -1)], [Expand__438:0 -> (-1)], [06/23/2020-11:17:53] [W] [TRT] ModelImporter.cpp:135: No importer registered for op: ReverseSequence. Attempting to import as plugin. [06/23/2020-11:17:53] [I] [TRT] builtin_op_importers.cpp:3556: Searching for plugin: ReverseSequence, plugin_version: 001, plugin_namespace: [06/23/2020-11:17:53] [E] [TRT] INVALID_ARGUMENT: getPluginCreator could not find plugin ReverseSequence version 001 ERROR: builtin_op_importers.cpp:3558 In function importFallbackPluginImporter: [8] Assertion failed: creator && "Plugin not found" [06/23/2020-11:17:53] [E] Failed to parse onnx file [06/23/2020-11:17:53] [E] Parsing model failed [06/23/2020-11:17:53] [E] Engine creation failed [06/23/2020-11:17:53] [E] Engine set up failed &&&& FAILED TensorRT.trtexec # ./out/trtexec --onnx=/home/Username/Downloads/onnx_models/model_wolstm.onnx --shapes=input_3:1x200x200x3 --verbose