build git:(master) ✗ LD_LIBRARY_PATH=out ./out/trtexec --onnx=/home/username/Downloads/model_10.onnx --shapes=input_3:1x200x200x3 --verbose &&&& RUNNING TensorRT.trtexec # ./out/trtexec --onnx=/home/username/Downloads/model_10.onnx --shapes=input_3:1x200x200x3 --verbose [06/24/2020-15:03:04] [I] === Model Options === [06/24/2020-15:03:04] [I] Format: ONNX [06/24/2020-15:03:04] [I] Model: /home/username/Downloads/model_10.onnx [06/24/2020-15:03:04] [I] Output: [06/24/2020-15:03:04] [I] === Build Options === [06/24/2020-15:03:04] [I] Max batch: explicit [06/24/2020-15:03:04] [I] Workspace: 16 MB [06/24/2020-15:03:04] [I] minTiming: 1 [06/24/2020-15:03:04] [I] avgTiming: 8 [06/24/2020-15:03:04] [I] Precision: FP32 [06/24/2020-15:03:04] [I] Calibration: [06/24/2020-15:03:04] [I] Safe mode: Disabled [06/24/2020-15:03:04] [I] Save engine: [06/24/2020-15:03:04] [I] Load engine: [06/24/2020-15:03:04] [I] Inputs format: fp32:CHW [06/24/2020-15:03:04] [I] Outputs format: fp32:CHW [06/24/2020-15:03:04] [I] Input build shape: input_3=1x200x200x3+1x200x200x3+1x200x200x3 [06/24/2020-15:03:04] [I] === System Options === [06/24/2020-15:03:04] [I] Device: 0 [06/24/2020-15:03:04] [I] DLACore: [06/24/2020-15:03:04] [I] Plugins: [06/24/2020-15:03:04] [I] === Inference Options === [06/24/2020-15:03:04] [I] Batch: Explicit [06/24/2020-15:03:04] [I] Iterations: 10 [06/24/2020-15:03:04] [I] Duration: 3s (+ 200ms warm up) [06/24/2020-15:03:04] [I] Sleep time: 0ms [06/24/2020-15:03:04] [I] Streams: 1 [06/24/2020-15:03:04] [I] ExposeDMA: Disabled [06/24/2020-15:03:04] [I] Spin-wait: Disabled [06/24/2020-15:03:04] [I] Multithreading: Disabled [06/24/2020-15:03:04] [I] CUDA Graph: Disabled [06/24/2020-15:03:04] [I] Skip inference: Disabled [06/24/2020-15:03:04] [I] Inputs: [06/24/2020-15:03:04] [I] === Reporting Options === [06/24/2020-15:03:04] [I] Verbose: Enabled [06/24/2020-15:03:04] [I] Averages: 10 inferences [06/24/2020-15:03:04] [I] Percentile: 99 [06/24/2020-15:03:04] [I] Dump output: Disabled [06/24/2020-15:03:04] [I] Profile: Disabled [06/24/2020-15:03:04] [I] Export timing to JSON file: [06/24/2020-15:03:04] [I] Export output to JSON file: [06/24/2020-15:03:04] [I] Export profile to JSON file: [06/24/2020-15:03:04] [I] [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::GridAnchor_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::NMS_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::Reorg_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::Region_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::PriorBox_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::Normalize_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::RPROI_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::BatchedNMS_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::FlattenConcat_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::CropAndResize [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::Proposal [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::BatchTilePlugin_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::DetectionLayer_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::ProposalLayer_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::PyramidROIAlign_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::ResizeNearest_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::SpecialSlice_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::InstanceNormalization_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::GenerateDetection_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::MultilevelProposeROI_TRT [06/24/2020-15:03:04] [V] [TRT] Plugin creator registration succeeded - ::MultilevelCropAndResize_TRT ---------------------------------------------------------------- Input filename: /home/username/Downloads/model_10.onnx ONNX IR version: 0.0.5 Opset version: 10 Producer name: tf2onnx Producer version: 1.6.2 Domain: Model version: 0 Doc string: ---------------------------------------------------------------- [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::GridAnchor_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::NMS_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Reorg_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Region_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::PriorBox_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Normalize_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::RPROI_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::BatchedNMS_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::FlattenConcat_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::CropAndResize [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::Proposal [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::BatchTilePlugin_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::DetectionLayer_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::ProposalLayer_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::PyramidROIAlign_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::ResizeNearest_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::SpecialSlice_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::InstanceNormalization_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::GenerateDetection_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::MultilevelProposeROI_TRT [06/24/2020-15:03:06] [V] [TRT] Plugin creator registration succeeded - ONNXTRT_NAMESPACE::MultilevelCropAndResize_TRT [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:203: Adding network input: input_1:0 with dtype: float32, dimensions: (-1, 1, 32, 128) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: input_1:0 for ONNX tensor: input_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here keras_learning_phase:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here trip_count__31 [06/24/2020-15:03:06] [W] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:230: Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [06/24/2020-15:03:06] [W] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:240: One or more weights outside the range of INT32 was clamped [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/free:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/axes:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/Reshape_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/Tensordot/Const_2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here dense/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_6/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_6/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_5/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_5/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_4/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_4/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_3/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_3/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_2/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_2/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_1/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d_1/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here conv2d/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here const_slice__323 [06/24/2020-15:03:06] [W] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here const_fold_opt__912 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here const_1__474 [06/24/2020-15:03:06] [W] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/onnx2trt_utils.cpp:216: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice_3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice_2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/strided_slice:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/Const_3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/while/Const_2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/forward_lstm_1_1/time:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice_3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice_2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional_1/backward_lstm_1_1/while/strided_slice:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/strided_slice_3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/strided_slice_2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/strided_slice_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/strided_slice:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/clip_by_value_1/Minimum/y:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/clip_by_value/y:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/forward_lstm_1/while/add_8/y:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/backward_lstm_1/while/strided_slice_3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/backward_lstm_1/while/strided_slice_2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/backward_lstm_1/while/strided_slice_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here bidirectional/backward_lstm_1/while/strided_slice:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_1/moving_variance:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_1/moving_mean:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_1/gamma:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization_1/beta:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization/moving_variance:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization/moving_mean:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization/gamma:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here batch_normalization/beta:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split_1-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/forward_lstm_1_1/while/split-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split_1-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional_1/backward_lstm_1_1/while/split-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split_1-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split_1-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split_1-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split_1-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/forward_lstm_1/while/split-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split_1-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split_1-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split_1-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split_1-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split-folded-3:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split-folded-2:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split-folded-1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:90: Importing initializer: ?? here ConstantFolding/bidirectional/backward_lstm_1/while/split-folded-0:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d/BiasAdd [Conv] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: input_1:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d/BiasAdd [Conv] inputs: [input_1:0 -> (-1, 1, 32, 128)], [conv2d/Conv2D/ReadVariableOp:0 -> (64, 1, 3, 3)], [conv2d/BiasAdd/ReadVariableOp:0 -> (64)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 1, 32, 128) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 64, 32, 128) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d/BiasAdd for ONNX node: conv2d/BiasAdd [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d/BiasAdd:0 for ONNX tensor: conv2d/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d/BiasAdd [Conv] outputs: [conv2d/BiasAdd:0 -> (-1, 64, 32, 128)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d/Relu [Relu] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d/Relu [Relu] inputs: [conv2d/BiasAdd:0 -> (-1, 64, 32, 128)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d/Relu for ONNX node: conv2d/Relu [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d/Relu:0 for ONNX tensor: conv2d/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d/Relu [Relu] outputs: [conv2d/Relu:0 -> (-1, 64, 32, 128)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: max_pooling2d/MaxPool [MaxPool] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: max_pooling2d/MaxPool [MaxPool] inputs: [conv2d/Relu:0 -> (-1, 64, 32, 128)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: max_pooling2d/MaxPool for ONNX node: max_pooling2d/MaxPool [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: max_pooling2d/MaxPool:0 for ONNX tensor: max_pooling2d/MaxPool:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: max_pooling2d/MaxPool [MaxPool] outputs: [max_pooling2d/MaxPool:0 -> (-1, 64, 16, 64)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_1/BiasAdd [Conv] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: max_pooling2d/MaxPool:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_1/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_1/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_1/BiasAdd [Conv] inputs: [max_pooling2d/MaxPool:0 -> (-1, 64, 16, 64)], [conv2d_1/Conv2D/ReadVariableOp:0 -> (128, 64, 3, 3)], [conv2d_1/BiasAdd/ReadVariableOp:0 -> (128)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 64, 16, 64) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 128, 16, 64) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_1/BiasAdd for ONNX node: conv2d_1/BiasAdd [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_1/BiasAdd:0 for ONNX tensor: conv2d_1/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_1/BiasAdd [Conv] outputs: [conv2d_1/BiasAdd:0 -> (-1, 128, 16, 64)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_1/Relu [Relu] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_1/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_1/Relu [Relu] inputs: [conv2d_1/BiasAdd:0 -> (-1, 128, 16, 64)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_1/Relu for ONNX node: conv2d_1/Relu [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_1/Relu:0 for ONNX tensor: conv2d_1/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_1/Relu [Relu] outputs: [conv2d_1/Relu:0 -> (-1, 128, 16, 64)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: max_pooling2d_1/MaxPool [MaxPool] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_1/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: max_pooling2d_1/MaxPool [MaxPool] inputs: [conv2d_1/Relu:0 -> (-1, 128, 16, 64)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: max_pooling2d_1/MaxPool for ONNX node: max_pooling2d_1/MaxPool [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: max_pooling2d_1/MaxPool:0 for ONNX tensor: max_pooling2d_1/MaxPool:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: max_pooling2d_1/MaxPool [MaxPool] outputs: [max_pooling2d_1/MaxPool:0 -> (-1, 128, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_2/BiasAdd [Conv] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: max_pooling2d_1/MaxPool:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_2/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_2/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_2/BiasAdd [Conv] inputs: [max_pooling2d_1/MaxPool:0 -> (-1, 128, 8, 32)], [conv2d_2/Conv2D/ReadVariableOp:0 -> (256, 128, 3, 3)], [conv2d_2/BiasAdd/ReadVariableOp:0 -> (256)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 128, 8, 32) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 256, 8, 32) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_2/BiasAdd for ONNX node: conv2d_2/BiasAdd [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_2/BiasAdd:0 for ONNX tensor: conv2d_2/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_2/BiasAdd [Conv] outputs: [conv2d_2/BiasAdd:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_2/Relu [Relu] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_2/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_2/Relu [Relu] inputs: [conv2d_2/BiasAdd:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_2/Relu for ONNX node: conv2d_2/Relu [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_2/Relu:0 for ONNX tensor: conv2d_2/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_2/Relu [Relu] outputs: [conv2d_2/Relu:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_3/BiasAdd [Conv] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_2/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_3/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_3/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_3/BiasAdd [Conv] inputs: [conv2d_2/Relu:0 -> (-1, 256, 8, 32)], [conv2d_3/Conv2D/ReadVariableOp:0 -> (256, 256, 3, 3)], [conv2d_3/BiasAdd/ReadVariableOp:0 -> (256)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 256, 8, 32) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 256, 8, 32) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_3/BiasAdd for ONNX node: conv2d_3/BiasAdd [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_3/BiasAdd:0 for ONNX tensor: conv2d_3/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_3/BiasAdd [Conv] outputs: [conv2d_3/BiasAdd:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_3/Relu [Relu] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_3/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_3/Relu [Relu] inputs: [conv2d_3/BiasAdd:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_3/Relu for ONNX node: conv2d_3/Relu [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_3/Relu:0 for ONNX tensor: conv2d_3/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_3/Relu [Relu] outputs: [conv2d_3/Relu:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: max_pooling2d_2/MaxPool [MaxPool] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_3/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: max_pooling2d_2/MaxPool [MaxPool] inputs: [conv2d_3/Relu:0 -> (-1, 256, 8, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: max_pooling2d_2/MaxPool for ONNX node: max_pooling2d_2/MaxPool [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: max_pooling2d_2/MaxPool:0 for ONNX tensor: max_pooling2d_2/MaxPool:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: max_pooling2d_2/MaxPool [MaxPool] outputs: [max_pooling2d_2/MaxPool:0 -> (-1, 256, 4, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_4/BiasAdd [Conv] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: max_pooling2d_2/MaxPool:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_4/Conv2D/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_4/BiasAdd/ReadVariableOp:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_4/BiasAdd [Conv] inputs: [max_pooling2d_2/MaxPool:0 -> (-1, 256, 4, 32)], [conv2d_4/Conv2D/ReadVariableOp:0 -> (512, 256, 3, 3)], [conv2d_4/BiasAdd/ReadVariableOp:0 -> (512)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:523: Convolution input dimensions: (-1, 256, 4, 32) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:605: Using kernel: (3, 3), strides: (1, 1), padding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/builtin_op_importers.cpp:606: Convolution output dimensions: (-1, 512, 4, 32) [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_4/BiasAdd for ONNX node: conv2d_4/BiasAdd [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_4/BiasAdd:0 for ONNX tensor: conv2d_4/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_4/BiasAdd [Conv] outputs: [conv2d_4/BiasAdd:0 -> (-1, 512, 4, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: conv2d_4/Relu [Relu] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: conv2d_4/BiasAdd:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: conv2d_4/Relu [Relu] inputs: [conv2d_4/BiasAdd:0 -> (-1, 512, 4, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:122: Registering layer: conv2d_4/Relu for ONNX node: conv2d_4/Relu [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ImporterContext.hpp:97: Registering tensor: conv2d_4/Relu:0 for ONNX tensor: conv2d_4/Relu:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:180: conv2d_4/Relu [Relu] outputs: [conv2d_4/Relu:0 -> (-1, 512, 4, 32)], [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:107: Parsing node: batch_normalization/cond_If__119 [If] [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:123: Searching for input: keras_learning_phase:0 [06/24/2020-15:03:06] [V] [TRT] /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:129: batch_normalization/cond_If__119 [If] inputs: [keras_learning_phase:0 -> ()], While parsing node number 13 [If -> "batch_normalization/cond/Merge:0"]: --- Begin node --- input: "keras_learning_phase:0" output: "batch_normalization/cond/Merge:0" name: "batch_normalization/cond_If__119" op_type: "If" attribute { name: "then_branch" g { node { input: "conv2d_4/Relu:0" input: "batch_normalization/gamma:0" input: "batch_normalization/beta:0" input: "batch_normalization/cond/FusedBatchNormV3__289" input: "batch_normalization/cond/FusedBatchNormV3__290" output: "batch_normalization/cond/FusedBatchNormV3:0" name: "batch_normalization/cond/FusedBatchNormV3" op_type: "BatchNormalization" attribute { name: "epsilon" f: 0.001 type: FLOAT } domain: "" } node { input: "batch_normalization/cond/FusedBatchNormV3:0" output: "sub_graph_ending_node_Identity__120:0" name: "batch_normalization/cond/FusedBatchNormV3__287" op_type: "Transpose" attribute { name: "perm" ints: 0 ints: 2 ints: 3 ints: 1 type: INTS } } name: "tf2onnx" initializer { dims: 512 data_type: 1 name: "batch_normalization/cond/FusedBatchNormV3__290" raw_data: "..." } initializer { dims: 512 data_type: 1 name: "batch_normalization/cond/FusedBatchNormV3__289" raw_data: "..." } doc_string: "graph for batch_normalization/cond_If__119 then_branch" output { name: "sub_graph_ending_node_Identity__120:0" type { tensor_type { elem_type: 1 shape { dim { dim_param: "unk__2235" } dim { dim_param: "unk__2236" } dim { dim_param: "unk__2237" } dim { dim_param: "unk__2238" } } } } } } type: GRAPH } attribute { name: "else_branch" g { node { input: "conv2d_4/Relu:0" input: "batch_normalization/gamma:0" input: "batch_normalization/beta:0" input: "batch_normalization/moving_mean:0" input: "batch_normalization/moving_variance:0" output: "batch_normalization/cond/FusedBatchNormV3_1:0" name: "batch_normalization/cond/FusedBatchNormV3_1" op_type: "BatchNormalization" attribute { name: "epsilon" f: 0.001 type: FLOAT } domain: "" } node { input: "batch_normalization/cond/FusedBatchNormV3_1:0" output: "sub_graph_ending_node_Identity__121:0" name: "batch_normalization/cond/FusedBatchNormV3_1__293" op_type: "Transpose" attribute { name: "perm" ints: 0 ints: 2 ints: 3 ints: 1 type: INTS } } name: "tf2onnx" doc_string: "graph for batch_normalization/cond_If__119 else_branch" output { name: "sub_graph_ending_node_Identity__121:0" type { tensor_type { elem_type: 1 shape { dim { dim_param: "unk__2239" } dim { dim_param: "unk__2240" } dim { dim_param: "unk__2241" } dim { dim_param: "unk__2242" } } } } } } type: GRAPH } domain: "" --- End node --- ERROR: /home/username/pipline/TRT_OSS/TensorRT/parsers/onnx/ModelImporter.cpp:134 In function parseGraph: [8] No importer registered for op: really ?If [06/24/2020-15:03:06] [E] Failed to parse onnx file [06/24/2020-15:03:06] [E] Parsing model failed [06/24/2020-15:03:06] [E] Engine creation failed [06/24/2020-15:03:06] [E] Engine set up failed &&&& FAILED TensorRT.trtexec # ./out/trtexec --onnx=/home/username/Downloads/model_10.onnx --shapes=input_3:1x200x200x3 --verbose