&&&& RUNNING TensorRT.trtexec # ./trtexec --onnx=/home/darshan/TXTR-TDTR/TXTR-TDTR-merged/Text_recognition_1.8_12.onnx --shapes=input1:10x1x32x100,input2:10x36 --saveEngine=/home/darshan/TR.trt --plugins=/home/darshan/TXTR-TDTR/TXTR-TDTR-merged/onnxparser-trt-plugin-sample-master/libnvinfer_plugin.so.7.1.3 --plugins=/home/darshan/trt-samples-for-hackathon-cn/plugins/scatter_elements.so --plugins=/home/darshan/trt-samples-for-hackathon-cn/plugins/ScatterND.so --verbose [06/17/2021-17:55:04] [I] === Model Options === [06/17/2021-17:55:04] [I] Format: ONNX [06/17/2021-17:55:04] [I] Model: /home/darshan/TXTR-TDTR/TXTR-TDTR-merged/Text_recognition_1.8_12.onnx [06/17/2021-17:55:04] [I] Output: [06/17/2021-17:55:04] [I] === Build Options === [06/17/2021-17:55:04] [I] Max batch: explicit [06/17/2021-17:55:04] [I] Workspace: 16 MB [06/17/2021-17:55:04] [I] minTiming: 1 [06/17/2021-17:55:04] [I] avgTiming: 8 [06/17/2021-17:55:04] [I] Precision: FP32 [06/17/2021-17:55:04] [I] Calibration: [06/17/2021-17:55:04] [I] Safe mode: Disabled [06/17/2021-17:55:04] [I] Save engine: /home/darshan/TR.trt [06/17/2021-17:55:04] [I] Load engine: [06/17/2021-17:55:04] [I] Builder Cache: Enabled [06/17/2021-17:55:04] [I] NVTX verbosity: 0 [06/17/2021-17:55:04] [I] Inputs format: fp32:CHW [06/17/2021-17:55:04] [I] Outputs format: fp32:CHW [06/17/2021-17:55:04] [I] Input build shape: input1=10x1x32x100+10x1x32x100+10x1x32x100 [06/17/2021-17:55:04] [I] Input build shape: input2=10x36+10x36+10x36 [06/17/2021-17:55:04] [I] Input calibration shapes: model [06/17/2021-17:55:04] [I] === System Options === [06/17/2021-17:55:04] [I] Device: 0 [06/17/2021-17:55:04] [I] DLACore: [06/17/2021-17:55:04] [I] Plugins: /home/darshan/trt-samples-for-hackathon-cn/plugins/ScatterND.so /home/darshan/trt-samples-for-hackathon-cn/plugins/scatter_elements.so /home/darshan/TXTR-TDTR/TXTR-TDTR-merged/onnxparser-trt-plugin-sample-master/libnvinfer_plugin.so.7.1.3 [06/17/2021-17:55:04] [I] === Inference Options === [06/17/2021-17:55:04] [I] Batch: Explicit [06/17/2021-17:55:04] [I] Input inference shape: input2=10x36 [06/17/2021-17:55:04] [I] Input inference shape: input1=10x1x32x100 [06/17/2021-17:55:04] [I] Iterations: 10 [06/17/2021-17:55:04] [I] Duration: 3s (+ 200ms warm up) [06/17/2021-17:55:04] [I] Sleep time: 0ms [06/17/2021-17:55:04] [I] Streams: 1 [06/17/2021-17:55:04] [I] ExposeDMA: Disabled [06/17/2021-17:55:04] [I] Spin-wait: Disabled [06/17/2021-17:55:04] [I] Multithreading: Disabled [06/17/2021-17:55:04] [I] CUDA Graph: Disabled [06/17/2021-17:55:04] [I] Skip inference: Disabled [06/17/2021-17:55:04] [I] Inputs: [06/17/2021-17:55:04] [I] === Reporting Options === [06/17/2021-17:55:04] [I] Verbose: Enabled [06/17/2021-17:55:04] [I] Averages: 10 inferences [06/17/2021-17:55:04] [I] Percentile: 99 [06/17/2021-17:55:04] [I] Dump output: Disabled [06/17/2021-17:55:04] [I] Profile: Disabled [06/17/2021-17:55:04] [I] Export timing to JSON file: [06/17/2021-17:55:04] [I] Export output to JSON file: [06/17/2021-17:55:04] [I] Export profile to JSON file: [06/17/2021-17:55:04] [I] [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::Proposal version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::Split version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [06/17/2021-17:55:04] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [06/17/2021-17:55:04] [I] Loading supplied plugin library: /home/darshan/trt-samples-for-hackathon-cn/plugins/ScatterND.so [06/17/2021-17:55:04] [I] Loading supplied plugin library: /home/darshan/trt-samples-for-hackathon-cn/plugins/scatter_elements.so [06/17/2021-17:55:04] [I] Loading supplied plugin library: /home/darshan/TXTR-TDTR/TXTR-TDTR-merged/onnxparser-trt-plugin-sample-master/libnvinfer_plugin.so.7.1.3 [libprotobuf WARNING google/protobuf/io/coded_stream.cc:604] Reading dangerously large protocol message. If the message turns out to be larger than 2147483647 bytes, parsing will be halted for security reasons. To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h. [libprotobuf WARNING google/protobuf/io/coded_stream.cc:81] The total number of bytes read was 748781898 [06/17/2021-17:55:05] [I] [TRT] ---------------------------------------------------------------- [06/17/2021-17:55:05] [I] [TRT] Input filename: /home/darshan/TXTR-TDTR/TXTR-TDTR-merged/Text_recognition_1.8_12.onnx [06/17/2021-17:55:05] [I] [TRT] ONNX IR version: 0.0.6 [06/17/2021-17:55:05] [I] [TRT] Opset version: 12 [06/17/2021-17:55:05] [I] [TRT] Producer name: pytorch [06/17/2021-17:55:05] [I] [TRT] Producer version: 1.8 [06/17/2021-17:55:05] [I] [TRT] Domain: [06/17/2021-17:55:05] [I] [TRT] Model version: 0 [06/17/2021-17:55:05] [I] [TRT] Doc string: [06/17/2021-17:55:05] [I] [TRT] ---------------------------------------------------------------- [libprotobuf WARNING google/protobuf/io/coded_stream.cc:604] Reading dangerously large protocol message. If the message turns out to be larger than 2147483647 bytes, parsing will be halted for security reasons. To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h. [libprotobuf WARNING google/protobuf/io/coded_stream.cc:81] The total number of bytes read was 748781898 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::Split version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [06/17/2021-17:55:06] [V] [TRT] Adding network input: input.1 with dtype: float32, dimensions: (10, 1, 32, 100) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: input.1 for ONNX tensor: input.1 [06/17/2021-17:55:06] [V] [TRT] Adding network input: 1 with dtype: int32, dimensions: (10, 26) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 1 for ONNX tensor: 1 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Transformation.LocalizationNetwork.localization_fc1.0.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Transformation.LocalizationNetwork.localization_fc1.0.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Transformation.LocalizationNetwork.localization_fc2.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Transformation.LocalizationNetwork.localization_fc2.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Transformation.GridGenerator.inv_delta_C [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Transformation.GridGenerator.P_hat [06/17/2021-17:55:06] [V] [TRT] Importing initializer: FeatureExtraction.TextAttentionModule.conv31.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Refiner.iid.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: Refiner.decoder.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block1.selective_decoder.second_attention.generator.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.rnn.weight_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.rnn.bias_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block2.selective_decoder.second_attention.generator.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.rnn.weight_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.rnn.bias_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block3.selective_decoder.second_attention.generator.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.rnn.weight_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.rnn.bias_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block4.selective_decoder.second_attention.generator.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.rnn.weight_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.rnn.bias_ih [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Importing initializer: ctx_block5.selective_decoder.second_attention.generator.bias [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15109 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15110 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15112 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15113 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15115 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15116 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15118 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15119 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15121 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15122 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15124 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15125 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15127 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15128 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15130 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15131 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15133 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15134 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15136 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15137 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15139 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15140 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15142 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15143 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15145 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15146 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15148 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15149 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15151 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15152 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15154 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15155 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15157 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15158 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15160 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15161 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15163 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15164 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15166 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15167 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15169 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15170 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15172 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15173 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15175 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15176 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15178 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15179 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15181 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15182 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15184 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15185 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15187 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15188 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15190 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15191 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15193 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15194 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15196 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15197 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15199 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15200 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15202 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15203 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15205 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15206 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15208 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15209 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15211 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15212 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15214 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15215 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15216 [06/17/2021-17:55:06] [W] [TRT] /home/darshan/onnx-tensorrt/onnx2trt_utils.cpp:228: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15217 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15218 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15219 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15220 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15221 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15222 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15223 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15224 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15225 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15226 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15227 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15228 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15229 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15230 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15231 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15232 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15233 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15234 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15235 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15236 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15237 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15278 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15279 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15280 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15281 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15282 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15283 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15284 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15285 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15326 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15327 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15328 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15329 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15330 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15331 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15332 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15333 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15334 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15336 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15339 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15343 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15344 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15346 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15347 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15348 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15349 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15351 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15352 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15353 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15354 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15356 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15357 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15358 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15359 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15361 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15362 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15363 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15364 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15366 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15367 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15368 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15369 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15371 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15372 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15373 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15374 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15376 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15377 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15378 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15379 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15381 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15382 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15383 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15384 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15386 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15387 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15388 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15389 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15391 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15392 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15393 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15394 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15396 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15397 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15398 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15399 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15401 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15402 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15403 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15404 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15406 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15407 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15408 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15409 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15411 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15412 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15413 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15414 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15416 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15417 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15418 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15419 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15421 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15422 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15423 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15424 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15426 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15427 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15428 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15429 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15431 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15432 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15433 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15434 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15436 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15437 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15438 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15439 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15441 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15442 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15443 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15444 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15446 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15447 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15448 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15449 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15451 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15452 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15453 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15454 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15456 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15457 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15458 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15459 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15461 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15462 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15463 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15464 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15466 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15467 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15468 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15469 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15471 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15472 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15473 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15474 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15475 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15476 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15517 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15518 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15519 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15520 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15521 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15522 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15523 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15524 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15565 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15566 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15567 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15568 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15569 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15570 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15571 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15572 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15573 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15575 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15578 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15582 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15583 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15585 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15586 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15587 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15588 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15590 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15591 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15592 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15593 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15595 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15596 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15597 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15598 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15600 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15601 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15602 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15603 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15605 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15606 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15607 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15608 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15610 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15611 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15612 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15613 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15615 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15616 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15617 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15618 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15620 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15621 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15622 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15623 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15625 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15626 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15627 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15628 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15630 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15631 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15632 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15633 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15635 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15636 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15637 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15638 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15640 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15641 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15642 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15643 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15645 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15646 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15647 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15648 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15650 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15651 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15652 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15653 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15655 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15656 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15657 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15658 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15660 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15661 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15662 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15663 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15665 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15666 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15667 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15668 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15670 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15671 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15672 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15673 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15675 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15676 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15677 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15678 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15680 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15681 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15682 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15683 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15685 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15686 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15687 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15688 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15690 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15691 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15692 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15693 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15695 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15696 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15697 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15698 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15700 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15701 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15702 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15703 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15705 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15706 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15707 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15708 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15710 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15711 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15712 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15713 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15714 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15715 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15756 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15757 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15758 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15759 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15760 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15761 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15762 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15763 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15804 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15805 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15806 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15807 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15808 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15809 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15810 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15811 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15812 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15814 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15817 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15821 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15822 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15824 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15825 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15826 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15827 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15829 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15830 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15831 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15832 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15834 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15835 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15836 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15837 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15839 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15840 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15841 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15842 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15844 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15845 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15846 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15847 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15849 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15850 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15851 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15852 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15854 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15855 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15856 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15857 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15859 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15860 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15861 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15862 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15864 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15865 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15866 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15867 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15869 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15870 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15871 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15872 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15874 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15875 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15876 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15877 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15879 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15880 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15881 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15882 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15884 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15885 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15886 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15887 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15889 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15890 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15891 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15892 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15894 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15895 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15896 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15897 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15899 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15900 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15901 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15902 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15904 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15905 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15906 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15907 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15909 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15910 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15911 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15912 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15914 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15915 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15916 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15917 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15919 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15920 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15921 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15922 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15924 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15925 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15926 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15927 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15929 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15930 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15931 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15932 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15934 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15935 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15936 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15937 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15939 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15940 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15941 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15942 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15944 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15945 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15946 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15947 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15949 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15950 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15951 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15952 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15953 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15954 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15995 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15996 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15997 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15998 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 15999 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16000 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16001 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16002 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16043 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16044 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16045 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16046 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16047 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16048 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16049 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16050 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16051 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16053 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16056 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16060 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16061 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16063 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16064 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16065 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16066 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16068 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16069 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16070 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16071 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16073 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16074 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16075 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16076 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16078 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16079 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16080 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16081 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16083 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16084 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16085 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16086 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16088 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16089 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16090 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16091 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16093 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16094 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16095 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16096 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16098 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16099 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16100 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16101 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16103 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16104 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16105 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16106 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16108 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16109 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16110 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16111 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16113 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16114 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16115 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16116 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16118 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16119 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16120 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16121 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16123 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16124 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16125 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16126 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16128 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16129 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16130 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16131 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16133 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16134 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16135 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16136 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16138 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16139 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16140 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16141 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16143 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16144 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16145 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16146 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16148 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16149 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16150 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16151 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16153 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16154 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16155 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16156 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16158 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16159 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16160 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16161 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16163 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16164 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16165 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16166 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16168 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16169 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16170 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16171 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16173 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16174 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16175 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16176 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16178 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16179 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16180 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16181 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16183 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16184 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16185 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16186 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16188 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16189 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16190 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16191 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16192 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16193 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16234 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16235 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16236 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16237 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16238 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16239 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16240 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16241 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16282 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16283 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16284 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16285 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16286 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16287 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16288 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16289 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16290 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16292 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16295 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16299 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16300 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16302 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16303 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16304 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16305 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16307 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16308 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16309 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16310 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16312 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16313 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16314 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16315 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16317 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16318 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16319 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16320 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16322 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16323 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16324 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16325 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16327 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16328 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16329 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16330 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16332 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16333 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16334 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16335 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16337 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16338 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16339 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16340 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16342 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16343 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16344 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16345 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16347 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16348 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16349 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16350 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16352 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16353 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16354 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16355 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16357 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16358 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16359 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16360 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16362 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16363 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16364 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16365 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16367 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16368 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16369 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16370 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16372 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16373 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16374 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16375 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16377 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16378 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16379 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16380 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16382 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16383 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16384 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16385 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16387 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16388 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16389 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16390 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16392 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16393 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16394 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16395 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16397 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16398 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16399 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16400 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16402 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16403 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16404 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16405 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16407 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16408 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16409 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16410 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16412 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16413 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16414 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16415 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16417 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16418 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16419 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16420 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16422 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16423 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16424 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16425 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16427 [06/17/2021-17:55:06] [V] [TRT] Importing initializer: 16428 [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_0 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: input.1 [06/17/2021-17:55:06] [V] [TRT] Shape_0 [Shape] inputs: [input.1 -> (10, 1, 32, 100)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_0 for ONNX node: Shape_0 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 394 for ONNX tensor: 394 [06/17/2021-17:55:06] [V] [TRT] Shape_0 [Shape] outputs: [394 -> (4)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_1 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_1 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_1 [Constant] outputs: [395 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_2 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 394 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 395 [06/17/2021-17:55:06] [V] [TRT] Gather_2 [Gather] inputs: [394 -> (4)], [395 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 395 for ONNX initializer: 395 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 0 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_2 for ONNX node: Gather_2 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 396 for ONNX tensor: 396 [06/17/2021-17:55:06] [V] [TRT] Gather_2 [Gather] outputs: [396 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_3 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: input.1 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15109 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15110 [06/17/2021-17:55:06] [V] [TRT] Conv_3 [Conv] inputs: [input.1 -> (10, 1, 32, 100)], [15109 -> (64, 1, 3, 3)], [15110 -> (64)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 1, 32, 100) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_3 for ONNX node: Conv_3 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 64, 32, 100) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15108 for ONNX tensor: 15108 [06/17/2021-17:55:06] [V] [TRT] Conv_3 [Conv] outputs: [15108 -> (10, 64, 32, 100)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_4 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15108 [06/17/2021-17:55:06] [V] [TRT] Relu_4 [Relu] inputs: [15108 -> (10, 64, 32, 100)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_4 for ONNX node: Relu_4 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 399 for ONNX tensor: 399 [06/17/2021-17:55:06] [V] [TRT] Relu_4 [Relu] outputs: [399 -> (10, 64, 32, 100)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MaxPool_5 [MaxPool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 399 [06/17/2021-17:55:06] [V] [TRT] MaxPool_5 [MaxPool] inputs: [399 -> (10, 64, 32, 100)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MaxPool_5 for ONNX node: MaxPool_5 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 400 for ONNX tensor: 400 [06/17/2021-17:55:06] [V] [TRT] MaxPool_5 [MaxPool] outputs: [400 -> (10, 64, 16, 50)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_6 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 400 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15112 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15113 [06/17/2021-17:55:06] [V] [TRT] Conv_6 [Conv] inputs: [400 -> (10, 64, 16, 50)], [15112 -> (128, 64, 3, 3)], [15113 -> (128)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 64, 16, 50) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_6 for ONNX node: Conv_6 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 128, 16, 50) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15111 for ONNX tensor: 15111 [06/17/2021-17:55:06] [V] [TRT] Conv_6 [Conv] outputs: [15111 -> (10, 128, 16, 50)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_7 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15111 [06/17/2021-17:55:06] [V] [TRT] Relu_7 [Relu] inputs: [15111 -> (10, 128, 16, 50)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_7 for ONNX node: Relu_7 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403 [06/17/2021-17:55:06] [V] [TRT] Relu_7 [Relu] outputs: [403 -> (10, 128, 16, 50)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MaxPool_8 [MaxPool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 403 [06/17/2021-17:55:06] [V] [TRT] MaxPool_8 [MaxPool] inputs: [403 -> (10, 128, 16, 50)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MaxPool_8 for ONNX node: MaxPool_8 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 404 for ONNX tensor: 404 [06/17/2021-17:55:06] [V] [TRT] MaxPool_8 [MaxPool] outputs: [404 -> (10, 128, 8, 25)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_9 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 404 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15115 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15116 [06/17/2021-17:55:06] [V] [TRT] Conv_9 [Conv] inputs: [404 -> (10, 128, 8, 25)], [15115 -> (256, 128, 3, 3)], [15116 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 128, 8, 25) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_9 for ONNX node: Conv_9 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, 8, 25) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15114 for ONNX tensor: 15114 [06/17/2021-17:55:06] [V] [TRT] Conv_9 [Conv] outputs: [15114 -> (10, 256, 8, 25)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_10 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15114 [06/17/2021-17:55:06] [V] [TRT] Relu_10 [Relu] inputs: [15114 -> (10, 256, 8, 25)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_10 for ONNX node: Relu_10 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 407 for ONNX tensor: 407 [06/17/2021-17:55:06] [V] [TRT] Relu_10 [Relu] outputs: [407 -> (10, 256, 8, 25)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MaxPool_11 [MaxPool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 407 [06/17/2021-17:55:06] [V] [TRT] MaxPool_11 [MaxPool] inputs: [407 -> (10, 256, 8, 25)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MaxPool_11 for ONNX node: MaxPool_11 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 408 for ONNX tensor: 408 [06/17/2021-17:55:06] [V] [TRT] MaxPool_11 [MaxPool] outputs: [408 -> (10, 256, 4, 12)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_12 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 408 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15118 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15119 [06/17/2021-17:55:06] [V] [TRT] Conv_12 [Conv] inputs: [408 -> (10, 256, 4, 12)], [15118 -> (512, 256, 3, 3)], [15119 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, 4, 12) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_12 for ONNX node: Conv_12 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, 4, 12) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15117 for ONNX tensor: 15117 [06/17/2021-17:55:06] [V] [TRT] Conv_12 [Conv] outputs: [15117 -> (10, 512, 4, 12)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_13 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15117 [06/17/2021-17:55:06] [V] [TRT] Relu_13 [Relu] inputs: [15117 -> (10, 512, 4, 12)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_13 for ONNX node: Relu_13 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 411 for ONNX tensor: 411 [06/17/2021-17:55:06] [V] [TRT] Relu_13 [Relu] outputs: [411 -> (10, 512, 4, 12)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: GlobalAveragePool_14 [GlobalAveragePool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 411 [06/17/2021-17:55:06] [V] [TRT] GlobalAveragePool_14 [GlobalAveragePool] inputs: [411 -> (10, 512, 4, 12)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: GlobalAveragePool_14 for ONNX node: GlobalAveragePool_14 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 412 for ONNX tensor: 412 [06/17/2021-17:55:06] [V] [TRT] GlobalAveragePool_14 [GlobalAveragePool] outputs: [412 -> (10, 512, 1, 1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_15 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 396 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_15 [Unsqueeze] inputs: [396 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_15 for ONNX node: Unsqueeze_15 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 414 for ONNX tensor: 414 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_15 [Unsqueeze] outputs: [414 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_16 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 414 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15216 [06/17/2021-17:55:06] [V] [TRT] Concat_16 [Concat] inputs: [414 -> (1)], [15216 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15216 for ONNX initializer: 15216 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_16 for ONNX node: Concat_16 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 416 for ONNX tensor: 416 [06/17/2021-17:55:06] [V] [TRT] Concat_16 [Concat] outputs: [416 -> (2)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_17 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 412 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 416 [06/17/2021-17:55:06] [V] [TRT] Reshape_17 [Reshape] inputs: [412 -> (10, 512, 1, 1)], [416 -> (2)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_17 for ONNX node: Reshape_17 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 417 for ONNX tensor: 417 [06/17/2021-17:55:06] [V] [TRT] Reshape_17 [Reshape] outputs: [417 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gemm_18 [Gemm] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 417 [06/17/2021-17:55:06] [V] [TRT] Searching for input: Transformation.LocalizationNetwork.localization_fc1.0.weight [06/17/2021-17:55:06] [V] [TRT] Searching for input: Transformation.LocalizationNetwork.localization_fc1.0.bias [06/17/2021-17:55:06] [V] [TRT] Gemm_18 [Gemm] inputs: [417 -> (-1, -1)], [Transformation.LocalizationNetwork.localization_fc1.0.weight -> (256, 512)], [Transformation.LocalizationNetwork.localization_fc1.0.bias -> (256)], [06/17/2021-17:55:06] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met. [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gemm_18 for ONNX node: Gemm_18 [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, 256, 1, 1), squeezing to: (_, _) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 418 for ONNX tensor: 418 [06/17/2021-17:55:06] [V] [TRT] Gemm_18 [Gemm] outputs: [418 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_19 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 418 [06/17/2021-17:55:06] [V] [TRT] Relu_19 [Relu] inputs: [418 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_19 for ONNX node: Relu_19 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 419 for ONNX tensor: 419 [06/17/2021-17:55:06] [V] [TRT] Relu_19 [Relu] outputs: [419 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gemm_20 [Gemm] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 419 [06/17/2021-17:55:06] [V] [TRT] Searching for input: Transformation.LocalizationNetwork.localization_fc2.weight [06/17/2021-17:55:06] [V] [TRT] Searching for input: Transformation.LocalizationNetwork.localization_fc2.bias [06/17/2021-17:55:06] [V] [TRT] Gemm_20 [Gemm] inputs: [419 -> (-1, -1)], [Transformation.LocalizationNetwork.localization_fc2.weight -> (40, 256)], [Transformation.LocalizationNetwork.localization_fc2.bias -> (40)], [06/17/2021-17:55:06] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met. [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gemm_20 for ONNX node: Gemm_20 [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, 40, 1, 1), squeezing to: (_, _) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 420 for ONNX tensor: 420 [06/17/2021-17:55:06] [V] [TRT] Gemm_20 [Gemm] outputs: [420 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_21 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 396 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_21 [Unsqueeze] inputs: [396 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_21 for ONNX node: Unsqueeze_21 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 423 for ONNX tensor: 423 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_21 [Unsqueeze] outputs: [423 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_22 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 423 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15217 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15218 [06/17/2021-17:55:06] [V] [TRT] Concat_22 [Concat] inputs: [423 -> (1)], [15217 -> (1)], [15218 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15217 for ONNX initializer: 15217 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15218 for ONNX initializer: 15218 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_22 for ONNX node: Concat_22 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 426 for ONNX tensor: 426 [06/17/2021-17:55:06] [V] [TRT] Concat_22 [Concat] outputs: [426 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_23 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 420 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 426 [06/17/2021-17:55:06] [V] [TRT] Reshape_23 [Reshape] inputs: [420 -> (-1, -1)], [426 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_23 for ONNX node: Reshape_23 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 427 for ONNX tensor: 427 [06/17/2021-17:55:06] [V] [TRT] Reshape_23 [Reshape] outputs: [427 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_24 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 427 [06/17/2021-17:55:06] [V] [TRT] Shape_24 [Shape] inputs: [427 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_24 for ONNX node: Shape_24 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 428 for ONNX tensor: 428 [06/17/2021-17:55:06] [V] [TRT] Shape_24 [Shape] outputs: [428 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_25 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_25 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_25 [Constant] outputs: [429 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_26 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 428 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 429 [06/17/2021-17:55:06] [V] [TRT] Gather_26 [Gather] inputs: [428 -> (3)], [429 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 429 for ONNX initializer: 429 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 0 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_26 for ONNX node: Gather_26 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 430 for ONNX tensor: 430 [06/17/2021-17:55:06] [V] [TRT] Gather_26 [Gather] outputs: [430 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_27 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 430 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_27 [Unsqueeze] inputs: [430 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_27 for ONNX node: Unsqueeze_27 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 433 for ONNX tensor: 433 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_27 [Unsqueeze] outputs: [433 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_28 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 433 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15219 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15220 [06/17/2021-17:55:06] [V] [TRT] Concat_28 [Concat] inputs: [433 -> (1)], [15219 -> (1)], [15220 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15219 for ONNX initializer: 15219 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15220 for ONNX initializer: 15220 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_28 for ONNX node: Concat_28 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 436 for ONNX tensor: 436 [06/17/2021-17:55:06] [V] [TRT] Concat_28 [Concat] outputs: [436 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_29 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 430 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_29 [Unsqueeze] inputs: [430 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_29 for ONNX node: Unsqueeze_29 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 437 for ONNX tensor: 437 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_29 [Unsqueeze] outputs: [437 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_30 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 437 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15221 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15222 [06/17/2021-17:55:06] [V] [TRT] Concat_30 [Concat] inputs: [437 -> (1)], [15221 -> (1)], [15222 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15221 for ONNX initializer: 15221 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15222 for ONNX initializer: 15222 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_30 for ONNX node: Concat_30 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 440 for ONNX tensor: 440 [06/17/2021-17:55:06] [V] [TRT] Concat_30 [Concat] outputs: [440 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_31 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 436 [06/17/2021-17:55:06] [V] [TRT] Shape_31 [Shape] inputs: [436 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_31 for ONNX node: Shape_31 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 441 for ONNX tensor: 441 [06/17/2021-17:55:06] [V] [TRT] Shape_31 [Shape] outputs: [441 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_32 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 441 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_32 [ConstantOfShape] inputs: [441 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_32 for ONNX node: ConstantOfShape_32 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 442 for ONNX tensor: 442 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_32 [ConstantOfShape] outputs: [442 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_33 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: Transformation.GridGenerator.inv_delta_C [06/17/2021-17:55:06] [V] [TRT] Searching for input: 442 [06/17/2021-17:55:06] [V] [TRT] Expand_33 [Expand] inputs: [Transformation.GridGenerator.inv_delta_C -> (23, 23)], [442 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: Transformation.GridGenerator.inv_delta_C for ONNX initializer: Transformation.GridGenerator.inv_delta_C [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_33 for ONNX node: Expand_33 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 443 for ONNX tensor: 443 [06/17/2021-17:55:06] [V] [TRT] Expand_33 [Expand] outputs: [443 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Tile_34 [Tile] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 443 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 440 [06/17/2021-17:55:06] [V] [TRT] Tile_34 [Tile] inputs: [443 -> ()], [440 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Tile_34 for ONNX node: Tile_34 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 444 for ONNX tensor: 444 [06/17/2021-17:55:06] [V] [TRT] Tile_34 [Tile] outputs: [444 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_35 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 430 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_35 [Unsqueeze] inputs: [430 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_35 for ONNX node: Unsqueeze_35 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 447 for ONNX tensor: 447 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_35 [Unsqueeze] outputs: [447 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_36 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 447 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15223 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15224 [06/17/2021-17:55:06] [V] [TRT] Concat_36 [Concat] inputs: [447 -> (1)], [15223 -> (1)], [15224 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15223 for ONNX initializer: 15223 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15224 for ONNX initializer: 15224 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_36 for ONNX node: Concat_36 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 450 for ONNX tensor: 450 [06/17/2021-17:55:06] [V] [TRT] Concat_36 [Concat] outputs: [450 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_37 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 430 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_37 [Unsqueeze] inputs: [430 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_37 for ONNX node: Unsqueeze_37 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 451 for ONNX tensor: 451 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_37 [Unsqueeze] outputs: [451 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_38 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 451 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15225 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15226 [06/17/2021-17:55:06] [V] [TRT] Concat_38 [Concat] inputs: [451 -> (1)], [15225 -> (1)], [15226 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15225 for ONNX initializer: 15225 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15226 for ONNX initializer: 15226 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_38 for ONNX node: Concat_38 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 454 for ONNX tensor: 454 [06/17/2021-17:55:06] [V] [TRT] Concat_38 [Concat] outputs: [454 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_39 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 450 [06/17/2021-17:55:06] [V] [TRT] Shape_39 [Shape] inputs: [450 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_39 for ONNX node: Shape_39 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455 [06/17/2021-17:55:06] [V] [TRT] Shape_39 [Shape] outputs: [455 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_40 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 455 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_40 [ConstantOfShape] inputs: [455 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_40 for ONNX node: ConstantOfShape_40 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 456 for ONNX tensor: 456 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_40 [ConstantOfShape] outputs: [456 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_41 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: Transformation.GridGenerator.P_hat [06/17/2021-17:55:06] [V] [TRT] Searching for input: 456 [06/17/2021-17:55:06] [V] [TRT] Expand_41 [Expand] inputs: [Transformation.GridGenerator.P_hat -> (3200, 23)], [456 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: Transformation.GridGenerator.P_hat for ONNX initializer: Transformation.GridGenerator.P_hat [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_41 for ONNX node: Expand_41 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 457 for ONNX tensor: 457 [06/17/2021-17:55:06] [V] [TRT] Expand_41 [Expand] outputs: [457 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Tile_42 [Tile] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 457 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 454 [06/17/2021-17:55:06] [V] [TRT] Tile_42 [Tile] inputs: [457 -> ()], [454 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Tile_42 for ONNX node: Tile_42 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 458 for ONNX tensor: 458 [06/17/2021-17:55:06] [V] [TRT] Tile_42 [Tile] outputs: [458 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_43 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 430 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_43 [Unsqueeze] inputs: [430 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_43 for ONNX node: Unsqueeze_43 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 461 for ONNX tensor: 461 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_43 [Unsqueeze] outputs: [461 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_44 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 461 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15227 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15228 [06/17/2021-17:55:06] [V] [TRT] Concat_44 [Concat] inputs: [461 -> (1)], [15227 -> (1)], [15228 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15227 for ONNX initializer: 15227 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15228 for ONNX initializer: 15228 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_44 for ONNX node: Concat_44 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 464 for ONNX tensor: 464 [06/17/2021-17:55:06] [V] [TRT] Concat_44 [Concat] outputs: [464 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_45 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 464 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_45 [ConstantOfShape] inputs: [464 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_45 for ONNX node: ConstantOfShape_45 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 465 for ONNX tensor: 465 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_45 [ConstantOfShape] outputs: [465 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Cast_46 [Cast] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 465 [06/17/2021-17:55:06] [V] [TRT] Cast_46 [Cast] inputs: [465 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Casting to type: float32 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Cast_46 for ONNX node: Cast_46 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 466 for ONNX tensor: 466 [06/17/2021-17:55:06] [V] [TRT] Cast_46 [Cast] outputs: [466 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Cast_47 [Cast] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 466 [06/17/2021-17:55:06] [V] [TRT] Cast_47 [Cast] inputs: [466 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Casting to type: float32 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Cast_47 for ONNX node: Cast_47 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 467 for ONNX tensor: 467 [06/17/2021-17:55:06] [V] [TRT] Cast_47 [Cast] outputs: [467 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_48 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 427 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 467 [06/17/2021-17:55:06] [V] [TRT] Concat_48 [Concat] inputs: [427 -> (-1, -1, -1)], [467 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_48 for ONNX node: Concat_48 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 468 for ONNX tensor: 468 [06/17/2021-17:55:06] [V] [TRT] Concat_48 [Concat] outputs: [468 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_49 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 444 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 468 [06/17/2021-17:55:06] [V] [TRT] MatMul_49 [MatMul] inputs: [444 -> (-1, -1, -1)], [468 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_49 for ONNX node: MatMul_49 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 469 for ONNX tensor: 469 [06/17/2021-17:55:06] [V] [TRT] MatMul_49 [MatMul] outputs: [469 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_50 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 458 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 469 [06/17/2021-17:55:06] [V] [TRT] MatMul_50 [MatMul] inputs: [458 -> (-1, -1, -1)], [469 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_50 for ONNX node: MatMul_50 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 470 for ONNX tensor: 470 [06/17/2021-17:55:06] [V] [TRT] MatMul_50 [MatMul] outputs: [470 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_51 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 470 [06/17/2021-17:55:06] [V] [TRT] Shape_51 [Shape] inputs: [470 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_51 for ONNX node: Shape_51 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 471 for ONNX tensor: 471 [06/17/2021-17:55:06] [V] [TRT] Shape_51 [Shape] outputs: [471 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_52 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_52 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_52 [Constant] outputs: [472 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_53 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 471 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 472 [06/17/2021-17:55:06] [V] [TRT] Gather_53 [Gather] inputs: [471 -> (3)], [472 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 472 for ONNX initializer: 472 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 0 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_53 for ONNX node: Gather_53 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 473 for ONNX tensor: 473 [06/17/2021-17:55:06] [V] [TRT] Gather_53 [Gather] outputs: [473 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_54 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 473 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_54 [Unsqueeze] inputs: [473 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_54 for ONNX node: Unsqueeze_54 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 477 for ONNX tensor: 477 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_54 [Unsqueeze] outputs: [477 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_55 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 477 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15229 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15230 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15231 [06/17/2021-17:55:06] [V] [TRT] Concat_55 [Concat] inputs: [477 -> (1)], [15229 -> (1)], [15230 -> (1)], [15231 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15229 for ONNX initializer: 15229 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15230 for ONNX initializer: 15230 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15231 for ONNX initializer: 15231 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_55 for ONNX node: Concat_55 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 481 for ONNX tensor: 481 [06/17/2021-17:55:06] [V] [TRT] Concat_55 [Concat] outputs: [481 -> (4)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_56 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 470 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 481 [06/17/2021-17:55:06] [V] [TRT] Reshape_56 [Reshape] inputs: [470 -> (-1, -1, -1)], [481 -> (4)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_56 for ONNX node: Reshape_56 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 482 for ONNX tensor: 482 [06/17/2021-17:55:06] [V] [TRT] Reshape_56 [Reshape] outputs: [482 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: GridSampler_57 [GridSampler] [06/17/2021-17:55:06] [V] [TRT] Searching for input: input.1 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 482 [06/17/2021-17:55:06] [V] [TRT] GridSampler_57 [GridSampler] inputs: [input.1 -> (10, 1, 32, 100)], [482 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [I] [TRT] No importer registered for op: GridSampler. Attempting to import as plugin. [06/17/2021-17:55:06] [I] [TRT] Searching for plugin: GridSampler, plugin_version: 1, plugin_namespace: [06/17/2021-17:55:06] [I] [TRT] Successfully created plugin: GridSampler [06/17/2021-17:55:06] [V] [TRT] Registering layer: GridSampler_57 for ONNX node: GridSampler_57 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 483 for ONNX tensor: 483 [06/17/2021-17:55:06] [V] [TRT] GridSampler_57 [GridSampler] outputs: [483 -> (10, 1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_58 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 483 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15121 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15122 [06/17/2021-17:55:06] [V] [TRT] Conv_58 [Conv] inputs: [483 -> (10, 1, -1, -1)], [15121 -> (32, 1, 3, 3)], [15122 -> (32)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_58 for ONNX node: Conv_58 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 32 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 32, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15120 for ONNX tensor: 15120 [06/17/2021-17:55:06] [V] [TRT] Conv_58 [Conv] outputs: [15120 -> (10, 32, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_59 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15120 [06/17/2021-17:55:06] [V] [TRT] Relu_59 [Relu] inputs: [15120 -> (10, 32, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_59 for ONNX node: Relu_59 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 486 for ONNX tensor: 486 [06/17/2021-17:55:06] [V] [TRT] Relu_59 [Relu] outputs: [486 -> (10, 32, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_60 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 486 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15124 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15125 [06/17/2021-17:55:06] [V] [TRT] Conv_60 [Conv] inputs: [486 -> (10, 32, -1, -1)], [15124 -> (64, 32, 3, 3)], [15125 -> (64)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 32, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_60 for ONNX node: Conv_60 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 64, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15123 for ONNX tensor: 15123 [06/17/2021-17:55:06] [V] [TRT] Conv_60 [Conv] outputs: [15123 -> (10, 64, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_61 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15123 [06/17/2021-17:55:06] [V] [TRT] Relu_61 [Relu] inputs: [15123 -> (10, 64, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_61 for ONNX node: Relu_61 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 489 for ONNX tensor: 489 [06/17/2021-17:55:06] [V] [TRT] Relu_61 [Relu] outputs: [489 -> (10, 64, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MaxPool_62 [MaxPool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 489 [06/17/2021-17:55:06] [V] [TRT] MaxPool_62 [MaxPool] inputs: [489 -> (10, 64, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MaxPool_62 for ONNX node: MaxPool_62 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 490 for ONNX tensor: 490 [06/17/2021-17:55:06] [V] [TRT] MaxPool_62 [MaxPool] outputs: [490 -> (10, 64, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_63 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 490 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15127 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15128 [06/17/2021-17:55:06] [V] [TRT] Conv_63 [Conv] inputs: [490 -> (10, 64, -1, -1)], [15127 -> (128, 64, 3, 3)], [15128 -> (128)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 64, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_63 for ONNX node: Conv_63 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15126 for ONNX tensor: 15126 [06/17/2021-17:55:06] [V] [TRT] Conv_63 [Conv] outputs: [15126 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_64 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15126 [06/17/2021-17:55:06] [V] [TRT] Relu_64 [Relu] inputs: [15126 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_64 for ONNX node: Relu_64 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 493 for ONNX tensor: 493 [06/17/2021-17:55:06] [V] [TRT] Relu_64 [Relu] outputs: [493 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_65 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 493 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15130 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15131 [06/17/2021-17:55:06] [V] [TRT] Conv_65 [Conv] inputs: [493 -> (10, 128, -1, -1)], [15130 -> (128, 128, 3, 3)], [15131 -> (128)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_65 for ONNX node: Conv_65 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15129 for ONNX tensor: 15129 [06/17/2021-17:55:06] [V] [TRT] Conv_65 [Conv] outputs: [15129 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_66 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 490 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15133 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15134 [06/17/2021-17:55:06] [V] [TRT] Conv_66 [Conv] inputs: [490 -> (10, 64, -1, -1)], [15133 -> (128, 64, 1, 1)], [15134 -> (128)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 64, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_66 for ONNX node: Conv_66 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 128 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15132 for ONNX tensor: 15132 [06/17/2021-17:55:06] [V] [TRT] Conv_66 [Conv] outputs: [15132 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_67 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15129 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15132 [06/17/2021-17:55:06] [V] [TRT] Add_67 [Add] inputs: [15129 -> (10, 128, -1, -1)], [15132 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_67 for ONNX node: Add_67 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 498 for ONNX tensor: 498 [06/17/2021-17:55:06] [V] [TRT] Add_67 [Add] outputs: [498 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_68 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 498 [06/17/2021-17:55:06] [V] [TRT] Relu_68 [Relu] inputs: [498 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_68 for ONNX node: Relu_68 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 499 for ONNX tensor: 499 [06/17/2021-17:55:06] [V] [TRT] Relu_68 [Relu] outputs: [499 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_69 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 499 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15136 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15137 [06/17/2021-17:55:06] [V] [TRT] Conv_69 [Conv] inputs: [499 -> (10, 128, -1, -1)], [15136 -> (128, 128, 3, 3)], [15137 -> (128)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_69 for ONNX node: Conv_69 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 128 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15135 for ONNX tensor: 15135 [06/17/2021-17:55:06] [V] [TRT] Conv_69 [Conv] outputs: [15135 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_70 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15135 [06/17/2021-17:55:06] [V] [TRT] Relu_70 [Relu] inputs: [15135 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_70 for ONNX node: Relu_70 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 502 for ONNX tensor: 502 [06/17/2021-17:55:06] [V] [TRT] Relu_70 [Relu] outputs: [502 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MaxPool_71 [MaxPool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 502 [06/17/2021-17:55:06] [V] [TRT] MaxPool_71 [MaxPool] inputs: [502 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MaxPool_71 for ONNX node: MaxPool_71 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 503 for ONNX tensor: 503 [06/17/2021-17:55:06] [V] [TRT] MaxPool_71 [MaxPool] outputs: [503 -> (10, 128, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_72 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 503 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15139 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15140 [06/17/2021-17:55:06] [V] [TRT] Conv_72 [Conv] inputs: [503 -> (10, 128, -1, -1)], [15139 -> (256, 128, 3, 3)], [15140 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_72 for ONNX node: Conv_72 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15138 for ONNX tensor: 15138 [06/17/2021-17:55:06] [V] [TRT] Conv_72 [Conv] outputs: [15138 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_73 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15138 [06/17/2021-17:55:06] [V] [TRT] Relu_73 [Relu] inputs: [15138 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_73 for ONNX node: Relu_73 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 506 for ONNX tensor: 506 [06/17/2021-17:55:06] [V] [TRT] Relu_73 [Relu] outputs: [506 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_74 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 506 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15142 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15143 [06/17/2021-17:55:06] [V] [TRT] Conv_74 [Conv] inputs: [506 -> (10, 256, -1, -1)], [15142 -> (256, 256, 3, 3)], [15143 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_74 for ONNX node: Conv_74 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15141 for ONNX tensor: 15141 [06/17/2021-17:55:06] [V] [TRT] Conv_74 [Conv] outputs: [15141 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_75 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 503 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15145 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15146 [06/17/2021-17:55:06] [V] [TRT] Conv_75 [Conv] inputs: [503 -> (10, 128, -1, -1)], [15145 -> (256, 128, 1, 1)], [15146 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 128, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_75 for ONNX node: Conv_75 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15144 for ONNX tensor: 15144 [06/17/2021-17:55:06] [V] [TRT] Conv_75 [Conv] outputs: [15144 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_76 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15141 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15144 [06/17/2021-17:55:06] [V] [TRT] Add_76 [Add] inputs: [15141 -> (10, 256, -1, -1)], [15144 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_76 for ONNX node: Add_76 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511 [06/17/2021-17:55:06] [V] [TRT] Add_76 [Add] outputs: [511 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_77 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 511 [06/17/2021-17:55:06] [V] [TRT] Relu_77 [Relu] inputs: [511 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_77 for ONNX node: Relu_77 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 512 for ONNX tensor: 512 [06/17/2021-17:55:06] [V] [TRT] Relu_77 [Relu] outputs: [512 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_78 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 512 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15148 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15149 [06/17/2021-17:55:06] [V] [TRT] Conv_78 [Conv] inputs: [512 -> (10, 256, -1, -1)], [15148 -> (256, 256, 3, 3)], [15149 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_78 for ONNX node: Conv_78 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15147 for ONNX tensor: 15147 [06/17/2021-17:55:06] [V] [TRT] Conv_78 [Conv] outputs: [15147 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_79 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15147 [06/17/2021-17:55:06] [V] [TRT] Relu_79 [Relu] inputs: [15147 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_79 for ONNX node: Relu_79 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 515 for ONNX tensor: 515 [06/17/2021-17:55:06] [V] [TRT] Relu_79 [Relu] outputs: [515 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_80 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 515 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15151 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15152 [06/17/2021-17:55:06] [V] [TRT] Conv_80 [Conv] inputs: [515 -> (10, 256, -1, -1)], [15151 -> (256, 256, 3, 3)], [15152 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_80 for ONNX node: Conv_80 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15150 for ONNX tensor: 15150 [06/17/2021-17:55:06] [V] [TRT] Conv_80 [Conv] outputs: [15150 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_81 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15150 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 512 [06/17/2021-17:55:06] [V] [TRT] Add_81 [Add] inputs: [15150 -> (10, 256, -1, -1)], [512 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_81 for ONNX node: Add_81 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518 [06/17/2021-17:55:06] [V] [TRT] Add_81 [Add] outputs: [518 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_82 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 518 [06/17/2021-17:55:06] [V] [TRT] Relu_82 [Relu] inputs: [518 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_82 for ONNX node: Relu_82 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 519 for ONNX tensor: 519 [06/17/2021-17:55:06] [V] [TRT] Relu_82 [Relu] outputs: [519 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_83 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 519 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15154 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15155 [06/17/2021-17:55:06] [V] [TRT] Conv_83 [Conv] inputs: [519 -> (10, 256, -1, -1)], [15154 -> (256, 256, 3, 3)], [15155 -> (256)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_83 for ONNX node: Conv_83 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 256 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15153 for ONNX tensor: 15153 [06/17/2021-17:55:06] [V] [TRT] Conv_83 [Conv] outputs: [15153 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_84 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15153 [06/17/2021-17:55:06] [V] [TRT] Relu_84 [Relu] inputs: [15153 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_84 for ONNX node: Relu_84 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 522 for ONNX tensor: 522 [06/17/2021-17:55:06] [V] [TRT] Relu_84 [Relu] outputs: [522 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MaxPool_85 [MaxPool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 522 [06/17/2021-17:55:06] [V] [TRT] MaxPool_85 [MaxPool] inputs: [522 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MaxPool_85 for ONNX node: MaxPool_85 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 523 for ONNX tensor: 523 [06/17/2021-17:55:06] [V] [TRT] MaxPool_85 [MaxPool] outputs: [523 -> (10, 256, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_86 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 523 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15157 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15158 [06/17/2021-17:55:06] [V] [TRT] Conv_86 [Conv] inputs: [523 -> (10, 256, -1, -1)], [15157 -> (512, 256, 3, 3)], [15158 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_86 for ONNX node: Conv_86 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15156 for ONNX tensor: 15156 [06/17/2021-17:55:06] [V] [TRT] Conv_86 [Conv] outputs: [15156 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_87 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15156 [06/17/2021-17:55:06] [V] [TRT] Relu_87 [Relu] inputs: [15156 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_87 for ONNX node: Relu_87 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 526 for ONNX tensor: 526 [06/17/2021-17:55:06] [V] [TRT] Relu_87 [Relu] outputs: [526 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_88 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 526 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15160 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15161 [06/17/2021-17:55:06] [V] [TRT] Conv_88 [Conv] inputs: [526 -> (10, 512, -1, -1)], [15160 -> (512, 512, 3, 3)], [15161 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_88 for ONNX node: Conv_88 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15159 for ONNX tensor: 15159 [06/17/2021-17:55:06] [V] [TRT] Conv_88 [Conv] outputs: [15159 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_89 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 523 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15163 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15164 [06/17/2021-17:55:06] [V] [TRT] Conv_89 [Conv] inputs: [523 -> (10, 256, -1, -1)], [15163 -> (512, 256, 1, 1)], [15164 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 256, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_89 for ONNX node: Conv_89 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15162 for ONNX tensor: 15162 [06/17/2021-17:55:06] [V] [TRT] Conv_89 [Conv] outputs: [15162 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_90 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15159 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15162 [06/17/2021-17:55:06] [V] [TRT] Add_90 [Add] inputs: [15159 -> (10, 512, -1, -1)], [15162 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_90 for ONNX node: Add_90 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531 [06/17/2021-17:55:06] [V] [TRT] Add_90 [Add] outputs: [531 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_91 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 531 [06/17/2021-17:55:06] [V] [TRT] Relu_91 [Relu] inputs: [531 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_91 for ONNX node: Relu_91 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532 [06/17/2021-17:55:06] [V] [TRT] Relu_91 [Relu] outputs: [532 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_92 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 532 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15166 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15167 [06/17/2021-17:55:06] [V] [TRT] Conv_92 [Conv] inputs: [532 -> (10, 512, -1, -1)], [15166 -> (512, 512, 3, 3)], [15167 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_92 for ONNX node: Conv_92 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15165 for ONNX tensor: 15165 [06/17/2021-17:55:06] [V] [TRT] Conv_92 [Conv] outputs: [15165 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_93 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15165 [06/17/2021-17:55:06] [V] [TRT] Relu_93 [Relu] inputs: [15165 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_93 for ONNX node: Relu_93 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535 [06/17/2021-17:55:06] [V] [TRT] Relu_93 [Relu] outputs: [535 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_94 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 535 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15169 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15170 [06/17/2021-17:55:06] [V] [TRT] Conv_94 [Conv] inputs: [535 -> (10, 512, -1, -1)], [15169 -> (512, 512, 3, 3)], [15170 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_94 for ONNX node: Conv_94 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15168 for ONNX tensor: 15168 [06/17/2021-17:55:06] [V] [TRT] Conv_94 [Conv] outputs: [15168 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_95 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15168 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 532 [06/17/2021-17:55:06] [V] [TRT] Add_95 [Add] inputs: [15168 -> (10, 512, -1, -1)], [532 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_95 for ONNX node: Add_95 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 538 for ONNX tensor: 538 [06/17/2021-17:55:06] [V] [TRT] Add_95 [Add] outputs: [538 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_96 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 538 [06/17/2021-17:55:06] [V] [TRT] Relu_96 [Relu] inputs: [538 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_96 for ONNX node: Relu_96 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 539 for ONNX tensor: 539 [06/17/2021-17:55:06] [V] [TRT] Relu_96 [Relu] outputs: [539 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_97 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 539 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15172 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15173 [06/17/2021-17:55:06] [V] [TRT] Conv_97 [Conv] inputs: [539 -> (10, 512, -1, -1)], [15172 -> (512, 512, 3, 3)], [15173 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_97 for ONNX node: Conv_97 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15171 for ONNX tensor: 15171 [06/17/2021-17:55:06] [V] [TRT] Conv_97 [Conv] outputs: [15171 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_98 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15171 [06/17/2021-17:55:06] [V] [TRT] Relu_98 [Relu] inputs: [15171 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_98 for ONNX node: Relu_98 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 542 for ONNX tensor: 542 [06/17/2021-17:55:06] [V] [TRT] Relu_98 [Relu] outputs: [542 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_99 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 542 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15175 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15176 [06/17/2021-17:55:06] [V] [TRT] Conv_99 [Conv] inputs: [542 -> (10, 512, -1, -1)], [15175 -> (512, 512, 3, 3)], [15176 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_99 for ONNX node: Conv_99 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15174 for ONNX tensor: 15174 [06/17/2021-17:55:06] [V] [TRT] Conv_99 [Conv] outputs: [15174 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_100 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15174 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 539 [06/17/2021-17:55:06] [V] [TRT] Add_100 [Add] inputs: [15174 -> (10, 512, -1, -1)], [539 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_100 for ONNX node: Add_100 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 545 for ONNX tensor: 545 [06/17/2021-17:55:06] [V] [TRT] Add_100 [Add] outputs: [545 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_101 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 545 [06/17/2021-17:55:06] [V] [TRT] Relu_101 [Relu] inputs: [545 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_101 for ONNX node: Relu_101 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 546 for ONNX tensor: 546 [06/17/2021-17:55:06] [V] [TRT] Relu_101 [Relu] outputs: [546 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_102 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 546 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15178 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15179 [06/17/2021-17:55:06] [V] [TRT] Conv_102 [Conv] inputs: [546 -> (10, 512, -1, -1)], [15178 -> (512, 512, 3, 3)], [15179 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_102 for ONNX node: Conv_102 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15177 for ONNX tensor: 15177 [06/17/2021-17:55:06] [V] [TRT] Conv_102 [Conv] outputs: [15177 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_103 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15177 [06/17/2021-17:55:06] [V] [TRT] Relu_103 [Relu] inputs: [15177 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_103 for ONNX node: Relu_103 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549 [06/17/2021-17:55:06] [V] [TRT] Relu_103 [Relu] outputs: [549 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_104 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 549 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15181 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15182 [06/17/2021-17:55:06] [V] [TRT] Conv_104 [Conv] inputs: [549 -> (10, 512, -1, -1)], [15181 -> (512, 512, 3, 3)], [15182 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_104 for ONNX node: Conv_104 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15180 for ONNX tensor: 15180 [06/17/2021-17:55:06] [V] [TRT] Conv_104 [Conv] outputs: [15180 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_105 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15180 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 546 [06/17/2021-17:55:06] [V] [TRT] Add_105 [Add] inputs: [15180 -> (10, 512, -1, -1)], [546 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_105 for ONNX node: Add_105 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552 [06/17/2021-17:55:06] [V] [TRT] Add_105 [Add] outputs: [552 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_106 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 552 [06/17/2021-17:55:06] [V] [TRT] Relu_106 [Relu] inputs: [552 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_106 for ONNX node: Relu_106 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553 [06/17/2021-17:55:06] [V] [TRT] Relu_106 [Relu] outputs: [553 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_107 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 553 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15184 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15185 [06/17/2021-17:55:06] [V] [TRT] Conv_107 [Conv] inputs: [553 -> (10, 512, -1, -1)], [15184 -> (512, 512, 3, 3)], [15185 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_107 for ONNX node: Conv_107 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15183 for ONNX tensor: 15183 [06/17/2021-17:55:06] [V] [TRT] Conv_107 [Conv] outputs: [15183 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_108 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15183 [06/17/2021-17:55:06] [V] [TRT] Relu_108 [Relu] inputs: [15183 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_108 for ONNX node: Relu_108 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 556 for ONNX tensor: 556 [06/17/2021-17:55:06] [V] [TRT] Relu_108 [Relu] outputs: [556 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_109 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 556 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15187 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15188 [06/17/2021-17:55:06] [V] [TRT] Conv_109 [Conv] inputs: [556 -> (10, 512, -1, -1)], [15187 -> (512, 512, 3, 3)], [15188 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_109 for ONNX node: Conv_109 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15186 for ONNX tensor: 15186 [06/17/2021-17:55:06] [V] [TRT] Conv_109 [Conv] outputs: [15186 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_110 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15186 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 553 [06/17/2021-17:55:06] [V] [TRT] Add_110 [Add] inputs: [15186 -> (10, 512, -1, -1)], [553 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_110 for ONNX node: Add_110 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559 [06/17/2021-17:55:06] [V] [TRT] Add_110 [Add] outputs: [559 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_111 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 559 [06/17/2021-17:55:06] [V] [TRT] Relu_111 [Relu] inputs: [559 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_111 for ONNX node: Relu_111 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 560 for ONNX tensor: 560 [06/17/2021-17:55:06] [V] [TRT] Relu_111 [Relu] outputs: [560 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_112 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 560 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15190 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15191 [06/17/2021-17:55:06] [V] [TRT] Conv_112 [Conv] inputs: [560 -> (10, 512, -1, -1)], [15190 -> (512, 512, 3, 3)], [15191 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_112 for ONNX node: Conv_112 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15189 for ONNX tensor: 15189 [06/17/2021-17:55:06] [V] [TRT] Conv_112 [Conv] outputs: [15189 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_113 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15189 [06/17/2021-17:55:06] [V] [TRT] Relu_113 [Relu] inputs: [15189 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_113 for ONNX node: Relu_113 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 563 for ONNX tensor: 563 [06/17/2021-17:55:06] [V] [TRT] Relu_113 [Relu] outputs: [563 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_114 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 563 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15193 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15194 [06/17/2021-17:55:06] [V] [TRT] Conv_114 [Conv] inputs: [563 -> (10, 512, -1, -1)], [15193 -> (512, 512, 3, 3)], [15194 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_114 for ONNX node: Conv_114 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15192 for ONNX tensor: 15192 [06/17/2021-17:55:06] [V] [TRT] Conv_114 [Conv] outputs: [15192 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_115 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15192 [06/17/2021-17:55:06] [V] [TRT] Relu_115 [Relu] inputs: [15192 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_115 for ONNX node: Relu_115 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 566 for ONNX tensor: 566 [06/17/2021-17:55:06] [V] [TRT] Relu_115 [Relu] outputs: [566 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_116 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 566 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15196 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15197 [06/17/2021-17:55:06] [V] [TRT] Conv_116 [Conv] inputs: [566 -> (10, 512, -1, -1)], [15196 -> (512, 512, 3, 3)], [15197 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_116 for ONNX node: Conv_116 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15195 for ONNX tensor: 15195 [06/17/2021-17:55:06] [V] [TRT] Conv_116 [Conv] outputs: [15195 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_117 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15195 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 563 [06/17/2021-17:55:06] [V] [TRT] Add_117 [Add] inputs: [15195 -> (10, 512, -1, -1)], [563 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_117 for ONNX node: Add_117 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569 [06/17/2021-17:55:06] [V] [TRT] Add_117 [Add] outputs: [569 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_118 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 569 [06/17/2021-17:55:06] [V] [TRT] Relu_118 [Relu] inputs: [569 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_118 for ONNX node: Relu_118 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570 [06/17/2021-17:55:06] [V] [TRT] Relu_118 [Relu] outputs: [570 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_119 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 570 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15199 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15200 [06/17/2021-17:55:06] [V] [TRT] Conv_119 [Conv] inputs: [570 -> (10, 512, -1, -1)], [15199 -> (512, 512, 3, 3)], [15200 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_119 for ONNX node: Conv_119 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15198 for ONNX tensor: 15198 [06/17/2021-17:55:06] [V] [TRT] Conv_119 [Conv] outputs: [15198 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_120 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15198 [06/17/2021-17:55:06] [V] [TRT] Relu_120 [Relu] inputs: [15198 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_120 for ONNX node: Relu_120 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 573 for ONNX tensor: 573 [06/17/2021-17:55:06] [V] [TRT] Relu_120 [Relu] outputs: [573 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_121 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 573 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15202 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15203 [06/17/2021-17:55:06] [V] [TRT] Conv_121 [Conv] inputs: [573 -> (10, 512, -1, -1)], [15202 -> (512, 512, 3, 3)], [15203 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_121 for ONNX node: Conv_121 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15201 for ONNX tensor: 15201 [06/17/2021-17:55:06] [V] [TRT] Conv_121 [Conv] outputs: [15201 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_122 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15201 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 570 [06/17/2021-17:55:06] [V] [TRT] Add_122 [Add] inputs: [15201 -> (10, 512, -1, -1)], [570 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_122 for ONNX node: Add_122 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576 [06/17/2021-17:55:06] [V] [TRT] Add_122 [Add] outputs: [576 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_123 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 576 [06/17/2021-17:55:06] [V] [TRT] Relu_123 [Relu] inputs: [576 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_123 for ONNX node: Relu_123 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 577 for ONNX tensor: 577 [06/17/2021-17:55:06] [V] [TRT] Relu_123 [Relu] outputs: [577 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_124 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 577 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15205 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15206 [06/17/2021-17:55:06] [V] [TRT] Conv_124 [Conv] inputs: [577 -> (10, 512, -1, -1)], [15205 -> (512, 512, 3, 3)], [15206 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_124 for ONNX node: Conv_124 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15204 for ONNX tensor: 15204 [06/17/2021-17:55:06] [V] [TRT] Conv_124 [Conv] outputs: [15204 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_125 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15204 [06/17/2021-17:55:06] [V] [TRT] Relu_125 [Relu] inputs: [15204 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_125 for ONNX node: Relu_125 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580 [06/17/2021-17:55:06] [V] [TRT] Relu_125 [Relu] outputs: [580 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_126 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 580 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15208 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15209 [06/17/2021-17:55:06] [V] [TRT] Conv_126 [Conv] inputs: [580 -> (10, 512, -1, -1)], [15208 -> (512, 512, 3, 3)], [15209 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_126 for ONNX node: Conv_126 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15207 for ONNX tensor: 15207 [06/17/2021-17:55:06] [V] [TRT] Conv_126 [Conv] outputs: [15207 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_127 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15207 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 577 [06/17/2021-17:55:06] [V] [TRT] Add_127 [Add] inputs: [15207 -> (10, 512, -1, -1)], [577 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_127 for ONNX node: Add_127 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 583 for ONNX tensor: 583 [06/17/2021-17:55:06] [V] [TRT] Add_127 [Add] outputs: [583 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_128 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 583 [06/17/2021-17:55:06] [V] [TRT] Relu_128 [Relu] inputs: [583 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_128 for ONNX node: Relu_128 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584 [06/17/2021-17:55:06] [V] [TRT] Relu_128 [Relu] outputs: [584 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_129 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 584 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15211 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15212 [06/17/2021-17:55:06] [V] [TRT] Conv_129 [Conv] inputs: [584 -> (10, 512, -1, -1)], [15211 -> (512, 512, 2, 2)], [15212 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_129 for ONNX node: Conv_129 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (2, 2), strides: (2, 1), prepadding: (0, 1), postpadding: (0, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15210 for ONNX tensor: 15210 [06/17/2021-17:55:06] [V] [TRT] Conv_129 [Conv] outputs: [15210 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_130 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15210 [06/17/2021-17:55:06] [V] [TRT] Relu_130 [Relu] inputs: [15210 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_130 for ONNX node: Relu_130 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587 [06/17/2021-17:55:06] [V] [TRT] Relu_130 [Relu] outputs: [587 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_131 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 587 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15214 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15215 [06/17/2021-17:55:06] [V] [TRT] Conv_131 [Conv] inputs: [587 -> (10, 512, -1, -1)], [15214 -> (512, 512, 2, 2)], [15215 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_131 for ONNX node: Conv_131 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (2, 2), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 15213 for ONNX tensor: 15213 [06/17/2021-17:55:06] [V] [TRT] Conv_131 [Conv] outputs: [15213 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Relu_132 [Relu] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15213 [06/17/2021-17:55:06] [V] [TRT] Relu_132 [Relu] inputs: [15213 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Relu_132 for ONNX node: Relu_132 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590 [06/17/2021-17:55:06] [V] [TRT] Relu_132 [Relu] outputs: [590 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Conv_133 [Conv] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 590 [06/17/2021-17:55:06] [V] [TRT] Searching for input: FeatureExtraction.TextAttentionModule.conv31.weight [06/17/2021-17:55:06] [V] [TRT] Conv_133 [Conv] inputs: [590 -> (10, 512, -1, -1)], [FeatureExtraction.TextAttentionModule.conv31.weight -> (512, 512, 1, 3)], [06/17/2021-17:55:06] [V] [TRT] Convolution input dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Conv_133 for ONNX node: Conv_133 [06/17/2021-17:55:06] [V] [TRT] Using kernel: (1, 3), strides: (1, 1), prepadding: (0, 1), postpadding: (0, 1), dilations: (1, 1), numOutputs: 512 [06/17/2021-17:55:06] [V] [TRT] Convolution output dimensions: (10, 512, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 591 for ONNX tensor: 591 [06/17/2021-17:55:06] [V] [TRT] Conv_133 [Conv] outputs: [591 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Sigmoid_134 [Sigmoid] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 591 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_134 [Sigmoid] inputs: [591 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Sigmoid_134 for ONNX node: Sigmoid_134 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 592 for ONNX tensor: 592 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_134 [Sigmoid] outputs: [592 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_135 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 592 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 590 [06/17/2021-17:55:06] [V] [TRT] Mul_135 [Mul] inputs: [592 -> (10, 512, -1, -1)], [590 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_135 for ONNX node: Mul_135 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 593 for ONNX tensor: 593 [06/17/2021-17:55:06] [V] [TRT] Mul_135 [Mul] outputs: [593 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_136 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 593 [06/17/2021-17:55:06] [V] [TRT] Transpose_136 [Transpose] inputs: [593 -> (10, 512, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_136 for ONNX node: Transpose_136 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 594 for ONNX tensor: 594 [06/17/2021-17:55:06] [V] [TRT] Transpose_136 [Transpose] outputs: [594 -> (10, -1, 512, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: AveragePool_137 [AveragePool] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 594 [06/17/2021-17:55:06] [V] [TRT] AveragePool_137 [AveragePool] inputs: [594 -> (10, -1, 512, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: AveragePool_137 for ONNX node: AveragePool_137 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 595 for ONNX tensor: 595 [06/17/2021-17:55:06] [V] [TRT] AveragePool_137 [AveragePool] outputs: [595 -> (10, -1, 512, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Squeeze_138 [Squeeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 595 [06/17/2021-17:55:06] [V] [TRT] Squeeze_138 [Squeeze] inputs: [595 -> (10, -1, 512, -1)], [06/17/2021-17:55:06] [V] [TRT] Original shape: (10, _, 512, _), squeezing to: (_, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Squeeze_138 for ONNX node: Squeeze_138 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 596 for ONNX tensor: 596 [06/17/2021-17:55:06] [V] [TRT] Squeeze_138 [Squeeze] outputs: [596 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_139 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 596 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15232 [06/17/2021-17:55:06] [V] [TRT] MatMul_139 [MatMul] inputs: [596 -> (-1, -1, -1)], [15232 -> (512, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15232 for ONNX initializer: 15232 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_139 for ONNX node: MatMul_139 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 598 for ONNX tensor: 598 [06/17/2021-17:55:06] [V] [TRT] MatMul_139 [MatMul] outputs: [598 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_140 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 598 [06/17/2021-17:55:06] [V] [TRT] Searching for input: Refiner.iid.bias [06/17/2021-17:55:06] [V] [TRT] Add_140 [Add] inputs: [598 -> (-1, -1, 512)], [Refiner.iid.bias -> (512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: Refiner.iid.bias for ONNX initializer: Refiner.iid.bias [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_140 for ONNX node: Add_140 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 599 for ONNX tensor: 599 [06/17/2021-17:55:06] [V] [TRT] Add_140 [Add] outputs: [599 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_141 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 599 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15233 [06/17/2021-17:55:06] [V] [TRT] MatMul_141 [MatMul] inputs: [599 -> (-1, -1, 512)], [15233 -> (512, 96)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15233 for ONNX initializer: 15233 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_141 for ONNX node: MatMul_141 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 601 for ONNX tensor: 601 [06/17/2021-17:55:06] [V] [TRT] MatMul_141 [MatMul] outputs: [601 -> (-1, -1, 96)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_142 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 601 [06/17/2021-17:55:06] [V] [TRT] Searching for input: Refiner.decoder.bias [06/17/2021-17:55:06] [V] [TRT] Add_142 [Add] inputs: [601 -> (-1, -1, 96)], [Refiner.decoder.bias -> (96)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: Refiner.decoder.bias for ONNX initializer: Refiner.decoder.bias [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_142 for ONNX node: Add_142 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 602_0 for ONNX tensor: 602 [06/17/2021-17:55:06] [V] [TRT] Add_142 [Add] outputs: [602 -> (-1, -1, 96)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_143 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 596 [06/17/2021-17:55:06] [V] [TRT] Shape_143 [Shape] inputs: [596 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_143 for ONNX node: Shape_143 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 603 for ONNX tensor: 603 [06/17/2021-17:55:06] [V] [TRT] Shape_143 [Shape] outputs: [603 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_144 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_144 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_144 [Constant] outputs: [604 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_145 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 603 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 604 [06/17/2021-17:55:06] [V] [TRT] Gather_145 [Gather] inputs: [603 -> (3)], [604 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 604 for ONNX initializer: 604 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 0 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_145 for ONNX node: Gather_145 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 605 for ONNX tensor: 605 [06/17/2021-17:55:06] [V] [TRT] Gather_145 [Gather] outputs: [605 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_146 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 605 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_146 [Unsqueeze] inputs: [605 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_146 for ONNX node: Unsqueeze_146 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_146 [Unsqueeze] outputs: [609 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_147 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15234 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 609 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15235 [06/17/2021-17:55:06] [V] [TRT] Concat_147 [Concat] inputs: [15234 -> (1)], [609 -> (1)], [15235 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15234 for ONNX initializer: 15234 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15235 for ONNX initializer: 15235 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_147 for ONNX node: Concat_147 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 611 for ONNX tensor: 611 [06/17/2021-17:55:06] [V] [TRT] Concat_147 [Concat] outputs: [611 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_148 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 611 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_148 [ConstantOfShape] inputs: [611 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_148 for ONNX node: ConstantOfShape_148 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 612 for ONNX tensor: 612 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_148 [ConstantOfShape] outputs: [612 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_149 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 605 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_149 [Unsqueeze] inputs: [605 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_149 for ONNX node: Unsqueeze_149 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 616 for ONNX tensor: 616 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_149 [Unsqueeze] outputs: [616 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_150 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15236 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 616 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15237 [06/17/2021-17:55:06] [V] [TRT] Concat_150 [Concat] inputs: [15236 -> (1)], [616 -> (1)], [15237 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15236 for ONNX initializer: 15236 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15237 for ONNX initializer: 15237 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_150 for ONNX node: Concat_150 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 618 for ONNX tensor: 618 [06/17/2021-17:55:06] [V] [TRT] Concat_150 [Concat] outputs: [618 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_151 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 618 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_151 [ConstantOfShape] inputs: [618 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_151 for ONNX node: ConstantOfShape_151 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 619 for ONNX tensor: 619 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_151 [ConstantOfShape] outputs: [619 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_152 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 596 [06/17/2021-17:55:06] [V] [TRT] Transpose_152 [Transpose] inputs: [596 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_152 for ONNX node: Transpose_152 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 620 for ONNX tensor: 620 [06/17/2021-17:55:06] [V] [TRT] Transpose_152 [Transpose] outputs: [620 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: LSTM_153 [LSTM] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 620 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15279 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15280 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15278 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 612 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 619 [06/17/2021-17:55:06] [V] [TRT] LSTM_153 [LSTM] inputs: [620 -> (-1, -1, -1)], [15279 -> (2, 2048, 512)], [15280 -> (2, 2048, 512)], [15278 -> (2, 4096)], [optional input, not set], [612 -> (-1, -1, -1)], [619 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15279 for ONNX initializer: 15279 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15280 for ONNX initializer: 15280 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15278 for ONNX initializer: 15278 [06/17/2021-17:55:06] [V] [TRT] Bias shape is: (2, 4096) [06/17/2021-17:55:06] [V] [TRT] Reshaping bias to: (2, 2, 2048) [06/17/2021-17:55:06] [V] [TRT] After reduction, bias shape is: (2, 1, 2048) [06/17/2021-17:55:06] [V] [TRT] numDirectionsTensor shape: (1) [06/17/2021-17:55:06] [V] [TRT] hiddenSizeTensor shape: (1) [06/17/2021-17:55:06] [V] [TRT] batchSizeTensor shape: (1) [06/17/2021-17:55:06] [V] [TRT] Gate output rank (equal to initial hidden/cell state rank): (3) [06/17/2021-17:55:06] [V] [TRT] Initial hidden state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Initial cell state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Entering Loop [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [06/17/2021-17:55:06] [V] [TRT] Input shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: LSTM_153 for ONNX node: LSTM_153 [06/17/2021-17:55:06] [V] [TRT] Hidden state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Cell state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] X(t) * W^T -> (2, -1, 2048) [06/17/2021-17:55:06] [V] [TRT] H(t-1) * R^T -> (2, -1, 2048) [06/17/2021-17:55:06] [V] [TRT] intermediate(t) -> (2, -1, 2048) [06/17/2021-17:55:06] [V] [TRT] c(t) -> (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] C(t) -> (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] H(t) -> (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Concatenated output shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Forward pass shape: (0, 0, 0) [06/17/2021-17:55:06] [V] [TRT] Reverse pass shape: (0, 0, 0) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 737 for ONNX tensor: 737 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739 [06/17/2021-17:55:06] [V] [TRT] LSTM_153 [LSTM] outputs: [737 -> (-1, -1, -1, -1)], [738 -> (-1, -1, -1)], [739 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_154 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 737 [06/17/2021-17:55:06] [V] [TRT] Transpose_154 [Transpose] inputs: [737 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_154 for ONNX node: Transpose_154 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 740 for ONNX tensor: 740 [06/17/2021-17:55:06] [V] [TRT] Transpose_154 [Transpose] outputs: [740 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_155 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_155 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_155 [Constant] outputs: [741 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_156 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 740 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 741 [06/17/2021-17:55:06] [V] [TRT] Reshape_156 [Reshape] inputs: [740 -> (-1, -1, -1, -1)], [741 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_156 for ONNX node: Reshape_156 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742 [06/17/2021-17:55:06] [V] [TRT] Reshape_156 [Reshape] outputs: [742 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_157 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 742 [06/17/2021-17:55:06] [V] [TRT] Transpose_157 [Transpose] inputs: [742 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_157 for ONNX node: Transpose_157 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743 [06/17/2021-17:55:06] [V] [TRT] Transpose_157 [Transpose] outputs: [743 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_158 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 743 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15281 [06/17/2021-17:55:06] [V] [TRT] MatMul_158 [MatMul] inputs: [743 -> (-1, -1, -1)], [15281 -> (1024, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15281 for ONNX initializer: 15281 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_158 for ONNX node: MatMul_158 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 745 for ONNX tensor: 745 [06/17/2021-17:55:06] [V] [TRT] MatMul_158 [MatMul] outputs: [745 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_159 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 745 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Add_159 [Add] inputs: [745 -> (-1, -1, 512)], [ctx_block1.sequence_modeling.0.linear.bias -> (512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.sequence_modeling.0.linear.bias for ONNX initializer: ctx_block1.sequence_modeling.0.linear.bias [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_159 for ONNX node: Add_159 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 746 for ONNX tensor: 746 [06/17/2021-17:55:06] [V] [TRT] Add_159 [Add] outputs: [746 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_160 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 746 [06/17/2021-17:55:06] [V] [TRT] Shape_160 [Shape] inputs: [746 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_160 for ONNX node: Shape_160 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 747 for ONNX tensor: 747 [06/17/2021-17:55:06] [V] [TRT] Shape_160 [Shape] outputs: [747 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_161 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_161 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_161 [Constant] outputs: [748 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_162 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 747 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 748 [06/17/2021-17:55:06] [V] [TRT] Gather_162 [Gather] inputs: [747 -> (3)], [748 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 748 for ONNX initializer: 748 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 0 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_162 for ONNX node: Gather_162 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 749 for ONNX tensor: 749 [06/17/2021-17:55:06] [V] [TRT] Gather_162 [Gather] outputs: [749 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_163 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 749 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_163 [Unsqueeze] inputs: [749 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_163 for ONNX node: Unsqueeze_163 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 753 for ONNX tensor: 753 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_163 [Unsqueeze] outputs: [753 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_164 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15282 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 753 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15283 [06/17/2021-17:55:06] [V] [TRT] Concat_164 [Concat] inputs: [15282 -> (1)], [753 -> (1)], [15283 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15282 for ONNX initializer: 15282 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15283 for ONNX initializer: 15283 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_164 for ONNX node: Concat_164 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 755 for ONNX tensor: 755 [06/17/2021-17:55:06] [V] [TRT] Concat_164 [Concat] outputs: [755 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_165 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 755 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_165 [ConstantOfShape] inputs: [755 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_165 for ONNX node: ConstantOfShape_165 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 756 for ONNX tensor: 756 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_165 [ConstantOfShape] outputs: [756 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_166 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 749 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_166 [Unsqueeze] inputs: [749 -> ()], [06/17/2021-17:55:06] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_166 for ONNX node: Unsqueeze_166 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_166 [Unsqueeze] outputs: [760 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_167 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15284 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 760 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15285 [06/17/2021-17:55:06] [V] [TRT] Concat_167 [Concat] inputs: [15284 -> (1)], [760 -> (1)], [15285 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15284 for ONNX initializer: 15284 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15285 for ONNX initializer: 15285 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_167 for ONNX node: Concat_167 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762 [06/17/2021-17:55:06] [V] [TRT] Concat_167 [Concat] outputs: [762 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_168 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 762 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_168 [ConstantOfShape] inputs: [762 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_168 for ONNX node: ConstantOfShape_168 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_168 [ConstantOfShape] outputs: [763 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_169 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 746 [06/17/2021-17:55:06] [V] [TRT] Transpose_169 [Transpose] inputs: [746 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_169 for ONNX node: Transpose_169 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764 [06/17/2021-17:55:06] [V] [TRT] Transpose_169 [Transpose] outputs: [764 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: LSTM_170 [LSTM] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 764 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15327 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15328 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15326 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 756 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 763 [06/17/2021-17:55:06] [V] [TRT] LSTM_170 [LSTM] inputs: [764 -> (-1, -1, 512)], [15327 -> (2, 2048, 512)], [15328 -> (2, 2048, 512)], [15326 -> (2, 4096)], [optional input, not set], [756 -> (-1, -1, -1)], [763 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15327 for ONNX initializer: 15327 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15328 for ONNX initializer: 15328 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15326 for ONNX initializer: 15326 [06/17/2021-17:55:06] [V] [TRT] Bias shape is: (2, 4096) [06/17/2021-17:55:06] [V] [TRT] Reshaping bias to: (2, 2, 2048) [06/17/2021-17:55:06] [V] [TRT] After reduction, bias shape is: (2, 1, 2048) [06/17/2021-17:55:06] [V] [TRT] numDirectionsTensor shape: (1) [06/17/2021-17:55:06] [V] [TRT] hiddenSizeTensor shape: (1) [06/17/2021-17:55:06] [V] [TRT] batchSizeTensor shape: (1) [06/17/2021-17:55:06] [V] [TRT] Gate output rank (equal to initial hidden/cell state rank): (3) [06/17/2021-17:55:06] [V] [TRT] Initial hidden state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Initial cell state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Entering Loop [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, 512), unsqueezing to: (_, _, _) [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, 512), unsqueezing to: (_, _, _) [06/17/2021-17:55:06] [V] [TRT] Input shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: LSTM_170 for ONNX node: LSTM_170 [06/17/2021-17:55:06] [V] [TRT] Hidden state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Cell state shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] X(t) * W^T -> (2, -1, 2048) [06/17/2021-17:55:06] [V] [TRT] H(t-1) * R^T -> (2, -1, 2048) [06/17/2021-17:55:06] [V] [TRT] intermediate(t) -> (2, -1, 2048) [06/17/2021-17:55:06] [V] [TRT] c(t) -> (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] C(t) -> (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] H(t) -> (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Concatenated output shape: (-1, -1, -1) [06/17/2021-17:55:06] [V] [TRT] Forward pass shape: (0, 0, 0) [06/17/2021-17:55:06] [V] [TRT] Reverse pass shape: (0, 0, 0) [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 881 for ONNX tensor: 881 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 882 for ONNX tensor: 882 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883 [06/17/2021-17:55:06] [V] [TRT] LSTM_170 [LSTM] outputs: [881 -> (-1, -1, -1, -1)], [882 -> (-1, -1, -1)], [883 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_171 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 881 [06/17/2021-17:55:06] [V] [TRT] Transpose_171 [Transpose] inputs: [881 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_171 for ONNX node: Transpose_171 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 884 for ONNX tensor: 884 [06/17/2021-17:55:06] [V] [TRT] Transpose_171 [Transpose] outputs: [884 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_172 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_172 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_172 [Constant] outputs: [885 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_173 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 884 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 885 [06/17/2021-17:55:06] [V] [TRT] Reshape_173 [Reshape] inputs: [884 -> (-1, -1, -1, -1)], [885 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_173 for ONNX node: Reshape_173 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 886 for ONNX tensor: 886 [06/17/2021-17:55:06] [V] [TRT] Reshape_173 [Reshape] outputs: [886 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_174 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 886 [06/17/2021-17:55:06] [V] [TRT] Transpose_174 [Transpose] inputs: [886 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_174 for ONNX node: Transpose_174 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 887 for ONNX tensor: 887 [06/17/2021-17:55:06] [V] [TRT] Transpose_174 [Transpose] outputs: [887 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_175 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 887 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15329 [06/17/2021-17:55:06] [V] [TRT] MatMul_175 [MatMul] inputs: [887 -> (-1, -1, -1)], [15329 -> (1024, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15329 for ONNX initializer: 15329 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_175 for ONNX node: MatMul_175 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 889 for ONNX tensor: 889 [06/17/2021-17:55:06] [V] [TRT] MatMul_175 [MatMul] outputs: [889 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_176 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 889 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Add_176 [Add] inputs: [889 -> (-1, -1, 512)], [ctx_block1.sequence_modeling.1.linear.bias -> (512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.sequence_modeling.1.linear.bias for ONNX initializer: ctx_block1.sequence_modeling.1.linear.bias [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_176 for ONNX node: Add_176 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 890 for ONNX tensor: 890 [06/17/2021-17:55:06] [V] [TRT] Add_176 [Add] outputs: [890 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_177 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 890 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 596 [06/17/2021-17:55:06] [V] [TRT] Concat_177 [Concat] inputs: [890 -> (-1, -1, 512)], [596 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_177 for ONNX node: Concat_177 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 891 for ONNX tensor: 891 [06/17/2021-17:55:06] [V] [TRT] Concat_177 [Concat] outputs: [891 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_178 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 891 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15330 [06/17/2021-17:55:06] [V] [TRT] MatMul_178 [MatMul] inputs: [891 -> (-1, -1, -1)], [15330 -> (1024, 1024)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15330 for ONNX initializer: 15330 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_178 for ONNX node: MatMul_178 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 893 for ONNX tensor: 893 [06/17/2021-17:55:06] [V] [TRT] MatMul_178 [MatMul] outputs: [893 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_179 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 893 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Add_179 [Add] inputs: [893 -> (-1, -1, 1024)], [ctx_block1.selective_decoder.first_attention.bias -> (1024)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.selective_decoder.first_attention.bias for ONNX initializer: ctx_block1.selective_decoder.first_attention.bias [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_179 for ONNX node: Add_179 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 894 for ONNX tensor: 894 [06/17/2021-17:55:06] [V] [TRT] Add_179 [Add] outputs: [894 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_180 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 891 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 894 [06/17/2021-17:55:06] [V] [TRT] Mul_180 [Mul] inputs: [891 -> (-1, -1, -1)], [894 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_180 for ONNX node: Mul_180 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 895 for ONNX tensor: 895 [06/17/2021-17:55:06] [V] [TRT] Mul_180 [Mul] outputs: [895 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_181 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_181 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_181 [Constant] outputs: [898 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_182 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 1 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 898 [06/17/2021-17:55:06] [V] [TRT] Gather_182 [Gather] inputs: [1 -> (10, 26)], [898 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 898 for ONNX initializer: 898 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 1 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_182 for ONNX node: Gather_182 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 899 for ONNX tensor: 899 [06/17/2021-17:55:06] [V] [TRT] Gather_182 [Gather] outputs: [899 -> (10)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_183 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 899 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_183 [Unsqueeze] inputs: [899 -> (10)], [06/17/2021-17:55:06] [V] [TRT] Original shape: (10,), unsqueezing to: (10, 1) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_183 for ONNX node: Unsqueeze_183 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 900 for ONNX tensor: 900 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_183 [Unsqueeze] outputs: [900 -> (10, 1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_184 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_184 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_184 [Constant] outputs: [901 -> (10, 96)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_185 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 900 [06/17/2021-17:55:06] [V] [TRT] Shape_185 [Shape] inputs: [900 -> (10, 1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_185 for ONNX node: Shape_185 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 904 for ONNX tensor: 904 [06/17/2021-17:55:06] [V] [TRT] Shape_185 [Shape] outputs: [904 -> (2)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_186 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15332 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 904 [06/17/2021-17:55:06] [V] [TRT] Expand_186 [Expand] inputs: [15332 -> ()], [904 -> (2)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15332 for ONNX initializer: 15332 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_186 for ONNX node: Expand_186 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 905 for ONNX tensor: 905 [06/17/2021-17:55:06] [V] [TRT] Expand_186 [Expand] outputs: [905 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ScatterElements_187 [ScatterElements] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 901 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 900 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 905 [06/17/2021-17:55:06] [V] [TRT] ScatterElements_187 [ScatterElements] inputs: [901 -> (10, 96)], [900 -> (10, 1)], [905 -> (-1, -1)], [06/17/2021-17:55:06] [I] [TRT] No importer registered for op: ScatterElements. Attempting to import as plugin. [06/17/2021-17:55:06] [I] [TRT] Searching for plugin: ScatterElements, plugin_version: 1, plugin_namespace: getFieldNames createPlugin [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 901 for ONNX initializer: 901 [06/17/2021-17:55:06] [I] [TRT] Successfully created plugin: ScatterElements [06/17/2021-17:55:06] [V] [TRT] Registering layer: ScatterElements_187 for ONNX node: ScatterElements_187 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 906 for ONNX tensor: 906 [06/17/2021-17:55:06] [V] [TRT] ScatterElements_187 [ScatterElements] outputs: [906 -> (10, 96)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_188 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 895 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15333 [06/17/2021-17:55:06] [V] [TRT] MatMul_188 [MatMul] inputs: [895 -> (-1, -1, 1024)], [15333 -> (1024, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15333 for ONNX initializer: 15333 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_188 for ONNX node: MatMul_188 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 908 for ONNX tensor: 908 [06/17/2021-17:55:06] [V] [TRT] MatMul_188 [MatMul] outputs: [908 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_189 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 908 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Add_189 [Add] inputs: [908 -> (-1, -1, 512)], [ctx_block1.selective_decoder.second_attention.attention_cell.i2h.bias -> (512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.selective_decoder.second_attention.attention_cell.i2h.bias for ONNX initializer: ctx_block1.selective_decoder.second_attention.attention_cell.i2h.bias [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_189 for ONNX node: Add_189 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 909 for ONNX tensor: 909 [06/17/2021-17:55:06] [V] [TRT] Add_189 [Add] outputs: [909 -> (-1, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_190 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_190 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_190 [Constant] outputs: [910 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gemm_191 [Gemm] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 910 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Gemm_191 [Gemm] inputs: [910 -> (10, 512)], [ctx_block1.selective_decoder.second_attention.attention_cell.h2h.weight -> (512, 512)], [ctx_block1.selective_decoder.second_attention.attention_cell.h2h.bias -> (512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 910 for ONNX initializer: 910 [06/17/2021-17:55:06] [W] [TRT] /home/darshan/onnx-tensorrt/builtin_op_importers.cpp:1221: Weight ctx_block1.selective_decoder.second_attention.attention_cell.h2h.weight has been transposed! If you plan on overwriting this weight with the Refitter API, the new weights must be pre-transposed [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.weight for ONNX initializer: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.weight [06/17/2021-17:55:06] [V] [TRT] Using opA: 0 opB: 0 [06/17/2021-17:55:06] [V] [TRT] GEMM: A, after squeezing: (10, 512) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gemm_191 for ONNX node: Gemm_191 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.bias for ONNX initializer: ctx_block1.selective_decoder.second_attention.attention_cell.h2h.bias [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 911 for ONNX tensor: 911 [06/17/2021-17:55:06] [V] [TRT] Gemm_191 [Gemm] outputs: [911 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_192 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 911 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_192 [Unsqueeze] inputs: [911 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Original shape: (10, 512), unsqueezing to: (10, 1, 512) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_192 for ONNX node: Unsqueeze_192 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 912 for ONNX tensor: 912 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_192 [Unsqueeze] outputs: [912 -> (10, 1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_193 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 909 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 912 [06/17/2021-17:55:06] [V] [TRT] Add_193 [Add] inputs: [909 -> (-1, -1, 512)], [912 -> (10, 1, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_193 for ONNX node: Add_193 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 913 for ONNX tensor: 913 [06/17/2021-17:55:06] [V] [TRT] Add_193 [Add] outputs: [913 -> (10, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Tanh_194 [Tanh] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 913 [06/17/2021-17:55:06] [V] [TRT] Tanh_194 [Tanh] inputs: [913 -> (10, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Tanh_194 for ONNX node: Tanh_194 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 914 for ONNX tensor: 914 [06/17/2021-17:55:06] [V] [TRT] Tanh_194 [Tanh] outputs: [914 -> (10, -1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_195 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 914 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15334 [06/17/2021-17:55:06] [V] [TRT] MatMul_195 [MatMul] inputs: [914 -> (10, -1, 512)], [15334 -> (512, 1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15334 for ONNX initializer: 15334 [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_195 for ONNX node: MatMul_195 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 916 for ONNX tensor: 916 [06/17/2021-17:55:06] [V] [TRT] MatMul_195 [MatMul] outputs: [916 -> (10, -1, 1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Transpose_196 [Transpose] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 916 [06/17/2021-17:55:06] [V] [TRT] Transpose_196 [Transpose] inputs: [916 -> (10, -1, 1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Transpose_196 for ONNX node: Transpose_196 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 917 for ONNX tensor: 917 [06/17/2021-17:55:06] [V] [TRT] Transpose_196 [Transpose] outputs: [917 -> (10, 1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Softmax_197 [Softmax] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 917 [06/17/2021-17:55:06] [V] [TRT] Softmax_197 [Softmax] inputs: [917 -> (10, 1, -1)], [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering layer: Softmax_197 for ONNX node: Softmax_197 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 918 for ONNX tensor: 918 [06/17/2021-17:55:06] [V] [TRT] Softmax_197 [Softmax] outputs: [918 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: MatMul_198 [MatMul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 918 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 895 [06/17/2021-17:55:06] [V] [TRT] MatMul_198 [MatMul] inputs: [918 -> (-1, -1, -1)], [895 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: MatMul_198 for ONNX node: MatMul_198 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 919 for ONNX tensor: 919 [06/17/2021-17:55:06] [V] [TRT] MatMul_198 [MatMul] outputs: [919 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Squeeze_199 [Squeeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 919 [06/17/2021-17:55:06] [V] [TRT] Squeeze_199 [Squeeze] inputs: [919 -> (-1, -1, 1024)], [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _, 1024), squeezing to: (_, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Squeeze_199 for ONNX node: Squeeze_199 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 920 for ONNX tensor: 920 [06/17/2021-17:55:06] [V] [TRT] Squeeze_199 [Squeeze] outputs: [920 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_200 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 920 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 906 [06/17/2021-17:55:06] [V] [TRT] Concat_200 [Concat] inputs: [920 -> (-1, -1)], [906 -> (10, 96)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_200 for ONNX node: Concat_200 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 921 for ONNX tensor: 921 [06/17/2021-17:55:06] [V] [TRT] Concat_200 [Concat] outputs: [921 -> (10, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_201 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_201 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_201 [Constant] outputs: [922 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gemm_202 [Gemm] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 922 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Gemm_202 [Gemm] inputs: [922 -> (10, 512)], [ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_hh -> (2048, 512)], [ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_hh -> (2048)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 922 for ONNX initializer: 922 [06/17/2021-17:55:06] [W] [TRT] /home/darshan/onnx-tensorrt/builtin_op_importers.cpp:1221: Weight ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_hh has been transposed! If you plan on overwriting this weight with the Refitter API, the new weights must be pre-transposed [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_hh for ONNX initializer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_hh [06/17/2021-17:55:06] [V] [TRT] Using opA: 0 opB: 0 [06/17/2021-17:55:06] [V] [TRT] GEMM: A, after squeezing: (10, 512) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gemm_202 for ONNX node: Gemm_202 [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_hh for ONNX initializer: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_hh [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 923 for ONNX tensor: 923 [06/17/2021-17:55:06] [V] [TRT] Gemm_202 [Gemm] outputs: [923 -> (10, 2048)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gemm_203 [Gemm] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 921 [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_ih [06/17/2021-17:55:06] [V] [TRT] Searching for input: ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_ih [06/17/2021-17:55:06] [V] [TRT] Gemm_203 [Gemm] inputs: [921 -> (10, -1)], [ctx_block1.selective_decoder.second_attention.attention_cell.rnn.weight_ih -> (2048, 1120)], [ctx_block1.selective_decoder.second_attention.attention_cell.rnn.bias_ih -> (2048)], [06/17/2021-17:55:06] [V] [TRT] GEMM: using FC layer instead of MM because all criteria were met. [06/17/2021-17:55:06] [V] [TRT] Original shape: (10, _), unsqueezing to: (_, _, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gemm_203 for ONNX node: Gemm_203 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, 2048, 1, 1), squeezing to: (_, _) [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 924 for ONNX tensor: 924 [06/17/2021-17:55:06] [V] [TRT] Gemm_203 [Gemm] outputs: [924 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_204 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 923 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 924 [06/17/2021-17:55:06] [V] [TRT] Add_204 [Add] inputs: [923 -> (10, 2048)], [924 -> (-1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_204 for ONNX node: Add_204 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 925 for ONNX tensor: 925 [06/17/2021-17:55:06] [V] [TRT] Add_204 [Add] outputs: [925 -> (10, 2048)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Split_205 [Split] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 925 [06/17/2021-17:55:06] [V] [TRT] Split_205 [Split] inputs: [925 -> (10, 2048)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Split_205 for ONNX node: Split_205 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Split_205_1 for ONNX node: Split_205 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Split_205_2 for ONNX node: Split_205 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Split_205_3 for ONNX node: Split_205 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 926 for ONNX tensor: 926 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 928 for ONNX tensor: 928 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 929 for ONNX tensor: 929 [06/17/2021-17:55:06] [V] [TRT] Split_205 [Split] outputs: [926 -> (10, 512)], [927 -> (10, 512)], [928 -> (10, 512)], [929 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Sigmoid_206 [Sigmoid] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 926 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_206 [Sigmoid] inputs: [926 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Sigmoid_206 for ONNX node: Sigmoid_206 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 930 for ONNX tensor: 930 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_206 [Sigmoid] outputs: [930 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Sigmoid_207 [Sigmoid] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 927 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_207 [Sigmoid] inputs: [927 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Sigmoid_207 for ONNX node: Sigmoid_207 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 931 for ONNX tensor: 931 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_207 [Sigmoid] outputs: [931 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Tanh_208 [Tanh] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 928 [06/17/2021-17:55:06] [V] [TRT] Tanh_208 [Tanh] inputs: [928 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Tanh_208 for ONNX node: Tanh_208 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 932 for ONNX tensor: 932 [06/17/2021-17:55:06] [V] [TRT] Tanh_208 [Tanh] outputs: [932 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Sigmoid_209 [Sigmoid] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 929 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_209 [Sigmoid] inputs: [929 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Sigmoid_209 for ONNX node: Sigmoid_209 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 933 for ONNX tensor: 933 [06/17/2021-17:55:06] [V] [TRT] Sigmoid_209 [Sigmoid] outputs: [933 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_210 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_210 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_210 [Constant] outputs: [934 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_211 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 931 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 934 [06/17/2021-17:55:06] [V] [TRT] Mul_211 [Mul] inputs: [931 -> (10, 512)], [934 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 934 for ONNX initializer: 934 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_211 for ONNX node: Mul_211 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 935 for ONNX tensor: 935 [06/17/2021-17:55:06] [V] [TRT] Mul_211 [Mul] outputs: [935 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_212 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 930 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 932 [06/17/2021-17:55:06] [V] [TRT] Mul_212 [Mul] inputs: [930 -> (10, 512)], [932 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_212 for ONNX node: Mul_212 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 936 for ONNX tensor: 936 [06/17/2021-17:55:06] [V] [TRT] Mul_212 [Mul] outputs: [936 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_213 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 935 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 936 [06/17/2021-17:55:06] [V] [TRT] Add_213 [Add] inputs: [935 -> (10, 512)], [936 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_213 for ONNX node: Add_213 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 937 for ONNX tensor: 937 [06/17/2021-17:55:06] [V] [TRT] Add_213 [Add] outputs: [937 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Tanh_214 [Tanh] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 937 [06/17/2021-17:55:06] [V] [TRT] Tanh_214 [Tanh] inputs: [937 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Tanh_214 for ONNX node: Tanh_214 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 938 for ONNX tensor: 938 [06/17/2021-17:55:06] [V] [TRT] Tanh_214 [Tanh] outputs: [938 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_215 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 933 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 938 [06/17/2021-17:55:06] [V] [TRT] Mul_215 [Mul] inputs: [933 -> (10, 512)], [938 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_215 for ONNX node: Mul_215 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 939 for ONNX tensor: 939 [06/17/2021-17:55:06] [V] [TRT] Mul_215 [Mul] outputs: [939 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_216 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 939 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15336 [06/17/2021-17:55:06] [V] [TRT] Expand_216 [Expand] inputs: [939 -> (10, 512)], [15336 -> (2)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_216 for ONNX node: Expand_216 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 943 for ONNX tensor: 943 [06/17/2021-17:55:06] [V] [TRT] Expand_216 [Expand] outputs: [943 -> (10, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_217 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_217 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_217 [Constant] outputs: [948 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_218 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_218 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_218 [Constant] outputs: [949 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Range_219 [Range] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 948 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15339 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 949 [06/17/2021-17:55:06] [V] [TRT] Range_219 [Range] inputs: [948 -> ()], [15339 -> ()], [949 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Range_219 for ONNX node: Range_219 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 950 for ONNX tensor: 950 [06/17/2021-17:55:06] [V] [TRT] Range_219 [Range] outputs: [950 -> (10)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_220 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_220 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_220 [Constant] outputs: [956 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_221 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_221 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_221 [Constant] outputs: [957 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Range_222 [Range] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 956 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15343 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 957 [06/17/2021-17:55:06] [V] [TRT] Range_222 [Range] inputs: [956 -> ()], [15343 -> ()], [957 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Range_222 for ONNX node: Range_222 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 958 for ONNX tensor: 958 [06/17/2021-17:55:06] [V] [TRT] Range_222 [Range] outputs: [958 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_223 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_223 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_223 [Constant] outputs: [959 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_224 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 950 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 959 [06/17/2021-17:55:06] [V] [TRT] Reshape_224 [Reshape] inputs: [950 -> (10)], [959 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_224 for ONNX node: Reshape_224 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 960 for ONNX tensor: 960 [06/17/2021-17:55:06] [V] [TRT] Reshape_224 [Reshape] outputs: [960 -> (10, 1, 1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_225 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_225 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_225 [Constant] outputs: [963 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_226 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 958 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 963 [06/17/2021-17:55:06] [V] [TRT] Reshape_226 [Reshape] inputs: [958 -> (512)], [963 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_226 for ONNX node: Reshape_226 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 964 for ONNX tensor: 964 [06/17/2021-17:55:06] [V] [TRT] Reshape_226 [Reshape] outputs: [964 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_227 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 960 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15344 [06/17/2021-17:55:06] [V] [TRT] Add_227 [Add] inputs: [960 -> (10, 1, 1)], [15344 -> (1, 1)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15344 for ONNX initializer: 15344 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_227 for ONNX node: Add_227 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 965 for ONNX tensor: 965 [06/17/2021-17:55:06] [V] [TRT] Add_227 [Add] outputs: [965 -> (10, 1, 1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Add_228 [Add] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 965 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 964 [06/17/2021-17:55:06] [V] [TRT] Add_228 [Add] inputs: [965 -> (10, 1, 1)], [964 -> (512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Add_228 for ONNX node: Add_228 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 966 for ONNX tensor: 966 [06/17/2021-17:55:06] [V] [TRT] Add_228 [Add] outputs: [966 -> (10, 1, 512)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_229 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 966 [06/17/2021-17:55:06] [V] [TRT] Shape_229 [Shape] inputs: [966 -> (10, 1, 512)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_229 for ONNX node: Shape_229 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 967 for ONNX tensor: 967 [06/17/2021-17:55:06] [V] [TRT] Shape_229 [Shape] outputs: [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_230 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Shape_230 [Shape] inputs: [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_230 for ONNX node: Shape_230 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 968 for ONNX tensor: 968 [06/17/2021-17:55:06] [V] [TRT] Shape_230 [Shape] outputs: [968 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_231 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 968 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_231 [ConstantOfShape] inputs: [968 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_231 for ONNX node: ConstantOfShape_231 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 969 for ONNX tensor: 969 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_231 [ConstantOfShape] outputs: [969 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_232 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_232 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_232 [Constant] outputs: [970 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_233 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 969 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 970 [06/17/2021-17:55:06] [V] [TRT] Mul_233 [Mul] inputs: [969 -> (-1)], [970 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 970 for ONNX initializer: 970 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_233 for ONNX node: Mul_233 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 971 for ONNX tensor: 971 [06/17/2021-17:55:06] [V] [TRT] Mul_233 [Mul] outputs: [971 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Equal_234 [Equal] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 971 [06/17/2021-17:55:06] [V] [TRT] Equal_234 [Equal] inputs: [967 -> (3)], [971 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Equal_234 for ONNX node: Equal_234 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 972 for ONNX tensor: 972 [06/17/2021-17:55:06] [V] [TRT] Equal_234 [Equal] outputs: [972 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Where_235 [Where] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 972 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 969 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Where_235 [Where] inputs: [972 -> (3)], [969 -> (-1)], [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Where_235 for ONNX node: Where_235 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 973 for ONNX tensor: 973 [06/17/2021-17:55:06] [V] [TRT] Where_235 [Where] outputs: [973 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_236 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 960 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 973 [06/17/2021-17:55:06] [V] [TRT] Expand_236 [Expand] inputs: [960 -> (10, 1, 1)], [973 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_236 for ONNX node: Expand_236 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 974 for ONNX tensor: 974 [06/17/2021-17:55:06] [V] [TRT] Expand_236 [Expand] outputs: [974 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_237 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 974 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_237 [Unsqueeze] inputs: [974 -> (-1, -1, -1)], [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _, _), unsqueezing to: (_, _, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_237 for ONNX node: Unsqueeze_237 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 975 for ONNX tensor: 975 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_237 [Unsqueeze] outputs: [975 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_238 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Shape_238 [Shape] inputs: [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_238 for ONNX node: Shape_238 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 976 for ONNX tensor: 976 [06/17/2021-17:55:06] [V] [TRT] Shape_238 [Shape] outputs: [976 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_239 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 976 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_239 [ConstantOfShape] inputs: [976 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_239 for ONNX node: ConstantOfShape_239 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 977 for ONNX tensor: 977 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_239 [ConstantOfShape] outputs: [977 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_240 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_240 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_240 [Constant] outputs: [978 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_241 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 977 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 978 [06/17/2021-17:55:06] [V] [TRT] Mul_241 [Mul] inputs: [977 -> (-1)], [978 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 978 for ONNX initializer: 978 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_241 for ONNX node: Mul_241 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 979 for ONNX tensor: 979 [06/17/2021-17:55:06] [V] [TRT] Mul_241 [Mul] outputs: [979 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Equal_242 [Equal] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 979 [06/17/2021-17:55:06] [V] [TRT] Equal_242 [Equal] inputs: [967 -> (3)], [979 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Equal_242 for ONNX node: Equal_242 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 980 for ONNX tensor: 980 [06/17/2021-17:55:06] [V] [TRT] Equal_242 [Equal] outputs: [980 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Where_243 [Where] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 980 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 977 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Where_243 [Where] inputs: [980 -> (3)], [977 -> (-1)], [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Where_243 for ONNX node: Where_243 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 981 for ONNX tensor: 981 [06/17/2021-17:55:06] [V] [TRT] Where_243 [Where] outputs: [981 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_244 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15344 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 981 [06/17/2021-17:55:06] [V] [TRT] Expand_244 [Expand] inputs: [15344 -> (1, 1)], [981 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15344_4 for ONNX initializer: 15344 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_244 for ONNX node: Expand_244 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 982 for ONNX tensor: 982 [06/17/2021-17:55:06] [V] [TRT] Expand_244 [Expand] outputs: [982 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_245 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 982 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_245 [Unsqueeze] inputs: [982 -> (-1, -1, -1)], [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _, _), unsqueezing to: (_, _, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_245 for ONNX node: Unsqueeze_245 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 983 for ONNX tensor: 983 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_245 [Unsqueeze] outputs: [983 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Shape_246 [Shape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Shape_246 [Shape] inputs: [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Shape_246 for ONNX node: Shape_246 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 984 for ONNX tensor: 984 [06/17/2021-17:55:06] [V] [TRT] Shape_246 [Shape] outputs: [984 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ConstantOfShape_247 [ConstantOfShape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 984 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_247 [ConstantOfShape] inputs: [984 -> (1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: ConstantOfShape_247 for ONNX node: ConstantOfShape_247 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 985 for ONNX tensor: 985 [06/17/2021-17:55:06] [V] [TRT] ConstantOfShape_247 [ConstantOfShape] outputs: [985 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_248 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_248 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_248 [Constant] outputs: [986 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Mul_249 [Mul] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 985 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 986 [06/17/2021-17:55:06] [V] [TRT] Mul_249 [Mul] inputs: [985 -> (-1)], [986 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 986 for ONNX initializer: 986 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering layer: Mul_249 for ONNX node: Mul_249 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 987 for ONNX tensor: 987 [06/17/2021-17:55:06] [V] [TRT] Mul_249 [Mul] outputs: [987 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Equal_250 [Equal] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 987 [06/17/2021-17:55:06] [V] [TRT] Equal_250 [Equal] inputs: [967 -> (3)], [987 -> (-1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Equal_250 for ONNX node: Equal_250 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 988 for ONNX tensor: 988 [06/17/2021-17:55:06] [V] [TRT] Equal_250 [Equal] outputs: [988 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Where_251 [Where] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 988 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 985 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Where_251 [Where] inputs: [988 -> (3)], [985 -> (-1)], [967 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Where_251 for ONNX node: Where_251 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 989 for ONNX tensor: 989 [06/17/2021-17:55:06] [V] [TRT] Where_251 [Where] outputs: [989 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Expand_252 [Expand] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 964 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 989 [06/17/2021-17:55:06] [V] [TRT] Expand_252 [Expand] inputs: [964 -> (512)], [989 -> (3)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Expand_252 for ONNX node: Expand_252 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 990 for ONNX tensor: 990 [06/17/2021-17:55:06] [V] [TRT] Expand_252 [Expand] outputs: [990 -> (-1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_253 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 990 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_253 [Unsqueeze] inputs: [990 -> (-1, -1, -1)], [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Original shape: (_, _, _), unsqueezing to: (_, _, _, _) [06/17/2021-17:55:06] [V] [TRT] Registering layer: Unsqueeze_253 for ONNX node: Unsqueeze_253 [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 991 for ONNX tensor: 991 [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_253 [Unsqueeze] outputs: [991 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_254 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 975 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 983 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 991 [06/17/2021-17:55:06] [V] [TRT] Concat_254 [Concat] inputs: [975 -> (-1, -1, -1, -1)], [983 -> (-1, -1, -1, -1)], [991 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_254 for ONNX node: Concat_254 [06/17/2021-17:55:06] [I] [TRT] MatMul_195: broadcasting input1 to make tensors conform, dims(input0)=[10,-1,512][NONE] dims(input1)=[1,512,1][NONE]. [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 992 for ONNX tensor: 992 [06/17/2021-17:55:06] [V] [TRT] Concat_254 [Concat] outputs: [992 -> (-1, -1, -1, -1)], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Concat_255 [Concat] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 967 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15346 [06/17/2021-17:55:06] [V] [TRT] Concat_255 [Concat] inputs: [967 -> (3)], [15346 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering layer: Concat_255 for ONNX node: Concat_255 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 998 for ONNX tensor: 998 [06/17/2021-17:55:06] [V] [TRT] Concat_255 [Concat] outputs: [998 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Reshape_256 [Reshape] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 943 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 998 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Reshape_256 [Reshape] inputs: [943 -> (10, 512)], [998 -> ()], [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Registering layer: Reshape_256 for ONNX node: Reshape_256 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 999 for ONNX tensor: 999 [06/17/2021-17:55:06] [V] [TRT] Reshape_256 [Reshape] outputs: [999 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: ScatterND_257 [ScatterND] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 15331 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 992 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Searching for input: 999 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] ScatterND_257 [ScatterND] inputs: [15331 -> (10, 26, 512)], [992 -> ()], [999 -> ()], [06/17/2021-17:55:06] [I] [TRT] No importer registered for op: ScatterND. Attempting to import as plugin. [06/17/2021-17:55:06] [I] [TRT] Searching for plugin: ScatterND, plugin_version: 1, plugin_namespace: getFieldNames createPlugin [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 15331 for ONNX initializer: 15331 [06/17/2021-17:55:06] [I] [TRT] Successfully created plugin: ScatterND [06/17/2021-17:55:06] [V] [TRT] Registering layer: ScatterND_257 for ONNX node: ScatterND_257 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 1000 for ONNX tensor: 1000 [06/17/2021-17:55:06] [V] [TRT] ScatterND_257 [ScatterND] outputs: [1000 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Constant_258 [Constant] [06/17/2021-17:55:06] [V] [TRT] Constant_258 [Constant] inputs: [06/17/2021-17:55:06] [V] [TRT] Constant_258 [Constant] outputs: [1001 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Gather_259 [Gather] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 1 [06/17/2021-17:55:06] [V] [TRT] Searching for input: 1001 [06/17/2021-17:55:06] [V] [TRT] Gather_259 [Gather] inputs: [1 -> (10, 26)], [1001 -> ()], [06/17/2021-17:55:06] [V] [TRT] Registering constant layer: 1001 for ONNX initializer: 1001 [06/17/2021-17:55:06] [V] [TRT] Using Gather axis: 1 [06/17/2021-17:55:06] [V] [TRT] Registering layer: Gather_259 for ONNX node: Gather_259 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Registering tensor: 1002 for ONNX tensor: 1002 [06/17/2021-17:55:06] [V] [TRT] Gather_259 [Gather] outputs: [1002 -> ()], [06/17/2021-17:55:06] [V] [TRT] Parsing node: Unsqueeze_260 [Unsqueeze] [06/17/2021-17:55:06] [V] [TRT] Searching for input: 1002 [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [V] [TRT] Unsqueeze_260 [Unsqueeze] inputs: [1002 -> ()], [06/17/2021-17:55:06] [E] [TRT] (Unnamed Layer* 634) [Constant]: constant weights has count 0 but 1 was expected [06/17/2021-17:55:06] [E] [TRT] /home/darshan/onnx-tensorrt/ModelImporter.cpp:703: While parsing node number 260 [Unsqueeze -> "1003"]: [06/17/2021-17:55:06] [E] [TRT] /home/darshan/onnx-tensorrt/ModelImporter.cpp:704: --- Begin node --- [06/17/2021-17:55:06] [E] [TRT] /home/darshan/onnx-tensorrt/ModelImporter.cpp:705: input: "1002" output: "1003" name: "Unsqueeze_260" op_type: "Unsqueeze" attribute { name: "axes" ints: 1 type: INTS } [06/17/2021-17:55:06] [E] [TRT] /home/darshan/onnx-tensorrt/ModelImporter.cpp:706: --- End node --- [06/17/2021-17:55:06] [E] [TRT] /home/darshan/onnx-tensorrt/ModelImporter.cpp:709: ERROR: /home/darshan/onnx-tensorrt/onnx2trt_utils.cpp:196 In function convertAxis: [8] Assertion failed: axis >= 0 && axis < nbDims [06/17/2021-17:55:06] [E] Failed to parse onnx file [06/17/2021-17:55:06] [E] Parsing model failed [06/17/2021-17:55:06] [E] Engine creation failed [06/17/2021-17:55:06] [E] Engine set up failed