&&&& RUNNING TensorRT.trtexec [TensorRT v8401] # /workspace/TensorRT/build/out/trtexec --onnx=sparse-bert-large-uncased-squad_opset11.onnx --saveEngine=bs_256_sparse-bert-large-uncased-squad_opset11.trt --duration=10 --workspace=10000 --fp16 --useCudaGraph --dumpProfile --separateProfileRun --sparsity=enable --optShapes=input_mask:256x128,segment_ids:256x128,input_ids:256x128 --verbose [06/20/2022-16:24:32] [W] --workspace flag has been deprecated by --memPoolSize flag. [06/20/2022-16:24:32] [I] === Model Options === [06/20/2022-16:24:32] [I] Format: ONNX [06/20/2022-16:24:32] [I] Model: sparse-bert-large-uncased-squad_opset11.onnx [06/20/2022-16:24:32] [I] Output: [06/20/2022-16:24:32] [I] === Build Options === [06/20/2022-16:24:32] [I] Max batch: explicit batch [06/20/2022-16:24:32] [I] Memory Pools: workspace: 10000 MiB, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [06/20/2022-16:24:32] [I] minTiming: 1 [06/20/2022-16:24:32] [I] avgTiming: 8 [06/20/2022-16:24:32] [I] Precision: FP32+FP16 [06/20/2022-16:24:32] [I] LayerPrecisions: [06/20/2022-16:24:32] [I] Calibration: [06/20/2022-16:24:32] [I] Refit: Disabled [06/20/2022-16:24:32] [I] Sparsity: Enabled [06/20/2022-16:24:32] [I] Safe mode: Disabled [06/20/2022-16:24:32] [I] DirectIO mode: Disabled [06/20/2022-16:24:32] [I] Restricted mode: Disabled [06/20/2022-16:24:32] [I] Build only: Disabled [06/20/2022-16:24:32] [I] Save engine: bs_256_sparse-bert-large-uncased-squad_opset11.trt [06/20/2022-16:24:32] [I] Load engine: [06/20/2022-16:24:32] [I] Profiling verbosity: 0 [06/20/2022-16:24:32] [I] Tactic sources: Using default tactic sources [06/20/2022-16:24:32] [I] timingCacheMode: local [06/20/2022-16:24:32] [I] timingCacheFile: [06/20/2022-16:24:32] [I] Input(s)s format: fp32:CHW [06/20/2022-16:24:32] [I] Output(s)s format: fp32:CHW [06/20/2022-16:24:32] [I] Input build shape: input_ids=256x128+256x128+256x128 [06/20/2022-16:24:32] [I] Input build shape: segment_ids=256x128+256x128+256x128 [06/20/2022-16:24:32] [I] Input build shape: input_mask=256x128+256x128+256x128 [06/20/2022-16:24:32] [I] Input calibration shapes: model [06/20/2022-16:24:32] [I] === System Options === [06/20/2022-16:24:32] [I] Device: 0 [06/20/2022-16:24:32] [I] DLACore: [06/20/2022-16:24:32] [I] Plugins: [06/20/2022-16:24:32] [I] === Inference Options === [06/20/2022-16:24:32] [I] Batch: Explicit [06/20/2022-16:24:32] [I] Input inference shape: input_ids=256x128 [06/20/2022-16:24:32] [I] Input inference shape: input_mask=256x128 [06/20/2022-16:24:32] [I] Input inference shape: segment_ids=256x128 [06/20/2022-16:24:32] [I] Iterations: 10 [06/20/2022-16:24:32] [I] Duration: 10s (+ 200ms warm up) [06/20/2022-16:24:32] [I] Sleep time: 0ms [06/20/2022-16:24:32] [I] Idle time: 0ms [06/20/2022-16:24:32] [I] Streams: 1 [06/20/2022-16:24:32] [I] ExposeDMA: Disabled [06/20/2022-16:24:32] [I] Data transfers: Enabled [06/20/2022-16:24:32] [I] Spin-wait: Disabled [06/20/2022-16:24:32] [I] Multithreading: Disabled [06/20/2022-16:24:32] [I] CUDA Graph: Enabled [06/20/2022-16:24:32] [I] Separate profiling: Enabled [06/20/2022-16:24:32] [I] Time Deserialize: Disabled [06/20/2022-16:24:32] [I] Time Refit: Disabled [06/20/2022-16:24:32] [I] Inputs: [06/20/2022-16:24:32] [I] === Reporting Options === [06/20/2022-16:24:32] [I] Verbose: Enabled [06/20/2022-16:24:32] [I] Averages: 10 inferences [06/20/2022-16:24:32] [I] Percentile: 99 [06/20/2022-16:24:32] [I] Dump refittable layers:Disabled [06/20/2022-16:24:32] [I] Dump output: Disabled [06/20/2022-16:24:32] [I] Profile: Enabled [06/20/2022-16:24:32] [I] Export timing to JSON file: [06/20/2022-16:24:32] [I] Export output to JSON file: [06/20/2022-16:24:32] [I] Export profile to JSON file: [06/20/2022-16:24:32] [I] [06/20/2022-16:24:32] [I] === Device Information === [06/20/2022-16:24:32] [I] Selected Device: NVIDIA A100-PCIE-40GB [06/20/2022-16:24:32] [I] Compute Capability: 8.0 [06/20/2022-16:24:32] [I] SMs: 108 [06/20/2022-16:24:32] [I] Compute Clock Rate: 1.41 GHz [06/20/2022-16:24:32] [I] Device Global Memory: 40390 MiB [06/20/2022-16:24:32] [I] Shared Memory per SM: 164 KiB [06/20/2022-16:24:32] [I] Memory Bus Width: 5120 bits (ECC enabled) [06/20/2022-16:24:32] [I] Memory Clock Rate: 1.215 GHz [06/20/2022-16:24:32] [I] [06/20/2022-16:24:32] [I] TensorRT version: 8.4.1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::DecodeBbox3DPlugin version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::EfficientNMS_Explicit_TF_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::EfficientNMS_Implicit_TF_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::MultiscaleDeformableAttnPlugin_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::PillarScatterPlugin version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::Proposal version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::Split version 1 [06/20/2022-16:24:32] [V] [TRT] Registered plugin creator - ::VoxelGeneratorPlugin version 1 [06/20/2022-16:24:33] [I] [TRT] [MemUsageChange] Init CUDA: CPU +330, GPU +0, now: CPU 339, GPU 11155 (MiB) [06/20/2022-16:24:34] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +413, GPU +132, now: CPU 769, GPU 11287 (MiB) [06/20/2022-16:24:34] [I] Start parsing network model [libprotobuf WARNING /workspace/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/io/coded_stream.cc:604] Reading dangerously large protocol message. If the message turns out to be larger than 2147483647 bytes, parsing will be halted for security reasons. To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h. [libprotobuf WARNING /workspace/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/io/coded_stream.cc:81] The total number of bytes read was 1336517802 [06/20/2022-16:24:35] [I] [TRT] ---------------------------------------------------------------- [06/20/2022-16:24:35] [I] [TRT] Input filename: sparse-bert-large-uncased-squad_opset11.onnx [06/20/2022-16:24:35] [I] [TRT] ONNX IR version: 0.0.6 [06/20/2022-16:24:35] [I] [TRT] Opset version: 11 [06/20/2022-16:24:35] [I] [TRT] Producer name: pytorch [06/20/2022-16:24:35] [I] [TRT] Producer version: 1.9 [06/20/2022-16:24:35] [I] [TRT] Domain: [06/20/2022-16:24:35] [I] [TRT] Model version: 0 [06/20/2022-16:24:35] [I] [TRT] Doc string: [06/20/2022-16:24:35] [I] [TRT] ---------------------------------------------------------------- [libprotobuf WARNING /workspace/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/io/coded_stream.cc:604] Reading dangerously large protocol message. If the message turns out to be larger than 2147483647 bytes, parsing will be halted for security reasons. To increase the limit (or to disable these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h. [libprotobuf WARNING /workspace/TensorRT/build/third_party.protobuf/src/third_party.protobuf/src/google/protobuf/io/coded_stream.cc:81] The total number of bytes read was 1336517802 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::DecodeBbox3DPlugin version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Explicit_TF_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_Implicit_TF_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::MultiscaleDeformableAttnPlugin_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::PillarScatterPlugin version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::Split version 1 [06/20/2022-16:24:37] [V] [TRT] Plugin creator already registered - ::VoxelGeneratorPlugin version 1 [06/20/2022-16:24:37] [V] [TRT] Adding network input: input_ids with dtype: int32, dimensions: (-1, -1) [06/20/2022-16:24:37] [V] [TRT] Registering tensor: input_ids for ONNX tensor: input_ids [06/20/2022-16:24:37] [V] [TRT] Adding network input: input_mask with dtype: int32, dimensions: (-1, -1) [06/20/2022-16:24:37] [V] [TRT] Registering tensor: input_mask for ONNX tensor: input_mask [06/20/2022-16:24:37] [V] [TRT] Adding network input: segment_ids with dtype: int32, dimensions: (-1, -1) [06/20/2022-16:24:37] [V] [TRT] Registering tensor: segment_ids for ONNX tensor: segment_ids [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.embeddings.position_ids [06/20/2022-16:24:37] [W] [TRT] parsers/onnx/onnx2trt_utils.cpp:369: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.embeddings.word_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.embeddings.position_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.embeddings.token_type_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.embeddings.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.embeddings.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.0.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.1.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.2.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.3.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.4.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.5.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.6.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.7.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.8.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.9.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.10.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.11.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.12.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.13.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.14.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.15.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.16.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.17.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.18.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.19.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.20.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.21.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.22.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Importing initializer: bert.encoder.layer.23.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: qa_outputs.bias [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3173 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3174 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3175 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3176 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3177 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3178 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3179 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3180 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3181 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3182 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3183 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3184 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3185 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3186 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3187 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3188 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3189 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3190 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3191 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3192 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3193 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3194 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3195 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3196 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3197 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3198 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3199 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3200 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3201 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3202 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3203 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3204 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3205 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3206 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3207 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3208 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3209 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3210 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3211 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3212 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3213 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3214 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3215 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3216 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3217 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3218 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3219 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3220 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3221 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3222 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3223 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3224 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3225 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3226 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3227 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3228 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3229 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3230 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3231 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3232 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3233 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3234 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3235 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3236 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3237 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3238 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3239 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3240 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3241 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3242 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3243 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3244 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3245 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3246 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3247 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3248 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3249 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3250 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3251 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3252 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3253 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3254 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3255 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3256 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3257 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3258 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3259 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3260 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3261 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3262 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3263 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3264 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3265 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3266 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3267 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3268 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3269 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3270 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3271 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3272 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3273 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3274 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3275 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3276 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3277 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3278 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3279 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3280 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3281 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3282 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3283 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3284 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3285 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3286 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3287 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3288 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3289 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3290 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3291 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3292 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3293 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3294 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3295 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3296 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3297 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3298 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3299 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3300 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3301 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3302 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3303 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3304 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3305 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3306 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3307 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3308 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3309 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3310 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3311 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3312 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3313 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3314 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3315 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3316 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3317 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3318 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3319 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3320 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3321 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3322 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3323 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3324 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3325 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3326 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3327 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3328 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3329 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3330 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3331 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3332 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3333 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3334 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3335 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3336 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3337 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3338 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3339 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3340 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3341 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3342 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3343 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3344 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3345 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3346 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3347 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3348 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3349 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3350 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3351 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3352 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3353 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3354 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3355 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3356 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3357 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3358 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3359 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3360 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3361 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3362 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3363 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3364 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3365 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3366 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3367 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3368 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3369 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3370 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3371 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3372 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3373 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3374 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3375 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3376 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3377 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3378 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3379 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3380 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3381 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3382 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3383 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3384 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3385 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3386 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3387 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3388 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3389 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3390 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3391 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3392 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3393 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3394 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3395 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3396 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3397 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3398 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3399 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3400 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3401 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3402 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3403 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3404 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3405 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3406 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3407 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3408 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3409 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3410 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3411 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3412 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3413 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3414 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3415 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3416 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3417 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3418 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3419 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3420 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3421 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3422 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3423 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3424 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3425 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3426 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3427 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3428 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3429 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3430 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3431 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3432 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3433 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3434 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3435 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3436 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3437 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3438 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3439 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3440 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3441 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3442 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3443 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3444 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3445 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3446 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3447 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3448 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3449 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3450 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3451 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3452 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3453 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3454 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3455 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3456 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3457 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3458 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3459 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3460 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3461 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3462 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3463 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3464 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3465 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3466 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3467 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3468 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3469 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3470 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3471 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3472 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3473 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3474 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3475 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3476 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3477 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3478 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3479 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3480 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3481 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3482 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3483 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3484 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3485 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3486 [06/20/2022-16:24:37] [V] [TRT] Importing initializer: 3487 [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_0 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: input_mask [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_0 [Unsqueeze] inputs: [input_mask -> (-1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_0 for ONNX node: Unsqueeze_0 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 395 for ONNX tensor: 395 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_0 [Unsqueeze] outputs: [395 -> (-1, 1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_1 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 395 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_1 [Unsqueeze] inputs: [395 -> (-1, 1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_1 for ONNX node: Unsqueeze_1 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 396 for ONNX tensor: 396 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_1 [Unsqueeze] outputs: [396 -> (-1, 1, 1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Cast_2 [Cast] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 396 [06/20/2022-16:24:37] [V] [TRT] Cast_2 [Cast] inputs: [396 -> (-1, 1, 1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Casting to type: float32 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Cast_2 for ONNX node: Cast_2 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 397 for ONNX tensor: 397 [06/20/2022-16:24:37] [V] [TRT] Cast_2 [Cast] outputs: [397 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_3 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_3 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_3 [Constant] outputs: [398 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_4 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 398 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 397 [06/20/2022-16:24:37] [V] [TRT] Sub_4 [Sub] inputs: [398 -> ()[FLOAT]], [397 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 398 for ONNX node: 398 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_4 for ONNX node: Sub_4 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 399 for ONNX tensor: 399 [06/20/2022-16:24:37] [V] [TRT] Sub_4 [Sub] outputs: [399 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_5 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_5 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_5 [Constant] outputs: [400 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_6 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 399 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 400 [06/20/2022-16:24:37] [V] [TRT] Mul_6 [Mul] inputs: [399 -> (-1, 1, 1, -1)[FLOAT]], [400 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 400 for ONNX node: 400 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_6 for ONNX node: Mul_6 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 401 for ONNX tensor: 401 [06/20/2022-16:24:37] [V] [TRT] Mul_6 [Mul] outputs: [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_7 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: input_ids [06/20/2022-16:24:37] [V] [TRT] Shape_7 [Shape] inputs: [input_ids -> (-1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_7 for ONNX node: Shape_7 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 402 for ONNX tensor: 402 [06/20/2022-16:24:37] [V] [TRT] Shape_7 [Shape] outputs: [402 -> (2)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_8 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_8 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_8 [Constant] outputs: [403 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_9 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 402 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 403 [06/20/2022-16:24:37] [V] [TRT] Gather_9 [Gather] inputs: [402 -> (2)[INT32]], [403 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 403 for ONNX node: 403 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_9 for ONNX node: Gather_9 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 404 for ONNX tensor: 404 [06/20/2022-16:24:37] [V] [TRT] Gather_9 [Gather] outputs: [404 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_10 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_10 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_10 [Constant] outputs: [405 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_11 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 404 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 405 [06/20/2022-16:24:37] [V] [TRT] Add_11 [Add] inputs: [404 -> ()[INT32]], [405 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 405 for ONNX node: 405 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_11 for ONNX node: Add_11 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 406 for ONNX tensor: 406 [06/20/2022-16:24:37] [V] [TRT] Add_11 [Add] outputs: [406 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_12 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 406 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_12 [Unsqueeze] inputs: [406 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_12 for ONNX node: Unsqueeze_12 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 410 for ONNX tensor: 410 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_12 [Unsqueeze] outputs: [410 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_13 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_13 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_13 [Constant] outputs: [412 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Slice_14 [Slice] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.embeddings.position_ids [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3173 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 410 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3174 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 412 [06/20/2022-16:24:37] [V] [TRT] Slice_14 [Slice] inputs: [bert.embeddings.position_ids -> (1, 512)[INT32]], [3173 -> (1)[INT32]], [410 -> (1)[INT32]], [3174 -> (1)[INT32]], [412 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.embeddings.position_ids for ONNX node: bert.embeddings.position_ids [06/20/2022-16:24:37] [V] [TRT] Registering layer: Slice_14 for ONNX node: Slice_14 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 413 for ONNX tensor: 413 [06/20/2022-16:24:37] [V] [TRT] Slice_14 [Slice] outputs: [413 -> (1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_15 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.embeddings.word_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Searching for input: input_ids [06/20/2022-16:24:37] [V] [TRT] Gather_15 [Gather] inputs: [bert.embeddings.word_embeddings.weight -> (30522, 1024)[FLOAT]], [input_ids -> (-1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.embeddings.word_embeddings.weight for ONNX node: bert.embeddings.word_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_15 for ONNX node: Gather_15 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 414 for ONNX tensor: 414 [06/20/2022-16:24:37] [V] [TRT] Gather_15 [Gather] outputs: [414 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_16 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.embeddings.token_type_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Searching for input: segment_ids [06/20/2022-16:24:37] [V] [TRT] Gather_16 [Gather] inputs: [bert.embeddings.token_type_embeddings.weight -> (2, 1024)[FLOAT]], [segment_ids -> (-1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.embeddings.token_type_embeddings.weight for ONNX node: bert.embeddings.token_type_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_16 for ONNX node: Gather_16 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 415 for ONNX tensor: 415 [06/20/2022-16:24:37] [V] [TRT] Gather_16 [Gather] outputs: [415 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_17 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 414 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 415 [06/20/2022-16:24:37] [V] [TRT] Add_17 [Add] inputs: [414 -> (-1, -1, 1024)[FLOAT]], [415 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_17 for ONNX node: Add_17 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 416 for ONNX tensor: 416 [06/20/2022-16:24:37] [V] [TRT] Add_17 [Add] outputs: [416 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_18 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.embeddings.position_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Searching for input: 413 [06/20/2022-16:24:37] [V] [TRT] Gather_18 [Gather] inputs: [bert.embeddings.position_embeddings.weight -> (512, 1024)[FLOAT]], [413 -> (1, -1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.embeddings.position_embeddings.weight for ONNX node: bert.embeddings.position_embeddings.weight [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_18 for ONNX node: Gather_18 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 417 for ONNX tensor: 417 [06/20/2022-16:24:37] [V] [TRT] Gather_18 [Gather] outputs: [417 -> (1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_19 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 416 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 417 [06/20/2022-16:24:37] [V] [TRT] Add_19 [Add] inputs: [416 -> (-1, -1, 1024)[FLOAT]], [417 -> (1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_19 for ONNX node: Add_19 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 418 for ONNX tensor: 418 [06/20/2022-16:24:37] [V] [TRT] Add_19 [Add] outputs: [418 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_20 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 418 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_20 [ReduceMean] inputs: [418 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_20 for ONNX node: ReduceMean_20 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 419 for ONNX tensor: 419 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_20 [ReduceMean] outputs: [419 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_21 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 418 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 419 [06/20/2022-16:24:37] [V] [TRT] Sub_21 [Sub] inputs: [418 -> (-1, -1, 1024)[FLOAT]], [419 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_21 for ONNX node: Sub_21 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 420 for ONNX tensor: 420 [06/20/2022-16:24:37] [V] [TRT] Sub_21 [Sub] outputs: [420 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_22 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_22 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_22 [Constant] outputs: [421 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_23 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 420 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 421 [06/20/2022-16:24:37] [V] [TRT] Pow_23 [Pow] inputs: [420 -> (-1, -1, 1024)[FLOAT]], [421 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 421 for ONNX node: 421 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_23 for ONNX node: Pow_23 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 422 for ONNX tensor: 422 [06/20/2022-16:24:37] [V] [TRT] Pow_23 [Pow] outputs: [422 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_24 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 422 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_24 [ReduceMean] inputs: [422 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_24 for ONNX node: ReduceMean_24 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 423 for ONNX tensor: 423 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_24 [ReduceMean] outputs: [423 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_25 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_25 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_25 [Constant] outputs: [424 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_26 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 423 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 424 [06/20/2022-16:24:37] [V] [TRT] Add_26 [Add] inputs: [423 -> (-1, -1, 1)[FLOAT]], [424 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 424 for ONNX node: 424 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_26 for ONNX node: Add_26 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 425 for ONNX tensor: 425 [06/20/2022-16:24:37] [V] [TRT] Add_26 [Add] outputs: [425 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_27 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 425 [06/20/2022-16:24:37] [V] [TRT] Sqrt_27 [Sqrt] inputs: [425 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_27 for ONNX node: Sqrt_27 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 426 for ONNX tensor: 426 [06/20/2022-16:24:37] [V] [TRT] Sqrt_27 [Sqrt] outputs: [426 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_28 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 420 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 426 [06/20/2022-16:24:37] [V] [TRT] Div_28 [Div] inputs: [420 -> (-1, -1, 1024)[FLOAT]], [426 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_28 for ONNX node: Div_28 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 427 for ONNX tensor: 427 [06/20/2022-16:24:37] [V] [TRT] Div_28 [Div] outputs: [427 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_29 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 427 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.embeddings.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_29 [Mul] inputs: [427 -> (-1, -1, 1024)[FLOAT]], [bert.embeddings.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.embeddings.LayerNorm.weight for ONNX node: bert.embeddings.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_29 for ONNX node: Mul_29 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 428 for ONNX tensor: 428 [06/20/2022-16:24:37] [V] [TRT] Mul_29 [Mul] outputs: [428 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_30 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 428 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.embeddings.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_30 [Add] inputs: [428 -> (-1, -1, 1024)[FLOAT]], [bert.embeddings.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.embeddings.LayerNorm.bias for ONNX node: bert.embeddings.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_30 for ONNX node: Add_30 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 429 for ONNX tensor: 429 [06/20/2022-16:24:37] [V] [TRT] Add_30 [Add] outputs: [429 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_31 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 429 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3175 [06/20/2022-16:24:37] [V] [TRT] MatMul_31 [MatMul] inputs: [429 -> (-1, -1, 1024)[FLOAT]], [3175 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3175 for ONNX node: 3175 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_31 for ONNX node: MatMul_31 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 431 for ONNX tensor: 431 [06/20/2022-16:24:37] [V] [TRT] MatMul_31 [MatMul] outputs: [431 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_32 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 431 [06/20/2022-16:24:37] [V] [TRT] Add_32 [Add] inputs: [bert.encoder.layer.0.attention.self.query.bias -> (1024)[FLOAT]], [431 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.attention.self.query.bias for ONNX node: bert.encoder.layer.0.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_32 for ONNX node: Add_32 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 432 for ONNX tensor: 432 [06/20/2022-16:24:37] [V] [TRT] Add_32 [Add] outputs: [432 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_33 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 429 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3176 [06/20/2022-16:24:37] [V] [TRT] MatMul_33 [MatMul] inputs: [429 -> (-1, -1, 1024)[FLOAT]], [3176 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3176 for ONNX node: 3176 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_33 for ONNX node: MatMul_33 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 434 for ONNX tensor: 434 [06/20/2022-16:24:37] [V] [TRT] MatMul_33 [MatMul] outputs: [434 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_34 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 434 [06/20/2022-16:24:37] [V] [TRT] Add_34 [Add] inputs: [bert.encoder.layer.0.attention.self.key.bias -> (1024)[FLOAT]], [434 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.attention.self.key.bias for ONNX node: bert.encoder.layer.0.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_34 for ONNX node: Add_34 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 435 for ONNX tensor: 435 [06/20/2022-16:24:37] [V] [TRT] Add_34 [Add] outputs: [435 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_35 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 435 [06/20/2022-16:24:37] [V] [TRT] Shape_35 [Shape] inputs: [435 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_35 for ONNX node: Shape_35 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 436 for ONNX tensor: 436 [06/20/2022-16:24:37] [V] [TRT] Shape_35 [Shape] outputs: [436 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_36 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_36 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_36 [Constant] outputs: [437 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_37 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 436 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 437 [06/20/2022-16:24:37] [V] [TRT] Gather_37 [Gather] inputs: [436 -> (3)[INT32]], [437 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 437 for ONNX node: 437 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_37 for ONNX node: Gather_37 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 438 for ONNX tensor: 438 [06/20/2022-16:24:37] [V] [TRT] Gather_37 [Gather] outputs: [438 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_38 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 435 [06/20/2022-16:24:37] [V] [TRT] Shape_38 [Shape] inputs: [435 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_38 for ONNX node: Shape_38 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 439 for ONNX tensor: 439 [06/20/2022-16:24:37] [V] [TRT] Shape_38 [Shape] outputs: [439 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_39 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_39 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_39 [Constant] outputs: [440 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_40 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 439 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 440 [06/20/2022-16:24:37] [V] [TRT] Gather_40 [Gather] inputs: [439 -> (3)[INT32]], [440 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 440 for ONNX node: 440 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_40 for ONNX node: Gather_40 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 441 for ONNX tensor: 441 [06/20/2022-16:24:37] [V] [TRT] Gather_40 [Gather] outputs: [441 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_41 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 438 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_41 [Unsqueeze] inputs: [438 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_41 for ONNX node: Unsqueeze_41 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 444 for ONNX tensor: 444 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_41 [Unsqueeze] outputs: [444 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_42 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 441 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_42 [Unsqueeze] inputs: [441 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_42 for ONNX node: Unsqueeze_42 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 445 for ONNX tensor: 445 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_42 [Unsqueeze] outputs: [445 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_43 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 444 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 445 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3177 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3178 [06/20/2022-16:24:37] [V] [TRT] Concat_43 [Concat] inputs: [444 -> (1)[INT32]], [445 -> (1)[INT32]], [3177 -> (1)[INT32]], [3178 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3177 for ONNX node: 3177 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3178 for ONNX node: 3178 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_43 for ONNX node: Concat_43 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 448 for ONNX tensor: 448 [06/20/2022-16:24:37] [V] [TRT] Concat_43 [Concat] outputs: [448 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_44 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 435 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 448 [06/20/2022-16:24:37] [V] [TRT] Reshape_44 [Reshape] inputs: [435 -> (-1, -1, 1024)[FLOAT]], [448 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_44 for ONNX node: Reshape_44 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 449 for ONNX tensor: 449 [06/20/2022-16:24:37] [V] [TRT] Reshape_44 [Reshape] outputs: [449 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_45 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 429 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3179 [06/20/2022-16:24:37] [V] [TRT] MatMul_45 [MatMul] inputs: [429 -> (-1, -1, 1024)[FLOAT]], [3179 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3179 for ONNX node: 3179 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_45 for ONNX node: MatMul_45 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 451 for ONNX tensor: 451 [06/20/2022-16:24:37] [V] [TRT] MatMul_45 [MatMul] outputs: [451 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_46 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 451 [06/20/2022-16:24:37] [V] [TRT] Add_46 [Add] inputs: [bert.encoder.layer.0.attention.self.value.bias -> (1024)[FLOAT]], [451 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.attention.self.value.bias for ONNX node: bert.encoder.layer.0.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_46 for ONNX node: Add_46 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 452 for ONNX tensor: 452 [06/20/2022-16:24:37] [V] [TRT] Add_46 [Add] outputs: [452 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_47 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 452 [06/20/2022-16:24:37] [V] [TRT] Shape_47 [Shape] inputs: [452 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_47 for ONNX node: Shape_47 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 453 for ONNX tensor: 453 [06/20/2022-16:24:37] [V] [TRT] Shape_47 [Shape] outputs: [453 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_48 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_48 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_48 [Constant] outputs: [454 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_49 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 453 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 454 [06/20/2022-16:24:37] [V] [TRT] Gather_49 [Gather] inputs: [453 -> (3)[INT32]], [454 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 454 for ONNX node: 454 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_49 for ONNX node: Gather_49 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455 [06/20/2022-16:24:37] [V] [TRT] Gather_49 [Gather] outputs: [455 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_50 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 452 [06/20/2022-16:24:37] [V] [TRT] Shape_50 [Shape] inputs: [452 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_50 for ONNX node: Shape_50 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 456 for ONNX tensor: 456 [06/20/2022-16:24:37] [V] [TRT] Shape_50 [Shape] outputs: [456 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_51 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_51 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_51 [Constant] outputs: [457 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_52 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 456 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 457 [06/20/2022-16:24:37] [V] [TRT] Gather_52 [Gather] inputs: [456 -> (3)[INT32]], [457 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 457 for ONNX node: 457 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_52 for ONNX node: Gather_52 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 458 for ONNX tensor: 458 [06/20/2022-16:24:37] [V] [TRT] Gather_52 [Gather] outputs: [458 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_53 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 455 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_53 [Unsqueeze] inputs: [455 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_53 for ONNX node: Unsqueeze_53 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 461 for ONNX tensor: 461 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_53 [Unsqueeze] outputs: [461 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_54 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 458 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_54 [Unsqueeze] inputs: [458 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_54 for ONNX node: Unsqueeze_54 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 462 for ONNX tensor: 462 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_54 [Unsqueeze] outputs: [462 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_55 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 461 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 462 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3180 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3181 [06/20/2022-16:24:37] [V] [TRT] Concat_55 [Concat] inputs: [461 -> (1)[INT32]], [462 -> (1)[INT32]], [3180 -> (1)[INT32]], [3181 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3180 for ONNX node: 3180 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3181 for ONNX node: 3181 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_55 for ONNX node: Concat_55 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 465 for ONNX tensor: 465 [06/20/2022-16:24:37] [V] [TRT] Concat_55 [Concat] outputs: [465 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_56 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 452 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 465 [06/20/2022-16:24:37] [V] [TRT] Reshape_56 [Reshape] inputs: [452 -> (-1, -1, 1024)[FLOAT]], [465 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_56 for ONNX node: Reshape_56 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 466 for ONNX tensor: 466 [06/20/2022-16:24:37] [V] [TRT] Reshape_56 [Reshape] outputs: [466 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_57 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 466 [06/20/2022-16:24:37] [V] [TRT] Transpose_57 [Transpose] inputs: [466 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_57 for ONNX node: Transpose_57 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 467 for ONNX tensor: 467 [06/20/2022-16:24:37] [V] [TRT] Transpose_57 [Transpose] outputs: [467 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_58 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 432 [06/20/2022-16:24:37] [V] [TRT] Shape_58 [Shape] inputs: [432 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_58 for ONNX node: Shape_58 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 468 for ONNX tensor: 468 [06/20/2022-16:24:37] [V] [TRT] Shape_58 [Shape] outputs: [468 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_59 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_59 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_59 [Constant] outputs: [469 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_60 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 468 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 469 [06/20/2022-16:24:37] [V] [TRT] Gather_60 [Gather] inputs: [468 -> (3)[INT32]], [469 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 469 for ONNX node: 469 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_60 for ONNX node: Gather_60 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 470 for ONNX tensor: 470 [06/20/2022-16:24:37] [V] [TRT] Gather_60 [Gather] outputs: [470 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_61 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 432 [06/20/2022-16:24:37] [V] [TRT] Shape_61 [Shape] inputs: [432 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_61 for ONNX node: Shape_61 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 471 for ONNX tensor: 471 [06/20/2022-16:24:37] [V] [TRT] Shape_61 [Shape] outputs: [471 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_62 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_62 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_62 [Constant] outputs: [472 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_63 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 471 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 472 [06/20/2022-16:24:37] [V] [TRT] Gather_63 [Gather] inputs: [471 -> (3)[INT32]], [472 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 472 for ONNX node: 472 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_63 for ONNX node: Gather_63 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 473 for ONNX tensor: 473 [06/20/2022-16:24:37] [V] [TRT] Gather_63 [Gather] outputs: [473 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_64 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 470 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_64 [Unsqueeze] inputs: [470 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_64 for ONNX node: Unsqueeze_64 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 476 for ONNX tensor: 476 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_64 [Unsqueeze] outputs: [476 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_65 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 473 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_65 [Unsqueeze] inputs: [473 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_65 for ONNX node: Unsqueeze_65 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 477 for ONNX tensor: 477 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_65 [Unsqueeze] outputs: [477 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_66 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 476 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 477 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3182 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3183 [06/20/2022-16:24:37] [V] [TRT] Concat_66 [Concat] inputs: [476 -> (1)[INT32]], [477 -> (1)[INT32]], [3182 -> (1)[INT32]], [3183 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3182 for ONNX node: 3182 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3183 for ONNX node: 3183 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_66 for ONNX node: Concat_66 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 480 for ONNX tensor: 480 [06/20/2022-16:24:37] [V] [TRT] Concat_66 [Concat] outputs: [480 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_67 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 432 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 480 [06/20/2022-16:24:37] [V] [TRT] Reshape_67 [Reshape] inputs: [432 -> (-1, -1, 1024)[FLOAT]], [480 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_67 for ONNX node: Reshape_67 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 481 for ONNX tensor: 481 [06/20/2022-16:24:37] [V] [TRT] Reshape_67 [Reshape] outputs: [481 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_68 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 481 [06/20/2022-16:24:37] [V] [TRT] Transpose_68 [Transpose] inputs: [481 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_68 for ONNX node: Transpose_68 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 482 for ONNX tensor: 482 [06/20/2022-16:24:37] [V] [TRT] Transpose_68 [Transpose] outputs: [482 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_69 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 449 [06/20/2022-16:24:37] [V] [TRT] Transpose_69 [Transpose] inputs: [449 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_69 for ONNX node: Transpose_69 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 483 for ONNX tensor: 483 [06/20/2022-16:24:37] [V] [TRT] Transpose_69 [Transpose] outputs: [483 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_70 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 482 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 483 [06/20/2022-16:24:37] [V] [TRT] MatMul_70 [MatMul] inputs: [482 -> (-1, 16, -1, 64)[FLOAT]], [483 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_70 for ONNX node: MatMul_70 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 484 for ONNX tensor: 484 [06/20/2022-16:24:37] [V] [TRT] MatMul_70 [MatMul] outputs: [484 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_71 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_71 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_71 [Constant] outputs: [485 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_72 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 484 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 485 [06/20/2022-16:24:37] [V] [TRT] Div_72 [Div] inputs: [484 -> (-1, 16, -1, -1)[FLOAT]], [485 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 485 for ONNX node: 485 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_72 for ONNX node: Div_72 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 486 for ONNX tensor: 486 [06/20/2022-16:24:37] [V] [TRT] Div_72 [Div] outputs: [486 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_73 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 486 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:37] [V] [TRT] Add_73 [Add] inputs: [486 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_73 for ONNX node: Add_73 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 487 for ONNX tensor: 487 [06/20/2022-16:24:37] [V] [TRT] Add_73 [Add] outputs: [487 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Softmax_74 [Softmax] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 487 [06/20/2022-16:24:37] [V] [TRT] Softmax_74 [Softmax] inputs: [487 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Softmax_74 for ONNX node: Softmax_74 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 488 for ONNX tensor: 488 [06/20/2022-16:24:37] [V] [TRT] Softmax_74 [Softmax] outputs: [488 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_75 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 488 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 467 [06/20/2022-16:24:37] [V] [TRT] MatMul_75 [MatMul] inputs: [488 -> (-1, 16, -1, -1)[FLOAT]], [467 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_75 for ONNX node: MatMul_75 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 489 for ONNX tensor: 489 [06/20/2022-16:24:37] [V] [TRT] MatMul_75 [MatMul] outputs: [489 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_76 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 489 [06/20/2022-16:24:37] [V] [TRT] Transpose_76 [Transpose] inputs: [489 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_76 for ONNX node: Transpose_76 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 490 for ONNX tensor: 490 [06/20/2022-16:24:37] [V] [TRT] Transpose_76 [Transpose] outputs: [490 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_77 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 490 [06/20/2022-16:24:37] [V] [TRT] Shape_77 [Shape] inputs: [490 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_77 for ONNX node: Shape_77 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 491 for ONNX tensor: 491 [06/20/2022-16:24:37] [V] [TRT] Shape_77 [Shape] outputs: [491 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_78 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_78 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_78 [Constant] outputs: [492 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_79 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 491 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 492 [06/20/2022-16:24:37] [V] [TRT] Gather_79 [Gather] inputs: [491 -> (4)[INT32]], [492 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 492 for ONNX node: 492 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_79 for ONNX node: Gather_79 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 493 for ONNX tensor: 493 [06/20/2022-16:24:37] [V] [TRT] Gather_79 [Gather] outputs: [493 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_80 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 490 [06/20/2022-16:24:37] [V] [TRT] Shape_80 [Shape] inputs: [490 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_80 for ONNX node: Shape_80 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 494 for ONNX tensor: 494 [06/20/2022-16:24:37] [V] [TRT] Shape_80 [Shape] outputs: [494 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_81 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_81 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_81 [Constant] outputs: [495 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_82 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 494 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 495 [06/20/2022-16:24:37] [V] [TRT] Gather_82 [Gather] inputs: [494 -> (4)[INT32]], [495 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 495 for ONNX node: 495 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_82 for ONNX node: Gather_82 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 496 for ONNX tensor: 496 [06/20/2022-16:24:37] [V] [TRT] Gather_82 [Gather] outputs: [496 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_83 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 493 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_83 [Unsqueeze] inputs: [493 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_83 for ONNX node: Unsqueeze_83 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 498 for ONNX tensor: 498 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_83 [Unsqueeze] outputs: [498 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_84 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 496 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_84 [Unsqueeze] inputs: [496 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_84 for ONNX node: Unsqueeze_84 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 499 for ONNX tensor: 499 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_84 [Unsqueeze] outputs: [499 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_85 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 498 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 499 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3184 [06/20/2022-16:24:37] [V] [TRT] Concat_85 [Concat] inputs: [498 -> (1)[INT32]], [499 -> (1)[INT32]], [3184 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3184 for ONNX node: 3184 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_85 for ONNX node: Concat_85 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 501 for ONNX tensor: 501 [06/20/2022-16:24:37] [V] [TRT] Concat_85 [Concat] outputs: [501 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_86 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 490 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 501 [06/20/2022-16:24:37] [V] [TRT] Reshape_86 [Reshape] inputs: [490 -> (-1, -1, 16, 64)[FLOAT]], [501 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_86 for ONNX node: Reshape_86 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 502 for ONNX tensor: 502 [06/20/2022-16:24:37] [V] [TRT] Reshape_86 [Reshape] outputs: [502 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_87 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 502 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3185 [06/20/2022-16:24:37] [V] [TRT] MatMul_87 [MatMul] inputs: [502 -> (-1, -1, 1024)[FLOAT]], [3185 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3185 for ONNX node: 3185 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_87 for ONNX node: MatMul_87 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 504 for ONNX tensor: 504 [06/20/2022-16:24:37] [V] [TRT] MatMul_87 [MatMul] outputs: [504 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_88 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 504 [06/20/2022-16:24:37] [V] [TRT] Add_88 [Add] inputs: [bert.encoder.layer.0.attention.output.dense.bias -> (1024)[FLOAT]], [504 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.attention.output.dense.bias for ONNX node: bert.encoder.layer.0.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_88 for ONNX node: Add_88 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 505 for ONNX tensor: 505 [06/20/2022-16:24:37] [V] [TRT] Add_88 [Add] outputs: [505 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_89 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 505 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 429 [06/20/2022-16:24:37] [V] [TRT] Add_89 [Add] inputs: [505 -> (-1, -1, 1024)[FLOAT]], [429 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_89 for ONNX node: Add_89 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 506 for ONNX tensor: 506 [06/20/2022-16:24:37] [V] [TRT] Add_89 [Add] outputs: [506 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_90 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 506 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_90 [ReduceMean] inputs: [506 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_90 for ONNX node: ReduceMean_90 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 507 for ONNX tensor: 507 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_90 [ReduceMean] outputs: [507 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_91 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 506 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 507 [06/20/2022-16:24:37] [V] [TRT] Sub_91 [Sub] inputs: [506 -> (-1, -1, 1024)[FLOAT]], [507 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_91 for ONNX node: Sub_91 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 508 for ONNX tensor: 508 [06/20/2022-16:24:37] [V] [TRT] Sub_91 [Sub] outputs: [508 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_92 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_92 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_92 [Constant] outputs: [509 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_93 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 508 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 509 [06/20/2022-16:24:37] [V] [TRT] Pow_93 [Pow] inputs: [508 -> (-1, -1, 1024)[FLOAT]], [509 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 509 for ONNX node: 509 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_93 for ONNX node: Pow_93 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 510 for ONNX tensor: 510 [06/20/2022-16:24:37] [V] [TRT] Pow_93 [Pow] outputs: [510 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_94 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 510 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_94 [ReduceMean] inputs: [510 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_94 for ONNX node: ReduceMean_94 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_94 [ReduceMean] outputs: [511 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_95 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_95 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_95 [Constant] outputs: [512 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_96 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 511 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 512 [06/20/2022-16:24:37] [V] [TRT] Add_96 [Add] inputs: [511 -> (-1, -1, 1)[FLOAT]], [512 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 512 for ONNX node: 512 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_96 for ONNX node: Add_96 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 513 for ONNX tensor: 513 [06/20/2022-16:24:37] [V] [TRT] Add_96 [Add] outputs: [513 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_97 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 513 [06/20/2022-16:24:37] [V] [TRT] Sqrt_97 [Sqrt] inputs: [513 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_97 for ONNX node: Sqrt_97 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 514 for ONNX tensor: 514 [06/20/2022-16:24:37] [V] [TRT] Sqrt_97 [Sqrt] outputs: [514 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_98 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 508 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 514 [06/20/2022-16:24:37] [V] [TRT] Div_98 [Div] inputs: [508 -> (-1, -1, 1024)[FLOAT]], [514 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_98 for ONNX node: Div_98 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 515 for ONNX tensor: 515 [06/20/2022-16:24:37] [V] [TRT] Div_98 [Div] outputs: [515 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_99 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 515 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_99 [Mul] inputs: [515 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.0.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.0.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_99 for ONNX node: Mul_99 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 516 for ONNX tensor: 516 [06/20/2022-16:24:37] [V] [TRT] Mul_99 [Mul] outputs: [516 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_100 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 516 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_100 [Add] inputs: [516 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.0.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.0.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_100 for ONNX node: Add_100 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 517 for ONNX tensor: 517 [06/20/2022-16:24:37] [V] [TRT] Add_100 [Add] outputs: [517 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_101 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 517 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3186 [06/20/2022-16:24:37] [V] [TRT] MatMul_101 [MatMul] inputs: [517 -> (-1, -1, 1024)[FLOAT]], [3186 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3186 for ONNX node: 3186 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_101 for ONNX node: MatMul_101 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 519 for ONNX tensor: 519 [06/20/2022-16:24:37] [V] [TRT] MatMul_101 [MatMul] outputs: [519 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_102 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 519 [06/20/2022-16:24:37] [V] [TRT] Add_102 [Add] inputs: [bert.encoder.layer.0.intermediate.dense.bias -> (4096)[FLOAT]], [519 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.intermediate.dense.bias for ONNX node: bert.encoder.layer.0.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_102 for ONNX node: Add_102 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520 [06/20/2022-16:24:37] [V] [TRT] Add_102 [Add] outputs: [520 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_103 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_103 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_103 [Constant] outputs: [521 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_104 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 520 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 521 [06/20/2022-16:24:37] [V] [TRT] Div_104 [Div] inputs: [520 -> (-1, -1, 4096)[FLOAT]], [521 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 521 for ONNX node: 521 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_104 for ONNX node: Div_104 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 522 for ONNX tensor: 522 [06/20/2022-16:24:37] [V] [TRT] Div_104 [Div] outputs: [522 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Erf_105 [Erf] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 522 [06/20/2022-16:24:37] [V] [TRT] Erf_105 [Erf] inputs: [522 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Erf_105 for ONNX node: Erf_105 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 523 for ONNX tensor: 523 [06/20/2022-16:24:37] [V] [TRT] Erf_105 [Erf] outputs: [523 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_106 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_106 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_106 [Constant] outputs: [524 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_107 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 523 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 524 [06/20/2022-16:24:37] [V] [TRT] Add_107 [Add] inputs: [523 -> (-1, -1, 4096)[FLOAT]], [524 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 524 for ONNX node: 524 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_107 for ONNX node: Add_107 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 525 for ONNX tensor: 525 [06/20/2022-16:24:37] [V] [TRT] Add_107 [Add] outputs: [525 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_108 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 520 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 525 [06/20/2022-16:24:37] [V] [TRT] Mul_108 [Mul] inputs: [520 -> (-1, -1, 4096)[FLOAT]], [525 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_108 for ONNX node: Mul_108 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 526 for ONNX tensor: 526 [06/20/2022-16:24:37] [V] [TRT] Mul_108 [Mul] outputs: [526 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_109 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_109 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_109 [Constant] outputs: [527 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_110 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 526 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 527 [06/20/2022-16:24:37] [V] [TRT] Mul_110 [Mul] inputs: [526 -> (-1, -1, 4096)[FLOAT]], [527 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 527 for ONNX node: 527 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_110 for ONNX node: Mul_110 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 528 for ONNX tensor: 528 [06/20/2022-16:24:37] [V] [TRT] Mul_110 [Mul] outputs: [528 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_111 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 528 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3187 [06/20/2022-16:24:37] [V] [TRT] MatMul_111 [MatMul] inputs: [528 -> (-1, -1, 4096)[FLOAT]], [3187 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3187 for ONNX node: 3187 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_111 for ONNX node: MatMul_111 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 530 for ONNX tensor: 530 [06/20/2022-16:24:37] [V] [TRT] MatMul_111 [MatMul] outputs: [530 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_112 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 530 [06/20/2022-16:24:37] [V] [TRT] Add_112 [Add] inputs: [bert.encoder.layer.0.output.dense.bias -> (1024)[FLOAT]], [530 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.output.dense.bias for ONNX node: bert.encoder.layer.0.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_112 for ONNX node: Add_112 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531 [06/20/2022-16:24:37] [V] [TRT] Add_112 [Add] outputs: [531 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_113 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 531 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 517 [06/20/2022-16:24:37] [V] [TRT] Add_113 [Add] inputs: [531 -> (-1, -1, 1024)[FLOAT]], [517 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_113 for ONNX node: Add_113 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532 [06/20/2022-16:24:37] [V] [TRT] Add_113 [Add] outputs: [532 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_114 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 532 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_114 [ReduceMean] inputs: [532 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_114 for ONNX node: ReduceMean_114 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 533 for ONNX tensor: 533 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_114 [ReduceMean] outputs: [533 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_115 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 532 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 533 [06/20/2022-16:24:37] [V] [TRT] Sub_115 [Sub] inputs: [532 -> (-1, -1, 1024)[FLOAT]], [533 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_115 for ONNX node: Sub_115 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 534 for ONNX tensor: 534 [06/20/2022-16:24:37] [V] [TRT] Sub_115 [Sub] outputs: [534 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_116 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_116 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_116 [Constant] outputs: [535 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_117 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 534 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 535 [06/20/2022-16:24:37] [V] [TRT] Pow_117 [Pow] inputs: [534 -> (-1, -1, 1024)[FLOAT]], [535 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 535 for ONNX node: 535 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_117 for ONNX node: Pow_117 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 536 for ONNX tensor: 536 [06/20/2022-16:24:37] [V] [TRT] Pow_117 [Pow] outputs: [536 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_118 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 536 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_118 [ReduceMean] inputs: [536 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_118 for ONNX node: ReduceMean_118 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_118 [ReduceMean] outputs: [537 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_119 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_119 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_119 [Constant] outputs: [538 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_120 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 537 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 538 [06/20/2022-16:24:37] [V] [TRT] Add_120 [Add] inputs: [537 -> (-1, -1, 1)[FLOAT]], [538 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 538 for ONNX node: 538 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_120 for ONNX node: Add_120 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 539 for ONNX tensor: 539 [06/20/2022-16:24:37] [V] [TRT] Add_120 [Add] outputs: [539 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_121 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 539 [06/20/2022-16:24:37] [V] [TRT] Sqrt_121 [Sqrt] inputs: [539 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_121 for ONNX node: Sqrt_121 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540 [06/20/2022-16:24:37] [V] [TRT] Sqrt_121 [Sqrt] outputs: [540 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_122 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 534 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 540 [06/20/2022-16:24:37] [V] [TRT] Div_122 [Div] inputs: [534 -> (-1, -1, 1024)[FLOAT]], [540 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_122 for ONNX node: Div_122 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 541 for ONNX tensor: 541 [06/20/2022-16:24:37] [V] [TRT] Div_122 [Div] outputs: [541 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_123 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 541 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_123 [Mul] inputs: [541 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.0.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.output.LayerNorm.weight for ONNX node: bert.encoder.layer.0.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_123 for ONNX node: Mul_123 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 542 for ONNX tensor: 542 [06/20/2022-16:24:37] [V] [TRT] Mul_123 [Mul] outputs: [542 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_124 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 542 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.0.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_124 [Add] inputs: [542 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.0.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.0.output.LayerNorm.bias for ONNX node: bert.encoder.layer.0.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_124 for ONNX node: Add_124 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 543 for ONNX tensor: 543 [06/20/2022-16:24:37] [V] [TRT] Add_124 [Add] outputs: [543 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_125 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 543 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3188 [06/20/2022-16:24:37] [V] [TRT] MatMul_125 [MatMul] inputs: [543 -> (-1, -1, 1024)[FLOAT]], [3188 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3188 for ONNX node: 3188 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_125 for ONNX node: MatMul_125 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 545 for ONNX tensor: 545 [06/20/2022-16:24:37] [V] [TRT] MatMul_125 [MatMul] outputs: [545 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_126 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 545 [06/20/2022-16:24:37] [V] [TRT] Add_126 [Add] inputs: [bert.encoder.layer.1.attention.self.query.bias -> (1024)[FLOAT]], [545 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.attention.self.query.bias for ONNX node: bert.encoder.layer.1.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_126 for ONNX node: Add_126 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 546 for ONNX tensor: 546 [06/20/2022-16:24:37] [V] [TRT] Add_126 [Add] outputs: [546 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_127 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 543 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3189 [06/20/2022-16:24:37] [V] [TRT] MatMul_127 [MatMul] inputs: [543 -> (-1, -1, 1024)[FLOAT]], [3189 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3189 for ONNX node: 3189 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_127 for ONNX node: MatMul_127 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 548 for ONNX tensor: 548 [06/20/2022-16:24:37] [V] [TRT] MatMul_127 [MatMul] outputs: [548 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_128 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 548 [06/20/2022-16:24:37] [V] [TRT] Add_128 [Add] inputs: [bert.encoder.layer.1.attention.self.key.bias -> (1024)[FLOAT]], [548 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.attention.self.key.bias for ONNX node: bert.encoder.layer.1.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_128 for ONNX node: Add_128 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549 [06/20/2022-16:24:37] [V] [TRT] Add_128 [Add] outputs: [549 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_129 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 549 [06/20/2022-16:24:37] [V] [TRT] Shape_129 [Shape] inputs: [549 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_129 for ONNX node: Shape_129 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 550 for ONNX tensor: 550 [06/20/2022-16:24:37] [V] [TRT] Shape_129 [Shape] outputs: [550 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_130 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_130 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_130 [Constant] outputs: [551 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_131 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 550 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 551 [06/20/2022-16:24:37] [V] [TRT] Gather_131 [Gather] inputs: [550 -> (3)[INT32]], [551 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 551 for ONNX node: 551 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_131 for ONNX node: Gather_131 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552 [06/20/2022-16:24:37] [V] [TRT] Gather_131 [Gather] outputs: [552 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_132 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 549 [06/20/2022-16:24:37] [V] [TRT] Shape_132 [Shape] inputs: [549 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_132 for ONNX node: Shape_132 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553 [06/20/2022-16:24:37] [V] [TRT] Shape_132 [Shape] outputs: [553 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_133 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_133 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_133 [Constant] outputs: [554 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_134 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 553 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 554 [06/20/2022-16:24:37] [V] [TRT] Gather_134 [Gather] inputs: [553 -> (3)[INT32]], [554 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 554 for ONNX node: 554 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_134 for ONNX node: Gather_134 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 555 for ONNX tensor: 555 [06/20/2022-16:24:37] [V] [TRT] Gather_134 [Gather] outputs: [555 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_135 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 552 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_135 [Unsqueeze] inputs: [552 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_135 for ONNX node: Unsqueeze_135 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 558 for ONNX tensor: 558 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_135 [Unsqueeze] outputs: [558 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_136 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 555 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_136 [Unsqueeze] inputs: [555 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_136 for ONNX node: Unsqueeze_136 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_136 [Unsqueeze] outputs: [559 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_137 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 558 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 559 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3190 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3191 [06/20/2022-16:24:37] [V] [TRT] Concat_137 [Concat] inputs: [558 -> (1)[INT32]], [559 -> (1)[INT32]], [3190 -> (1)[INT32]], [3191 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3190 for ONNX node: 3190 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3191 for ONNX node: 3191 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_137 for ONNX node: Concat_137 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 562 for ONNX tensor: 562 [06/20/2022-16:24:37] [V] [TRT] Concat_137 [Concat] outputs: [562 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_138 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 549 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 562 [06/20/2022-16:24:37] [V] [TRT] Reshape_138 [Reshape] inputs: [549 -> (-1, -1, 1024)[FLOAT]], [562 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_138 for ONNX node: Reshape_138 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 563 for ONNX tensor: 563 [06/20/2022-16:24:37] [V] [TRT] Reshape_138 [Reshape] outputs: [563 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_139 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 543 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3192 [06/20/2022-16:24:37] [V] [TRT] MatMul_139 [MatMul] inputs: [543 -> (-1, -1, 1024)[FLOAT]], [3192 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3192 for ONNX node: 3192 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_139 for ONNX node: MatMul_139 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 565 for ONNX tensor: 565 [06/20/2022-16:24:37] [V] [TRT] MatMul_139 [MatMul] outputs: [565 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_140 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 565 [06/20/2022-16:24:37] [V] [TRT] Add_140 [Add] inputs: [bert.encoder.layer.1.attention.self.value.bias -> (1024)[FLOAT]], [565 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.attention.self.value.bias for ONNX node: bert.encoder.layer.1.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_140 for ONNX node: Add_140 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 566 for ONNX tensor: 566 [06/20/2022-16:24:37] [V] [TRT] Add_140 [Add] outputs: [566 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_141 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 566 [06/20/2022-16:24:37] [V] [TRT] Shape_141 [Shape] inputs: [566 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_141 for ONNX node: Shape_141 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 567 for ONNX tensor: 567 [06/20/2022-16:24:37] [V] [TRT] Shape_141 [Shape] outputs: [567 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_142 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_142 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_142 [Constant] outputs: [568 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_143 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 567 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 568 [06/20/2022-16:24:37] [V] [TRT] Gather_143 [Gather] inputs: [567 -> (3)[INT32]], [568 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 568 for ONNX node: 568 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_143 for ONNX node: Gather_143 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569 [06/20/2022-16:24:37] [V] [TRT] Gather_143 [Gather] outputs: [569 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_144 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 566 [06/20/2022-16:24:37] [V] [TRT] Shape_144 [Shape] inputs: [566 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_144 for ONNX node: Shape_144 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570 [06/20/2022-16:24:37] [V] [TRT] Shape_144 [Shape] outputs: [570 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_145 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_145 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_145 [Constant] outputs: [571 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_146 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 570 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 571 [06/20/2022-16:24:37] [V] [TRT] Gather_146 [Gather] inputs: [570 -> (3)[INT32]], [571 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 571 for ONNX node: 571 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_146 for ONNX node: Gather_146 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 572 for ONNX tensor: 572 [06/20/2022-16:24:37] [V] [TRT] Gather_146 [Gather] outputs: [572 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_147 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 569 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_147 [Unsqueeze] inputs: [569 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_147 for ONNX node: Unsqueeze_147 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 575 for ONNX tensor: 575 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_147 [Unsqueeze] outputs: [575 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_148 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 572 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_148 [Unsqueeze] inputs: [572 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_148 for ONNX node: Unsqueeze_148 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_148 [Unsqueeze] outputs: [576 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_149 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 575 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 576 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3193 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3194 [06/20/2022-16:24:37] [V] [TRT] Concat_149 [Concat] inputs: [575 -> (1)[INT32]], [576 -> (1)[INT32]], [3193 -> (1)[INT32]], [3194 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3193 for ONNX node: 3193 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3194 for ONNX node: 3194 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_149 for ONNX node: Concat_149 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 579 for ONNX tensor: 579 [06/20/2022-16:24:37] [V] [TRT] Concat_149 [Concat] outputs: [579 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_150 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 566 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 579 [06/20/2022-16:24:37] [V] [TRT] Reshape_150 [Reshape] inputs: [566 -> (-1, -1, 1024)[FLOAT]], [579 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_150 for ONNX node: Reshape_150 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580 [06/20/2022-16:24:37] [V] [TRT] Reshape_150 [Reshape] outputs: [580 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_151 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 580 [06/20/2022-16:24:37] [V] [TRT] Transpose_151 [Transpose] inputs: [580 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_151 for ONNX node: Transpose_151 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 581 for ONNX tensor: 581 [06/20/2022-16:24:37] [V] [TRT] Transpose_151 [Transpose] outputs: [581 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_152 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 546 [06/20/2022-16:24:37] [V] [TRT] Shape_152 [Shape] inputs: [546 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_152 for ONNX node: Shape_152 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 582 for ONNX tensor: 582 [06/20/2022-16:24:37] [V] [TRT] Shape_152 [Shape] outputs: [582 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_153 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_153 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_153 [Constant] outputs: [583 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_154 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 582 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 583 [06/20/2022-16:24:37] [V] [TRT] Gather_154 [Gather] inputs: [582 -> (3)[INT32]], [583 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 583 for ONNX node: 583 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_154 for ONNX node: Gather_154 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584 [06/20/2022-16:24:37] [V] [TRT] Gather_154 [Gather] outputs: [584 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_155 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 546 [06/20/2022-16:24:37] [V] [TRT] Shape_155 [Shape] inputs: [546 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_155 for ONNX node: Shape_155 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 585 for ONNX tensor: 585 [06/20/2022-16:24:37] [V] [TRT] Shape_155 [Shape] outputs: [585 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_156 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_156 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_156 [Constant] outputs: [586 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_157 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 585 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 586 [06/20/2022-16:24:37] [V] [TRT] Gather_157 [Gather] inputs: [585 -> (3)[INT32]], [586 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 586 for ONNX node: 586 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_157 for ONNX node: Gather_157 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587 [06/20/2022-16:24:37] [V] [TRT] Gather_157 [Gather] outputs: [587 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_158 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 584 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_158 [Unsqueeze] inputs: [584 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_158 for ONNX node: Unsqueeze_158 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_158 [Unsqueeze] outputs: [590 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_159 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 587 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_159 [Unsqueeze] inputs: [587 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_159 for ONNX node: Unsqueeze_159 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 591 for ONNX tensor: 591 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_159 [Unsqueeze] outputs: [591 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_160 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 590 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 591 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3195 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3196 [06/20/2022-16:24:37] [V] [TRT] Concat_160 [Concat] inputs: [590 -> (1)[INT32]], [591 -> (1)[INT32]], [3195 -> (1)[INT32]], [3196 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3195 for ONNX node: 3195 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3196 for ONNX node: 3196 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_160 for ONNX node: Concat_160 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 594 for ONNX tensor: 594 [06/20/2022-16:24:37] [V] [TRT] Concat_160 [Concat] outputs: [594 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_161 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 546 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 594 [06/20/2022-16:24:37] [V] [TRT] Reshape_161 [Reshape] inputs: [546 -> (-1, -1, 1024)[FLOAT]], [594 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_161 for ONNX node: Reshape_161 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 595 for ONNX tensor: 595 [06/20/2022-16:24:37] [V] [TRT] Reshape_161 [Reshape] outputs: [595 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_162 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 595 [06/20/2022-16:24:37] [V] [TRT] Transpose_162 [Transpose] inputs: [595 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_162 for ONNX node: Transpose_162 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 596 for ONNX tensor: 596 [06/20/2022-16:24:37] [V] [TRT] Transpose_162 [Transpose] outputs: [596 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_163 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 563 [06/20/2022-16:24:37] [V] [TRT] Transpose_163 [Transpose] inputs: [563 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_163 for ONNX node: Transpose_163 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 597 for ONNX tensor: 597 [06/20/2022-16:24:37] [V] [TRT] Transpose_163 [Transpose] outputs: [597 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_164 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 596 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 597 [06/20/2022-16:24:37] [V] [TRT] MatMul_164 [MatMul] inputs: [596 -> (-1, 16, -1, 64)[FLOAT]], [597 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_164 for ONNX node: MatMul_164 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 598 for ONNX tensor: 598 [06/20/2022-16:24:37] [V] [TRT] MatMul_164 [MatMul] outputs: [598 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_165 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_165 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_165 [Constant] outputs: [599 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_166 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 598 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 599 [06/20/2022-16:24:37] [V] [TRT] Div_166 [Div] inputs: [598 -> (-1, 16, -1, -1)[FLOAT]], [599 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 599 for ONNX node: 599 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_166 for ONNX node: Div_166 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 600 for ONNX tensor: 600 [06/20/2022-16:24:37] [V] [TRT] Div_166 [Div] outputs: [600 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_167 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 600 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:37] [V] [TRT] Add_167 [Add] inputs: [600 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_167 for ONNX node: Add_167 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 601 for ONNX tensor: 601 [06/20/2022-16:24:37] [V] [TRT] Add_167 [Add] outputs: [601 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Softmax_168 [Softmax] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 601 [06/20/2022-16:24:37] [V] [TRT] Softmax_168 [Softmax] inputs: [601 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Softmax_168 for ONNX node: Softmax_168 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 602 for ONNX tensor: 602 [06/20/2022-16:24:37] [V] [TRT] Softmax_168 [Softmax] outputs: [602 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_169 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 602 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 581 [06/20/2022-16:24:37] [V] [TRT] MatMul_169 [MatMul] inputs: [602 -> (-1, 16, -1, -1)[FLOAT]], [581 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_169 for ONNX node: MatMul_169 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 603 for ONNX tensor: 603 [06/20/2022-16:24:37] [V] [TRT] MatMul_169 [MatMul] outputs: [603 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_170 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 603 [06/20/2022-16:24:37] [V] [TRT] Transpose_170 [Transpose] inputs: [603 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_170 for ONNX node: Transpose_170 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 604 for ONNX tensor: 604 [06/20/2022-16:24:37] [V] [TRT] Transpose_170 [Transpose] outputs: [604 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_171 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 604 [06/20/2022-16:24:37] [V] [TRT] Shape_171 [Shape] inputs: [604 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_171 for ONNX node: Shape_171 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 605 for ONNX tensor: 605 [06/20/2022-16:24:37] [V] [TRT] Shape_171 [Shape] outputs: [605 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_172 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_172 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_172 [Constant] outputs: [606 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_173 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 605 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 606 [06/20/2022-16:24:37] [V] [TRT] Gather_173 [Gather] inputs: [605 -> (4)[INT32]], [606 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 606 for ONNX node: 606 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_173 for ONNX node: Gather_173 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 607 for ONNX tensor: 607 [06/20/2022-16:24:37] [V] [TRT] Gather_173 [Gather] outputs: [607 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_174 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 604 [06/20/2022-16:24:37] [V] [TRT] Shape_174 [Shape] inputs: [604 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_174 for ONNX node: Shape_174 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608 [06/20/2022-16:24:37] [V] [TRT] Shape_174 [Shape] outputs: [608 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_175 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_175 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_175 [Constant] outputs: [609 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_176 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 608 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 609 [06/20/2022-16:24:37] [V] [TRT] Gather_176 [Gather] inputs: [608 -> (4)[INT32]], [609 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 609 for ONNX node: 609 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_176 for ONNX node: Gather_176 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 610 for ONNX tensor: 610 [06/20/2022-16:24:37] [V] [TRT] Gather_176 [Gather] outputs: [610 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_177 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 607 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_177 [Unsqueeze] inputs: [607 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_177 for ONNX node: Unsqueeze_177 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 612 for ONNX tensor: 612 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_177 [Unsqueeze] outputs: [612 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_178 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 610 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_178 [Unsqueeze] inputs: [610 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_178 for ONNX node: Unsqueeze_178 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_178 [Unsqueeze] outputs: [613 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_179 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 612 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 613 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3197 [06/20/2022-16:24:37] [V] [TRT] Concat_179 [Concat] inputs: [612 -> (1)[INT32]], [613 -> (1)[INT32]], [3197 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3197 for ONNX node: 3197 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_179 for ONNX node: Concat_179 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615 [06/20/2022-16:24:37] [V] [TRT] Concat_179 [Concat] outputs: [615 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_180 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 604 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 615 [06/20/2022-16:24:37] [V] [TRT] Reshape_180 [Reshape] inputs: [604 -> (-1, -1, 16, 64)[FLOAT]], [615 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_180 for ONNX node: Reshape_180 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 616 for ONNX tensor: 616 [06/20/2022-16:24:37] [V] [TRT] Reshape_180 [Reshape] outputs: [616 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_181 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 616 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3198 [06/20/2022-16:24:37] [V] [TRT] MatMul_181 [MatMul] inputs: [616 -> (-1, -1, 1024)[FLOAT]], [3198 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3198 for ONNX node: 3198 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_181 for ONNX node: MatMul_181 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 618 for ONNX tensor: 618 [06/20/2022-16:24:37] [V] [TRT] MatMul_181 [MatMul] outputs: [618 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_182 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 618 [06/20/2022-16:24:37] [V] [TRT] Add_182 [Add] inputs: [bert.encoder.layer.1.attention.output.dense.bias -> (1024)[FLOAT]], [618 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.attention.output.dense.bias for ONNX node: bert.encoder.layer.1.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_182 for ONNX node: Add_182 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 619 for ONNX tensor: 619 [06/20/2022-16:24:37] [V] [TRT] Add_182 [Add] outputs: [619 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_183 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 619 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 543 [06/20/2022-16:24:37] [V] [TRT] Add_183 [Add] inputs: [619 -> (-1, -1, 1024)[FLOAT]], [543 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_183 for ONNX node: Add_183 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 620 for ONNX tensor: 620 [06/20/2022-16:24:37] [V] [TRT] Add_183 [Add] outputs: [620 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_184 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 620 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_184 [ReduceMean] inputs: [620 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_184 for ONNX node: ReduceMean_184 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_184 [ReduceMean] outputs: [621 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_185 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 620 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 621 [06/20/2022-16:24:37] [V] [TRT] Sub_185 [Sub] inputs: [620 -> (-1, -1, 1024)[FLOAT]], [621 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_185 for ONNX node: Sub_185 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 622 for ONNX tensor: 622 [06/20/2022-16:24:37] [V] [TRT] Sub_185 [Sub] outputs: [622 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_186 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_186 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_186 [Constant] outputs: [623 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_187 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 622 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 623 [06/20/2022-16:24:37] [V] [TRT] Pow_187 [Pow] inputs: [622 -> (-1, -1, 1024)[FLOAT]], [623 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 623 for ONNX node: 623 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_187 for ONNX node: Pow_187 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 624 for ONNX tensor: 624 [06/20/2022-16:24:37] [V] [TRT] Pow_187 [Pow] outputs: [624 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_188 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 624 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_188 [ReduceMean] inputs: [624 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_188 for ONNX node: ReduceMean_188 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 625 for ONNX tensor: 625 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_188 [ReduceMean] outputs: [625 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_189 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_189 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_189 [Constant] outputs: [626 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_190 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 625 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 626 [06/20/2022-16:24:37] [V] [TRT] Add_190 [Add] inputs: [625 -> (-1, -1, 1)[FLOAT]], [626 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 626 for ONNX node: 626 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_190 for ONNX node: Add_190 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 627 for ONNX tensor: 627 [06/20/2022-16:24:37] [V] [TRT] Add_190 [Add] outputs: [627 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_191 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 627 [06/20/2022-16:24:37] [V] [TRT] Sqrt_191 [Sqrt] inputs: [627 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_191 for ONNX node: Sqrt_191 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628 [06/20/2022-16:24:37] [V] [TRT] Sqrt_191 [Sqrt] outputs: [628 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_192 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 622 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 628 [06/20/2022-16:24:37] [V] [TRT] Div_192 [Div] inputs: [622 -> (-1, -1, 1024)[FLOAT]], [628 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_192 for ONNX node: Div_192 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629 [06/20/2022-16:24:37] [V] [TRT] Div_192 [Div] outputs: [629 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_193 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 629 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_193 [Mul] inputs: [629 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.1.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.1.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_193 for ONNX node: Mul_193 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 630 for ONNX tensor: 630 [06/20/2022-16:24:37] [V] [TRT] Mul_193 [Mul] outputs: [630 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_194 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 630 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_194 [Add] inputs: [630 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.1.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.1.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_194 for ONNX node: Add_194 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 631 for ONNX tensor: 631 [06/20/2022-16:24:37] [V] [TRT] Add_194 [Add] outputs: [631 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_195 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 631 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3199 [06/20/2022-16:24:37] [V] [TRT] MatMul_195 [MatMul] inputs: [631 -> (-1, -1, 1024)[FLOAT]], [3199 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3199 for ONNX node: 3199 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_195 for ONNX node: MatMul_195 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 633 for ONNX tensor: 633 [06/20/2022-16:24:37] [V] [TRT] MatMul_195 [MatMul] outputs: [633 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_196 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 633 [06/20/2022-16:24:37] [V] [TRT] Add_196 [Add] inputs: [bert.encoder.layer.1.intermediate.dense.bias -> (4096)[FLOAT]], [633 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.intermediate.dense.bias for ONNX node: bert.encoder.layer.1.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_196 for ONNX node: Add_196 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 634 for ONNX tensor: 634 [06/20/2022-16:24:37] [V] [TRT] Add_196 [Add] outputs: [634 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_197 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_197 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_197 [Constant] outputs: [635 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_198 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 634 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 635 [06/20/2022-16:24:37] [V] [TRT] Div_198 [Div] inputs: [634 -> (-1, -1, 4096)[FLOAT]], [635 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 635 for ONNX node: 635 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_198 for ONNX node: Div_198 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 636 for ONNX tensor: 636 [06/20/2022-16:24:37] [V] [TRT] Div_198 [Div] outputs: [636 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Erf_199 [Erf] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 636 [06/20/2022-16:24:37] [V] [TRT] Erf_199 [Erf] inputs: [636 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Erf_199 for ONNX node: Erf_199 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637 [06/20/2022-16:24:37] [V] [TRT] Erf_199 [Erf] outputs: [637 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_200 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_200 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_200 [Constant] outputs: [638 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_201 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 637 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 638 [06/20/2022-16:24:37] [V] [TRT] Add_201 [Add] inputs: [637 -> (-1, -1, 4096)[FLOAT]], [638 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 638 for ONNX node: 638 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_201 for ONNX node: Add_201 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 639 for ONNX tensor: 639 [06/20/2022-16:24:37] [V] [TRT] Add_201 [Add] outputs: [639 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_202 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 634 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 639 [06/20/2022-16:24:37] [V] [TRT] Mul_202 [Mul] inputs: [634 -> (-1, -1, 4096)[FLOAT]], [639 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_202 for ONNX node: Mul_202 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640 [06/20/2022-16:24:37] [V] [TRT] Mul_202 [Mul] outputs: [640 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_203 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_203 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_203 [Constant] outputs: [641 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_204 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 640 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 641 [06/20/2022-16:24:37] [V] [TRT] Mul_204 [Mul] inputs: [640 -> (-1, -1, 4096)[FLOAT]], [641 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 641 for ONNX node: 641 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_204 for ONNX node: Mul_204 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642 [06/20/2022-16:24:37] [V] [TRT] Mul_204 [Mul] outputs: [642 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_205 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 642 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3200 [06/20/2022-16:24:37] [V] [TRT] MatMul_205 [MatMul] inputs: [642 -> (-1, -1, 4096)[FLOAT]], [3200 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3200 for ONNX node: 3200 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_205 for ONNX node: MatMul_205 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 644 for ONNX tensor: 644 [06/20/2022-16:24:37] [V] [TRT] MatMul_205 [MatMul] outputs: [644 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_206 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 644 [06/20/2022-16:24:37] [V] [TRT] Add_206 [Add] inputs: [bert.encoder.layer.1.output.dense.bias -> (1024)[FLOAT]], [644 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.output.dense.bias for ONNX node: bert.encoder.layer.1.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_206 for ONNX node: Add_206 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 645 for ONNX tensor: 645 [06/20/2022-16:24:37] [V] [TRT] Add_206 [Add] outputs: [645 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_207 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 645 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 631 [06/20/2022-16:24:37] [V] [TRT] Add_207 [Add] inputs: [645 -> (-1, -1, 1024)[FLOAT]], [631 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_207 for ONNX node: Add_207 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646 [06/20/2022-16:24:37] [V] [TRT] Add_207 [Add] outputs: [646 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_208 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 646 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_208 [ReduceMean] inputs: [646 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_208 for ONNX node: ReduceMean_208 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_208 [ReduceMean] outputs: [647 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_209 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 646 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 647 [06/20/2022-16:24:37] [V] [TRT] Sub_209 [Sub] inputs: [646 -> (-1, -1, 1024)[FLOAT]], [647 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_209 for ONNX node: Sub_209 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 648 for ONNX tensor: 648 [06/20/2022-16:24:37] [V] [TRT] Sub_209 [Sub] outputs: [648 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_210 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_210 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_210 [Constant] outputs: [649 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_211 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 648 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 649 [06/20/2022-16:24:37] [V] [TRT] Pow_211 [Pow] inputs: [648 -> (-1, -1, 1024)[FLOAT]], [649 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 649 for ONNX node: 649 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_211 for ONNX node: Pow_211 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 650 for ONNX tensor: 650 [06/20/2022-16:24:37] [V] [TRT] Pow_211 [Pow] outputs: [650 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_212 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 650 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_212 [ReduceMean] inputs: [650 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_212 for ONNX node: ReduceMean_212 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 651 for ONNX tensor: 651 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_212 [ReduceMean] outputs: [651 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_213 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_213 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_213 [Constant] outputs: [652 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_214 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 651 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 652 [06/20/2022-16:24:37] [V] [TRT] Add_214 [Add] inputs: [651 -> (-1, -1, 1)[FLOAT]], [652 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 652 for ONNX node: 652 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_214 for ONNX node: Add_214 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 653 for ONNX tensor: 653 [06/20/2022-16:24:37] [V] [TRT] Add_214 [Add] outputs: [653 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_215 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 653 [06/20/2022-16:24:37] [V] [TRT] Sqrt_215 [Sqrt] inputs: [653 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_215 for ONNX node: Sqrt_215 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 654 for ONNX tensor: 654 [06/20/2022-16:24:37] [V] [TRT] Sqrt_215 [Sqrt] outputs: [654 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_216 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 648 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 654 [06/20/2022-16:24:37] [V] [TRT] Div_216 [Div] inputs: [648 -> (-1, -1, 1024)[FLOAT]], [654 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_216 for ONNX node: Div_216 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 655 for ONNX tensor: 655 [06/20/2022-16:24:37] [V] [TRT] Div_216 [Div] outputs: [655 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_217 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 655 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_217 [Mul] inputs: [655 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.1.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.output.LayerNorm.weight for ONNX node: bert.encoder.layer.1.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_217 for ONNX node: Mul_217 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 656 for ONNX tensor: 656 [06/20/2022-16:24:37] [V] [TRT] Mul_217 [Mul] outputs: [656 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_218 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 656 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.1.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_218 [Add] inputs: [656 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.1.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.1.output.LayerNorm.bias for ONNX node: bert.encoder.layer.1.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_218 for ONNX node: Add_218 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657 [06/20/2022-16:24:37] [V] [TRT] Add_218 [Add] outputs: [657 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_219 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 657 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3201 [06/20/2022-16:24:37] [V] [TRT] MatMul_219 [MatMul] inputs: [657 -> (-1, -1, 1024)[FLOAT]], [3201 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3201 for ONNX node: 3201 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_219 for ONNX node: MatMul_219 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 659 for ONNX tensor: 659 [06/20/2022-16:24:37] [V] [TRT] MatMul_219 [MatMul] outputs: [659 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_220 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 659 [06/20/2022-16:24:37] [V] [TRT] Add_220 [Add] inputs: [bert.encoder.layer.2.attention.self.query.bias -> (1024)[FLOAT]], [659 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.attention.self.query.bias for ONNX node: bert.encoder.layer.2.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_220 for ONNX node: Add_220 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 660 for ONNX tensor: 660 [06/20/2022-16:24:37] [V] [TRT] Add_220 [Add] outputs: [660 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_221 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 657 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3202 [06/20/2022-16:24:37] [V] [TRT] MatMul_221 [MatMul] inputs: [657 -> (-1, -1, 1024)[FLOAT]], [3202 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3202 for ONNX node: 3202 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_221 for ONNX node: MatMul_221 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 662 for ONNX tensor: 662 [06/20/2022-16:24:37] [V] [TRT] MatMul_221 [MatMul] outputs: [662 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_222 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 662 [06/20/2022-16:24:37] [V] [TRT] Add_222 [Add] inputs: [bert.encoder.layer.2.attention.self.key.bias -> (1024)[FLOAT]], [662 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.attention.self.key.bias for ONNX node: bert.encoder.layer.2.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_222 for ONNX node: Add_222 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 663 for ONNX tensor: 663 [06/20/2022-16:24:37] [V] [TRT] Add_222 [Add] outputs: [663 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_223 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 663 [06/20/2022-16:24:37] [V] [TRT] Shape_223 [Shape] inputs: [663 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_223 for ONNX node: Shape_223 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 664 for ONNX tensor: 664 [06/20/2022-16:24:37] [V] [TRT] Shape_223 [Shape] outputs: [664 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_224 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_224 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_224 [Constant] outputs: [665 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_225 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 664 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 665 [06/20/2022-16:24:37] [V] [TRT] Gather_225 [Gather] inputs: [664 -> (3)[INT32]], [665 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 665 for ONNX node: 665 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_225 for ONNX node: Gather_225 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 666 for ONNX tensor: 666 [06/20/2022-16:24:37] [V] [TRT] Gather_225 [Gather] outputs: [666 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_226 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 663 [06/20/2022-16:24:37] [V] [TRT] Shape_226 [Shape] inputs: [663 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_226 for ONNX node: Shape_226 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 667 for ONNX tensor: 667 [06/20/2022-16:24:37] [V] [TRT] Shape_226 [Shape] outputs: [667 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_227 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_227 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_227 [Constant] outputs: [668 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_228 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 667 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 668 [06/20/2022-16:24:37] [V] [TRT] Gather_228 [Gather] inputs: [667 -> (3)[INT32]], [668 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 668 for ONNX node: 668 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_228 for ONNX node: Gather_228 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 669 for ONNX tensor: 669 [06/20/2022-16:24:37] [V] [TRT] Gather_228 [Gather] outputs: [669 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_229 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 666 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_229 [Unsqueeze] inputs: [666 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_229 for ONNX node: Unsqueeze_229 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 672 for ONNX tensor: 672 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_229 [Unsqueeze] outputs: [672 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_230 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 669 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_230 [Unsqueeze] inputs: [669 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_230 for ONNX node: Unsqueeze_230 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_230 [Unsqueeze] outputs: [673 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_231 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 672 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 673 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3203 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3204 [06/20/2022-16:24:37] [V] [TRT] Concat_231 [Concat] inputs: [672 -> (1)[INT32]], [673 -> (1)[INT32]], [3203 -> (1)[INT32]], [3204 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3203 for ONNX node: 3203 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3204 for ONNX node: 3204 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_231 for ONNX node: Concat_231 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 676 for ONNX tensor: 676 [06/20/2022-16:24:37] [V] [TRT] Concat_231 [Concat] outputs: [676 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_232 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 663 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 676 [06/20/2022-16:24:37] [V] [TRT] Reshape_232 [Reshape] inputs: [663 -> (-1, -1, 1024)[FLOAT]], [676 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_232 for ONNX node: Reshape_232 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 677 for ONNX tensor: 677 [06/20/2022-16:24:37] [V] [TRT] Reshape_232 [Reshape] outputs: [677 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_233 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 657 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3205 [06/20/2022-16:24:37] [V] [TRT] MatMul_233 [MatMul] inputs: [657 -> (-1, -1, 1024)[FLOAT]], [3205 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3205 for ONNX node: 3205 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_233 for ONNX node: MatMul_233 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 679 for ONNX tensor: 679 [06/20/2022-16:24:37] [V] [TRT] MatMul_233 [MatMul] outputs: [679 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_234 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 679 [06/20/2022-16:24:37] [V] [TRT] Add_234 [Add] inputs: [bert.encoder.layer.2.attention.self.value.bias -> (1024)[FLOAT]], [679 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.attention.self.value.bias for ONNX node: bert.encoder.layer.2.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_234 for ONNX node: Add_234 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 680 for ONNX tensor: 680 [06/20/2022-16:24:37] [V] [TRT] Add_234 [Add] outputs: [680 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_235 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 680 [06/20/2022-16:24:37] [V] [TRT] Shape_235 [Shape] inputs: [680 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_235 for ONNX node: Shape_235 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 681 for ONNX tensor: 681 [06/20/2022-16:24:37] [V] [TRT] Shape_235 [Shape] outputs: [681 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_236 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_236 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_236 [Constant] outputs: [682 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_237 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 681 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 682 [06/20/2022-16:24:37] [V] [TRT] Gather_237 [Gather] inputs: [681 -> (3)[INT32]], [682 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 682 for ONNX node: 682 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_237 for ONNX node: Gather_237 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 683 for ONNX tensor: 683 [06/20/2022-16:24:37] [V] [TRT] Gather_237 [Gather] outputs: [683 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_238 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 680 [06/20/2022-16:24:37] [V] [TRT] Shape_238 [Shape] inputs: [680 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_238 for ONNX node: Shape_238 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 684 for ONNX tensor: 684 [06/20/2022-16:24:37] [V] [TRT] Shape_238 [Shape] outputs: [684 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_239 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_239 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_239 [Constant] outputs: [685 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_240 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 684 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 685 [06/20/2022-16:24:37] [V] [TRT] Gather_240 [Gather] inputs: [684 -> (3)[INT32]], [685 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 685 for ONNX node: 685 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_240 for ONNX node: Gather_240 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 686 for ONNX tensor: 686 [06/20/2022-16:24:37] [V] [TRT] Gather_240 [Gather] outputs: [686 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_241 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 683 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_241 [Unsqueeze] inputs: [683 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_241 for ONNX node: Unsqueeze_241 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 689 for ONNX tensor: 689 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_241 [Unsqueeze] outputs: [689 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_242 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 686 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_242 [Unsqueeze] inputs: [686 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_242 for ONNX node: Unsqueeze_242 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 690 for ONNX tensor: 690 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_242 [Unsqueeze] outputs: [690 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_243 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 689 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 690 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3206 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3207 [06/20/2022-16:24:37] [V] [TRT] Concat_243 [Concat] inputs: [689 -> (1)[INT32]], [690 -> (1)[INT32]], [3206 -> (1)[INT32]], [3207 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3206 for ONNX node: 3206 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3207 for ONNX node: 3207 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_243 for ONNX node: Concat_243 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 693 for ONNX tensor: 693 [06/20/2022-16:24:37] [V] [TRT] Concat_243 [Concat] outputs: [693 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_244 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 680 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 693 [06/20/2022-16:24:37] [V] [TRT] Reshape_244 [Reshape] inputs: [680 -> (-1, -1, 1024)[FLOAT]], [693 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_244 for ONNX node: Reshape_244 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 694 for ONNX tensor: 694 [06/20/2022-16:24:37] [V] [TRT] Reshape_244 [Reshape] outputs: [694 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_245 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 694 [06/20/2022-16:24:37] [V] [TRT] Transpose_245 [Transpose] inputs: [694 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_245 for ONNX node: Transpose_245 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 695 for ONNX tensor: 695 [06/20/2022-16:24:37] [V] [TRT] Transpose_245 [Transpose] outputs: [695 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_246 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 660 [06/20/2022-16:24:37] [V] [TRT] Shape_246 [Shape] inputs: [660 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_246 for ONNX node: Shape_246 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 696 for ONNX tensor: 696 [06/20/2022-16:24:37] [V] [TRT] Shape_246 [Shape] outputs: [696 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_247 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_247 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_247 [Constant] outputs: [697 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_248 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 696 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 697 [06/20/2022-16:24:37] [V] [TRT] Gather_248 [Gather] inputs: [696 -> (3)[INT32]], [697 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 697 for ONNX node: 697 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_248 for ONNX node: Gather_248 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 698 for ONNX tensor: 698 [06/20/2022-16:24:37] [V] [TRT] Gather_248 [Gather] outputs: [698 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_249 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 660 [06/20/2022-16:24:37] [V] [TRT] Shape_249 [Shape] inputs: [660 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_249 for ONNX node: Shape_249 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 699 for ONNX tensor: 699 [06/20/2022-16:24:37] [V] [TRT] Shape_249 [Shape] outputs: [699 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_250 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_250 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_250 [Constant] outputs: [700 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_251 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 699 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 700 [06/20/2022-16:24:37] [V] [TRT] Gather_251 [Gather] inputs: [699 -> (3)[INT32]], [700 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 700 for ONNX node: 700 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_251 for ONNX node: Gather_251 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 701 for ONNX tensor: 701 [06/20/2022-16:24:37] [V] [TRT] Gather_251 [Gather] outputs: [701 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_252 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 698 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_252 [Unsqueeze] inputs: [698 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_252 for ONNX node: Unsqueeze_252 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 704 for ONNX tensor: 704 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_252 [Unsqueeze] outputs: [704 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_253 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 701 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_253 [Unsqueeze] inputs: [701 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_253 for ONNX node: Unsqueeze_253 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 705 for ONNX tensor: 705 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_253 [Unsqueeze] outputs: [705 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_254 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 704 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 705 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3208 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3209 [06/20/2022-16:24:37] [V] [TRT] Concat_254 [Concat] inputs: [704 -> (1)[INT32]], [705 -> (1)[INT32]], [3208 -> (1)[INT32]], [3209 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3208 for ONNX node: 3208 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3209 for ONNX node: 3209 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_254 for ONNX node: Concat_254 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 708 for ONNX tensor: 708 [06/20/2022-16:24:37] [V] [TRT] Concat_254 [Concat] outputs: [708 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_255 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 660 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 708 [06/20/2022-16:24:37] [V] [TRT] Reshape_255 [Reshape] inputs: [660 -> (-1, -1, 1024)[FLOAT]], [708 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_255 for ONNX node: Reshape_255 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 709 for ONNX tensor: 709 [06/20/2022-16:24:37] [V] [TRT] Reshape_255 [Reshape] outputs: [709 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_256 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 709 [06/20/2022-16:24:37] [V] [TRT] Transpose_256 [Transpose] inputs: [709 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_256 for ONNX node: Transpose_256 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 710 for ONNX tensor: 710 [06/20/2022-16:24:37] [V] [TRT] Transpose_256 [Transpose] outputs: [710 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_257 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 677 [06/20/2022-16:24:37] [V] [TRT] Transpose_257 [Transpose] inputs: [677 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_257 for ONNX node: Transpose_257 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 711 for ONNX tensor: 711 [06/20/2022-16:24:37] [V] [TRT] Transpose_257 [Transpose] outputs: [711 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_258 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 710 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 711 [06/20/2022-16:24:37] [V] [TRT] MatMul_258 [MatMul] inputs: [710 -> (-1, 16, -1, 64)[FLOAT]], [711 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_258 for ONNX node: MatMul_258 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 712 for ONNX tensor: 712 [06/20/2022-16:24:37] [V] [TRT] MatMul_258 [MatMul] outputs: [712 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_259 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_259 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_259 [Constant] outputs: [713 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_260 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 712 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 713 [06/20/2022-16:24:37] [V] [TRT] Div_260 [Div] inputs: [712 -> (-1, 16, -1, -1)[FLOAT]], [713 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 713 for ONNX node: 713 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_260 for ONNX node: Div_260 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 714 for ONNX tensor: 714 [06/20/2022-16:24:37] [V] [TRT] Div_260 [Div] outputs: [714 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_261 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 714 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:37] [V] [TRT] Add_261 [Add] inputs: [714 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_261 for ONNX node: Add_261 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 715 for ONNX tensor: 715 [06/20/2022-16:24:37] [V] [TRT] Add_261 [Add] outputs: [715 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Softmax_262 [Softmax] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 715 [06/20/2022-16:24:37] [V] [TRT] Softmax_262 [Softmax] inputs: [715 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Softmax_262 for ONNX node: Softmax_262 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 716 for ONNX tensor: 716 [06/20/2022-16:24:37] [V] [TRT] Softmax_262 [Softmax] outputs: [716 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_263 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 716 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 695 [06/20/2022-16:24:37] [V] [TRT] MatMul_263 [MatMul] inputs: [716 -> (-1, 16, -1, -1)[FLOAT]], [695 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_263 for ONNX node: MatMul_263 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 717 for ONNX tensor: 717 [06/20/2022-16:24:37] [V] [TRT] MatMul_263 [MatMul] outputs: [717 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_264 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 717 [06/20/2022-16:24:37] [V] [TRT] Transpose_264 [Transpose] inputs: [717 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_264 for ONNX node: Transpose_264 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 718 for ONNX tensor: 718 [06/20/2022-16:24:37] [V] [TRT] Transpose_264 [Transpose] outputs: [718 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_265 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 718 [06/20/2022-16:24:37] [V] [TRT] Shape_265 [Shape] inputs: [718 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_265 for ONNX node: Shape_265 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 719 for ONNX tensor: 719 [06/20/2022-16:24:37] [V] [TRT] Shape_265 [Shape] outputs: [719 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_266 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_266 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_266 [Constant] outputs: [720 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_267 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 719 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 720 [06/20/2022-16:24:37] [V] [TRT] Gather_267 [Gather] inputs: [719 -> (4)[INT32]], [720 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 720 for ONNX node: 720 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_267 for ONNX node: Gather_267 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 721 for ONNX tensor: 721 [06/20/2022-16:24:37] [V] [TRT] Gather_267 [Gather] outputs: [721 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_268 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 718 [06/20/2022-16:24:37] [V] [TRT] Shape_268 [Shape] inputs: [718 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_268 for ONNX node: Shape_268 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 722 for ONNX tensor: 722 [06/20/2022-16:24:37] [V] [TRT] Shape_268 [Shape] outputs: [722 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_269 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_269 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_269 [Constant] outputs: [723 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_270 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 722 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 723 [06/20/2022-16:24:37] [V] [TRT] Gather_270 [Gather] inputs: [722 -> (4)[INT32]], [723 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 723 for ONNX node: 723 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_270 for ONNX node: Gather_270 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724 [06/20/2022-16:24:37] [V] [TRT] Gather_270 [Gather] outputs: [724 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_271 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 721 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_271 [Unsqueeze] inputs: [721 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_271 for ONNX node: Unsqueeze_271 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 726 for ONNX tensor: 726 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_271 [Unsqueeze] outputs: [726 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_272 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 724 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_272 [Unsqueeze] inputs: [724 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_272 for ONNX node: Unsqueeze_272 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 727 for ONNX tensor: 727 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_272 [Unsqueeze] outputs: [727 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_273 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 726 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 727 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3210 [06/20/2022-16:24:37] [V] [TRT] Concat_273 [Concat] inputs: [726 -> (1)[INT32]], [727 -> (1)[INT32]], [3210 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3210 for ONNX node: 3210 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_273 for ONNX node: Concat_273 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 729 for ONNX tensor: 729 [06/20/2022-16:24:37] [V] [TRT] Concat_273 [Concat] outputs: [729 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_274 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 718 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 729 [06/20/2022-16:24:37] [V] [TRT] Reshape_274 [Reshape] inputs: [718 -> (-1, -1, 16, 64)[FLOAT]], [729 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_274 for ONNX node: Reshape_274 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 730 for ONNX tensor: 730 [06/20/2022-16:24:37] [V] [TRT] Reshape_274 [Reshape] outputs: [730 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_275 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 730 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3211 [06/20/2022-16:24:37] [V] [TRT] MatMul_275 [MatMul] inputs: [730 -> (-1, -1, 1024)[FLOAT]], [3211 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3211 for ONNX node: 3211 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_275 for ONNX node: MatMul_275 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 732 for ONNX tensor: 732 [06/20/2022-16:24:37] [V] [TRT] MatMul_275 [MatMul] outputs: [732 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_276 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 732 [06/20/2022-16:24:37] [V] [TRT] Add_276 [Add] inputs: [bert.encoder.layer.2.attention.output.dense.bias -> (1024)[FLOAT]], [732 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.attention.output.dense.bias for ONNX node: bert.encoder.layer.2.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_276 for ONNX node: Add_276 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733 [06/20/2022-16:24:37] [V] [TRT] Add_276 [Add] outputs: [733 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_277 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 733 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 657 [06/20/2022-16:24:37] [V] [TRT] Add_277 [Add] inputs: [733 -> (-1, -1, 1024)[FLOAT]], [657 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_277 for ONNX node: Add_277 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 734 for ONNX tensor: 734 [06/20/2022-16:24:37] [V] [TRT] Add_277 [Add] outputs: [734 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_278 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 734 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_278 [ReduceMean] inputs: [734 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_278 for ONNX node: ReduceMean_278 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 735 for ONNX tensor: 735 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_278 [ReduceMean] outputs: [735 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_279 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 734 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 735 [06/20/2022-16:24:37] [V] [TRT] Sub_279 [Sub] inputs: [734 -> (-1, -1, 1024)[FLOAT]], [735 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_279 for ONNX node: Sub_279 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 736 for ONNX tensor: 736 [06/20/2022-16:24:37] [V] [TRT] Sub_279 [Sub] outputs: [736 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_280 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_280 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_280 [Constant] outputs: [737 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_281 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 736 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 737 [06/20/2022-16:24:37] [V] [TRT] Pow_281 [Pow] inputs: [736 -> (-1, -1, 1024)[FLOAT]], [737 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 737 for ONNX node: 737 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_281 for ONNX node: Pow_281 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738 [06/20/2022-16:24:37] [V] [TRT] Pow_281 [Pow] outputs: [738 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_282 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 738 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_282 [ReduceMean] inputs: [738 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_282 for ONNX node: ReduceMean_282 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_282 [ReduceMean] outputs: [739 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_283 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_283 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_283 [Constant] outputs: [740 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_284 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 739 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 740 [06/20/2022-16:24:37] [V] [TRT] Add_284 [Add] inputs: [739 -> (-1, -1, 1)[FLOAT]], [740 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 740 for ONNX node: 740 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_284 for ONNX node: Add_284 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741 [06/20/2022-16:24:37] [V] [TRT] Add_284 [Add] outputs: [741 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_285 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 741 [06/20/2022-16:24:37] [V] [TRT] Sqrt_285 [Sqrt] inputs: [741 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_285 for ONNX node: Sqrt_285 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742 [06/20/2022-16:24:37] [V] [TRT] Sqrt_285 [Sqrt] outputs: [742 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_286 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 736 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 742 [06/20/2022-16:24:37] [V] [TRT] Div_286 [Div] inputs: [736 -> (-1, -1, 1024)[FLOAT]], [742 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_286 for ONNX node: Div_286 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743 [06/20/2022-16:24:37] [V] [TRT] Div_286 [Div] outputs: [743 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_287 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 743 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_287 [Mul] inputs: [743 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.2.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.2.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_287 for ONNX node: Mul_287 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744 [06/20/2022-16:24:37] [V] [TRT] Mul_287 [Mul] outputs: [744 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_288 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 744 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_288 [Add] inputs: [744 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.2.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.2.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_288 for ONNX node: Add_288 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 745 for ONNX tensor: 745 [06/20/2022-16:24:37] [V] [TRT] Add_288 [Add] outputs: [745 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_289 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 745 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3212 [06/20/2022-16:24:37] [V] [TRT] MatMul_289 [MatMul] inputs: [745 -> (-1, -1, 1024)[FLOAT]], [3212 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3212 for ONNX node: 3212 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_289 for ONNX node: MatMul_289 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 747 for ONNX tensor: 747 [06/20/2022-16:24:37] [V] [TRT] MatMul_289 [MatMul] outputs: [747 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_290 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 747 [06/20/2022-16:24:37] [V] [TRT] Add_290 [Add] inputs: [bert.encoder.layer.2.intermediate.dense.bias -> (4096)[FLOAT]], [747 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.intermediate.dense.bias for ONNX node: bert.encoder.layer.2.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_290 for ONNX node: Add_290 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 748 for ONNX tensor: 748 [06/20/2022-16:24:37] [V] [TRT] Add_290 [Add] outputs: [748 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_291 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_291 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_291 [Constant] outputs: [749 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_292 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 748 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 749 [06/20/2022-16:24:37] [V] [TRT] Div_292 [Div] inputs: [748 -> (-1, -1, 4096)[FLOAT]], [749 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 749 for ONNX node: 749 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_292 for ONNX node: Div_292 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 750 for ONNX tensor: 750 [06/20/2022-16:24:37] [V] [TRT] Div_292 [Div] outputs: [750 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Erf_293 [Erf] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 750 [06/20/2022-16:24:37] [V] [TRT] Erf_293 [Erf] inputs: [750 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Erf_293 for ONNX node: Erf_293 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 751 for ONNX tensor: 751 [06/20/2022-16:24:37] [V] [TRT] Erf_293 [Erf] outputs: [751 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_294 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_294 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_294 [Constant] outputs: [752 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_295 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 751 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 752 [06/20/2022-16:24:37] [V] [TRT] Add_295 [Add] inputs: [751 -> (-1, -1, 4096)[FLOAT]], [752 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 752 for ONNX node: 752 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_295 for ONNX node: Add_295 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 753 for ONNX tensor: 753 [06/20/2022-16:24:37] [V] [TRT] Add_295 [Add] outputs: [753 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_296 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 748 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 753 [06/20/2022-16:24:37] [V] [TRT] Mul_296 [Mul] inputs: [748 -> (-1, -1, 4096)[FLOAT]], [753 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_296 for ONNX node: Mul_296 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 754 for ONNX tensor: 754 [06/20/2022-16:24:37] [V] [TRT] Mul_296 [Mul] outputs: [754 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_297 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_297 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_297 [Constant] outputs: [755 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_298 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 754 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 755 [06/20/2022-16:24:37] [V] [TRT] Mul_298 [Mul] inputs: [754 -> (-1, -1, 4096)[FLOAT]], [755 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 755 for ONNX node: 755 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_298 for ONNX node: Mul_298 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 756 for ONNX tensor: 756 [06/20/2022-16:24:37] [V] [TRT] Mul_298 [Mul] outputs: [756 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_299 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 756 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3213 [06/20/2022-16:24:37] [V] [TRT] MatMul_299 [MatMul] inputs: [756 -> (-1, -1, 4096)[FLOAT]], [3213 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3213 for ONNX node: 3213 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_299 for ONNX node: MatMul_299 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 758 for ONNX tensor: 758 [06/20/2022-16:24:37] [V] [TRT] MatMul_299 [MatMul] outputs: [758 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_300 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 758 [06/20/2022-16:24:37] [V] [TRT] Add_300 [Add] inputs: [bert.encoder.layer.2.output.dense.bias -> (1024)[FLOAT]], [758 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.output.dense.bias for ONNX node: bert.encoder.layer.2.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_300 for ONNX node: Add_300 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 759 for ONNX tensor: 759 [06/20/2022-16:24:37] [V] [TRT] Add_300 [Add] outputs: [759 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_301 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 759 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 745 [06/20/2022-16:24:37] [V] [TRT] Add_301 [Add] inputs: [759 -> (-1, -1, 1024)[FLOAT]], [745 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_301 for ONNX node: Add_301 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760 [06/20/2022-16:24:37] [V] [TRT] Add_301 [Add] outputs: [760 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_302 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 760 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_302 [ReduceMean] inputs: [760 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_302 for ONNX node: ReduceMean_302 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 761 for ONNX tensor: 761 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_302 [ReduceMean] outputs: [761 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_303 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 760 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 761 [06/20/2022-16:24:37] [V] [TRT] Sub_303 [Sub] inputs: [760 -> (-1, -1, 1024)[FLOAT]], [761 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_303 for ONNX node: Sub_303 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762 [06/20/2022-16:24:37] [V] [TRT] Sub_303 [Sub] outputs: [762 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_304 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_304 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_304 [Constant] outputs: [763 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_305 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 762 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 763 [06/20/2022-16:24:37] [V] [TRT] Pow_305 [Pow] inputs: [762 -> (-1, -1, 1024)[FLOAT]], [763 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 763 for ONNX node: 763 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_305 for ONNX node: Pow_305 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764 [06/20/2022-16:24:37] [V] [TRT] Pow_305 [Pow] outputs: [764 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_306 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 764 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_306 [ReduceMean] inputs: [764 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_306 for ONNX node: ReduceMean_306 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 765 for ONNX tensor: 765 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_306 [ReduceMean] outputs: [765 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_307 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_307 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_307 [Constant] outputs: [766 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_308 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 765 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 766 [06/20/2022-16:24:37] [V] [TRT] Add_308 [Add] inputs: [765 -> (-1, -1, 1)[FLOAT]], [766 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 766 for ONNX node: 766 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_308 for ONNX node: Add_308 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 767 for ONNX tensor: 767 [06/20/2022-16:24:37] [V] [TRT] Add_308 [Add] outputs: [767 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_309 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 767 [06/20/2022-16:24:37] [V] [TRT] Sqrt_309 [Sqrt] inputs: [767 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_309 for ONNX node: Sqrt_309 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 768 for ONNX tensor: 768 [06/20/2022-16:24:37] [V] [TRT] Sqrt_309 [Sqrt] outputs: [768 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_310 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 762 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 768 [06/20/2022-16:24:37] [V] [TRT] Div_310 [Div] inputs: [762 -> (-1, -1, 1024)[FLOAT]], [768 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_310 for ONNX node: Div_310 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769 [06/20/2022-16:24:37] [V] [TRT] Div_310 [Div] outputs: [769 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_311 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 769 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_311 [Mul] inputs: [769 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.2.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.output.LayerNorm.weight for ONNX node: bert.encoder.layer.2.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_311 for ONNX node: Mul_311 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770 [06/20/2022-16:24:37] [V] [TRT] Mul_311 [Mul] outputs: [770 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_312 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 770 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.2.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_312 [Add] inputs: [770 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.2.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.2.output.LayerNorm.bias for ONNX node: bert.encoder.layer.2.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_312 for ONNX node: Add_312 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771 [06/20/2022-16:24:37] [V] [TRT] Add_312 [Add] outputs: [771 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_313 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 771 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3214 [06/20/2022-16:24:37] [V] [TRT] MatMul_313 [MatMul] inputs: [771 -> (-1, -1, 1024)[FLOAT]], [3214 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3214 for ONNX node: 3214 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_313 for ONNX node: MatMul_313 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773 [06/20/2022-16:24:37] [V] [TRT] MatMul_313 [MatMul] outputs: [773 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_314 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 773 [06/20/2022-16:24:37] [V] [TRT] Add_314 [Add] inputs: [bert.encoder.layer.3.attention.self.query.bias -> (1024)[FLOAT]], [773 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.attention.self.query.bias for ONNX node: bert.encoder.layer.3.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_314 for ONNX node: Add_314 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 774 for ONNX tensor: 774 [06/20/2022-16:24:37] [V] [TRT] Add_314 [Add] outputs: [774 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_315 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 771 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3215 [06/20/2022-16:24:37] [V] [TRT] MatMul_315 [MatMul] inputs: [771 -> (-1, -1, 1024)[FLOAT]], [3215 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3215 for ONNX node: 3215 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_315 for ONNX node: MatMul_315 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 776 for ONNX tensor: 776 [06/20/2022-16:24:37] [V] [TRT] MatMul_315 [MatMul] outputs: [776 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_316 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 776 [06/20/2022-16:24:37] [V] [TRT] Add_316 [Add] inputs: [bert.encoder.layer.3.attention.self.key.bias -> (1024)[FLOAT]], [776 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.attention.self.key.bias for ONNX node: bert.encoder.layer.3.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_316 for ONNX node: Add_316 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 777 for ONNX tensor: 777 [06/20/2022-16:24:37] [V] [TRT] Add_316 [Add] outputs: [777 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_317 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 777 [06/20/2022-16:24:37] [V] [TRT] Shape_317 [Shape] inputs: [777 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_317 for ONNX node: Shape_317 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 778 for ONNX tensor: 778 [06/20/2022-16:24:37] [V] [TRT] Shape_317 [Shape] outputs: [778 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_318 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_318 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_318 [Constant] outputs: [779 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_319 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 778 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 779 [06/20/2022-16:24:37] [V] [TRT] Gather_319 [Gather] inputs: [778 -> (3)[INT32]], [779 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 779 for ONNX node: 779 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_319 for ONNX node: Gather_319 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 780 for ONNX tensor: 780 [06/20/2022-16:24:37] [V] [TRT] Gather_319 [Gather] outputs: [780 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_320 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 777 [06/20/2022-16:24:37] [V] [TRT] Shape_320 [Shape] inputs: [777 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_320 for ONNX node: Shape_320 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 781 for ONNX tensor: 781 [06/20/2022-16:24:37] [V] [TRT] Shape_320 [Shape] outputs: [781 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_321 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_321 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_321 [Constant] outputs: [782 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_322 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 781 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 782 [06/20/2022-16:24:37] [V] [TRT] Gather_322 [Gather] inputs: [781 -> (3)[INT32]], [782 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 782 for ONNX node: 782 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_322 for ONNX node: Gather_322 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 783 for ONNX tensor: 783 [06/20/2022-16:24:37] [V] [TRT] Gather_322 [Gather] outputs: [783 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_323 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 780 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_323 [Unsqueeze] inputs: [780 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_323 for ONNX node: Unsqueeze_323 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_323 [Unsqueeze] outputs: [786 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_324 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 783 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_324 [Unsqueeze] inputs: [783 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_324 for ONNX node: Unsqueeze_324 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 787 for ONNX tensor: 787 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_324 [Unsqueeze] outputs: [787 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_325 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 786 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 787 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3216 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3217 [06/20/2022-16:24:37] [V] [TRT] Concat_325 [Concat] inputs: [786 -> (1)[INT32]], [787 -> (1)[INT32]], [3216 -> (1)[INT32]], [3217 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3216 for ONNX node: 3216 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3217 for ONNX node: 3217 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_325 for ONNX node: Concat_325 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 790 for ONNX tensor: 790 [06/20/2022-16:24:37] [V] [TRT] Concat_325 [Concat] outputs: [790 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_326 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 777 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 790 [06/20/2022-16:24:37] [V] [TRT] Reshape_326 [Reshape] inputs: [777 -> (-1, -1, 1024)[FLOAT]], [790 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_326 for ONNX node: Reshape_326 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 791 for ONNX tensor: 791 [06/20/2022-16:24:37] [V] [TRT] Reshape_326 [Reshape] outputs: [791 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_327 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 771 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3218 [06/20/2022-16:24:37] [V] [TRT] MatMul_327 [MatMul] inputs: [771 -> (-1, -1, 1024)[FLOAT]], [3218 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3218 for ONNX node: 3218 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_327 for ONNX node: MatMul_327 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 793 for ONNX tensor: 793 [06/20/2022-16:24:37] [V] [TRT] MatMul_327 [MatMul] outputs: [793 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_328 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 793 [06/20/2022-16:24:37] [V] [TRT] Add_328 [Add] inputs: [bert.encoder.layer.3.attention.self.value.bias -> (1024)[FLOAT]], [793 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.attention.self.value.bias for ONNX node: bert.encoder.layer.3.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_328 for ONNX node: Add_328 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 794 for ONNX tensor: 794 [06/20/2022-16:24:37] [V] [TRT] Add_328 [Add] outputs: [794 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_329 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 794 [06/20/2022-16:24:37] [V] [TRT] Shape_329 [Shape] inputs: [794 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_329 for ONNX node: Shape_329 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795 [06/20/2022-16:24:37] [V] [TRT] Shape_329 [Shape] outputs: [795 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_330 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_330 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_330 [Constant] outputs: [796 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_331 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 795 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 796 [06/20/2022-16:24:37] [V] [TRT] Gather_331 [Gather] inputs: [795 -> (3)[INT32]], [796 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 796 for ONNX node: 796 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_331 for ONNX node: Gather_331 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 797 for ONNX tensor: 797 [06/20/2022-16:24:37] [V] [TRT] Gather_331 [Gather] outputs: [797 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_332 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 794 [06/20/2022-16:24:37] [V] [TRT] Shape_332 [Shape] inputs: [794 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_332 for ONNX node: Shape_332 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 798 for ONNX tensor: 798 [06/20/2022-16:24:37] [V] [TRT] Shape_332 [Shape] outputs: [798 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_333 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_333 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_333 [Constant] outputs: [799 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_334 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 798 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 799 [06/20/2022-16:24:37] [V] [TRT] Gather_334 [Gather] inputs: [798 -> (3)[INT32]], [799 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 799 for ONNX node: 799 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_334 for ONNX node: Gather_334 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 800 for ONNX tensor: 800 [06/20/2022-16:24:37] [V] [TRT] Gather_334 [Gather] outputs: [800 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_335 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 797 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_335 [Unsqueeze] inputs: [797 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_335 for ONNX node: Unsqueeze_335 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 803 for ONNX tensor: 803 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_335 [Unsqueeze] outputs: [803 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_336 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 800 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_336 [Unsqueeze] inputs: [800 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_336 for ONNX node: Unsqueeze_336 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 804 for ONNX tensor: 804 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_336 [Unsqueeze] outputs: [804 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_337 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 803 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 804 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3219 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3220 [06/20/2022-16:24:37] [V] [TRT] Concat_337 [Concat] inputs: [803 -> (1)[INT32]], [804 -> (1)[INT32]], [3219 -> (1)[INT32]], [3220 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3219 for ONNX node: 3219 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3220 for ONNX node: 3220 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_337 for ONNX node: Concat_337 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 807 for ONNX tensor: 807 [06/20/2022-16:24:37] [V] [TRT] Concat_337 [Concat] outputs: [807 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_338 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 794 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 807 [06/20/2022-16:24:37] [V] [TRT] Reshape_338 [Reshape] inputs: [794 -> (-1, -1, 1024)[FLOAT]], [807 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_338 for ONNX node: Reshape_338 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 808 for ONNX tensor: 808 [06/20/2022-16:24:37] [V] [TRT] Reshape_338 [Reshape] outputs: [808 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_339 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 808 [06/20/2022-16:24:37] [V] [TRT] Transpose_339 [Transpose] inputs: [808 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_339 for ONNX node: Transpose_339 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 809 for ONNX tensor: 809 [06/20/2022-16:24:37] [V] [TRT] Transpose_339 [Transpose] outputs: [809 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_340 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 774 [06/20/2022-16:24:37] [V] [TRT] Shape_340 [Shape] inputs: [774 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_340 for ONNX node: Shape_340 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 810 for ONNX tensor: 810 [06/20/2022-16:24:37] [V] [TRT] Shape_340 [Shape] outputs: [810 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_341 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_341 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_341 [Constant] outputs: [811 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_342 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 810 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 811 [06/20/2022-16:24:37] [V] [TRT] Gather_342 [Gather] inputs: [810 -> (3)[INT32]], [811 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 811 for ONNX node: 811 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_342 for ONNX node: Gather_342 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 812 for ONNX tensor: 812 [06/20/2022-16:24:37] [V] [TRT] Gather_342 [Gather] outputs: [812 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_343 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 774 [06/20/2022-16:24:37] [V] [TRT] Shape_343 [Shape] inputs: [774 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_343 for ONNX node: Shape_343 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 813 for ONNX tensor: 813 [06/20/2022-16:24:37] [V] [TRT] Shape_343 [Shape] outputs: [813 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_344 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_344 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_344 [Constant] outputs: [814 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_345 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 813 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 814 [06/20/2022-16:24:37] [V] [TRT] Gather_345 [Gather] inputs: [813 -> (3)[INT32]], [814 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 814 for ONNX node: 814 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_345 for ONNX node: Gather_345 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 815 for ONNX tensor: 815 [06/20/2022-16:24:37] [V] [TRT] Gather_345 [Gather] outputs: [815 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_346 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 812 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_346 [Unsqueeze] inputs: [812 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_346 for ONNX node: Unsqueeze_346 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 818 for ONNX tensor: 818 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_346 [Unsqueeze] outputs: [818 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_347 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 815 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_347 [Unsqueeze] inputs: [815 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_347 for ONNX node: Unsqueeze_347 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 819 for ONNX tensor: 819 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_347 [Unsqueeze] outputs: [819 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_348 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 818 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 819 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3221 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3222 [06/20/2022-16:24:37] [V] [TRT] Concat_348 [Concat] inputs: [818 -> (1)[INT32]], [819 -> (1)[INT32]], [3221 -> (1)[INT32]], [3222 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3221 for ONNX node: 3221 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3222 for ONNX node: 3222 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_348 for ONNX node: Concat_348 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 822 for ONNX tensor: 822 [06/20/2022-16:24:37] [V] [TRT] Concat_348 [Concat] outputs: [822 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_349 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 774 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 822 [06/20/2022-16:24:37] [V] [TRT] Reshape_349 [Reshape] inputs: [774 -> (-1, -1, 1024)[FLOAT]], [822 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_349 for ONNX node: Reshape_349 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823 [06/20/2022-16:24:37] [V] [TRT] Reshape_349 [Reshape] outputs: [823 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_350 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 823 [06/20/2022-16:24:37] [V] [TRT] Transpose_350 [Transpose] inputs: [823 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_350 for ONNX node: Transpose_350 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 824 for ONNX tensor: 824 [06/20/2022-16:24:37] [V] [TRT] Transpose_350 [Transpose] outputs: [824 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_351 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 791 [06/20/2022-16:24:37] [V] [TRT] Transpose_351 [Transpose] inputs: [791 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_351 for ONNX node: Transpose_351 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 825 for ONNX tensor: 825 [06/20/2022-16:24:37] [V] [TRT] Transpose_351 [Transpose] outputs: [825 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_352 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 824 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 825 [06/20/2022-16:24:37] [V] [TRT] MatMul_352 [MatMul] inputs: [824 -> (-1, 16, -1, 64)[FLOAT]], [825 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_352 for ONNX node: MatMul_352 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 826 for ONNX tensor: 826 [06/20/2022-16:24:37] [V] [TRT] MatMul_352 [MatMul] outputs: [826 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_353 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_353 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_353 [Constant] outputs: [827 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_354 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 826 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 827 [06/20/2022-16:24:37] [V] [TRT] Div_354 [Div] inputs: [826 -> (-1, 16, -1, -1)[FLOAT]], [827 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 827 for ONNX node: 827 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_354 for ONNX node: Div_354 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 828 for ONNX tensor: 828 [06/20/2022-16:24:37] [V] [TRT] Div_354 [Div] outputs: [828 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_355 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 828 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:37] [V] [TRT] Add_355 [Add] inputs: [828 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_355 for ONNX node: Add_355 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 829 for ONNX tensor: 829 [06/20/2022-16:24:37] [V] [TRT] Add_355 [Add] outputs: [829 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Softmax_356 [Softmax] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 829 [06/20/2022-16:24:37] [V] [TRT] Softmax_356 [Softmax] inputs: [829 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Softmax_356 for ONNX node: Softmax_356 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 830 for ONNX tensor: 830 [06/20/2022-16:24:37] [V] [TRT] Softmax_356 [Softmax] outputs: [830 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_357 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 830 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 809 [06/20/2022-16:24:37] [V] [TRT] MatMul_357 [MatMul] inputs: [830 -> (-1, 16, -1, -1)[FLOAT]], [809 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_357 for ONNX node: MatMul_357 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 831 for ONNX tensor: 831 [06/20/2022-16:24:37] [V] [TRT] MatMul_357 [MatMul] outputs: [831 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_358 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 831 [06/20/2022-16:24:37] [V] [TRT] Transpose_358 [Transpose] inputs: [831 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_358 for ONNX node: Transpose_358 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 832 for ONNX tensor: 832 [06/20/2022-16:24:37] [V] [TRT] Transpose_358 [Transpose] outputs: [832 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_359 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 832 [06/20/2022-16:24:37] [V] [TRT] Shape_359 [Shape] inputs: [832 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_359 for ONNX node: Shape_359 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 833 for ONNX tensor: 833 [06/20/2022-16:24:37] [V] [TRT] Shape_359 [Shape] outputs: [833 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_360 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_360 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_360 [Constant] outputs: [834 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_361 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 833 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 834 [06/20/2022-16:24:37] [V] [TRT] Gather_361 [Gather] inputs: [833 -> (4)[INT32]], [834 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 834 for ONNX node: 834 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_361 for ONNX node: Gather_361 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 835 for ONNX tensor: 835 [06/20/2022-16:24:37] [V] [TRT] Gather_361 [Gather] outputs: [835 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_362 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 832 [06/20/2022-16:24:37] [V] [TRT] Shape_362 [Shape] inputs: [832 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_362 for ONNX node: Shape_362 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 836 for ONNX tensor: 836 [06/20/2022-16:24:37] [V] [TRT] Shape_362 [Shape] outputs: [836 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_363 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_363 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_363 [Constant] outputs: [837 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_364 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 836 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 837 [06/20/2022-16:24:37] [V] [TRT] Gather_364 [Gather] inputs: [836 -> (4)[INT32]], [837 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 837 for ONNX node: 837 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_364 for ONNX node: Gather_364 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 838 for ONNX tensor: 838 [06/20/2022-16:24:37] [V] [TRT] Gather_364 [Gather] outputs: [838 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_365 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 835 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_365 [Unsqueeze] inputs: [835 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_365 for ONNX node: Unsqueeze_365 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 840 for ONNX tensor: 840 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_365 [Unsqueeze] outputs: [840 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_366 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 838 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_366 [Unsqueeze] inputs: [838 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_366 for ONNX node: Unsqueeze_366 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 841 for ONNX tensor: 841 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_366 [Unsqueeze] outputs: [841 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_367 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 840 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 841 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3223 [06/20/2022-16:24:37] [V] [TRT] Concat_367 [Concat] inputs: [840 -> (1)[INT32]], [841 -> (1)[INT32]], [3223 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3223 for ONNX node: 3223 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_367 for ONNX node: Concat_367 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 843 for ONNX tensor: 843 [06/20/2022-16:24:37] [V] [TRT] Concat_367 [Concat] outputs: [843 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_368 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 832 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 843 [06/20/2022-16:24:37] [V] [TRT] Reshape_368 [Reshape] inputs: [832 -> (-1, -1, 16, 64)[FLOAT]], [843 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_368 for ONNX node: Reshape_368 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 844 for ONNX tensor: 844 [06/20/2022-16:24:37] [V] [TRT] Reshape_368 [Reshape] outputs: [844 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_369 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 844 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3224 [06/20/2022-16:24:37] [V] [TRT] MatMul_369 [MatMul] inputs: [844 -> (-1, -1, 1024)[FLOAT]], [3224 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3224 for ONNX node: 3224 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_369 for ONNX node: MatMul_369 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 846 for ONNX tensor: 846 [06/20/2022-16:24:37] [V] [TRT] MatMul_369 [MatMul] outputs: [846 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_370 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 846 [06/20/2022-16:24:37] [V] [TRT] Add_370 [Add] inputs: [bert.encoder.layer.3.attention.output.dense.bias -> (1024)[FLOAT]], [846 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.attention.output.dense.bias for ONNX node: bert.encoder.layer.3.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_370 for ONNX node: Add_370 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 847 for ONNX tensor: 847 [06/20/2022-16:24:37] [V] [TRT] Add_370 [Add] outputs: [847 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_371 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 847 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 771 [06/20/2022-16:24:37] [V] [TRT] Add_371 [Add] inputs: [847 -> (-1, -1, 1024)[FLOAT]], [771 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_371 for ONNX node: Add_371 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 848 for ONNX tensor: 848 [06/20/2022-16:24:37] [V] [TRT] Add_371 [Add] outputs: [848 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_372 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 848 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_372 [ReduceMean] inputs: [848 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_372 for ONNX node: ReduceMean_372 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 849 for ONNX tensor: 849 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_372 [ReduceMean] outputs: [849 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_373 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 848 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 849 [06/20/2022-16:24:37] [V] [TRT] Sub_373 [Sub] inputs: [848 -> (-1, -1, 1024)[FLOAT]], [849 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_373 for ONNX node: Sub_373 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 850 for ONNX tensor: 850 [06/20/2022-16:24:37] [V] [TRT] Sub_373 [Sub] outputs: [850 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_374 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_374 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_374 [Constant] outputs: [851 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_375 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 850 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 851 [06/20/2022-16:24:37] [V] [TRT] Pow_375 [Pow] inputs: [850 -> (-1, -1, 1024)[FLOAT]], [851 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 851 for ONNX node: 851 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_375 for ONNX node: Pow_375 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 852 for ONNX tensor: 852 [06/20/2022-16:24:37] [V] [TRT] Pow_375 [Pow] outputs: [852 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_376 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 852 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_376 [ReduceMean] inputs: [852 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_376 for ONNX node: ReduceMean_376 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 853 for ONNX tensor: 853 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_376 [ReduceMean] outputs: [853 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_377 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_377 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_377 [Constant] outputs: [854 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_378 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 853 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 854 [06/20/2022-16:24:37] [V] [TRT] Add_378 [Add] inputs: [853 -> (-1, -1, 1)[FLOAT]], [854 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 854 for ONNX node: 854 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_378 for ONNX node: Add_378 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 855 for ONNX tensor: 855 [06/20/2022-16:24:37] [V] [TRT] Add_378 [Add] outputs: [855 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_379 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 855 [06/20/2022-16:24:37] [V] [TRT] Sqrt_379 [Sqrt] inputs: [855 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_379 for ONNX node: Sqrt_379 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 856 for ONNX tensor: 856 [06/20/2022-16:24:37] [V] [TRT] Sqrt_379 [Sqrt] outputs: [856 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_380 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 850 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 856 [06/20/2022-16:24:37] [V] [TRT] Div_380 [Div] inputs: [850 -> (-1, -1, 1024)[FLOAT]], [856 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_380 for ONNX node: Div_380 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 857 for ONNX tensor: 857 [06/20/2022-16:24:37] [V] [TRT] Div_380 [Div] outputs: [857 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_381 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 857 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_381 [Mul] inputs: [857 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.3.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.3.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_381 for ONNX node: Mul_381 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 858 for ONNX tensor: 858 [06/20/2022-16:24:37] [V] [TRT] Mul_381 [Mul] outputs: [858 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_382 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 858 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_382 [Add] inputs: [858 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.3.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.3.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_382 for ONNX node: Add_382 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 859 for ONNX tensor: 859 [06/20/2022-16:24:37] [V] [TRT] Add_382 [Add] outputs: [859 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_383 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 859 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3225 [06/20/2022-16:24:37] [V] [TRT] MatMul_383 [MatMul] inputs: [859 -> (-1, -1, 1024)[FLOAT]], [3225 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3225 for ONNX node: 3225 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_383 for ONNX node: MatMul_383 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 861 for ONNX tensor: 861 [06/20/2022-16:24:37] [V] [TRT] MatMul_383 [MatMul] outputs: [861 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_384 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 861 [06/20/2022-16:24:37] [V] [TRT] Add_384 [Add] inputs: [bert.encoder.layer.3.intermediate.dense.bias -> (4096)[FLOAT]], [861 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.intermediate.dense.bias for ONNX node: bert.encoder.layer.3.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_384 for ONNX node: Add_384 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 862 for ONNX tensor: 862 [06/20/2022-16:24:37] [V] [TRT] Add_384 [Add] outputs: [862 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_385 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_385 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_385 [Constant] outputs: [863 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_386 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 862 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 863 [06/20/2022-16:24:37] [V] [TRT] Div_386 [Div] inputs: [862 -> (-1, -1, 4096)[FLOAT]], [863 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 863 for ONNX node: 863 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_386 for ONNX node: Div_386 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 864 for ONNX tensor: 864 [06/20/2022-16:24:37] [V] [TRT] Div_386 [Div] outputs: [864 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Erf_387 [Erf] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 864 [06/20/2022-16:24:37] [V] [TRT] Erf_387 [Erf] inputs: [864 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Erf_387 for ONNX node: Erf_387 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 865 for ONNX tensor: 865 [06/20/2022-16:24:37] [V] [TRT] Erf_387 [Erf] outputs: [865 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_388 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_388 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_388 [Constant] outputs: [866 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_389 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 865 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 866 [06/20/2022-16:24:37] [V] [TRT] Add_389 [Add] inputs: [865 -> (-1, -1, 4096)[FLOAT]], [866 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 866 for ONNX node: 866 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_389 for ONNX node: Add_389 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 867 for ONNX tensor: 867 [06/20/2022-16:24:37] [V] [TRT] Add_389 [Add] outputs: [867 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_390 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 862 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 867 [06/20/2022-16:24:37] [V] [TRT] Mul_390 [Mul] inputs: [862 -> (-1, -1, 4096)[FLOAT]], [867 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_390 for ONNX node: Mul_390 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 868 for ONNX tensor: 868 [06/20/2022-16:24:37] [V] [TRT] Mul_390 [Mul] outputs: [868 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_391 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_391 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_391 [Constant] outputs: [869 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_392 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 868 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 869 [06/20/2022-16:24:37] [V] [TRT] Mul_392 [Mul] inputs: [868 -> (-1, -1, 4096)[FLOAT]], [869 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 869 for ONNX node: 869 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_392 for ONNX node: Mul_392 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 870 for ONNX tensor: 870 [06/20/2022-16:24:37] [V] [TRT] Mul_392 [Mul] outputs: [870 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_393 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 870 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3226 [06/20/2022-16:24:37] [V] [TRT] MatMul_393 [MatMul] inputs: [870 -> (-1, -1, 4096)[FLOAT]], [3226 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3226 for ONNX node: 3226 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_393 for ONNX node: MatMul_393 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 872 for ONNX tensor: 872 [06/20/2022-16:24:37] [V] [TRT] MatMul_393 [MatMul] outputs: [872 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_394 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 872 [06/20/2022-16:24:37] [V] [TRT] Add_394 [Add] inputs: [bert.encoder.layer.3.output.dense.bias -> (1024)[FLOAT]], [872 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.output.dense.bias for ONNX node: bert.encoder.layer.3.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_394 for ONNX node: Add_394 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 873 for ONNX tensor: 873 [06/20/2022-16:24:37] [V] [TRT] Add_394 [Add] outputs: [873 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_395 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 873 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 859 [06/20/2022-16:24:37] [V] [TRT] Add_395 [Add] inputs: [873 -> (-1, -1, 1024)[FLOAT]], [859 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_395 for ONNX node: Add_395 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874 [06/20/2022-16:24:37] [V] [TRT] Add_395 [Add] outputs: [874 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_396 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 874 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_396 [ReduceMean] inputs: [874 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_396 for ONNX node: ReduceMean_396 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 875 for ONNX tensor: 875 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_396 [ReduceMean] outputs: [875 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_397 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 874 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 875 [06/20/2022-16:24:37] [V] [TRT] Sub_397 [Sub] inputs: [874 -> (-1, -1, 1024)[FLOAT]], [875 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_397 for ONNX node: Sub_397 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 876 for ONNX tensor: 876 [06/20/2022-16:24:37] [V] [TRT] Sub_397 [Sub] outputs: [876 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_398 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_398 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_398 [Constant] outputs: [877 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_399 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 876 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 877 [06/20/2022-16:24:37] [V] [TRT] Pow_399 [Pow] inputs: [876 -> (-1, -1, 1024)[FLOAT]], [877 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 877 for ONNX node: 877 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_399 for ONNX node: Pow_399 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 878 for ONNX tensor: 878 [06/20/2022-16:24:37] [V] [TRT] Pow_399 [Pow] outputs: [878 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_400 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 878 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_400 [ReduceMean] inputs: [878 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_400 for ONNX node: ReduceMean_400 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 879 for ONNX tensor: 879 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_400 [ReduceMean] outputs: [879 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_401 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_401 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_401 [Constant] outputs: [880 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_402 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 879 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 880 [06/20/2022-16:24:37] [V] [TRT] Add_402 [Add] inputs: [879 -> (-1, -1, 1)[FLOAT]], [880 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 880 for ONNX node: 880 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_402 for ONNX node: Add_402 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 881 for ONNX tensor: 881 [06/20/2022-16:24:37] [V] [TRT] Add_402 [Add] outputs: [881 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_403 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 881 [06/20/2022-16:24:37] [V] [TRT] Sqrt_403 [Sqrt] inputs: [881 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_403 for ONNX node: Sqrt_403 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 882 for ONNX tensor: 882 [06/20/2022-16:24:37] [V] [TRT] Sqrt_403 [Sqrt] outputs: [882 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_404 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 876 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 882 [06/20/2022-16:24:37] [V] [TRT] Div_404 [Div] inputs: [876 -> (-1, -1, 1024)[FLOAT]], [882 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_404 for ONNX node: Div_404 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883 [06/20/2022-16:24:37] [V] [TRT] Div_404 [Div] outputs: [883 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_405 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 883 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_405 [Mul] inputs: [883 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.3.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.output.LayerNorm.weight for ONNX node: bert.encoder.layer.3.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_405 for ONNX node: Mul_405 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 884 for ONNX tensor: 884 [06/20/2022-16:24:37] [V] [TRT] Mul_405 [Mul] outputs: [884 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_406 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 884 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.3.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_406 [Add] inputs: [884 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.3.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.3.output.LayerNorm.bias for ONNX node: bert.encoder.layer.3.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_406 for ONNX node: Add_406 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 885 for ONNX tensor: 885 [06/20/2022-16:24:37] [V] [TRT] Add_406 [Add] outputs: [885 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_407 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 885 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3227 [06/20/2022-16:24:37] [V] [TRT] MatMul_407 [MatMul] inputs: [885 -> (-1, -1, 1024)[FLOAT]], [3227 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3227 for ONNX node: 3227 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_407 for ONNX node: MatMul_407 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 887 for ONNX tensor: 887 [06/20/2022-16:24:37] [V] [TRT] MatMul_407 [MatMul] outputs: [887 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_408 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 887 [06/20/2022-16:24:37] [V] [TRT] Add_408 [Add] inputs: [bert.encoder.layer.4.attention.self.query.bias -> (1024)[FLOAT]], [887 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.attention.self.query.bias for ONNX node: bert.encoder.layer.4.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_408 for ONNX node: Add_408 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 888 for ONNX tensor: 888 [06/20/2022-16:24:37] [V] [TRT] Add_408 [Add] outputs: [888 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_409 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 885 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3228 [06/20/2022-16:24:37] [V] [TRT] MatMul_409 [MatMul] inputs: [885 -> (-1, -1, 1024)[FLOAT]], [3228 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3228 for ONNX node: 3228 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_409 for ONNX node: MatMul_409 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 890 for ONNX tensor: 890 [06/20/2022-16:24:37] [V] [TRT] MatMul_409 [MatMul] outputs: [890 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_410 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 890 [06/20/2022-16:24:37] [V] [TRT] Add_410 [Add] inputs: [bert.encoder.layer.4.attention.self.key.bias -> (1024)[FLOAT]], [890 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.attention.self.key.bias for ONNX node: bert.encoder.layer.4.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_410 for ONNX node: Add_410 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 891 for ONNX tensor: 891 [06/20/2022-16:24:37] [V] [TRT] Add_410 [Add] outputs: [891 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_411 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 891 [06/20/2022-16:24:37] [V] [TRT] Shape_411 [Shape] inputs: [891 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_411 for ONNX node: Shape_411 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 892 for ONNX tensor: 892 [06/20/2022-16:24:37] [V] [TRT] Shape_411 [Shape] outputs: [892 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_412 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_412 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_412 [Constant] outputs: [893 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_413 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 892 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 893 [06/20/2022-16:24:37] [V] [TRT] Gather_413 [Gather] inputs: [892 -> (3)[INT32]], [893 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 893 for ONNX node: 893 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_413 for ONNX node: Gather_413 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 894 for ONNX tensor: 894 [06/20/2022-16:24:37] [V] [TRT] Gather_413 [Gather] outputs: [894 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_414 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 891 [06/20/2022-16:24:37] [V] [TRT] Shape_414 [Shape] inputs: [891 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_414 for ONNX node: Shape_414 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 895 for ONNX tensor: 895 [06/20/2022-16:24:37] [V] [TRT] Shape_414 [Shape] outputs: [895 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_415 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_415 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_415 [Constant] outputs: [896 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_416 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 895 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 896 [06/20/2022-16:24:37] [V] [TRT] Gather_416 [Gather] inputs: [895 -> (3)[INT32]], [896 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 896 for ONNX node: 896 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_416 for ONNX node: Gather_416 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 897 for ONNX tensor: 897 [06/20/2022-16:24:37] [V] [TRT] Gather_416 [Gather] outputs: [897 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_417 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 894 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_417 [Unsqueeze] inputs: [894 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_417 for ONNX node: Unsqueeze_417 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 900 for ONNX tensor: 900 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_417 [Unsqueeze] outputs: [900 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_418 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 897 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_418 [Unsqueeze] inputs: [897 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_418 for ONNX node: Unsqueeze_418 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 901 for ONNX tensor: 901 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_418 [Unsqueeze] outputs: [901 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_419 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 900 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 901 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3229 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3230 [06/20/2022-16:24:37] [V] [TRT] Concat_419 [Concat] inputs: [900 -> (1)[INT32]], [901 -> (1)[INT32]], [3229 -> (1)[INT32]], [3230 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3229 for ONNX node: 3229 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3230 for ONNX node: 3230 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_419 for ONNX node: Concat_419 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 904 for ONNX tensor: 904 [06/20/2022-16:24:37] [V] [TRT] Concat_419 [Concat] outputs: [904 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_420 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 891 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 904 [06/20/2022-16:24:37] [V] [TRT] Reshape_420 [Reshape] inputs: [891 -> (-1, -1, 1024)[FLOAT]], [904 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_420 for ONNX node: Reshape_420 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 905 for ONNX tensor: 905 [06/20/2022-16:24:37] [V] [TRT] Reshape_420 [Reshape] outputs: [905 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_421 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 885 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3231 [06/20/2022-16:24:37] [V] [TRT] MatMul_421 [MatMul] inputs: [885 -> (-1, -1, 1024)[FLOAT]], [3231 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3231 for ONNX node: 3231 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_421 for ONNX node: MatMul_421 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907 [06/20/2022-16:24:37] [V] [TRT] MatMul_421 [MatMul] outputs: [907 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_422 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 907 [06/20/2022-16:24:37] [V] [TRT] Add_422 [Add] inputs: [bert.encoder.layer.4.attention.self.value.bias -> (1024)[FLOAT]], [907 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.attention.self.value.bias for ONNX node: bert.encoder.layer.4.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_422 for ONNX node: Add_422 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 908 for ONNX tensor: 908 [06/20/2022-16:24:37] [V] [TRT] Add_422 [Add] outputs: [908 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_423 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 908 [06/20/2022-16:24:37] [V] [TRT] Shape_423 [Shape] inputs: [908 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_423 for ONNX node: Shape_423 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 909 for ONNX tensor: 909 [06/20/2022-16:24:37] [V] [TRT] Shape_423 [Shape] outputs: [909 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_424 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_424 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_424 [Constant] outputs: [910 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_425 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 909 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 910 [06/20/2022-16:24:37] [V] [TRT] Gather_425 [Gather] inputs: [909 -> (3)[INT32]], [910 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 910 for ONNX node: 910 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_425 for ONNX node: Gather_425 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 911 for ONNX tensor: 911 [06/20/2022-16:24:37] [V] [TRT] Gather_425 [Gather] outputs: [911 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_426 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 908 [06/20/2022-16:24:37] [V] [TRT] Shape_426 [Shape] inputs: [908 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_426 for ONNX node: Shape_426 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 912 for ONNX tensor: 912 [06/20/2022-16:24:37] [V] [TRT] Shape_426 [Shape] outputs: [912 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_427 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_427 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_427 [Constant] outputs: [913 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_428 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 912 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 913 [06/20/2022-16:24:37] [V] [TRT] Gather_428 [Gather] inputs: [912 -> (3)[INT32]], [913 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 913 for ONNX node: 913 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_428 for ONNX node: Gather_428 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 914 for ONNX tensor: 914 [06/20/2022-16:24:37] [V] [TRT] Gather_428 [Gather] outputs: [914 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_429 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 911 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_429 [Unsqueeze] inputs: [911 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_429 for ONNX node: Unsqueeze_429 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 917 for ONNX tensor: 917 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_429 [Unsqueeze] outputs: [917 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_430 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 914 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_430 [Unsqueeze] inputs: [914 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_430 for ONNX node: Unsqueeze_430 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 918 for ONNX tensor: 918 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_430 [Unsqueeze] outputs: [918 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_431 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 917 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 918 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3232 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3233 [06/20/2022-16:24:37] [V] [TRT] Concat_431 [Concat] inputs: [917 -> (1)[INT32]], [918 -> (1)[INT32]], [3232 -> (1)[INT32]], [3233 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3232 for ONNX node: 3232 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3233 for ONNX node: 3233 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_431 for ONNX node: Concat_431 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 921 for ONNX tensor: 921 [06/20/2022-16:24:37] [V] [TRT] Concat_431 [Concat] outputs: [921 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_432 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 908 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 921 [06/20/2022-16:24:37] [V] [TRT] Reshape_432 [Reshape] inputs: [908 -> (-1, -1, 1024)[FLOAT]], [921 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_432 for ONNX node: Reshape_432 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 922 for ONNX tensor: 922 [06/20/2022-16:24:37] [V] [TRT] Reshape_432 [Reshape] outputs: [922 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_433 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 922 [06/20/2022-16:24:37] [V] [TRT] Transpose_433 [Transpose] inputs: [922 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_433 for ONNX node: Transpose_433 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 923 for ONNX tensor: 923 [06/20/2022-16:24:37] [V] [TRT] Transpose_433 [Transpose] outputs: [923 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_434 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 888 [06/20/2022-16:24:37] [V] [TRT] Shape_434 [Shape] inputs: [888 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_434 for ONNX node: Shape_434 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 924 for ONNX tensor: 924 [06/20/2022-16:24:37] [V] [TRT] Shape_434 [Shape] outputs: [924 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_435 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_435 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_435 [Constant] outputs: [925 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_436 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 924 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 925 [06/20/2022-16:24:37] [V] [TRT] Gather_436 [Gather] inputs: [924 -> (3)[INT32]], [925 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 925 for ONNX node: 925 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_436 for ONNX node: Gather_436 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 926 for ONNX tensor: 926 [06/20/2022-16:24:37] [V] [TRT] Gather_436 [Gather] outputs: [926 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_437 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 888 [06/20/2022-16:24:37] [V] [TRT] Shape_437 [Shape] inputs: [888 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_437 for ONNX node: Shape_437 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927 [06/20/2022-16:24:37] [V] [TRT] Shape_437 [Shape] outputs: [927 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_438 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_438 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_438 [Constant] outputs: [928 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_439 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 927 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 928 [06/20/2022-16:24:37] [V] [TRT] Gather_439 [Gather] inputs: [927 -> (3)[INT32]], [928 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 928 for ONNX node: 928 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_439 for ONNX node: Gather_439 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 929 for ONNX tensor: 929 [06/20/2022-16:24:37] [V] [TRT] Gather_439 [Gather] outputs: [929 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_440 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 926 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_440 [Unsqueeze] inputs: [926 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_440 for ONNX node: Unsqueeze_440 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 932 for ONNX tensor: 932 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_440 [Unsqueeze] outputs: [932 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_441 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 929 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_441 [Unsqueeze] inputs: [929 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_441 for ONNX node: Unsqueeze_441 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 933 for ONNX tensor: 933 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_441 [Unsqueeze] outputs: [933 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_442 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 932 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 933 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3234 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3235 [06/20/2022-16:24:37] [V] [TRT] Concat_442 [Concat] inputs: [932 -> (1)[INT32]], [933 -> (1)[INT32]], [3234 -> (1)[INT32]], [3235 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3234 for ONNX node: 3234 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3235 for ONNX node: 3235 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_442 for ONNX node: Concat_442 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 936 for ONNX tensor: 936 [06/20/2022-16:24:37] [V] [TRT] Concat_442 [Concat] outputs: [936 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_443 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 888 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 936 [06/20/2022-16:24:37] [V] [TRT] Reshape_443 [Reshape] inputs: [888 -> (-1, -1, 1024)[FLOAT]], [936 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_443 for ONNX node: Reshape_443 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 937 for ONNX tensor: 937 [06/20/2022-16:24:37] [V] [TRT] Reshape_443 [Reshape] outputs: [937 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_444 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 937 [06/20/2022-16:24:37] [V] [TRT] Transpose_444 [Transpose] inputs: [937 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_444 for ONNX node: Transpose_444 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 938 for ONNX tensor: 938 [06/20/2022-16:24:37] [V] [TRT] Transpose_444 [Transpose] outputs: [938 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_445 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 905 [06/20/2022-16:24:37] [V] [TRT] Transpose_445 [Transpose] inputs: [905 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_445 for ONNX node: Transpose_445 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 939 for ONNX tensor: 939 [06/20/2022-16:24:37] [V] [TRT] Transpose_445 [Transpose] outputs: [939 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_446 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 938 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 939 [06/20/2022-16:24:37] [V] [TRT] MatMul_446 [MatMul] inputs: [938 -> (-1, 16, -1, 64)[FLOAT]], [939 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_446 for ONNX node: MatMul_446 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 940 for ONNX tensor: 940 [06/20/2022-16:24:37] [V] [TRT] MatMul_446 [MatMul] outputs: [940 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_447 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_447 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_447 [Constant] outputs: [941 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_448 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 940 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 941 [06/20/2022-16:24:37] [V] [TRT] Div_448 [Div] inputs: [940 -> (-1, 16, -1, -1)[FLOAT]], [941 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 941 for ONNX node: 941 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_448 for ONNX node: Div_448 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 942 for ONNX tensor: 942 [06/20/2022-16:24:37] [V] [TRT] Div_448 [Div] outputs: [942 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_449 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 942 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:37] [V] [TRT] Add_449 [Add] inputs: [942 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_449 for ONNX node: Add_449 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 943 for ONNX tensor: 943 [06/20/2022-16:24:37] [V] [TRT] Add_449 [Add] outputs: [943 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Softmax_450 [Softmax] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 943 [06/20/2022-16:24:37] [V] [TRT] Softmax_450 [Softmax] inputs: [943 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Softmax_450 for ONNX node: Softmax_450 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 944 for ONNX tensor: 944 [06/20/2022-16:24:37] [V] [TRT] Softmax_450 [Softmax] outputs: [944 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_451 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 944 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 923 [06/20/2022-16:24:37] [V] [TRT] MatMul_451 [MatMul] inputs: [944 -> (-1, 16, -1, -1)[FLOAT]], [923 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_451 for ONNX node: MatMul_451 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 945 for ONNX tensor: 945 [06/20/2022-16:24:37] [V] [TRT] MatMul_451 [MatMul] outputs: [945 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_452 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 945 [06/20/2022-16:24:37] [V] [TRT] Transpose_452 [Transpose] inputs: [945 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_452 for ONNX node: Transpose_452 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 946 for ONNX tensor: 946 [06/20/2022-16:24:37] [V] [TRT] Transpose_452 [Transpose] outputs: [946 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_453 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 946 [06/20/2022-16:24:37] [V] [TRT] Shape_453 [Shape] inputs: [946 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_453 for ONNX node: Shape_453 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 947 for ONNX tensor: 947 [06/20/2022-16:24:37] [V] [TRT] Shape_453 [Shape] outputs: [947 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_454 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_454 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_454 [Constant] outputs: [948 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_455 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 947 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 948 [06/20/2022-16:24:37] [V] [TRT] Gather_455 [Gather] inputs: [947 -> (4)[INT32]], [948 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 948 for ONNX node: 948 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_455 for ONNX node: Gather_455 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 949 for ONNX tensor: 949 [06/20/2022-16:24:37] [V] [TRT] Gather_455 [Gather] outputs: [949 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_456 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 946 [06/20/2022-16:24:37] [V] [TRT] Shape_456 [Shape] inputs: [946 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_456 for ONNX node: Shape_456 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 950 for ONNX tensor: 950 [06/20/2022-16:24:37] [V] [TRT] Shape_456 [Shape] outputs: [950 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_457 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_457 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_457 [Constant] outputs: [951 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_458 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 950 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 951 [06/20/2022-16:24:37] [V] [TRT] Gather_458 [Gather] inputs: [950 -> (4)[INT32]], [951 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 951 for ONNX node: 951 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_458 for ONNX node: Gather_458 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 952 for ONNX tensor: 952 [06/20/2022-16:24:37] [V] [TRT] Gather_458 [Gather] outputs: [952 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_459 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 949 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_459 [Unsqueeze] inputs: [949 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_459 for ONNX node: Unsqueeze_459 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 954 for ONNX tensor: 954 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_459 [Unsqueeze] outputs: [954 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_460 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 952 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_460 [Unsqueeze] inputs: [952 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_460 for ONNX node: Unsqueeze_460 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 955 for ONNX tensor: 955 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_460 [Unsqueeze] outputs: [955 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_461 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 954 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 955 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3236 [06/20/2022-16:24:37] [V] [TRT] Concat_461 [Concat] inputs: [954 -> (1)[INT32]], [955 -> (1)[INT32]], [3236 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3236 for ONNX node: 3236 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_461 for ONNX node: Concat_461 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 957 for ONNX tensor: 957 [06/20/2022-16:24:37] [V] [TRT] Concat_461 [Concat] outputs: [957 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_462 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 946 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 957 [06/20/2022-16:24:37] [V] [TRT] Reshape_462 [Reshape] inputs: [946 -> (-1, -1, 16, 64)[FLOAT]], [957 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_462 for ONNX node: Reshape_462 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 958 for ONNX tensor: 958 [06/20/2022-16:24:37] [V] [TRT] Reshape_462 [Reshape] outputs: [958 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_463 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 958 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3237 [06/20/2022-16:24:37] [V] [TRT] MatMul_463 [MatMul] inputs: [958 -> (-1, -1, 1024)[FLOAT]], [3237 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3237 for ONNX node: 3237 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_463 for ONNX node: MatMul_463 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 960 for ONNX tensor: 960 [06/20/2022-16:24:37] [V] [TRT] MatMul_463 [MatMul] outputs: [960 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_464 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 960 [06/20/2022-16:24:37] [V] [TRT] Add_464 [Add] inputs: [bert.encoder.layer.4.attention.output.dense.bias -> (1024)[FLOAT]], [960 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.attention.output.dense.bias for ONNX node: bert.encoder.layer.4.attention.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_464 for ONNX node: Add_464 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 961 for ONNX tensor: 961 [06/20/2022-16:24:37] [V] [TRT] Add_464 [Add] outputs: [961 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_465 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 961 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 885 [06/20/2022-16:24:37] [V] [TRT] Add_465 [Add] inputs: [961 -> (-1, -1, 1024)[FLOAT]], [885 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_465 for ONNX node: Add_465 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 962 for ONNX tensor: 962 [06/20/2022-16:24:37] [V] [TRT] Add_465 [Add] outputs: [962 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_466 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 962 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_466 [ReduceMean] inputs: [962 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_466 for ONNX node: ReduceMean_466 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 963 for ONNX tensor: 963 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_466 [ReduceMean] outputs: [963 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_467 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 962 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 963 [06/20/2022-16:24:37] [V] [TRT] Sub_467 [Sub] inputs: [962 -> (-1, -1, 1024)[FLOAT]], [963 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_467 for ONNX node: Sub_467 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 964 for ONNX tensor: 964 [06/20/2022-16:24:37] [V] [TRT] Sub_467 [Sub] outputs: [964 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_468 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_468 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_468 [Constant] outputs: [965 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_469 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 964 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 965 [06/20/2022-16:24:37] [V] [TRT] Pow_469 [Pow] inputs: [964 -> (-1, -1, 1024)[FLOAT]], [965 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 965 for ONNX node: 965 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_469 for ONNX node: Pow_469 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 966 for ONNX tensor: 966 [06/20/2022-16:24:37] [V] [TRT] Pow_469 [Pow] outputs: [966 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_470 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 966 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_470 [ReduceMean] inputs: [966 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_470 for ONNX node: ReduceMean_470 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 967 for ONNX tensor: 967 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_470 [ReduceMean] outputs: [967 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_471 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_471 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_471 [Constant] outputs: [968 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_472 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 967 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 968 [06/20/2022-16:24:37] [V] [TRT] Add_472 [Add] inputs: [967 -> (-1, -1, 1)[FLOAT]], [968 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 968 for ONNX node: 968 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_472 for ONNX node: Add_472 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 969 for ONNX tensor: 969 [06/20/2022-16:24:37] [V] [TRT] Add_472 [Add] outputs: [969 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_473 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 969 [06/20/2022-16:24:37] [V] [TRT] Sqrt_473 [Sqrt] inputs: [969 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_473 for ONNX node: Sqrt_473 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 970 for ONNX tensor: 970 [06/20/2022-16:24:37] [V] [TRT] Sqrt_473 [Sqrt] outputs: [970 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_474 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 964 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 970 [06/20/2022-16:24:37] [V] [TRT] Div_474 [Div] inputs: [964 -> (-1, -1, 1024)[FLOAT]], [970 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_474 for ONNX node: Div_474 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 971 for ONNX tensor: 971 [06/20/2022-16:24:37] [V] [TRT] Div_474 [Div] outputs: [971 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_475 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 971 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_475 [Mul] inputs: [971 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.4.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.4.attention.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_475 for ONNX node: Mul_475 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 972 for ONNX tensor: 972 [06/20/2022-16:24:37] [V] [TRT] Mul_475 [Mul] outputs: [972 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_476 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 972 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_476 [Add] inputs: [972 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.4.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.4.attention.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_476 for ONNX node: Add_476 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 973 for ONNX tensor: 973 [06/20/2022-16:24:37] [V] [TRT] Add_476 [Add] outputs: [973 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_477 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 973 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3238 [06/20/2022-16:24:37] [V] [TRT] MatMul_477 [MatMul] inputs: [973 -> (-1, -1, 1024)[FLOAT]], [3238 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3238 for ONNX node: 3238 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_477 for ONNX node: MatMul_477 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 975 for ONNX tensor: 975 [06/20/2022-16:24:37] [V] [TRT] MatMul_477 [MatMul] outputs: [975 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_478 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 975 [06/20/2022-16:24:37] [V] [TRT] Add_478 [Add] inputs: [bert.encoder.layer.4.intermediate.dense.bias -> (4096)[FLOAT]], [975 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.intermediate.dense.bias for ONNX node: bert.encoder.layer.4.intermediate.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_478 for ONNX node: Add_478 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 976 for ONNX tensor: 976 [06/20/2022-16:24:37] [V] [TRT] Add_478 [Add] outputs: [976 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_479 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_479 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_479 [Constant] outputs: [977 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_480 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 976 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 977 [06/20/2022-16:24:37] [V] [TRT] Div_480 [Div] inputs: [976 -> (-1, -1, 4096)[FLOAT]], [977 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 977 for ONNX node: 977 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_480 for ONNX node: Div_480 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 978 for ONNX tensor: 978 [06/20/2022-16:24:37] [V] [TRT] Div_480 [Div] outputs: [978 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Erf_481 [Erf] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 978 [06/20/2022-16:24:37] [V] [TRT] Erf_481 [Erf] inputs: [978 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Erf_481 for ONNX node: Erf_481 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 979 for ONNX tensor: 979 [06/20/2022-16:24:37] [V] [TRT] Erf_481 [Erf] outputs: [979 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_482 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_482 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_482 [Constant] outputs: [980 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_483 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 979 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 980 [06/20/2022-16:24:37] [V] [TRT] Add_483 [Add] inputs: [979 -> (-1, -1, 4096)[FLOAT]], [980 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 980 for ONNX node: 980 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_483 for ONNX node: Add_483 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 981 for ONNX tensor: 981 [06/20/2022-16:24:37] [V] [TRT] Add_483 [Add] outputs: [981 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_484 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 976 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 981 [06/20/2022-16:24:37] [V] [TRT] Mul_484 [Mul] inputs: [976 -> (-1, -1, 4096)[FLOAT]], [981 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_484 for ONNX node: Mul_484 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 982 for ONNX tensor: 982 [06/20/2022-16:24:37] [V] [TRT] Mul_484 [Mul] outputs: [982 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_485 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_485 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_485 [Constant] outputs: [983 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_486 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 982 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 983 [06/20/2022-16:24:37] [V] [TRT] Mul_486 [Mul] inputs: [982 -> (-1, -1, 4096)[FLOAT]], [983 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 983 for ONNX node: 983 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_486 for ONNX node: Mul_486 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 984 for ONNX tensor: 984 [06/20/2022-16:24:37] [V] [TRT] Mul_486 [Mul] outputs: [984 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_487 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 984 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3239 [06/20/2022-16:24:37] [V] [TRT] MatMul_487 [MatMul] inputs: [984 -> (-1, -1, 4096)[FLOAT]], [3239 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3239 for ONNX node: 3239 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_487 for ONNX node: MatMul_487 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 986 for ONNX tensor: 986 [06/20/2022-16:24:37] [V] [TRT] MatMul_487 [MatMul] outputs: [986 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_488 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 986 [06/20/2022-16:24:37] [V] [TRT] Add_488 [Add] inputs: [bert.encoder.layer.4.output.dense.bias -> (1024)[FLOAT]], [986 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.output.dense.bias for ONNX node: bert.encoder.layer.4.output.dense.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_488 for ONNX node: Add_488 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 987 for ONNX tensor: 987 [06/20/2022-16:24:37] [V] [TRT] Add_488 [Add] outputs: [987 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_489 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 987 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 973 [06/20/2022-16:24:37] [V] [TRT] Add_489 [Add] inputs: [987 -> (-1, -1, 1024)[FLOAT]], [973 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_489 for ONNX node: Add_489 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 988 for ONNX tensor: 988 [06/20/2022-16:24:37] [V] [TRT] Add_489 [Add] outputs: [988 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_490 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 988 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_490 [ReduceMean] inputs: [988 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_490 for ONNX node: ReduceMean_490 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 989 for ONNX tensor: 989 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_490 [ReduceMean] outputs: [989 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sub_491 [Sub] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 988 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 989 [06/20/2022-16:24:37] [V] [TRT] Sub_491 [Sub] inputs: [988 -> (-1, -1, 1024)[FLOAT]], [989 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sub_491 for ONNX node: Sub_491 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 990 for ONNX tensor: 990 [06/20/2022-16:24:37] [V] [TRT] Sub_491 [Sub] outputs: [990 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_492 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_492 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_492 [Constant] outputs: [991 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Pow_493 [Pow] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 990 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 991 [06/20/2022-16:24:37] [V] [TRT] Pow_493 [Pow] inputs: [990 -> (-1, -1, 1024)[FLOAT]], [991 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 991 for ONNX node: 991 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Pow_493 for ONNX node: Pow_493 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 992 for ONNX tensor: 992 [06/20/2022-16:24:37] [V] [TRT] Pow_493 [Pow] outputs: [992 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: ReduceMean_494 [ReduceMean] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 992 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_494 [ReduceMean] inputs: [992 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: ReduceMean_494 for ONNX node: ReduceMean_494 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 993 for ONNX tensor: 993 [06/20/2022-16:24:37] [V] [TRT] ReduceMean_494 [ReduceMean] outputs: [993 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_495 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_495 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_495 [Constant] outputs: [994 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_496 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 993 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 994 [06/20/2022-16:24:37] [V] [TRT] Add_496 [Add] inputs: [993 -> (-1, -1, 1)[FLOAT]], [994 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 994 for ONNX node: 994 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_496 for ONNX node: Add_496 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 995 for ONNX tensor: 995 [06/20/2022-16:24:37] [V] [TRT] Add_496 [Add] outputs: [995 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Sqrt_497 [Sqrt] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 995 [06/20/2022-16:24:37] [V] [TRT] Sqrt_497 [Sqrt] inputs: [995 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Sqrt_497 for ONNX node: Sqrt_497 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 996 for ONNX tensor: 996 [06/20/2022-16:24:37] [V] [TRT] Sqrt_497 [Sqrt] outputs: [996 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_498 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 990 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 996 [06/20/2022-16:24:37] [V] [TRT] Div_498 [Div] inputs: [990 -> (-1, -1, 1024)[FLOAT]], [996 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_498 for ONNX node: Div_498 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 997 for ONNX tensor: 997 [06/20/2022-16:24:37] [V] [TRT] Div_498 [Div] outputs: [997 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Mul_499 [Mul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 997 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Mul_499 [Mul] inputs: [997 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.4.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.output.LayerNorm.weight for ONNX node: bert.encoder.layer.4.output.LayerNorm.weight [06/20/2022-16:24:37] [V] [TRT] Registering layer: Mul_499 for ONNX node: Mul_499 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 998 for ONNX tensor: 998 [06/20/2022-16:24:37] [V] [TRT] Mul_499 [Mul] outputs: [998 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_500 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 998 [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.4.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Add_500 [Add] inputs: [998 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.4.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.4.output.LayerNorm.bias for ONNX node: bert.encoder.layer.4.output.LayerNorm.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_500 for ONNX node: Add_500 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 999 for ONNX tensor: 999 [06/20/2022-16:24:37] [V] [TRT] Add_500 [Add] outputs: [999 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_501 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 999 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3240 [06/20/2022-16:24:37] [V] [TRT] MatMul_501 [MatMul] inputs: [999 -> (-1, -1, 1024)[FLOAT]], [3240 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3240 for ONNX node: 3240 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_501 for ONNX node: MatMul_501 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1001 for ONNX tensor: 1001 [06/20/2022-16:24:37] [V] [TRT] MatMul_501 [MatMul] outputs: [1001 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_502 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.5.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1001 [06/20/2022-16:24:37] [V] [TRT] Add_502 [Add] inputs: [bert.encoder.layer.5.attention.self.query.bias -> (1024)[FLOAT]], [1001 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.5.attention.self.query.bias for ONNX node: bert.encoder.layer.5.attention.self.query.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_502 for ONNX node: Add_502 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1002 for ONNX tensor: 1002 [06/20/2022-16:24:37] [V] [TRT] Add_502 [Add] outputs: [1002 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_503 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 999 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3241 [06/20/2022-16:24:37] [V] [TRT] MatMul_503 [MatMul] inputs: [999 -> (-1, -1, 1024)[FLOAT]], [3241 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3241 for ONNX node: 3241 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_503 for ONNX node: MatMul_503 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1004 for ONNX tensor: 1004 [06/20/2022-16:24:37] [V] [TRT] MatMul_503 [MatMul] outputs: [1004 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_504 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.5.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1004 [06/20/2022-16:24:37] [V] [TRT] Add_504 [Add] inputs: [bert.encoder.layer.5.attention.self.key.bias -> (1024)[FLOAT]], [1004 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.5.attention.self.key.bias for ONNX node: bert.encoder.layer.5.attention.self.key.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_504 for ONNX node: Add_504 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1005 for ONNX tensor: 1005 [06/20/2022-16:24:37] [V] [TRT] Add_504 [Add] outputs: [1005 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_505 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1005 [06/20/2022-16:24:37] [V] [TRT] Shape_505 [Shape] inputs: [1005 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_505 for ONNX node: Shape_505 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1006 for ONNX tensor: 1006 [06/20/2022-16:24:37] [V] [TRT] Shape_505 [Shape] outputs: [1006 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_506 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_506 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_506 [Constant] outputs: [1007 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_507 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1006 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1007 [06/20/2022-16:24:37] [V] [TRT] Gather_507 [Gather] inputs: [1006 -> (3)[INT32]], [1007 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1007 for ONNX node: 1007 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_507 for ONNX node: Gather_507 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1008 for ONNX tensor: 1008 [06/20/2022-16:24:37] [V] [TRT] Gather_507 [Gather] outputs: [1008 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_508 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1005 [06/20/2022-16:24:37] [V] [TRT] Shape_508 [Shape] inputs: [1005 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_508 for ONNX node: Shape_508 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1009 for ONNX tensor: 1009 [06/20/2022-16:24:37] [V] [TRT] Shape_508 [Shape] outputs: [1009 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_509 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_509 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_509 [Constant] outputs: [1010 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_510 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1009 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1010 [06/20/2022-16:24:37] [V] [TRT] Gather_510 [Gather] inputs: [1009 -> (3)[INT32]], [1010 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1010 for ONNX node: 1010 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_510 for ONNX node: Gather_510 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1011 for ONNX tensor: 1011 [06/20/2022-16:24:37] [V] [TRT] Gather_510 [Gather] outputs: [1011 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_511 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1008 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_511 [Unsqueeze] inputs: [1008 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_511 for ONNX node: Unsqueeze_511 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1014 for ONNX tensor: 1014 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_511 [Unsqueeze] outputs: [1014 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_512 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1011 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_512 [Unsqueeze] inputs: [1011 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_512 for ONNX node: Unsqueeze_512 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1015 for ONNX tensor: 1015 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_512 [Unsqueeze] outputs: [1015 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_513 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1014 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1015 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3242 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3243 [06/20/2022-16:24:37] [V] [TRT] Concat_513 [Concat] inputs: [1014 -> (1)[INT32]], [1015 -> (1)[INT32]], [3242 -> (1)[INT32]], [3243 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3242 for ONNX node: 3242 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3243 for ONNX node: 3243 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_513 for ONNX node: Concat_513 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1018 for ONNX tensor: 1018 [06/20/2022-16:24:37] [V] [TRT] Concat_513 [Concat] outputs: [1018 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_514 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1005 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1018 [06/20/2022-16:24:37] [V] [TRT] Reshape_514 [Reshape] inputs: [1005 -> (-1, -1, 1024)[FLOAT]], [1018 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_514 for ONNX node: Reshape_514 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1019 for ONNX tensor: 1019 [06/20/2022-16:24:37] [V] [TRT] Reshape_514 [Reshape] outputs: [1019 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_515 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 999 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3244 [06/20/2022-16:24:37] [V] [TRT] MatMul_515 [MatMul] inputs: [999 -> (-1, -1, 1024)[FLOAT]], [3244 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3244 for ONNX node: 3244 [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_515 for ONNX node: MatMul_515 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1021 for ONNX tensor: 1021 [06/20/2022-16:24:37] [V] [TRT] MatMul_515 [MatMul] outputs: [1021 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_516 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: bert.encoder.layer.5.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1021 [06/20/2022-16:24:37] [V] [TRT] Add_516 [Add] inputs: [bert.encoder.layer.5.attention.self.value.bias -> (1024)[FLOAT]], [1021 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: bert.encoder.layer.5.attention.self.value.bias for ONNX node: bert.encoder.layer.5.attention.self.value.bias [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_516 for ONNX node: Add_516 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1022 for ONNX tensor: 1022 [06/20/2022-16:24:37] [V] [TRT] Add_516 [Add] outputs: [1022 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_517 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1022 [06/20/2022-16:24:37] [V] [TRT] Shape_517 [Shape] inputs: [1022 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_517 for ONNX node: Shape_517 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1023 for ONNX tensor: 1023 [06/20/2022-16:24:37] [V] [TRT] Shape_517 [Shape] outputs: [1023 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_518 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_518 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_518 [Constant] outputs: [1024 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_519 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1023 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1024 [06/20/2022-16:24:37] [V] [TRT] Gather_519 [Gather] inputs: [1023 -> (3)[INT32]], [1024 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1024 for ONNX node: 1024 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_519 for ONNX node: Gather_519 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1025 for ONNX tensor: 1025 [06/20/2022-16:24:37] [V] [TRT] Gather_519 [Gather] outputs: [1025 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_520 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1022 [06/20/2022-16:24:37] [V] [TRT] Shape_520 [Shape] inputs: [1022 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_520 for ONNX node: Shape_520 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1026 for ONNX tensor: 1026 [06/20/2022-16:24:37] [V] [TRT] Shape_520 [Shape] outputs: [1026 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_521 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_521 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_521 [Constant] outputs: [1027 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_522 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1026 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1027 [06/20/2022-16:24:37] [V] [TRT] Gather_522 [Gather] inputs: [1026 -> (3)[INT32]], [1027 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1027 for ONNX node: 1027 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_522 for ONNX node: Gather_522 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1028 for ONNX tensor: 1028 [06/20/2022-16:24:37] [V] [TRT] Gather_522 [Gather] outputs: [1028 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_523 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1025 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_523 [Unsqueeze] inputs: [1025 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_523 for ONNX node: Unsqueeze_523 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1031 for ONNX tensor: 1031 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_523 [Unsqueeze] outputs: [1031 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_524 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1028 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_524 [Unsqueeze] inputs: [1028 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_524 for ONNX node: Unsqueeze_524 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1032 for ONNX tensor: 1032 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_524 [Unsqueeze] outputs: [1032 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_525 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1031 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1032 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3245 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3246 [06/20/2022-16:24:37] [V] [TRT] Concat_525 [Concat] inputs: [1031 -> (1)[INT32]], [1032 -> (1)[INT32]], [3245 -> (1)[INT32]], [3246 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3245 for ONNX node: 3245 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3246 for ONNX node: 3246 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_525 for ONNX node: Concat_525 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1035 for ONNX tensor: 1035 [06/20/2022-16:24:37] [V] [TRT] Concat_525 [Concat] outputs: [1035 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_526 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1022 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1035 [06/20/2022-16:24:37] [V] [TRT] Reshape_526 [Reshape] inputs: [1022 -> (-1, -1, 1024)[FLOAT]], [1035 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_526 for ONNX node: Reshape_526 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1036 for ONNX tensor: 1036 [06/20/2022-16:24:37] [V] [TRT] Reshape_526 [Reshape] outputs: [1036 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_527 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1036 [06/20/2022-16:24:37] [V] [TRT] Transpose_527 [Transpose] inputs: [1036 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_527 for ONNX node: Transpose_527 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1037 for ONNX tensor: 1037 [06/20/2022-16:24:37] [V] [TRT] Transpose_527 [Transpose] outputs: [1037 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_528 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1002 [06/20/2022-16:24:37] [V] [TRT] Shape_528 [Shape] inputs: [1002 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_528 for ONNX node: Shape_528 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1038 for ONNX tensor: 1038 [06/20/2022-16:24:37] [V] [TRT] Shape_528 [Shape] outputs: [1038 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_529 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_529 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_529 [Constant] outputs: [1039 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_530 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1038 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1039 [06/20/2022-16:24:37] [V] [TRT] Gather_530 [Gather] inputs: [1038 -> (3)[INT32]], [1039 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1039 for ONNX node: 1039 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_530 for ONNX node: Gather_530 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1040 for ONNX tensor: 1040 [06/20/2022-16:24:37] [V] [TRT] Gather_530 [Gather] outputs: [1040 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_531 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1002 [06/20/2022-16:24:37] [V] [TRT] Shape_531 [Shape] inputs: [1002 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_531 for ONNX node: Shape_531 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1041 for ONNX tensor: 1041 [06/20/2022-16:24:37] [V] [TRT] Shape_531 [Shape] outputs: [1041 -> (3)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_532 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_532 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_532 [Constant] outputs: [1042 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_533 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1041 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1042 [06/20/2022-16:24:37] [V] [TRT] Gather_533 [Gather] inputs: [1041 -> (3)[INT32]], [1042 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1042 for ONNX node: 1042 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_533 for ONNX node: Gather_533 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1043 for ONNX tensor: 1043 [06/20/2022-16:24:37] [V] [TRT] Gather_533 [Gather] outputs: [1043 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_534 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1040 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_534 [Unsqueeze] inputs: [1040 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_534 for ONNX node: Unsqueeze_534 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1046 for ONNX tensor: 1046 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_534 [Unsqueeze] outputs: [1046 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Unsqueeze_535 [Unsqueeze] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1043 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_535 [Unsqueeze] inputs: [1043 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:37] [V] [TRT] Registering layer: Unsqueeze_535 for ONNX node: Unsqueeze_535 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1047 for ONNX tensor: 1047 [06/20/2022-16:24:37] [V] [TRT] Unsqueeze_535 [Unsqueeze] outputs: [1047 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Concat_536 [Concat] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1046 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1047 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3247 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 3248 [06/20/2022-16:24:37] [V] [TRT] Concat_536 [Concat] inputs: [1046 -> (1)[INT32]], [1047 -> (1)[INT32]], [3247 -> (1)[INT32]], [3248 -> (1)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3247 for ONNX node: 3247 [06/20/2022-16:24:37] [V] [TRT] Registering layer: 3248 for ONNX node: 3248 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Concat_536 for ONNX node: Concat_536 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1050 for ONNX tensor: 1050 [06/20/2022-16:24:37] [V] [TRT] Concat_536 [Concat] outputs: [1050 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Reshape_537 [Reshape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1002 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1050 [06/20/2022-16:24:37] [V] [TRT] Reshape_537 [Reshape] inputs: [1002 -> (-1, -1, 1024)[FLOAT]], [1050 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Reshape_537 for ONNX node: Reshape_537 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1051 for ONNX tensor: 1051 [06/20/2022-16:24:37] [V] [TRT] Reshape_537 [Reshape] outputs: [1051 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_538 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1051 [06/20/2022-16:24:37] [V] [TRT] Transpose_538 [Transpose] inputs: [1051 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_538 for ONNX node: Transpose_538 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1052 for ONNX tensor: 1052 [06/20/2022-16:24:37] [V] [TRT] Transpose_538 [Transpose] outputs: [1052 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_539 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1019 [06/20/2022-16:24:37] [V] [TRT] Transpose_539 [Transpose] inputs: [1019 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_539 for ONNX node: Transpose_539 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1053 for ONNX tensor: 1053 [06/20/2022-16:24:37] [V] [TRT] Transpose_539 [Transpose] outputs: [1053 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_540 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1052 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1053 [06/20/2022-16:24:37] [V] [TRT] MatMul_540 [MatMul] inputs: [1052 -> (-1, 16, -1, 64)[FLOAT]], [1053 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_540 for ONNX node: MatMul_540 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1054 for ONNX tensor: 1054 [06/20/2022-16:24:37] [V] [TRT] MatMul_540 [MatMul] outputs: [1054 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_541 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_541 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_541 [Constant] outputs: [1055 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Div_542 [Div] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1054 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1055 [06/20/2022-16:24:37] [V] [TRT] Div_542 [Div] inputs: [1054 -> (-1, 16, -1, -1)[FLOAT]], [1055 -> ()[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1055 for ONNX node: 1055 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Div_542 for ONNX node: Div_542 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1056 for ONNX tensor: 1056 [06/20/2022-16:24:37] [V] [TRT] Div_542 [Div] outputs: [1056 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Add_543 [Add] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1056 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:37] [V] [TRT] Add_543 [Add] inputs: [1056 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Add_543 for ONNX node: Add_543 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1057 for ONNX tensor: 1057 [06/20/2022-16:24:37] [V] [TRT] Add_543 [Add] outputs: [1057 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Softmax_544 [Softmax] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1057 [06/20/2022-16:24:37] [V] [TRT] Softmax_544 [Softmax] inputs: [1057 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Softmax_544 for ONNX node: Softmax_544 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1058 for ONNX tensor: 1058 [06/20/2022-16:24:37] [V] [TRT] Softmax_544 [Softmax] outputs: [1058 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: MatMul_545 [MatMul] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1058 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1037 [06/20/2022-16:24:37] [V] [TRT] MatMul_545 [MatMul] inputs: [1058 -> (-1, 16, -1, -1)[FLOAT]], [1037 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: MatMul_545 for ONNX node: MatMul_545 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1059 for ONNX tensor: 1059 [06/20/2022-16:24:37] [V] [TRT] MatMul_545 [MatMul] outputs: [1059 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Transpose_546 [Transpose] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1059 [06/20/2022-16:24:37] [V] [TRT] Transpose_546 [Transpose] inputs: [1059 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Transpose_546 for ONNX node: Transpose_546 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1060 for ONNX tensor: 1060 [06/20/2022-16:24:37] [V] [TRT] Transpose_546 [Transpose] outputs: [1060 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_547 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1060 [06/20/2022-16:24:37] [V] [TRT] Shape_547 [Shape] inputs: [1060 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_547 for ONNX node: Shape_547 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1061 for ONNX tensor: 1061 [06/20/2022-16:24:37] [V] [TRT] Shape_547 [Shape] outputs: [1061 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_548 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_548 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_548 [Constant] outputs: [1062 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_549 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1061 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1062 [06/20/2022-16:24:37] [V] [TRT] Gather_549 [Gather] inputs: [1061 -> (4)[INT32]], [1062 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1062 for ONNX node: 1062 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_549 for ONNX node: Gather_549 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1063 for ONNX tensor: 1063 [06/20/2022-16:24:37] [V] [TRT] Gather_549 [Gather] outputs: [1063 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Shape_550 [Shape] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1060 [06/20/2022-16:24:37] [V] [TRT] Shape_550 [Shape] inputs: [1060 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: Shape_550 for ONNX node: Shape_550 [06/20/2022-16:24:37] [V] [TRT] Registering tensor: 1064 for ONNX tensor: 1064 [06/20/2022-16:24:37] [V] [TRT] Shape_550 [Shape] outputs: [1064 -> (4)[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Constant_551 [Constant] [06/20/2022-16:24:37] [V] [TRT] Constant_551 [Constant] inputs: [06/20/2022-16:24:37] [V] [TRT] Constant_551 [Constant] outputs: [1065 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Parsing node: Gather_552 [Gather] [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1064 [06/20/2022-16:24:37] [V] [TRT] Searching for input: 1065 [06/20/2022-16:24:37] [V] [TRT] Gather_552 [Gather] inputs: [1064 -> (4)[INT32]], [1065 -> ()[INT32]], [06/20/2022-16:24:37] [V] [TRT] Registering layer: 1065 for ONNX node: 1065 [06/20/2022-16:24:37] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:37] [V] [TRT] Registering layer: Gather_552 for ONNX node: Gather_552 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1066 for ONNX tensor: 1066 [06/20/2022-16:24:38] [V] [TRT] Gather_552 [Gather] outputs: [1066 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_553 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1063 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_553 [Unsqueeze] inputs: [1063 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_553 for ONNX node: Unsqueeze_553 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1068 for ONNX tensor: 1068 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_553 [Unsqueeze] outputs: [1068 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_554 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1066 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_554 [Unsqueeze] inputs: [1066 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_554 for ONNX node: Unsqueeze_554 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1069 for ONNX tensor: 1069 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_554 [Unsqueeze] outputs: [1069 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_555 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1068 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1069 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3249 [06/20/2022-16:24:38] [V] [TRT] Concat_555 [Concat] inputs: [1068 -> (1)[INT32]], [1069 -> (1)[INT32]], [3249 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3249 for ONNX node: 3249 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_555 for ONNX node: Concat_555 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1071 for ONNX tensor: 1071 [06/20/2022-16:24:38] [V] [TRT] Concat_555 [Concat] outputs: [1071 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_556 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1060 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1071 [06/20/2022-16:24:38] [V] [TRT] Reshape_556 [Reshape] inputs: [1060 -> (-1, -1, 16, 64)[FLOAT]], [1071 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_556 for ONNX node: Reshape_556 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1072 for ONNX tensor: 1072 [06/20/2022-16:24:38] [V] [TRT] Reshape_556 [Reshape] outputs: [1072 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_557 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1072 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3250 [06/20/2022-16:24:38] [V] [TRT] MatMul_557 [MatMul] inputs: [1072 -> (-1, -1, 1024)[FLOAT]], [3250 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3250 for ONNX node: 3250 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_557 for ONNX node: MatMul_557 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1074 for ONNX tensor: 1074 [06/20/2022-16:24:38] [V] [TRT] MatMul_557 [MatMul] outputs: [1074 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_558 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1074 [06/20/2022-16:24:38] [V] [TRT] Add_558 [Add] inputs: [bert.encoder.layer.5.attention.output.dense.bias -> (1024)[FLOAT]], [1074 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.attention.output.dense.bias for ONNX node: bert.encoder.layer.5.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_558 for ONNX node: Add_558 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1075 for ONNX tensor: 1075 [06/20/2022-16:24:38] [V] [TRT] Add_558 [Add] outputs: [1075 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_559 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1075 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 999 [06/20/2022-16:24:38] [V] [TRT] Add_559 [Add] inputs: [1075 -> (-1, -1, 1024)[FLOAT]], [999 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_559 for ONNX node: Add_559 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1076 for ONNX tensor: 1076 [06/20/2022-16:24:38] [V] [TRT] Add_559 [Add] outputs: [1076 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_560 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1076 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_560 [ReduceMean] inputs: [1076 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_560 for ONNX node: ReduceMean_560 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1077 for ONNX tensor: 1077 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_560 [ReduceMean] outputs: [1077 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_561 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1076 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1077 [06/20/2022-16:24:38] [V] [TRT] Sub_561 [Sub] inputs: [1076 -> (-1, -1, 1024)[FLOAT]], [1077 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_561 for ONNX node: Sub_561 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1078 for ONNX tensor: 1078 [06/20/2022-16:24:38] [V] [TRT] Sub_561 [Sub] outputs: [1078 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_562 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_562 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_562 [Constant] outputs: [1079 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_563 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1078 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1079 [06/20/2022-16:24:38] [V] [TRT] Pow_563 [Pow] inputs: [1078 -> (-1, -1, 1024)[FLOAT]], [1079 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1079 for ONNX node: 1079 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_563 for ONNX node: Pow_563 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1080 for ONNX tensor: 1080 [06/20/2022-16:24:38] [V] [TRT] Pow_563 [Pow] outputs: [1080 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_564 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1080 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_564 [ReduceMean] inputs: [1080 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_564 for ONNX node: ReduceMean_564 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1081 for ONNX tensor: 1081 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_564 [ReduceMean] outputs: [1081 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_565 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_565 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_565 [Constant] outputs: [1082 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_566 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1081 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1082 [06/20/2022-16:24:38] [V] [TRT] Add_566 [Add] inputs: [1081 -> (-1, -1, 1)[FLOAT]], [1082 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1082 for ONNX node: 1082 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_566 for ONNX node: Add_566 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1083 for ONNX tensor: 1083 [06/20/2022-16:24:38] [V] [TRT] Add_566 [Add] outputs: [1083 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_567 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1083 [06/20/2022-16:24:38] [V] [TRT] Sqrt_567 [Sqrt] inputs: [1083 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_567 for ONNX node: Sqrt_567 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1084 for ONNX tensor: 1084 [06/20/2022-16:24:38] [V] [TRT] Sqrt_567 [Sqrt] outputs: [1084 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_568 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1078 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1084 [06/20/2022-16:24:38] [V] [TRT] Div_568 [Div] inputs: [1078 -> (-1, -1, 1024)[FLOAT]], [1084 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_568 for ONNX node: Div_568 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1085 for ONNX tensor: 1085 [06/20/2022-16:24:38] [V] [TRT] Div_568 [Div] outputs: [1085 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_569 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1085 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_569 [Mul] inputs: [1085 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.5.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.5.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_569 for ONNX node: Mul_569 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1086 for ONNX tensor: 1086 [06/20/2022-16:24:38] [V] [TRT] Mul_569 [Mul] outputs: [1086 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_570 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1086 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_570 [Add] inputs: [1086 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.5.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.5.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_570 for ONNX node: Add_570 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1087 for ONNX tensor: 1087 [06/20/2022-16:24:38] [V] [TRT] Add_570 [Add] outputs: [1087 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_571 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1087 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3251 [06/20/2022-16:24:38] [V] [TRT] MatMul_571 [MatMul] inputs: [1087 -> (-1, -1, 1024)[FLOAT]], [3251 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3251 for ONNX node: 3251 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_571 for ONNX node: MatMul_571 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1089 for ONNX tensor: 1089 [06/20/2022-16:24:38] [V] [TRT] MatMul_571 [MatMul] outputs: [1089 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_572 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1089 [06/20/2022-16:24:38] [V] [TRT] Add_572 [Add] inputs: [bert.encoder.layer.5.intermediate.dense.bias -> (4096)[FLOAT]], [1089 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.intermediate.dense.bias for ONNX node: bert.encoder.layer.5.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_572 for ONNX node: Add_572 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1090 for ONNX tensor: 1090 [06/20/2022-16:24:38] [V] [TRT] Add_572 [Add] outputs: [1090 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_573 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_573 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_573 [Constant] outputs: [1091 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_574 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1090 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1091 [06/20/2022-16:24:38] [V] [TRT] Div_574 [Div] inputs: [1090 -> (-1, -1, 4096)[FLOAT]], [1091 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1091 for ONNX node: 1091 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_574 for ONNX node: Div_574 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1092 for ONNX tensor: 1092 [06/20/2022-16:24:38] [V] [TRT] Div_574 [Div] outputs: [1092 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Erf_575 [Erf] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1092 [06/20/2022-16:24:38] [V] [TRT] Erf_575 [Erf] inputs: [1092 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Erf_575 for ONNX node: Erf_575 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1093 for ONNX tensor: 1093 [06/20/2022-16:24:38] [V] [TRT] Erf_575 [Erf] outputs: [1093 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_576 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_576 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_576 [Constant] outputs: [1094 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_577 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1093 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1094 [06/20/2022-16:24:38] [V] [TRT] Add_577 [Add] inputs: [1093 -> (-1, -1, 4096)[FLOAT]], [1094 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1094 for ONNX node: 1094 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_577 for ONNX node: Add_577 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1095 for ONNX tensor: 1095 [06/20/2022-16:24:38] [V] [TRT] Add_577 [Add] outputs: [1095 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_578 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1090 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1095 [06/20/2022-16:24:38] [V] [TRT] Mul_578 [Mul] inputs: [1090 -> (-1, -1, 4096)[FLOAT]], [1095 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_578 for ONNX node: Mul_578 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1096 for ONNX tensor: 1096 [06/20/2022-16:24:38] [V] [TRT] Mul_578 [Mul] outputs: [1096 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_579 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_579 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_579 [Constant] outputs: [1097 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_580 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1096 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1097 [06/20/2022-16:24:38] [V] [TRT] Mul_580 [Mul] inputs: [1096 -> (-1, -1, 4096)[FLOAT]], [1097 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1097 for ONNX node: 1097 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_580 for ONNX node: Mul_580 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1098 for ONNX tensor: 1098 [06/20/2022-16:24:38] [V] [TRT] Mul_580 [Mul] outputs: [1098 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_581 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1098 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3252 [06/20/2022-16:24:38] [V] [TRT] MatMul_581 [MatMul] inputs: [1098 -> (-1, -1, 4096)[FLOAT]], [3252 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3252 for ONNX node: 3252 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_581 for ONNX node: MatMul_581 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1100 for ONNX tensor: 1100 [06/20/2022-16:24:38] [V] [TRT] MatMul_581 [MatMul] outputs: [1100 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_582 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1100 [06/20/2022-16:24:38] [V] [TRT] Add_582 [Add] inputs: [bert.encoder.layer.5.output.dense.bias -> (1024)[FLOAT]], [1100 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.output.dense.bias for ONNX node: bert.encoder.layer.5.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_582 for ONNX node: Add_582 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1101 for ONNX tensor: 1101 [06/20/2022-16:24:38] [V] [TRT] Add_582 [Add] outputs: [1101 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_583 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1101 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1087 [06/20/2022-16:24:38] [V] [TRT] Add_583 [Add] inputs: [1101 -> (-1, -1, 1024)[FLOAT]], [1087 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_583 for ONNX node: Add_583 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1102 for ONNX tensor: 1102 [06/20/2022-16:24:38] [V] [TRT] Add_583 [Add] outputs: [1102 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_584 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1102 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_584 [ReduceMean] inputs: [1102 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_584 for ONNX node: ReduceMean_584 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1103 for ONNX tensor: 1103 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_584 [ReduceMean] outputs: [1103 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_585 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1102 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1103 [06/20/2022-16:24:38] [V] [TRT] Sub_585 [Sub] inputs: [1102 -> (-1, -1, 1024)[FLOAT]], [1103 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_585 for ONNX node: Sub_585 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1104 for ONNX tensor: 1104 [06/20/2022-16:24:38] [V] [TRT] Sub_585 [Sub] outputs: [1104 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_586 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_586 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_586 [Constant] outputs: [1105 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_587 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1104 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1105 [06/20/2022-16:24:38] [V] [TRT] Pow_587 [Pow] inputs: [1104 -> (-1, -1, 1024)[FLOAT]], [1105 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1105 for ONNX node: 1105 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_587 for ONNX node: Pow_587 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1106 for ONNX tensor: 1106 [06/20/2022-16:24:38] [V] [TRT] Pow_587 [Pow] outputs: [1106 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_588 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1106 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_588 [ReduceMean] inputs: [1106 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_588 for ONNX node: ReduceMean_588 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1107 for ONNX tensor: 1107 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_588 [ReduceMean] outputs: [1107 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_589 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_589 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_589 [Constant] outputs: [1108 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_590 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1107 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1108 [06/20/2022-16:24:38] [V] [TRT] Add_590 [Add] inputs: [1107 -> (-1, -1, 1)[FLOAT]], [1108 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1108 for ONNX node: 1108 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_590 for ONNX node: Add_590 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1109 for ONNX tensor: 1109 [06/20/2022-16:24:38] [V] [TRT] Add_590 [Add] outputs: [1109 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_591 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1109 [06/20/2022-16:24:38] [V] [TRT] Sqrt_591 [Sqrt] inputs: [1109 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_591 for ONNX node: Sqrt_591 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1110 for ONNX tensor: 1110 [06/20/2022-16:24:38] [V] [TRT] Sqrt_591 [Sqrt] outputs: [1110 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_592 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1104 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1110 [06/20/2022-16:24:38] [V] [TRT] Div_592 [Div] inputs: [1104 -> (-1, -1, 1024)[FLOAT]], [1110 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_592 for ONNX node: Div_592 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1111 for ONNX tensor: 1111 [06/20/2022-16:24:38] [V] [TRT] Div_592 [Div] outputs: [1111 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_593 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1111 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_593 [Mul] inputs: [1111 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.5.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.output.LayerNorm.weight for ONNX node: bert.encoder.layer.5.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_593 for ONNX node: Mul_593 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1112 for ONNX tensor: 1112 [06/20/2022-16:24:38] [V] [TRT] Mul_593 [Mul] outputs: [1112 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_594 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1112 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.5.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_594 [Add] inputs: [1112 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.5.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.5.output.LayerNorm.bias for ONNX node: bert.encoder.layer.5.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_594 for ONNX node: Add_594 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1113 for ONNX tensor: 1113 [06/20/2022-16:24:38] [V] [TRT] Add_594 [Add] outputs: [1113 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_595 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1113 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3253 [06/20/2022-16:24:38] [V] [TRT] MatMul_595 [MatMul] inputs: [1113 -> (-1, -1, 1024)[FLOAT]], [3253 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3253 for ONNX node: 3253 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_595 for ONNX node: MatMul_595 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1115 for ONNX tensor: 1115 [06/20/2022-16:24:38] [V] [TRT] MatMul_595 [MatMul] outputs: [1115 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_596 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1115 [06/20/2022-16:24:38] [V] [TRT] Add_596 [Add] inputs: [bert.encoder.layer.6.attention.self.query.bias -> (1024)[FLOAT]], [1115 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.attention.self.query.bias for ONNX node: bert.encoder.layer.6.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_596 for ONNX node: Add_596 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1116 for ONNX tensor: 1116 [06/20/2022-16:24:38] [V] [TRT] Add_596 [Add] outputs: [1116 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_597 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1113 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3254 [06/20/2022-16:24:38] [V] [TRT] MatMul_597 [MatMul] inputs: [1113 -> (-1, -1, 1024)[FLOAT]], [3254 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3254 for ONNX node: 3254 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_597 for ONNX node: MatMul_597 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1118 for ONNX tensor: 1118 [06/20/2022-16:24:38] [V] [TRT] MatMul_597 [MatMul] outputs: [1118 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_598 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1118 [06/20/2022-16:24:38] [V] [TRT] Add_598 [Add] inputs: [bert.encoder.layer.6.attention.self.key.bias -> (1024)[FLOAT]], [1118 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.attention.self.key.bias for ONNX node: bert.encoder.layer.6.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_598 for ONNX node: Add_598 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1119 for ONNX tensor: 1119 [06/20/2022-16:24:38] [V] [TRT] Add_598 [Add] outputs: [1119 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_599 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1119 [06/20/2022-16:24:38] [V] [TRT] Shape_599 [Shape] inputs: [1119 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_599 for ONNX node: Shape_599 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1120 for ONNX tensor: 1120 [06/20/2022-16:24:38] [V] [TRT] Shape_599 [Shape] outputs: [1120 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_600 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_600 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_600 [Constant] outputs: [1121 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_601 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1120 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1121 [06/20/2022-16:24:38] [V] [TRT] Gather_601 [Gather] inputs: [1120 -> (3)[INT32]], [1121 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1121 for ONNX node: 1121 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_601 for ONNX node: Gather_601 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1122 for ONNX tensor: 1122 [06/20/2022-16:24:38] [V] [TRT] Gather_601 [Gather] outputs: [1122 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_602 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1119 [06/20/2022-16:24:38] [V] [TRT] Shape_602 [Shape] inputs: [1119 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_602 for ONNX node: Shape_602 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1123 for ONNX tensor: 1123 [06/20/2022-16:24:38] [V] [TRT] Shape_602 [Shape] outputs: [1123 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_603 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_603 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_603 [Constant] outputs: [1124 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_604 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1123 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1124 [06/20/2022-16:24:38] [V] [TRT] Gather_604 [Gather] inputs: [1123 -> (3)[INT32]], [1124 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1124 for ONNX node: 1124 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_604 for ONNX node: Gather_604 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1125 for ONNX tensor: 1125 [06/20/2022-16:24:38] [V] [TRT] Gather_604 [Gather] outputs: [1125 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_605 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1122 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_605 [Unsqueeze] inputs: [1122 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_605 for ONNX node: Unsqueeze_605 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1128 for ONNX tensor: 1128 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_605 [Unsqueeze] outputs: [1128 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_606 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1125 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_606 [Unsqueeze] inputs: [1125 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_606 for ONNX node: Unsqueeze_606 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1129 for ONNX tensor: 1129 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_606 [Unsqueeze] outputs: [1129 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_607 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1128 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1129 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3255 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3256 [06/20/2022-16:24:38] [V] [TRT] Concat_607 [Concat] inputs: [1128 -> (1)[INT32]], [1129 -> (1)[INT32]], [3255 -> (1)[INT32]], [3256 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3255 for ONNX node: 3255 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3256 for ONNX node: 3256 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_607 for ONNX node: Concat_607 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1132 for ONNX tensor: 1132 [06/20/2022-16:24:38] [V] [TRT] Concat_607 [Concat] outputs: [1132 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_608 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1119 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1132 [06/20/2022-16:24:38] [V] [TRT] Reshape_608 [Reshape] inputs: [1119 -> (-1, -1, 1024)[FLOAT]], [1132 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_608 for ONNX node: Reshape_608 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1133 for ONNX tensor: 1133 [06/20/2022-16:24:38] [V] [TRT] Reshape_608 [Reshape] outputs: [1133 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_609 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1113 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3257 [06/20/2022-16:24:38] [V] [TRT] MatMul_609 [MatMul] inputs: [1113 -> (-1, -1, 1024)[FLOAT]], [3257 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3257 for ONNX node: 3257 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_609 for ONNX node: MatMul_609 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1135 for ONNX tensor: 1135 [06/20/2022-16:24:38] [V] [TRT] MatMul_609 [MatMul] outputs: [1135 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_610 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1135 [06/20/2022-16:24:38] [V] [TRT] Add_610 [Add] inputs: [bert.encoder.layer.6.attention.self.value.bias -> (1024)[FLOAT]], [1135 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.attention.self.value.bias for ONNX node: bert.encoder.layer.6.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_610 for ONNX node: Add_610 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1136 for ONNX tensor: 1136 [06/20/2022-16:24:38] [V] [TRT] Add_610 [Add] outputs: [1136 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_611 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1136 [06/20/2022-16:24:38] [V] [TRT] Shape_611 [Shape] inputs: [1136 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_611 for ONNX node: Shape_611 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1137 for ONNX tensor: 1137 [06/20/2022-16:24:38] [V] [TRT] Shape_611 [Shape] outputs: [1137 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_612 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_612 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_612 [Constant] outputs: [1138 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_613 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1137 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1138 [06/20/2022-16:24:38] [V] [TRT] Gather_613 [Gather] inputs: [1137 -> (3)[INT32]], [1138 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1138 for ONNX node: 1138 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_613 for ONNX node: Gather_613 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1139 for ONNX tensor: 1139 [06/20/2022-16:24:38] [V] [TRT] Gather_613 [Gather] outputs: [1139 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_614 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1136 [06/20/2022-16:24:38] [V] [TRT] Shape_614 [Shape] inputs: [1136 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_614 for ONNX node: Shape_614 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1140 for ONNX tensor: 1140 [06/20/2022-16:24:38] [V] [TRT] Shape_614 [Shape] outputs: [1140 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_615 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_615 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_615 [Constant] outputs: [1141 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_616 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1140 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1141 [06/20/2022-16:24:38] [V] [TRT] Gather_616 [Gather] inputs: [1140 -> (3)[INT32]], [1141 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1141 for ONNX node: 1141 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_616 for ONNX node: Gather_616 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1142 for ONNX tensor: 1142 [06/20/2022-16:24:38] [V] [TRT] Gather_616 [Gather] outputs: [1142 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_617 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1139 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_617 [Unsqueeze] inputs: [1139 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_617 for ONNX node: Unsqueeze_617 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1145 for ONNX tensor: 1145 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_617 [Unsqueeze] outputs: [1145 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_618 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1142 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_618 [Unsqueeze] inputs: [1142 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_618 for ONNX node: Unsqueeze_618 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1146 for ONNX tensor: 1146 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_618 [Unsqueeze] outputs: [1146 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_619 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1145 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1146 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3258 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3259 [06/20/2022-16:24:38] [V] [TRT] Concat_619 [Concat] inputs: [1145 -> (1)[INT32]], [1146 -> (1)[INT32]], [3258 -> (1)[INT32]], [3259 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3258 for ONNX node: 3258 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3259 for ONNX node: 3259 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_619 for ONNX node: Concat_619 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1149 for ONNX tensor: 1149 [06/20/2022-16:24:38] [V] [TRT] Concat_619 [Concat] outputs: [1149 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_620 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1136 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1149 [06/20/2022-16:24:38] [V] [TRT] Reshape_620 [Reshape] inputs: [1136 -> (-1, -1, 1024)[FLOAT]], [1149 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_620 for ONNX node: Reshape_620 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1150 for ONNX tensor: 1150 [06/20/2022-16:24:38] [V] [TRT] Reshape_620 [Reshape] outputs: [1150 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_621 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1150 [06/20/2022-16:24:38] [V] [TRT] Transpose_621 [Transpose] inputs: [1150 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_621 for ONNX node: Transpose_621 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1151 for ONNX tensor: 1151 [06/20/2022-16:24:38] [V] [TRT] Transpose_621 [Transpose] outputs: [1151 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_622 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1116 [06/20/2022-16:24:38] [V] [TRT] Shape_622 [Shape] inputs: [1116 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_622 for ONNX node: Shape_622 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1152 for ONNX tensor: 1152 [06/20/2022-16:24:38] [V] [TRT] Shape_622 [Shape] outputs: [1152 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_623 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_623 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_623 [Constant] outputs: [1153 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_624 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1152 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1153 [06/20/2022-16:24:38] [V] [TRT] Gather_624 [Gather] inputs: [1152 -> (3)[INT32]], [1153 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1153 for ONNX node: 1153 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_624 for ONNX node: Gather_624 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1154 for ONNX tensor: 1154 [06/20/2022-16:24:38] [V] [TRT] Gather_624 [Gather] outputs: [1154 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_625 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1116 [06/20/2022-16:24:38] [V] [TRT] Shape_625 [Shape] inputs: [1116 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_625 for ONNX node: Shape_625 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1155 for ONNX tensor: 1155 [06/20/2022-16:24:38] [V] [TRT] Shape_625 [Shape] outputs: [1155 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_626 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_626 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_626 [Constant] outputs: [1156 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_627 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1155 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1156 [06/20/2022-16:24:38] [V] [TRT] Gather_627 [Gather] inputs: [1155 -> (3)[INT32]], [1156 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1156 for ONNX node: 1156 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_627 for ONNX node: Gather_627 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1157 for ONNX tensor: 1157 [06/20/2022-16:24:38] [V] [TRT] Gather_627 [Gather] outputs: [1157 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_628 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1154 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_628 [Unsqueeze] inputs: [1154 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_628 for ONNX node: Unsqueeze_628 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1160 for ONNX tensor: 1160 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_628 [Unsqueeze] outputs: [1160 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_629 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1157 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_629 [Unsqueeze] inputs: [1157 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_629 for ONNX node: Unsqueeze_629 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1161 for ONNX tensor: 1161 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_629 [Unsqueeze] outputs: [1161 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_630 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1160 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1161 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3260 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3261 [06/20/2022-16:24:38] [V] [TRT] Concat_630 [Concat] inputs: [1160 -> (1)[INT32]], [1161 -> (1)[INT32]], [3260 -> (1)[INT32]], [3261 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3260 for ONNX node: 3260 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3261 for ONNX node: 3261 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_630 for ONNX node: Concat_630 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1164 for ONNX tensor: 1164 [06/20/2022-16:24:38] [V] [TRT] Concat_630 [Concat] outputs: [1164 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_631 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1116 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1164 [06/20/2022-16:24:38] [V] [TRT] Reshape_631 [Reshape] inputs: [1116 -> (-1, -1, 1024)[FLOAT]], [1164 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_631 for ONNX node: Reshape_631 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1165 for ONNX tensor: 1165 [06/20/2022-16:24:38] [V] [TRT] Reshape_631 [Reshape] outputs: [1165 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_632 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1165 [06/20/2022-16:24:38] [V] [TRT] Transpose_632 [Transpose] inputs: [1165 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_632 for ONNX node: Transpose_632 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1166 for ONNX tensor: 1166 [06/20/2022-16:24:38] [V] [TRT] Transpose_632 [Transpose] outputs: [1166 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_633 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1133 [06/20/2022-16:24:38] [V] [TRT] Transpose_633 [Transpose] inputs: [1133 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_633 for ONNX node: Transpose_633 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1167 for ONNX tensor: 1167 [06/20/2022-16:24:38] [V] [TRT] Transpose_633 [Transpose] outputs: [1167 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_634 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1166 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1167 [06/20/2022-16:24:38] [V] [TRT] MatMul_634 [MatMul] inputs: [1166 -> (-1, 16, -1, 64)[FLOAT]], [1167 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_634 for ONNX node: MatMul_634 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1168 for ONNX tensor: 1168 [06/20/2022-16:24:38] [V] [TRT] MatMul_634 [MatMul] outputs: [1168 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_635 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_635 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_635 [Constant] outputs: [1169 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_636 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1168 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1169 [06/20/2022-16:24:38] [V] [TRT] Div_636 [Div] inputs: [1168 -> (-1, 16, -1, -1)[FLOAT]], [1169 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1169 for ONNX node: 1169 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_636 for ONNX node: Div_636 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1170 for ONNX tensor: 1170 [06/20/2022-16:24:38] [V] [TRT] Div_636 [Div] outputs: [1170 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_637 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1170 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:38] [V] [TRT] Add_637 [Add] inputs: [1170 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_637 for ONNX node: Add_637 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1171 for ONNX tensor: 1171 [06/20/2022-16:24:38] [V] [TRT] Add_637 [Add] outputs: [1171 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Softmax_638 [Softmax] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1171 [06/20/2022-16:24:38] [V] [TRT] Softmax_638 [Softmax] inputs: [1171 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Softmax_638 for ONNX node: Softmax_638 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1172 for ONNX tensor: 1172 [06/20/2022-16:24:38] [V] [TRT] Softmax_638 [Softmax] outputs: [1172 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_639 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1172 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1151 [06/20/2022-16:24:38] [V] [TRT] MatMul_639 [MatMul] inputs: [1172 -> (-1, 16, -1, -1)[FLOAT]], [1151 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_639 for ONNX node: MatMul_639 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1173 for ONNX tensor: 1173 [06/20/2022-16:24:38] [V] [TRT] MatMul_639 [MatMul] outputs: [1173 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_640 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1173 [06/20/2022-16:24:38] [V] [TRT] Transpose_640 [Transpose] inputs: [1173 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_640 for ONNX node: Transpose_640 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1174 for ONNX tensor: 1174 [06/20/2022-16:24:38] [V] [TRT] Transpose_640 [Transpose] outputs: [1174 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_641 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1174 [06/20/2022-16:24:38] [V] [TRT] Shape_641 [Shape] inputs: [1174 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_641 for ONNX node: Shape_641 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1175 for ONNX tensor: 1175 [06/20/2022-16:24:38] [V] [TRT] Shape_641 [Shape] outputs: [1175 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_642 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_642 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_642 [Constant] outputs: [1176 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_643 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1175 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1176 [06/20/2022-16:24:38] [V] [TRT] Gather_643 [Gather] inputs: [1175 -> (4)[INT32]], [1176 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1176 for ONNX node: 1176 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_643 for ONNX node: Gather_643 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1177 for ONNX tensor: 1177 [06/20/2022-16:24:38] [V] [TRT] Gather_643 [Gather] outputs: [1177 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_644 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1174 [06/20/2022-16:24:38] [V] [TRT] Shape_644 [Shape] inputs: [1174 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_644 for ONNX node: Shape_644 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1178 for ONNX tensor: 1178 [06/20/2022-16:24:38] [V] [TRT] Shape_644 [Shape] outputs: [1178 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_645 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_645 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_645 [Constant] outputs: [1179 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_646 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1178 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1179 [06/20/2022-16:24:38] [V] [TRT] Gather_646 [Gather] inputs: [1178 -> (4)[INT32]], [1179 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1179 for ONNX node: 1179 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_646 for ONNX node: Gather_646 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1180 for ONNX tensor: 1180 [06/20/2022-16:24:38] [V] [TRT] Gather_646 [Gather] outputs: [1180 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_647 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1177 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_647 [Unsqueeze] inputs: [1177 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_647 for ONNX node: Unsqueeze_647 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1182 for ONNX tensor: 1182 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_647 [Unsqueeze] outputs: [1182 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_648 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1180 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_648 [Unsqueeze] inputs: [1180 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_648 for ONNX node: Unsqueeze_648 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1183 for ONNX tensor: 1183 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_648 [Unsqueeze] outputs: [1183 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_649 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1182 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1183 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3262 [06/20/2022-16:24:38] [V] [TRT] Concat_649 [Concat] inputs: [1182 -> (1)[INT32]], [1183 -> (1)[INT32]], [3262 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3262 for ONNX node: 3262 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_649 for ONNX node: Concat_649 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1185 for ONNX tensor: 1185 [06/20/2022-16:24:38] [V] [TRT] Concat_649 [Concat] outputs: [1185 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_650 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1174 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1185 [06/20/2022-16:24:38] [V] [TRT] Reshape_650 [Reshape] inputs: [1174 -> (-1, -1, 16, 64)[FLOAT]], [1185 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_650 for ONNX node: Reshape_650 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1186 for ONNX tensor: 1186 [06/20/2022-16:24:38] [V] [TRT] Reshape_650 [Reshape] outputs: [1186 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_651 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1186 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3263 [06/20/2022-16:24:38] [V] [TRT] MatMul_651 [MatMul] inputs: [1186 -> (-1, -1, 1024)[FLOAT]], [3263 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3263 for ONNX node: 3263 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_651 for ONNX node: MatMul_651 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1188 for ONNX tensor: 1188 [06/20/2022-16:24:38] [V] [TRT] MatMul_651 [MatMul] outputs: [1188 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_652 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1188 [06/20/2022-16:24:38] [V] [TRT] Add_652 [Add] inputs: [bert.encoder.layer.6.attention.output.dense.bias -> (1024)[FLOAT]], [1188 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.attention.output.dense.bias for ONNX node: bert.encoder.layer.6.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_652 for ONNX node: Add_652 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1189 for ONNX tensor: 1189 [06/20/2022-16:24:38] [V] [TRT] Add_652 [Add] outputs: [1189 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_653 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1189 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1113 [06/20/2022-16:24:38] [V] [TRT] Add_653 [Add] inputs: [1189 -> (-1, -1, 1024)[FLOAT]], [1113 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_653 for ONNX node: Add_653 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1190 for ONNX tensor: 1190 [06/20/2022-16:24:38] [V] [TRT] Add_653 [Add] outputs: [1190 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_654 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1190 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_654 [ReduceMean] inputs: [1190 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_654 for ONNX node: ReduceMean_654 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1191 for ONNX tensor: 1191 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_654 [ReduceMean] outputs: [1191 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_655 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1190 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1191 [06/20/2022-16:24:38] [V] [TRT] Sub_655 [Sub] inputs: [1190 -> (-1, -1, 1024)[FLOAT]], [1191 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_655 for ONNX node: Sub_655 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1192 for ONNX tensor: 1192 [06/20/2022-16:24:38] [V] [TRT] Sub_655 [Sub] outputs: [1192 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_656 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_656 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_656 [Constant] outputs: [1193 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_657 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1192 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1193 [06/20/2022-16:24:38] [V] [TRT] Pow_657 [Pow] inputs: [1192 -> (-1, -1, 1024)[FLOAT]], [1193 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1193 for ONNX node: 1193 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_657 for ONNX node: Pow_657 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1194 for ONNX tensor: 1194 [06/20/2022-16:24:38] [V] [TRT] Pow_657 [Pow] outputs: [1194 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_658 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1194 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_658 [ReduceMean] inputs: [1194 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_658 for ONNX node: ReduceMean_658 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1195 for ONNX tensor: 1195 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_658 [ReduceMean] outputs: [1195 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_659 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_659 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_659 [Constant] outputs: [1196 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_660 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1195 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1196 [06/20/2022-16:24:38] [V] [TRT] Add_660 [Add] inputs: [1195 -> (-1, -1, 1)[FLOAT]], [1196 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1196 for ONNX node: 1196 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_660 for ONNX node: Add_660 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1197 for ONNX tensor: 1197 [06/20/2022-16:24:38] [V] [TRT] Add_660 [Add] outputs: [1197 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_661 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1197 [06/20/2022-16:24:38] [V] [TRT] Sqrt_661 [Sqrt] inputs: [1197 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_661 for ONNX node: Sqrt_661 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1198 for ONNX tensor: 1198 [06/20/2022-16:24:38] [V] [TRT] Sqrt_661 [Sqrt] outputs: [1198 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_662 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1192 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1198 [06/20/2022-16:24:38] [V] [TRT] Div_662 [Div] inputs: [1192 -> (-1, -1, 1024)[FLOAT]], [1198 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_662 for ONNX node: Div_662 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1199 for ONNX tensor: 1199 [06/20/2022-16:24:38] [V] [TRT] Div_662 [Div] outputs: [1199 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_663 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1199 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_663 [Mul] inputs: [1199 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.6.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.6.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_663 for ONNX node: Mul_663 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1200 for ONNX tensor: 1200 [06/20/2022-16:24:38] [V] [TRT] Mul_663 [Mul] outputs: [1200 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_664 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1200 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_664 [Add] inputs: [1200 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.6.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.6.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_664 for ONNX node: Add_664 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1201 for ONNX tensor: 1201 [06/20/2022-16:24:38] [V] [TRT] Add_664 [Add] outputs: [1201 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_665 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1201 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3264 [06/20/2022-16:24:38] [V] [TRT] MatMul_665 [MatMul] inputs: [1201 -> (-1, -1, 1024)[FLOAT]], [3264 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3264 for ONNX node: 3264 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_665 for ONNX node: MatMul_665 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1203 for ONNX tensor: 1203 [06/20/2022-16:24:38] [V] [TRT] MatMul_665 [MatMul] outputs: [1203 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_666 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1203 [06/20/2022-16:24:38] [V] [TRT] Add_666 [Add] inputs: [bert.encoder.layer.6.intermediate.dense.bias -> (4096)[FLOAT]], [1203 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.intermediate.dense.bias for ONNX node: bert.encoder.layer.6.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_666 for ONNX node: Add_666 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1204 for ONNX tensor: 1204 [06/20/2022-16:24:38] [V] [TRT] Add_666 [Add] outputs: [1204 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_667 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_667 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_667 [Constant] outputs: [1205 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_668 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1204 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1205 [06/20/2022-16:24:38] [V] [TRT] Div_668 [Div] inputs: [1204 -> (-1, -1, 4096)[FLOAT]], [1205 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1205 for ONNX node: 1205 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_668 for ONNX node: Div_668 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1206 for ONNX tensor: 1206 [06/20/2022-16:24:38] [V] [TRT] Div_668 [Div] outputs: [1206 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Erf_669 [Erf] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1206 [06/20/2022-16:24:38] [V] [TRT] Erf_669 [Erf] inputs: [1206 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Erf_669 for ONNX node: Erf_669 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1207 for ONNX tensor: 1207 [06/20/2022-16:24:38] [V] [TRT] Erf_669 [Erf] outputs: [1207 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_670 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_670 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_670 [Constant] outputs: [1208 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_671 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1207 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1208 [06/20/2022-16:24:38] [V] [TRT] Add_671 [Add] inputs: [1207 -> (-1, -1, 4096)[FLOAT]], [1208 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1208 for ONNX node: 1208 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_671 for ONNX node: Add_671 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1209 for ONNX tensor: 1209 [06/20/2022-16:24:38] [V] [TRT] Add_671 [Add] outputs: [1209 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_672 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1204 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1209 [06/20/2022-16:24:38] [V] [TRT] Mul_672 [Mul] inputs: [1204 -> (-1, -1, 4096)[FLOAT]], [1209 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_672 for ONNX node: Mul_672 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1210 for ONNX tensor: 1210 [06/20/2022-16:24:38] [V] [TRT] Mul_672 [Mul] outputs: [1210 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_673 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_673 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_673 [Constant] outputs: [1211 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_674 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1210 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1211 [06/20/2022-16:24:38] [V] [TRT] Mul_674 [Mul] inputs: [1210 -> (-1, -1, 4096)[FLOAT]], [1211 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1211 for ONNX node: 1211 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_674 for ONNX node: Mul_674 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1212 for ONNX tensor: 1212 [06/20/2022-16:24:38] [V] [TRT] Mul_674 [Mul] outputs: [1212 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_675 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1212 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3265 [06/20/2022-16:24:38] [V] [TRT] MatMul_675 [MatMul] inputs: [1212 -> (-1, -1, 4096)[FLOAT]], [3265 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3265 for ONNX node: 3265 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_675 for ONNX node: MatMul_675 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1214 for ONNX tensor: 1214 [06/20/2022-16:24:38] [V] [TRT] MatMul_675 [MatMul] outputs: [1214 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_676 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1214 [06/20/2022-16:24:38] [V] [TRT] Add_676 [Add] inputs: [bert.encoder.layer.6.output.dense.bias -> (1024)[FLOAT]], [1214 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.output.dense.bias for ONNX node: bert.encoder.layer.6.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_676 for ONNX node: Add_676 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1215 for ONNX tensor: 1215 [06/20/2022-16:24:38] [V] [TRT] Add_676 [Add] outputs: [1215 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_677 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1215 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1201 [06/20/2022-16:24:38] [V] [TRT] Add_677 [Add] inputs: [1215 -> (-1, -1, 1024)[FLOAT]], [1201 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_677 for ONNX node: Add_677 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1216 for ONNX tensor: 1216 [06/20/2022-16:24:38] [V] [TRT] Add_677 [Add] outputs: [1216 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_678 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1216 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_678 [ReduceMean] inputs: [1216 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_678 for ONNX node: ReduceMean_678 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1217 for ONNX tensor: 1217 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_678 [ReduceMean] outputs: [1217 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_679 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1216 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1217 [06/20/2022-16:24:38] [V] [TRT] Sub_679 [Sub] inputs: [1216 -> (-1, -1, 1024)[FLOAT]], [1217 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_679 for ONNX node: Sub_679 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1218 for ONNX tensor: 1218 [06/20/2022-16:24:38] [V] [TRT] Sub_679 [Sub] outputs: [1218 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_680 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_680 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_680 [Constant] outputs: [1219 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_681 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1218 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1219 [06/20/2022-16:24:38] [V] [TRT] Pow_681 [Pow] inputs: [1218 -> (-1, -1, 1024)[FLOAT]], [1219 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1219 for ONNX node: 1219 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_681 for ONNX node: Pow_681 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1220 for ONNX tensor: 1220 [06/20/2022-16:24:38] [V] [TRT] Pow_681 [Pow] outputs: [1220 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_682 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1220 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_682 [ReduceMean] inputs: [1220 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_682 for ONNX node: ReduceMean_682 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1221 for ONNX tensor: 1221 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_682 [ReduceMean] outputs: [1221 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_683 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_683 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_683 [Constant] outputs: [1222 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_684 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1221 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1222 [06/20/2022-16:24:38] [V] [TRT] Add_684 [Add] inputs: [1221 -> (-1, -1, 1)[FLOAT]], [1222 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1222 for ONNX node: 1222 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_684 for ONNX node: Add_684 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1223 for ONNX tensor: 1223 [06/20/2022-16:24:38] [V] [TRT] Add_684 [Add] outputs: [1223 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_685 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1223 [06/20/2022-16:24:38] [V] [TRT] Sqrt_685 [Sqrt] inputs: [1223 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_685 for ONNX node: Sqrt_685 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1224 for ONNX tensor: 1224 [06/20/2022-16:24:38] [V] [TRT] Sqrt_685 [Sqrt] outputs: [1224 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_686 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1218 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1224 [06/20/2022-16:24:38] [V] [TRT] Div_686 [Div] inputs: [1218 -> (-1, -1, 1024)[FLOAT]], [1224 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_686 for ONNX node: Div_686 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1225 for ONNX tensor: 1225 [06/20/2022-16:24:38] [V] [TRT] Div_686 [Div] outputs: [1225 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_687 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1225 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_687 [Mul] inputs: [1225 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.6.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.output.LayerNorm.weight for ONNX node: bert.encoder.layer.6.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_687 for ONNX node: Mul_687 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1226 for ONNX tensor: 1226 [06/20/2022-16:24:38] [V] [TRT] Mul_687 [Mul] outputs: [1226 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_688 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1226 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.6.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_688 [Add] inputs: [1226 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.6.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.6.output.LayerNorm.bias for ONNX node: bert.encoder.layer.6.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_688 for ONNX node: Add_688 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1227 for ONNX tensor: 1227 [06/20/2022-16:24:38] [V] [TRT] Add_688 [Add] outputs: [1227 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_689 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1227 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3266 [06/20/2022-16:24:38] [V] [TRT] MatMul_689 [MatMul] inputs: [1227 -> (-1, -1, 1024)[FLOAT]], [3266 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3266 for ONNX node: 3266 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_689 for ONNX node: MatMul_689 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1229 for ONNX tensor: 1229 [06/20/2022-16:24:38] [V] [TRT] MatMul_689 [MatMul] outputs: [1229 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_690 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1229 [06/20/2022-16:24:38] [V] [TRT] Add_690 [Add] inputs: [bert.encoder.layer.7.attention.self.query.bias -> (1024)[FLOAT]], [1229 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.attention.self.query.bias for ONNX node: bert.encoder.layer.7.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_690 for ONNX node: Add_690 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1230 for ONNX tensor: 1230 [06/20/2022-16:24:38] [V] [TRT] Add_690 [Add] outputs: [1230 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_691 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1227 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3267 [06/20/2022-16:24:38] [V] [TRT] MatMul_691 [MatMul] inputs: [1227 -> (-1, -1, 1024)[FLOAT]], [3267 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3267 for ONNX node: 3267 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_691 for ONNX node: MatMul_691 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1232 for ONNX tensor: 1232 [06/20/2022-16:24:38] [V] [TRT] MatMul_691 [MatMul] outputs: [1232 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_692 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1232 [06/20/2022-16:24:38] [V] [TRT] Add_692 [Add] inputs: [bert.encoder.layer.7.attention.self.key.bias -> (1024)[FLOAT]], [1232 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.attention.self.key.bias for ONNX node: bert.encoder.layer.7.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_692 for ONNX node: Add_692 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1233 for ONNX tensor: 1233 [06/20/2022-16:24:38] [V] [TRT] Add_692 [Add] outputs: [1233 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_693 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1233 [06/20/2022-16:24:38] [V] [TRT] Shape_693 [Shape] inputs: [1233 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_693 for ONNX node: Shape_693 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1234 for ONNX tensor: 1234 [06/20/2022-16:24:38] [V] [TRT] Shape_693 [Shape] outputs: [1234 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_694 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_694 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_694 [Constant] outputs: [1235 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_695 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1234 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1235 [06/20/2022-16:24:38] [V] [TRT] Gather_695 [Gather] inputs: [1234 -> (3)[INT32]], [1235 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1235 for ONNX node: 1235 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_695 for ONNX node: Gather_695 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1236 for ONNX tensor: 1236 [06/20/2022-16:24:38] [V] [TRT] Gather_695 [Gather] outputs: [1236 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_696 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1233 [06/20/2022-16:24:38] [V] [TRT] Shape_696 [Shape] inputs: [1233 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_696 for ONNX node: Shape_696 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1237 for ONNX tensor: 1237 [06/20/2022-16:24:38] [V] [TRT] Shape_696 [Shape] outputs: [1237 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_697 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_697 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_697 [Constant] outputs: [1238 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_698 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1237 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1238 [06/20/2022-16:24:38] [V] [TRT] Gather_698 [Gather] inputs: [1237 -> (3)[INT32]], [1238 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1238 for ONNX node: 1238 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_698 for ONNX node: Gather_698 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1239 for ONNX tensor: 1239 [06/20/2022-16:24:38] [V] [TRT] Gather_698 [Gather] outputs: [1239 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_699 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1236 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_699 [Unsqueeze] inputs: [1236 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_699 for ONNX node: Unsqueeze_699 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1242 for ONNX tensor: 1242 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_699 [Unsqueeze] outputs: [1242 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_700 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1239 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_700 [Unsqueeze] inputs: [1239 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_700 for ONNX node: Unsqueeze_700 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1243 for ONNX tensor: 1243 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_700 [Unsqueeze] outputs: [1243 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_701 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1242 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1243 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3268 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3269 [06/20/2022-16:24:38] [V] [TRT] Concat_701 [Concat] inputs: [1242 -> (1)[INT32]], [1243 -> (1)[INT32]], [3268 -> (1)[INT32]], [3269 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3268 for ONNX node: 3268 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3269 for ONNX node: 3269 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_701 for ONNX node: Concat_701 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1246 for ONNX tensor: 1246 [06/20/2022-16:24:38] [V] [TRT] Concat_701 [Concat] outputs: [1246 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_702 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1233 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1246 [06/20/2022-16:24:38] [V] [TRT] Reshape_702 [Reshape] inputs: [1233 -> (-1, -1, 1024)[FLOAT]], [1246 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_702 for ONNX node: Reshape_702 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1247 for ONNX tensor: 1247 [06/20/2022-16:24:38] [V] [TRT] Reshape_702 [Reshape] outputs: [1247 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_703 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1227 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3270 [06/20/2022-16:24:38] [V] [TRT] MatMul_703 [MatMul] inputs: [1227 -> (-1, -1, 1024)[FLOAT]], [3270 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3270 for ONNX node: 3270 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_703 for ONNX node: MatMul_703 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1249 for ONNX tensor: 1249 [06/20/2022-16:24:38] [V] [TRT] MatMul_703 [MatMul] outputs: [1249 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_704 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1249 [06/20/2022-16:24:38] [V] [TRT] Add_704 [Add] inputs: [bert.encoder.layer.7.attention.self.value.bias -> (1024)[FLOAT]], [1249 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.attention.self.value.bias for ONNX node: bert.encoder.layer.7.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_704 for ONNX node: Add_704 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1250 for ONNX tensor: 1250 [06/20/2022-16:24:38] [V] [TRT] Add_704 [Add] outputs: [1250 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_705 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1250 [06/20/2022-16:24:38] [V] [TRT] Shape_705 [Shape] inputs: [1250 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_705 for ONNX node: Shape_705 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1251 for ONNX tensor: 1251 [06/20/2022-16:24:38] [V] [TRT] Shape_705 [Shape] outputs: [1251 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_706 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_706 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_706 [Constant] outputs: [1252 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_707 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1251 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1252 [06/20/2022-16:24:38] [V] [TRT] Gather_707 [Gather] inputs: [1251 -> (3)[INT32]], [1252 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1252 for ONNX node: 1252 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_707 for ONNX node: Gather_707 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1253 for ONNX tensor: 1253 [06/20/2022-16:24:38] [V] [TRT] Gather_707 [Gather] outputs: [1253 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_708 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1250 [06/20/2022-16:24:38] [V] [TRT] Shape_708 [Shape] inputs: [1250 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_708 for ONNX node: Shape_708 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1254 for ONNX tensor: 1254 [06/20/2022-16:24:38] [V] [TRT] Shape_708 [Shape] outputs: [1254 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_709 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_709 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_709 [Constant] outputs: [1255 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_710 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1254 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1255 [06/20/2022-16:24:38] [V] [TRT] Gather_710 [Gather] inputs: [1254 -> (3)[INT32]], [1255 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1255 for ONNX node: 1255 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_710 for ONNX node: Gather_710 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1256 for ONNX tensor: 1256 [06/20/2022-16:24:38] [V] [TRT] Gather_710 [Gather] outputs: [1256 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_711 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1253 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_711 [Unsqueeze] inputs: [1253 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_711 for ONNX node: Unsqueeze_711 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1259 for ONNX tensor: 1259 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_711 [Unsqueeze] outputs: [1259 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_712 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1256 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_712 [Unsqueeze] inputs: [1256 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_712 for ONNX node: Unsqueeze_712 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1260 for ONNX tensor: 1260 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_712 [Unsqueeze] outputs: [1260 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_713 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1259 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1260 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3271 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3272 [06/20/2022-16:24:38] [V] [TRT] Concat_713 [Concat] inputs: [1259 -> (1)[INT32]], [1260 -> (1)[INT32]], [3271 -> (1)[INT32]], [3272 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3271 for ONNX node: 3271 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3272 for ONNX node: 3272 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_713 for ONNX node: Concat_713 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1263 for ONNX tensor: 1263 [06/20/2022-16:24:38] [V] [TRT] Concat_713 [Concat] outputs: [1263 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_714 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1250 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1263 [06/20/2022-16:24:38] [V] [TRT] Reshape_714 [Reshape] inputs: [1250 -> (-1, -1, 1024)[FLOAT]], [1263 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_714 for ONNX node: Reshape_714 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1264 for ONNX tensor: 1264 [06/20/2022-16:24:38] [V] [TRT] Reshape_714 [Reshape] outputs: [1264 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_715 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1264 [06/20/2022-16:24:38] [V] [TRT] Transpose_715 [Transpose] inputs: [1264 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_715 for ONNX node: Transpose_715 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1265 for ONNX tensor: 1265 [06/20/2022-16:24:38] [V] [TRT] Transpose_715 [Transpose] outputs: [1265 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_716 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1230 [06/20/2022-16:24:38] [V] [TRT] Shape_716 [Shape] inputs: [1230 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_716 for ONNX node: Shape_716 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1266 for ONNX tensor: 1266 [06/20/2022-16:24:38] [V] [TRT] Shape_716 [Shape] outputs: [1266 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_717 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_717 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_717 [Constant] outputs: [1267 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_718 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1266 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1267 [06/20/2022-16:24:38] [V] [TRT] Gather_718 [Gather] inputs: [1266 -> (3)[INT32]], [1267 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1267 for ONNX node: 1267 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_718 for ONNX node: Gather_718 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1268 for ONNX tensor: 1268 [06/20/2022-16:24:38] [V] [TRT] Gather_718 [Gather] outputs: [1268 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_719 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1230 [06/20/2022-16:24:38] [V] [TRT] Shape_719 [Shape] inputs: [1230 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_719 for ONNX node: Shape_719 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1269 for ONNX tensor: 1269 [06/20/2022-16:24:38] [V] [TRT] Shape_719 [Shape] outputs: [1269 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_720 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_720 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_720 [Constant] outputs: [1270 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_721 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1269 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1270 [06/20/2022-16:24:38] [V] [TRT] Gather_721 [Gather] inputs: [1269 -> (3)[INT32]], [1270 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1270 for ONNX node: 1270 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_721 for ONNX node: Gather_721 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1271 for ONNX tensor: 1271 [06/20/2022-16:24:38] [V] [TRT] Gather_721 [Gather] outputs: [1271 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_722 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1268 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_722 [Unsqueeze] inputs: [1268 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_722 for ONNX node: Unsqueeze_722 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1274 for ONNX tensor: 1274 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_722 [Unsqueeze] outputs: [1274 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_723 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1271 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_723 [Unsqueeze] inputs: [1271 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_723 for ONNX node: Unsqueeze_723 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1275 for ONNX tensor: 1275 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_723 [Unsqueeze] outputs: [1275 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_724 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1274 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1275 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3273 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3274 [06/20/2022-16:24:38] [V] [TRT] Concat_724 [Concat] inputs: [1274 -> (1)[INT32]], [1275 -> (1)[INT32]], [3273 -> (1)[INT32]], [3274 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3273 for ONNX node: 3273 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3274 for ONNX node: 3274 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_724 for ONNX node: Concat_724 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1278 for ONNX tensor: 1278 [06/20/2022-16:24:38] [V] [TRT] Concat_724 [Concat] outputs: [1278 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_725 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1230 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1278 [06/20/2022-16:24:38] [V] [TRT] Reshape_725 [Reshape] inputs: [1230 -> (-1, -1, 1024)[FLOAT]], [1278 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_725 for ONNX node: Reshape_725 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1279 for ONNX tensor: 1279 [06/20/2022-16:24:38] [V] [TRT] Reshape_725 [Reshape] outputs: [1279 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_726 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1279 [06/20/2022-16:24:38] [V] [TRT] Transpose_726 [Transpose] inputs: [1279 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_726 for ONNX node: Transpose_726 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1280 for ONNX tensor: 1280 [06/20/2022-16:24:38] [V] [TRT] Transpose_726 [Transpose] outputs: [1280 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_727 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1247 [06/20/2022-16:24:38] [V] [TRT] Transpose_727 [Transpose] inputs: [1247 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_727 for ONNX node: Transpose_727 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1281 for ONNX tensor: 1281 [06/20/2022-16:24:38] [V] [TRT] Transpose_727 [Transpose] outputs: [1281 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_728 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1280 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1281 [06/20/2022-16:24:38] [V] [TRT] MatMul_728 [MatMul] inputs: [1280 -> (-1, 16, -1, 64)[FLOAT]], [1281 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_728 for ONNX node: MatMul_728 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1282 for ONNX tensor: 1282 [06/20/2022-16:24:38] [V] [TRT] MatMul_728 [MatMul] outputs: [1282 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_729 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_729 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_729 [Constant] outputs: [1283 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_730 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1282 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1283 [06/20/2022-16:24:38] [V] [TRT] Div_730 [Div] inputs: [1282 -> (-1, 16, -1, -1)[FLOAT]], [1283 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1283 for ONNX node: 1283 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_730 for ONNX node: Div_730 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1284 for ONNX tensor: 1284 [06/20/2022-16:24:38] [V] [TRT] Div_730 [Div] outputs: [1284 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_731 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1284 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:38] [V] [TRT] Add_731 [Add] inputs: [1284 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_731 for ONNX node: Add_731 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1285 for ONNX tensor: 1285 [06/20/2022-16:24:38] [V] [TRT] Add_731 [Add] outputs: [1285 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Softmax_732 [Softmax] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1285 [06/20/2022-16:24:38] [V] [TRT] Softmax_732 [Softmax] inputs: [1285 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Softmax_732 for ONNX node: Softmax_732 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1286 for ONNX tensor: 1286 [06/20/2022-16:24:38] [V] [TRT] Softmax_732 [Softmax] outputs: [1286 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_733 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1286 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1265 [06/20/2022-16:24:38] [V] [TRT] MatMul_733 [MatMul] inputs: [1286 -> (-1, 16, -1, -1)[FLOAT]], [1265 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_733 for ONNX node: MatMul_733 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1287 for ONNX tensor: 1287 [06/20/2022-16:24:38] [V] [TRT] MatMul_733 [MatMul] outputs: [1287 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_734 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1287 [06/20/2022-16:24:38] [V] [TRT] Transpose_734 [Transpose] inputs: [1287 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_734 for ONNX node: Transpose_734 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1288 for ONNX tensor: 1288 [06/20/2022-16:24:38] [V] [TRT] Transpose_734 [Transpose] outputs: [1288 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_735 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1288 [06/20/2022-16:24:38] [V] [TRT] Shape_735 [Shape] inputs: [1288 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_735 for ONNX node: Shape_735 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1289 for ONNX tensor: 1289 [06/20/2022-16:24:38] [V] [TRT] Shape_735 [Shape] outputs: [1289 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_736 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_736 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_736 [Constant] outputs: [1290 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_737 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1289 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1290 [06/20/2022-16:24:38] [V] [TRT] Gather_737 [Gather] inputs: [1289 -> (4)[INT32]], [1290 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1290 for ONNX node: 1290 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_737 for ONNX node: Gather_737 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1291 for ONNX tensor: 1291 [06/20/2022-16:24:38] [V] [TRT] Gather_737 [Gather] outputs: [1291 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_738 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1288 [06/20/2022-16:24:38] [V] [TRT] Shape_738 [Shape] inputs: [1288 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_738 for ONNX node: Shape_738 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1292 for ONNX tensor: 1292 [06/20/2022-16:24:38] [V] [TRT] Shape_738 [Shape] outputs: [1292 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_739 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_739 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_739 [Constant] outputs: [1293 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_740 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1292 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1293 [06/20/2022-16:24:38] [V] [TRT] Gather_740 [Gather] inputs: [1292 -> (4)[INT32]], [1293 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1293 for ONNX node: 1293 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_740 for ONNX node: Gather_740 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1294 for ONNX tensor: 1294 [06/20/2022-16:24:38] [V] [TRT] Gather_740 [Gather] outputs: [1294 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_741 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1291 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_741 [Unsqueeze] inputs: [1291 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_741 for ONNX node: Unsqueeze_741 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1296 for ONNX tensor: 1296 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_741 [Unsqueeze] outputs: [1296 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_742 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1294 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_742 [Unsqueeze] inputs: [1294 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_742 for ONNX node: Unsqueeze_742 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1297 for ONNX tensor: 1297 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_742 [Unsqueeze] outputs: [1297 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_743 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1296 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1297 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3275 [06/20/2022-16:24:38] [V] [TRT] Concat_743 [Concat] inputs: [1296 -> (1)[INT32]], [1297 -> (1)[INT32]], [3275 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3275 for ONNX node: 3275 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_743 for ONNX node: Concat_743 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1299 for ONNX tensor: 1299 [06/20/2022-16:24:38] [V] [TRT] Concat_743 [Concat] outputs: [1299 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_744 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1288 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1299 [06/20/2022-16:24:38] [V] [TRT] Reshape_744 [Reshape] inputs: [1288 -> (-1, -1, 16, 64)[FLOAT]], [1299 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_744 for ONNX node: Reshape_744 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1300 for ONNX tensor: 1300 [06/20/2022-16:24:38] [V] [TRT] Reshape_744 [Reshape] outputs: [1300 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_745 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1300 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3276 [06/20/2022-16:24:38] [V] [TRT] MatMul_745 [MatMul] inputs: [1300 -> (-1, -1, 1024)[FLOAT]], [3276 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3276 for ONNX node: 3276 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_745 for ONNX node: MatMul_745 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1302 for ONNX tensor: 1302 [06/20/2022-16:24:38] [V] [TRT] MatMul_745 [MatMul] outputs: [1302 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_746 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1302 [06/20/2022-16:24:38] [V] [TRT] Add_746 [Add] inputs: [bert.encoder.layer.7.attention.output.dense.bias -> (1024)[FLOAT]], [1302 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.attention.output.dense.bias for ONNX node: bert.encoder.layer.7.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_746 for ONNX node: Add_746 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1303 for ONNX tensor: 1303 [06/20/2022-16:24:38] [V] [TRT] Add_746 [Add] outputs: [1303 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_747 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1303 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1227 [06/20/2022-16:24:38] [V] [TRT] Add_747 [Add] inputs: [1303 -> (-1, -1, 1024)[FLOAT]], [1227 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_747 for ONNX node: Add_747 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1304 for ONNX tensor: 1304 [06/20/2022-16:24:38] [V] [TRT] Add_747 [Add] outputs: [1304 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_748 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1304 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_748 [ReduceMean] inputs: [1304 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_748 for ONNX node: ReduceMean_748 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1305 for ONNX tensor: 1305 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_748 [ReduceMean] outputs: [1305 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_749 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1304 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1305 [06/20/2022-16:24:38] [V] [TRT] Sub_749 [Sub] inputs: [1304 -> (-1, -1, 1024)[FLOAT]], [1305 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_749 for ONNX node: Sub_749 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1306 for ONNX tensor: 1306 [06/20/2022-16:24:38] [V] [TRT] Sub_749 [Sub] outputs: [1306 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_750 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_750 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_750 [Constant] outputs: [1307 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_751 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1306 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1307 [06/20/2022-16:24:38] [V] [TRT] Pow_751 [Pow] inputs: [1306 -> (-1, -1, 1024)[FLOAT]], [1307 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1307 for ONNX node: 1307 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_751 for ONNX node: Pow_751 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1308 for ONNX tensor: 1308 [06/20/2022-16:24:38] [V] [TRT] Pow_751 [Pow] outputs: [1308 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_752 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1308 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_752 [ReduceMean] inputs: [1308 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_752 for ONNX node: ReduceMean_752 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1309 for ONNX tensor: 1309 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_752 [ReduceMean] outputs: [1309 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_753 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_753 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_753 [Constant] outputs: [1310 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_754 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1309 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1310 [06/20/2022-16:24:38] [V] [TRT] Add_754 [Add] inputs: [1309 -> (-1, -1, 1)[FLOAT]], [1310 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1310 for ONNX node: 1310 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_754 for ONNX node: Add_754 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1311 for ONNX tensor: 1311 [06/20/2022-16:24:38] [V] [TRT] Add_754 [Add] outputs: [1311 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_755 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1311 [06/20/2022-16:24:38] [V] [TRT] Sqrt_755 [Sqrt] inputs: [1311 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_755 for ONNX node: Sqrt_755 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1312 for ONNX tensor: 1312 [06/20/2022-16:24:38] [V] [TRT] Sqrt_755 [Sqrt] outputs: [1312 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_756 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1306 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1312 [06/20/2022-16:24:38] [V] [TRT] Div_756 [Div] inputs: [1306 -> (-1, -1, 1024)[FLOAT]], [1312 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_756 for ONNX node: Div_756 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1313 for ONNX tensor: 1313 [06/20/2022-16:24:38] [V] [TRT] Div_756 [Div] outputs: [1313 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_757 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1313 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_757 [Mul] inputs: [1313 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.7.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.7.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_757 for ONNX node: Mul_757 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1314 for ONNX tensor: 1314 [06/20/2022-16:24:38] [V] [TRT] Mul_757 [Mul] outputs: [1314 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_758 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1314 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_758 [Add] inputs: [1314 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.7.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.7.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_758 for ONNX node: Add_758 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1315 for ONNX tensor: 1315 [06/20/2022-16:24:38] [V] [TRT] Add_758 [Add] outputs: [1315 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_759 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1315 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3277 [06/20/2022-16:24:38] [V] [TRT] MatMul_759 [MatMul] inputs: [1315 -> (-1, -1, 1024)[FLOAT]], [3277 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3277 for ONNX node: 3277 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_759 for ONNX node: MatMul_759 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1317 for ONNX tensor: 1317 [06/20/2022-16:24:38] [V] [TRT] MatMul_759 [MatMul] outputs: [1317 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_760 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1317 [06/20/2022-16:24:38] [V] [TRT] Add_760 [Add] inputs: [bert.encoder.layer.7.intermediate.dense.bias -> (4096)[FLOAT]], [1317 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.intermediate.dense.bias for ONNX node: bert.encoder.layer.7.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_760 for ONNX node: Add_760 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1318 for ONNX tensor: 1318 [06/20/2022-16:24:38] [V] [TRT] Add_760 [Add] outputs: [1318 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_761 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_761 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_761 [Constant] outputs: [1319 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_762 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1318 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1319 [06/20/2022-16:24:38] [V] [TRT] Div_762 [Div] inputs: [1318 -> (-1, -1, 4096)[FLOAT]], [1319 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1319 for ONNX node: 1319 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_762 for ONNX node: Div_762 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1320 for ONNX tensor: 1320 [06/20/2022-16:24:38] [V] [TRT] Div_762 [Div] outputs: [1320 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Erf_763 [Erf] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1320 [06/20/2022-16:24:38] [V] [TRT] Erf_763 [Erf] inputs: [1320 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Erf_763 for ONNX node: Erf_763 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1321 for ONNX tensor: 1321 [06/20/2022-16:24:38] [V] [TRT] Erf_763 [Erf] outputs: [1321 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_764 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_764 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_764 [Constant] outputs: [1322 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_765 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1321 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1322 [06/20/2022-16:24:38] [V] [TRT] Add_765 [Add] inputs: [1321 -> (-1, -1, 4096)[FLOAT]], [1322 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1322 for ONNX node: 1322 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_765 for ONNX node: Add_765 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1323 for ONNX tensor: 1323 [06/20/2022-16:24:38] [V] [TRT] Add_765 [Add] outputs: [1323 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_766 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1318 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1323 [06/20/2022-16:24:38] [V] [TRT] Mul_766 [Mul] inputs: [1318 -> (-1, -1, 4096)[FLOAT]], [1323 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_766 for ONNX node: Mul_766 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1324 for ONNX tensor: 1324 [06/20/2022-16:24:38] [V] [TRT] Mul_766 [Mul] outputs: [1324 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_767 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_767 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_767 [Constant] outputs: [1325 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_768 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1324 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1325 [06/20/2022-16:24:38] [V] [TRT] Mul_768 [Mul] inputs: [1324 -> (-1, -1, 4096)[FLOAT]], [1325 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1325 for ONNX node: 1325 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_768 for ONNX node: Mul_768 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1326 for ONNX tensor: 1326 [06/20/2022-16:24:38] [V] [TRT] Mul_768 [Mul] outputs: [1326 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_769 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1326 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3278 [06/20/2022-16:24:38] [V] [TRT] MatMul_769 [MatMul] inputs: [1326 -> (-1, -1, 4096)[FLOAT]], [3278 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3278 for ONNX node: 3278 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_769 for ONNX node: MatMul_769 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1328 for ONNX tensor: 1328 [06/20/2022-16:24:38] [V] [TRT] MatMul_769 [MatMul] outputs: [1328 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_770 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1328 [06/20/2022-16:24:38] [V] [TRT] Add_770 [Add] inputs: [bert.encoder.layer.7.output.dense.bias -> (1024)[FLOAT]], [1328 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.output.dense.bias for ONNX node: bert.encoder.layer.7.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_770 for ONNX node: Add_770 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1329 for ONNX tensor: 1329 [06/20/2022-16:24:38] [V] [TRT] Add_770 [Add] outputs: [1329 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_771 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1329 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1315 [06/20/2022-16:24:38] [V] [TRT] Add_771 [Add] inputs: [1329 -> (-1, -1, 1024)[FLOAT]], [1315 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_771 for ONNX node: Add_771 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1330 for ONNX tensor: 1330 [06/20/2022-16:24:38] [V] [TRT] Add_771 [Add] outputs: [1330 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_772 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1330 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_772 [ReduceMean] inputs: [1330 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_772 for ONNX node: ReduceMean_772 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1331 for ONNX tensor: 1331 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_772 [ReduceMean] outputs: [1331 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_773 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1330 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1331 [06/20/2022-16:24:38] [V] [TRT] Sub_773 [Sub] inputs: [1330 -> (-1, -1, 1024)[FLOAT]], [1331 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_773 for ONNX node: Sub_773 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1332 for ONNX tensor: 1332 [06/20/2022-16:24:38] [V] [TRT] Sub_773 [Sub] outputs: [1332 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_774 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_774 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_774 [Constant] outputs: [1333 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_775 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1332 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1333 [06/20/2022-16:24:38] [V] [TRT] Pow_775 [Pow] inputs: [1332 -> (-1, -1, 1024)[FLOAT]], [1333 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1333 for ONNX node: 1333 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_775 for ONNX node: Pow_775 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1334 for ONNX tensor: 1334 [06/20/2022-16:24:38] [V] [TRT] Pow_775 [Pow] outputs: [1334 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_776 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1334 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_776 [ReduceMean] inputs: [1334 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_776 for ONNX node: ReduceMean_776 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1335 for ONNX tensor: 1335 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_776 [ReduceMean] outputs: [1335 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_777 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_777 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_777 [Constant] outputs: [1336 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_778 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1335 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1336 [06/20/2022-16:24:38] [V] [TRT] Add_778 [Add] inputs: [1335 -> (-1, -1, 1)[FLOAT]], [1336 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1336 for ONNX node: 1336 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_778 for ONNX node: Add_778 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1337 for ONNX tensor: 1337 [06/20/2022-16:24:38] [V] [TRT] Add_778 [Add] outputs: [1337 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_779 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1337 [06/20/2022-16:24:38] [V] [TRT] Sqrt_779 [Sqrt] inputs: [1337 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_779 for ONNX node: Sqrt_779 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1338 for ONNX tensor: 1338 [06/20/2022-16:24:38] [V] [TRT] Sqrt_779 [Sqrt] outputs: [1338 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_780 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1332 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1338 [06/20/2022-16:24:38] [V] [TRT] Div_780 [Div] inputs: [1332 -> (-1, -1, 1024)[FLOAT]], [1338 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_780 for ONNX node: Div_780 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1339 for ONNX tensor: 1339 [06/20/2022-16:24:38] [V] [TRT] Div_780 [Div] outputs: [1339 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_781 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1339 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_781 [Mul] inputs: [1339 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.7.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.output.LayerNorm.weight for ONNX node: bert.encoder.layer.7.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_781 for ONNX node: Mul_781 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1340 for ONNX tensor: 1340 [06/20/2022-16:24:38] [V] [TRT] Mul_781 [Mul] outputs: [1340 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_782 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1340 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.7.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_782 [Add] inputs: [1340 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.7.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.7.output.LayerNorm.bias for ONNX node: bert.encoder.layer.7.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_782 for ONNX node: Add_782 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1341 for ONNX tensor: 1341 [06/20/2022-16:24:38] [V] [TRT] Add_782 [Add] outputs: [1341 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_783 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1341 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3279 [06/20/2022-16:24:38] [V] [TRT] MatMul_783 [MatMul] inputs: [1341 -> (-1, -1, 1024)[FLOAT]], [3279 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3279 for ONNX node: 3279 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_783 for ONNX node: MatMul_783 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1343 for ONNX tensor: 1343 [06/20/2022-16:24:38] [V] [TRT] MatMul_783 [MatMul] outputs: [1343 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_784 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1343 [06/20/2022-16:24:38] [V] [TRT] Add_784 [Add] inputs: [bert.encoder.layer.8.attention.self.query.bias -> (1024)[FLOAT]], [1343 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.attention.self.query.bias for ONNX node: bert.encoder.layer.8.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_784 for ONNX node: Add_784 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1344 for ONNX tensor: 1344 [06/20/2022-16:24:38] [V] [TRT] Add_784 [Add] outputs: [1344 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_785 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1341 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3280 [06/20/2022-16:24:38] [V] [TRT] MatMul_785 [MatMul] inputs: [1341 -> (-1, -1, 1024)[FLOAT]], [3280 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3280 for ONNX node: 3280 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_785 for ONNX node: MatMul_785 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1346 for ONNX tensor: 1346 [06/20/2022-16:24:38] [V] [TRT] MatMul_785 [MatMul] outputs: [1346 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_786 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1346 [06/20/2022-16:24:38] [V] [TRT] Add_786 [Add] inputs: [bert.encoder.layer.8.attention.self.key.bias -> (1024)[FLOAT]], [1346 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.attention.self.key.bias for ONNX node: bert.encoder.layer.8.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_786 for ONNX node: Add_786 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1347 for ONNX tensor: 1347 [06/20/2022-16:24:38] [V] [TRT] Add_786 [Add] outputs: [1347 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_787 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1347 [06/20/2022-16:24:38] [V] [TRT] Shape_787 [Shape] inputs: [1347 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_787 for ONNX node: Shape_787 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1348 for ONNX tensor: 1348 [06/20/2022-16:24:38] [V] [TRT] Shape_787 [Shape] outputs: [1348 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_788 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_788 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_788 [Constant] outputs: [1349 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_789 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1348 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1349 [06/20/2022-16:24:38] [V] [TRT] Gather_789 [Gather] inputs: [1348 -> (3)[INT32]], [1349 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1349 for ONNX node: 1349 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_789 for ONNX node: Gather_789 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1350 for ONNX tensor: 1350 [06/20/2022-16:24:38] [V] [TRT] Gather_789 [Gather] outputs: [1350 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_790 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1347 [06/20/2022-16:24:38] [V] [TRT] Shape_790 [Shape] inputs: [1347 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_790 for ONNX node: Shape_790 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1351 for ONNX tensor: 1351 [06/20/2022-16:24:38] [V] [TRT] Shape_790 [Shape] outputs: [1351 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_791 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_791 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_791 [Constant] outputs: [1352 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_792 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1351 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1352 [06/20/2022-16:24:38] [V] [TRT] Gather_792 [Gather] inputs: [1351 -> (3)[INT32]], [1352 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1352 for ONNX node: 1352 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_792 for ONNX node: Gather_792 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1353 for ONNX tensor: 1353 [06/20/2022-16:24:38] [V] [TRT] Gather_792 [Gather] outputs: [1353 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_793 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1350 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_793 [Unsqueeze] inputs: [1350 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_793 for ONNX node: Unsqueeze_793 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1356 for ONNX tensor: 1356 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_793 [Unsqueeze] outputs: [1356 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_794 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1353 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_794 [Unsqueeze] inputs: [1353 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_794 for ONNX node: Unsqueeze_794 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1357 for ONNX tensor: 1357 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_794 [Unsqueeze] outputs: [1357 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_795 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1356 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1357 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3281 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3282 [06/20/2022-16:24:38] [V] [TRT] Concat_795 [Concat] inputs: [1356 -> (1)[INT32]], [1357 -> (1)[INT32]], [3281 -> (1)[INT32]], [3282 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3281 for ONNX node: 3281 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3282 for ONNX node: 3282 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_795 for ONNX node: Concat_795 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1360 for ONNX tensor: 1360 [06/20/2022-16:24:38] [V] [TRT] Concat_795 [Concat] outputs: [1360 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_796 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1347 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1360 [06/20/2022-16:24:38] [V] [TRT] Reshape_796 [Reshape] inputs: [1347 -> (-1, -1, 1024)[FLOAT]], [1360 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_796 for ONNX node: Reshape_796 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1361 for ONNX tensor: 1361 [06/20/2022-16:24:38] [V] [TRT] Reshape_796 [Reshape] outputs: [1361 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_797 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1341 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3283 [06/20/2022-16:24:38] [V] [TRT] MatMul_797 [MatMul] inputs: [1341 -> (-1, -1, 1024)[FLOAT]], [3283 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3283 for ONNX node: 3283 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_797 for ONNX node: MatMul_797 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1363 for ONNX tensor: 1363 [06/20/2022-16:24:38] [V] [TRT] MatMul_797 [MatMul] outputs: [1363 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_798 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1363 [06/20/2022-16:24:38] [V] [TRT] Add_798 [Add] inputs: [bert.encoder.layer.8.attention.self.value.bias -> (1024)[FLOAT]], [1363 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.attention.self.value.bias for ONNX node: bert.encoder.layer.8.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_798 for ONNX node: Add_798 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1364 for ONNX tensor: 1364 [06/20/2022-16:24:38] [V] [TRT] Add_798 [Add] outputs: [1364 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_799 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1364 [06/20/2022-16:24:38] [V] [TRT] Shape_799 [Shape] inputs: [1364 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_799 for ONNX node: Shape_799 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1365 for ONNX tensor: 1365 [06/20/2022-16:24:38] [V] [TRT] Shape_799 [Shape] outputs: [1365 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_800 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_800 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_800 [Constant] outputs: [1366 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_801 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1365 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1366 [06/20/2022-16:24:38] [V] [TRT] Gather_801 [Gather] inputs: [1365 -> (3)[INT32]], [1366 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1366 for ONNX node: 1366 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_801 for ONNX node: Gather_801 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1367 for ONNX tensor: 1367 [06/20/2022-16:24:38] [V] [TRT] Gather_801 [Gather] outputs: [1367 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_802 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1364 [06/20/2022-16:24:38] [V] [TRT] Shape_802 [Shape] inputs: [1364 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_802 for ONNX node: Shape_802 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1368 for ONNX tensor: 1368 [06/20/2022-16:24:38] [V] [TRT] Shape_802 [Shape] outputs: [1368 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_803 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_803 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_803 [Constant] outputs: [1369 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_804 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1368 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1369 [06/20/2022-16:24:38] [V] [TRT] Gather_804 [Gather] inputs: [1368 -> (3)[INT32]], [1369 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1369 for ONNX node: 1369 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_804 for ONNX node: Gather_804 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1370 for ONNX tensor: 1370 [06/20/2022-16:24:38] [V] [TRT] Gather_804 [Gather] outputs: [1370 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_805 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1367 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_805 [Unsqueeze] inputs: [1367 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_805 for ONNX node: Unsqueeze_805 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1373 for ONNX tensor: 1373 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_805 [Unsqueeze] outputs: [1373 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_806 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1370 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_806 [Unsqueeze] inputs: [1370 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_806 for ONNX node: Unsqueeze_806 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1374 for ONNX tensor: 1374 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_806 [Unsqueeze] outputs: [1374 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_807 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1373 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1374 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3284 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3285 [06/20/2022-16:24:38] [V] [TRT] Concat_807 [Concat] inputs: [1373 -> (1)[INT32]], [1374 -> (1)[INT32]], [3284 -> (1)[INT32]], [3285 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3284 for ONNX node: 3284 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3285 for ONNX node: 3285 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_807 for ONNX node: Concat_807 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1377 for ONNX tensor: 1377 [06/20/2022-16:24:38] [V] [TRT] Concat_807 [Concat] outputs: [1377 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_808 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1364 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1377 [06/20/2022-16:24:38] [V] [TRT] Reshape_808 [Reshape] inputs: [1364 -> (-1, -1, 1024)[FLOAT]], [1377 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_808 for ONNX node: Reshape_808 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1378 for ONNX tensor: 1378 [06/20/2022-16:24:38] [V] [TRT] Reshape_808 [Reshape] outputs: [1378 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_809 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1378 [06/20/2022-16:24:38] [V] [TRT] Transpose_809 [Transpose] inputs: [1378 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_809 for ONNX node: Transpose_809 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1379 for ONNX tensor: 1379 [06/20/2022-16:24:38] [V] [TRT] Transpose_809 [Transpose] outputs: [1379 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_810 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1344 [06/20/2022-16:24:38] [V] [TRT] Shape_810 [Shape] inputs: [1344 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_810 for ONNX node: Shape_810 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1380 for ONNX tensor: 1380 [06/20/2022-16:24:38] [V] [TRT] Shape_810 [Shape] outputs: [1380 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_811 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_811 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_811 [Constant] outputs: [1381 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_812 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1380 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1381 [06/20/2022-16:24:38] [V] [TRT] Gather_812 [Gather] inputs: [1380 -> (3)[INT32]], [1381 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1381 for ONNX node: 1381 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_812 for ONNX node: Gather_812 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1382 for ONNX tensor: 1382 [06/20/2022-16:24:38] [V] [TRT] Gather_812 [Gather] outputs: [1382 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_813 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1344 [06/20/2022-16:24:38] [V] [TRT] Shape_813 [Shape] inputs: [1344 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_813 for ONNX node: Shape_813 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1383 for ONNX tensor: 1383 [06/20/2022-16:24:38] [V] [TRT] Shape_813 [Shape] outputs: [1383 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_814 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_814 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_814 [Constant] outputs: [1384 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_815 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1383 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1384 [06/20/2022-16:24:38] [V] [TRT] Gather_815 [Gather] inputs: [1383 -> (3)[INT32]], [1384 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1384 for ONNX node: 1384 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_815 for ONNX node: Gather_815 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1385 for ONNX tensor: 1385 [06/20/2022-16:24:38] [V] [TRT] Gather_815 [Gather] outputs: [1385 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_816 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1382 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_816 [Unsqueeze] inputs: [1382 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_816 for ONNX node: Unsqueeze_816 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1388 for ONNX tensor: 1388 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_816 [Unsqueeze] outputs: [1388 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_817 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1385 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_817 [Unsqueeze] inputs: [1385 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_817 for ONNX node: Unsqueeze_817 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1389 for ONNX tensor: 1389 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_817 [Unsqueeze] outputs: [1389 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_818 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1388 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1389 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3286 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3287 [06/20/2022-16:24:38] [V] [TRT] Concat_818 [Concat] inputs: [1388 -> (1)[INT32]], [1389 -> (1)[INT32]], [3286 -> (1)[INT32]], [3287 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3286 for ONNX node: 3286 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3287 for ONNX node: 3287 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_818 for ONNX node: Concat_818 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1392 for ONNX tensor: 1392 [06/20/2022-16:24:38] [V] [TRT] Concat_818 [Concat] outputs: [1392 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_819 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1344 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1392 [06/20/2022-16:24:38] [V] [TRT] Reshape_819 [Reshape] inputs: [1344 -> (-1, -1, 1024)[FLOAT]], [1392 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_819 for ONNX node: Reshape_819 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1393 for ONNX tensor: 1393 [06/20/2022-16:24:38] [V] [TRT] Reshape_819 [Reshape] outputs: [1393 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_820 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1393 [06/20/2022-16:24:38] [V] [TRT] Transpose_820 [Transpose] inputs: [1393 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_820 for ONNX node: Transpose_820 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1394 for ONNX tensor: 1394 [06/20/2022-16:24:38] [V] [TRT] Transpose_820 [Transpose] outputs: [1394 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_821 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1361 [06/20/2022-16:24:38] [V] [TRT] Transpose_821 [Transpose] inputs: [1361 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_821 for ONNX node: Transpose_821 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1395 for ONNX tensor: 1395 [06/20/2022-16:24:38] [V] [TRT] Transpose_821 [Transpose] outputs: [1395 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_822 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1394 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1395 [06/20/2022-16:24:38] [V] [TRT] MatMul_822 [MatMul] inputs: [1394 -> (-1, 16, -1, 64)[FLOAT]], [1395 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_822 for ONNX node: MatMul_822 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1396 for ONNX tensor: 1396 [06/20/2022-16:24:38] [V] [TRT] MatMul_822 [MatMul] outputs: [1396 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_823 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_823 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_823 [Constant] outputs: [1397 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_824 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1396 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1397 [06/20/2022-16:24:38] [V] [TRT] Div_824 [Div] inputs: [1396 -> (-1, 16, -1, -1)[FLOAT]], [1397 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1397 for ONNX node: 1397 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_824 for ONNX node: Div_824 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1398 for ONNX tensor: 1398 [06/20/2022-16:24:38] [V] [TRT] Div_824 [Div] outputs: [1398 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_825 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1398 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:38] [V] [TRT] Add_825 [Add] inputs: [1398 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_825 for ONNX node: Add_825 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1399 for ONNX tensor: 1399 [06/20/2022-16:24:38] [V] [TRT] Add_825 [Add] outputs: [1399 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Softmax_826 [Softmax] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1399 [06/20/2022-16:24:38] [V] [TRT] Softmax_826 [Softmax] inputs: [1399 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Softmax_826 for ONNX node: Softmax_826 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1400 for ONNX tensor: 1400 [06/20/2022-16:24:38] [V] [TRT] Softmax_826 [Softmax] outputs: [1400 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_827 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1400 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1379 [06/20/2022-16:24:38] [V] [TRT] MatMul_827 [MatMul] inputs: [1400 -> (-1, 16, -1, -1)[FLOAT]], [1379 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_827 for ONNX node: MatMul_827 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1401 for ONNX tensor: 1401 [06/20/2022-16:24:38] [V] [TRT] MatMul_827 [MatMul] outputs: [1401 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Transpose_828 [Transpose] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1401 [06/20/2022-16:24:38] [V] [TRT] Transpose_828 [Transpose] inputs: [1401 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Transpose_828 for ONNX node: Transpose_828 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1402 for ONNX tensor: 1402 [06/20/2022-16:24:38] [V] [TRT] Transpose_828 [Transpose] outputs: [1402 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_829 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1402 [06/20/2022-16:24:38] [V] [TRT] Shape_829 [Shape] inputs: [1402 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_829 for ONNX node: Shape_829 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1403 for ONNX tensor: 1403 [06/20/2022-16:24:38] [V] [TRT] Shape_829 [Shape] outputs: [1403 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_830 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_830 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_830 [Constant] outputs: [1404 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_831 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1403 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1404 [06/20/2022-16:24:38] [V] [TRT] Gather_831 [Gather] inputs: [1403 -> (4)[INT32]], [1404 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1404 for ONNX node: 1404 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_831 for ONNX node: Gather_831 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1405 for ONNX tensor: 1405 [06/20/2022-16:24:38] [V] [TRT] Gather_831 [Gather] outputs: [1405 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_832 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1402 [06/20/2022-16:24:38] [V] [TRT] Shape_832 [Shape] inputs: [1402 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_832 for ONNX node: Shape_832 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1406 for ONNX tensor: 1406 [06/20/2022-16:24:38] [V] [TRT] Shape_832 [Shape] outputs: [1406 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_833 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_833 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_833 [Constant] outputs: [1407 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_834 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1406 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1407 [06/20/2022-16:24:38] [V] [TRT] Gather_834 [Gather] inputs: [1406 -> (4)[INT32]], [1407 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1407 for ONNX node: 1407 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_834 for ONNX node: Gather_834 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1408 for ONNX tensor: 1408 [06/20/2022-16:24:38] [V] [TRT] Gather_834 [Gather] outputs: [1408 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_835 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1405 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_835 [Unsqueeze] inputs: [1405 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_835 for ONNX node: Unsqueeze_835 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1410 for ONNX tensor: 1410 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_835 [Unsqueeze] outputs: [1410 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_836 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1408 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_836 [Unsqueeze] inputs: [1408 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_836 for ONNX node: Unsqueeze_836 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1411 for ONNX tensor: 1411 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_836 [Unsqueeze] outputs: [1411 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_837 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1410 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1411 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3288 [06/20/2022-16:24:38] [V] [TRT] Concat_837 [Concat] inputs: [1410 -> (1)[INT32]], [1411 -> (1)[INT32]], [3288 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3288 for ONNX node: 3288 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_837 for ONNX node: Concat_837 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1413 for ONNX tensor: 1413 [06/20/2022-16:24:38] [V] [TRT] Concat_837 [Concat] outputs: [1413 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_838 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1402 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1413 [06/20/2022-16:24:38] [V] [TRT] Reshape_838 [Reshape] inputs: [1402 -> (-1, -1, 16, 64)[FLOAT]], [1413 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_838 for ONNX node: Reshape_838 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1414 for ONNX tensor: 1414 [06/20/2022-16:24:38] [V] [TRT] Reshape_838 [Reshape] outputs: [1414 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_839 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1414 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3289 [06/20/2022-16:24:38] [V] [TRT] MatMul_839 [MatMul] inputs: [1414 -> (-1, -1, 1024)[FLOAT]], [3289 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3289 for ONNX node: 3289 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_839 for ONNX node: MatMul_839 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1416 for ONNX tensor: 1416 [06/20/2022-16:24:38] [V] [TRT] MatMul_839 [MatMul] outputs: [1416 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_840 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1416 [06/20/2022-16:24:38] [V] [TRT] Add_840 [Add] inputs: [bert.encoder.layer.8.attention.output.dense.bias -> (1024)[FLOAT]], [1416 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.attention.output.dense.bias for ONNX node: bert.encoder.layer.8.attention.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_840 for ONNX node: Add_840 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1417 for ONNX tensor: 1417 [06/20/2022-16:24:38] [V] [TRT] Add_840 [Add] outputs: [1417 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_841 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1417 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1341 [06/20/2022-16:24:38] [V] [TRT] Add_841 [Add] inputs: [1417 -> (-1, -1, 1024)[FLOAT]], [1341 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_841 for ONNX node: Add_841 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1418 for ONNX tensor: 1418 [06/20/2022-16:24:38] [V] [TRT] Add_841 [Add] outputs: [1418 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_842 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1418 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_842 [ReduceMean] inputs: [1418 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_842 for ONNX node: ReduceMean_842 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1419 for ONNX tensor: 1419 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_842 [ReduceMean] outputs: [1419 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_843 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1418 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1419 [06/20/2022-16:24:38] [V] [TRT] Sub_843 [Sub] inputs: [1418 -> (-1, -1, 1024)[FLOAT]], [1419 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_843 for ONNX node: Sub_843 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1420 for ONNX tensor: 1420 [06/20/2022-16:24:38] [V] [TRT] Sub_843 [Sub] outputs: [1420 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_844 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_844 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_844 [Constant] outputs: [1421 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_845 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1420 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1421 [06/20/2022-16:24:38] [V] [TRT] Pow_845 [Pow] inputs: [1420 -> (-1, -1, 1024)[FLOAT]], [1421 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1421 for ONNX node: 1421 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_845 for ONNX node: Pow_845 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1422 for ONNX tensor: 1422 [06/20/2022-16:24:38] [V] [TRT] Pow_845 [Pow] outputs: [1422 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_846 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1422 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_846 [ReduceMean] inputs: [1422 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_846 for ONNX node: ReduceMean_846 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1423 for ONNX tensor: 1423 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_846 [ReduceMean] outputs: [1423 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_847 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_847 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_847 [Constant] outputs: [1424 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_848 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1423 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1424 [06/20/2022-16:24:38] [V] [TRT] Add_848 [Add] inputs: [1423 -> (-1, -1, 1)[FLOAT]], [1424 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1424 for ONNX node: 1424 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_848 for ONNX node: Add_848 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1425 for ONNX tensor: 1425 [06/20/2022-16:24:38] [V] [TRT] Add_848 [Add] outputs: [1425 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_849 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1425 [06/20/2022-16:24:38] [V] [TRT] Sqrt_849 [Sqrt] inputs: [1425 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_849 for ONNX node: Sqrt_849 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1426 for ONNX tensor: 1426 [06/20/2022-16:24:38] [V] [TRT] Sqrt_849 [Sqrt] outputs: [1426 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_850 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1420 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1426 [06/20/2022-16:24:38] [V] [TRT] Div_850 [Div] inputs: [1420 -> (-1, -1, 1024)[FLOAT]], [1426 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_850 for ONNX node: Div_850 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1427 for ONNX tensor: 1427 [06/20/2022-16:24:38] [V] [TRT] Div_850 [Div] outputs: [1427 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_851 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1427 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_851 [Mul] inputs: [1427 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.8.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.8.attention.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_851 for ONNX node: Mul_851 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1428 for ONNX tensor: 1428 [06/20/2022-16:24:38] [V] [TRT] Mul_851 [Mul] outputs: [1428 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_852 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1428 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_852 [Add] inputs: [1428 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.8.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.8.attention.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_852 for ONNX node: Add_852 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1429 for ONNX tensor: 1429 [06/20/2022-16:24:38] [V] [TRT] Add_852 [Add] outputs: [1429 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_853 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1429 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3290 [06/20/2022-16:24:38] [V] [TRT] MatMul_853 [MatMul] inputs: [1429 -> (-1, -1, 1024)[FLOAT]], [3290 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3290 for ONNX node: 3290 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_853 for ONNX node: MatMul_853 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1431 for ONNX tensor: 1431 [06/20/2022-16:24:38] [V] [TRT] MatMul_853 [MatMul] outputs: [1431 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_854 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1431 [06/20/2022-16:24:38] [V] [TRT] Add_854 [Add] inputs: [bert.encoder.layer.8.intermediate.dense.bias -> (4096)[FLOAT]], [1431 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.intermediate.dense.bias for ONNX node: bert.encoder.layer.8.intermediate.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_854 for ONNX node: Add_854 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1432 for ONNX tensor: 1432 [06/20/2022-16:24:38] [V] [TRT] Add_854 [Add] outputs: [1432 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_855 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_855 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_855 [Constant] outputs: [1433 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_856 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1432 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1433 [06/20/2022-16:24:38] [V] [TRT] Div_856 [Div] inputs: [1432 -> (-1, -1, 4096)[FLOAT]], [1433 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1433 for ONNX node: 1433 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_856 for ONNX node: Div_856 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1434 for ONNX tensor: 1434 [06/20/2022-16:24:38] [V] [TRT] Div_856 [Div] outputs: [1434 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Erf_857 [Erf] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1434 [06/20/2022-16:24:38] [V] [TRT] Erf_857 [Erf] inputs: [1434 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Erf_857 for ONNX node: Erf_857 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1435 for ONNX tensor: 1435 [06/20/2022-16:24:38] [V] [TRT] Erf_857 [Erf] outputs: [1435 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_858 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_858 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_858 [Constant] outputs: [1436 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_859 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1435 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1436 [06/20/2022-16:24:38] [V] [TRT] Add_859 [Add] inputs: [1435 -> (-1, -1, 4096)[FLOAT]], [1436 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1436 for ONNX node: 1436 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_859 for ONNX node: Add_859 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1437 for ONNX tensor: 1437 [06/20/2022-16:24:38] [V] [TRT] Add_859 [Add] outputs: [1437 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_860 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1432 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1437 [06/20/2022-16:24:38] [V] [TRT] Mul_860 [Mul] inputs: [1432 -> (-1, -1, 4096)[FLOAT]], [1437 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_860 for ONNX node: Mul_860 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1438 for ONNX tensor: 1438 [06/20/2022-16:24:38] [V] [TRT] Mul_860 [Mul] outputs: [1438 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_861 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_861 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_861 [Constant] outputs: [1439 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_862 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1438 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1439 [06/20/2022-16:24:38] [V] [TRT] Mul_862 [Mul] inputs: [1438 -> (-1, -1, 4096)[FLOAT]], [1439 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1439 for ONNX node: 1439 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_862 for ONNX node: Mul_862 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1440 for ONNX tensor: 1440 [06/20/2022-16:24:38] [V] [TRT] Mul_862 [Mul] outputs: [1440 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_863 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1440 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3291 [06/20/2022-16:24:38] [V] [TRT] MatMul_863 [MatMul] inputs: [1440 -> (-1, -1, 4096)[FLOAT]], [3291 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3291 for ONNX node: 3291 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_863 for ONNX node: MatMul_863 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1442 for ONNX tensor: 1442 [06/20/2022-16:24:38] [V] [TRT] MatMul_863 [MatMul] outputs: [1442 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_864 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1442 [06/20/2022-16:24:38] [V] [TRT] Add_864 [Add] inputs: [bert.encoder.layer.8.output.dense.bias -> (1024)[FLOAT]], [1442 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.output.dense.bias for ONNX node: bert.encoder.layer.8.output.dense.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_864 for ONNX node: Add_864 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1443 for ONNX tensor: 1443 [06/20/2022-16:24:38] [V] [TRT] Add_864 [Add] outputs: [1443 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_865 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1443 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1429 [06/20/2022-16:24:38] [V] [TRT] Add_865 [Add] inputs: [1443 -> (-1, -1, 1024)[FLOAT]], [1429 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_865 for ONNX node: Add_865 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1444 for ONNX tensor: 1444 [06/20/2022-16:24:38] [V] [TRT] Add_865 [Add] outputs: [1444 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_866 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1444 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_866 [ReduceMean] inputs: [1444 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_866 for ONNX node: ReduceMean_866 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1445 for ONNX tensor: 1445 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_866 [ReduceMean] outputs: [1445 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sub_867 [Sub] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1444 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1445 [06/20/2022-16:24:38] [V] [TRT] Sub_867 [Sub] inputs: [1444 -> (-1, -1, 1024)[FLOAT]], [1445 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sub_867 for ONNX node: Sub_867 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1446 for ONNX tensor: 1446 [06/20/2022-16:24:38] [V] [TRT] Sub_867 [Sub] outputs: [1446 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_868 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_868 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_868 [Constant] outputs: [1447 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Pow_869 [Pow] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1446 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1447 [06/20/2022-16:24:38] [V] [TRT] Pow_869 [Pow] inputs: [1446 -> (-1, -1, 1024)[FLOAT]], [1447 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1447 for ONNX node: 1447 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Pow_869 for ONNX node: Pow_869 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1448 for ONNX tensor: 1448 [06/20/2022-16:24:38] [V] [TRT] Pow_869 [Pow] outputs: [1448 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: ReduceMean_870 [ReduceMean] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1448 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_870 [ReduceMean] inputs: [1448 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: ReduceMean_870 for ONNX node: ReduceMean_870 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1449 for ONNX tensor: 1449 [06/20/2022-16:24:38] [V] [TRT] ReduceMean_870 [ReduceMean] outputs: [1449 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_871 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_871 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_871 [Constant] outputs: [1450 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_872 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1449 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1450 [06/20/2022-16:24:38] [V] [TRT] Add_872 [Add] inputs: [1449 -> (-1, -1, 1)[FLOAT]], [1450 -> ()[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1450 for ONNX node: 1450 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_872 for ONNX node: Add_872 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1451 for ONNX tensor: 1451 [06/20/2022-16:24:38] [V] [TRT] Add_872 [Add] outputs: [1451 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Sqrt_873 [Sqrt] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1451 [06/20/2022-16:24:38] [V] [TRT] Sqrt_873 [Sqrt] inputs: [1451 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Sqrt_873 for ONNX node: Sqrt_873 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1452 for ONNX tensor: 1452 [06/20/2022-16:24:38] [V] [TRT] Sqrt_873 [Sqrt] outputs: [1452 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Div_874 [Div] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1446 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1452 [06/20/2022-16:24:38] [V] [TRT] Div_874 [Div] inputs: [1446 -> (-1, -1, 1024)[FLOAT]], [1452 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Div_874 for ONNX node: Div_874 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1453 for ONNX tensor: 1453 [06/20/2022-16:24:38] [V] [TRT] Div_874 [Div] outputs: [1453 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Mul_875 [Mul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1453 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Mul_875 [Mul] inputs: [1453 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.8.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.output.LayerNorm.weight for ONNX node: bert.encoder.layer.8.output.LayerNorm.weight [06/20/2022-16:24:38] [V] [TRT] Registering layer: Mul_875 for ONNX node: Mul_875 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1454 for ONNX tensor: 1454 [06/20/2022-16:24:38] [V] [TRT] Mul_875 [Mul] outputs: [1454 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_876 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1454 [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.8.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Add_876 [Add] inputs: [1454 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.8.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.8.output.LayerNorm.bias for ONNX node: bert.encoder.layer.8.output.LayerNorm.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_876 for ONNX node: Add_876 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1455 for ONNX tensor: 1455 [06/20/2022-16:24:38] [V] [TRT] Add_876 [Add] outputs: [1455 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_877 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1455 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3292 [06/20/2022-16:24:38] [V] [TRT] MatMul_877 [MatMul] inputs: [1455 -> (-1, -1, 1024)[FLOAT]], [3292 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3292 for ONNX node: 3292 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_877 for ONNX node: MatMul_877 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1457 for ONNX tensor: 1457 [06/20/2022-16:24:38] [V] [TRT] MatMul_877 [MatMul] outputs: [1457 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_878 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.9.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1457 [06/20/2022-16:24:38] [V] [TRT] Add_878 [Add] inputs: [bert.encoder.layer.9.attention.self.query.bias -> (1024)[FLOAT]], [1457 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.9.attention.self.query.bias for ONNX node: bert.encoder.layer.9.attention.self.query.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_878 for ONNX node: Add_878 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1458 for ONNX tensor: 1458 [06/20/2022-16:24:38] [V] [TRT] Add_878 [Add] outputs: [1458 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_879 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1455 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3293 [06/20/2022-16:24:38] [V] [TRT] MatMul_879 [MatMul] inputs: [1455 -> (-1, -1, 1024)[FLOAT]], [3293 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3293 for ONNX node: 3293 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_879 for ONNX node: MatMul_879 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1460 for ONNX tensor: 1460 [06/20/2022-16:24:38] [V] [TRT] MatMul_879 [MatMul] outputs: [1460 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_880 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.9.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1460 [06/20/2022-16:24:38] [V] [TRT] Add_880 [Add] inputs: [bert.encoder.layer.9.attention.self.key.bias -> (1024)[FLOAT]], [1460 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.9.attention.self.key.bias for ONNX node: bert.encoder.layer.9.attention.self.key.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_880 for ONNX node: Add_880 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1461 for ONNX tensor: 1461 [06/20/2022-16:24:38] [V] [TRT] Add_880 [Add] outputs: [1461 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_881 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1461 [06/20/2022-16:24:38] [V] [TRT] Shape_881 [Shape] inputs: [1461 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_881 for ONNX node: Shape_881 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1462 for ONNX tensor: 1462 [06/20/2022-16:24:38] [V] [TRT] Shape_881 [Shape] outputs: [1462 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_882 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_882 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_882 [Constant] outputs: [1463 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_883 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1462 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1463 [06/20/2022-16:24:38] [V] [TRT] Gather_883 [Gather] inputs: [1462 -> (3)[INT32]], [1463 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1463 for ONNX node: 1463 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_883 for ONNX node: Gather_883 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1464 for ONNX tensor: 1464 [06/20/2022-16:24:38] [V] [TRT] Gather_883 [Gather] outputs: [1464 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_884 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1461 [06/20/2022-16:24:38] [V] [TRT] Shape_884 [Shape] inputs: [1461 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_884 for ONNX node: Shape_884 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1465 for ONNX tensor: 1465 [06/20/2022-16:24:38] [V] [TRT] Shape_884 [Shape] outputs: [1465 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_885 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_885 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_885 [Constant] outputs: [1466 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_886 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1465 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1466 [06/20/2022-16:24:38] [V] [TRT] Gather_886 [Gather] inputs: [1465 -> (3)[INT32]], [1466 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1466 for ONNX node: 1466 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_886 for ONNX node: Gather_886 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1467 for ONNX tensor: 1467 [06/20/2022-16:24:38] [V] [TRT] Gather_886 [Gather] outputs: [1467 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_887 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1464 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_887 [Unsqueeze] inputs: [1464 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_887 for ONNX node: Unsqueeze_887 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1470 for ONNX tensor: 1470 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_887 [Unsqueeze] outputs: [1470 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_888 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1467 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_888 [Unsqueeze] inputs: [1467 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_888 for ONNX node: Unsqueeze_888 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1471 for ONNX tensor: 1471 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_888 [Unsqueeze] outputs: [1471 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_889 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1470 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1471 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3294 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3295 [06/20/2022-16:24:38] [V] [TRT] Concat_889 [Concat] inputs: [1470 -> (1)[INT32]], [1471 -> (1)[INT32]], [3294 -> (1)[INT32]], [3295 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3294 for ONNX node: 3294 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3295 for ONNX node: 3295 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_889 for ONNX node: Concat_889 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1474 for ONNX tensor: 1474 [06/20/2022-16:24:38] [V] [TRT] Concat_889 [Concat] outputs: [1474 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Reshape_890 [Reshape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1461 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1474 [06/20/2022-16:24:38] [V] [TRT] Reshape_890 [Reshape] inputs: [1461 -> (-1, -1, 1024)[FLOAT]], [1474 -> (4)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Reshape_890 for ONNX node: Reshape_890 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1475 for ONNX tensor: 1475 [06/20/2022-16:24:38] [V] [TRT] Reshape_890 [Reshape] outputs: [1475 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: MatMul_891 [MatMul] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1455 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3296 [06/20/2022-16:24:38] [V] [TRT] MatMul_891 [MatMul] inputs: [1455 -> (-1, -1, 1024)[FLOAT]], [3296 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3296 for ONNX node: 3296 [06/20/2022-16:24:38] [V] [TRT] Registering layer: MatMul_891 for ONNX node: MatMul_891 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1477 for ONNX tensor: 1477 [06/20/2022-16:24:38] [V] [TRT] MatMul_891 [MatMul] outputs: [1477 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Add_892 [Add] [06/20/2022-16:24:38] [V] [TRT] Searching for input: bert.encoder.layer.9.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1477 [06/20/2022-16:24:38] [V] [TRT] Add_892 [Add] inputs: [bert.encoder.layer.9.attention.self.value.bias -> (1024)[FLOAT]], [1477 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: bert.encoder.layer.9.attention.self.value.bias for ONNX node: bert.encoder.layer.9.attention.self.value.bias [06/20/2022-16:24:38] [V] [TRT] Registering layer: Add_892 for ONNX node: Add_892 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1478 for ONNX tensor: 1478 [06/20/2022-16:24:38] [V] [TRT] Add_892 [Add] outputs: [1478 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_893 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1478 [06/20/2022-16:24:38] [V] [TRT] Shape_893 [Shape] inputs: [1478 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_893 for ONNX node: Shape_893 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1479 for ONNX tensor: 1479 [06/20/2022-16:24:38] [V] [TRT] Shape_893 [Shape] outputs: [1479 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_894 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_894 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_894 [Constant] outputs: [1480 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_895 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1479 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1480 [06/20/2022-16:24:38] [V] [TRT] Gather_895 [Gather] inputs: [1479 -> (3)[INT32]], [1480 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1480 for ONNX node: 1480 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_895 for ONNX node: Gather_895 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1481 for ONNX tensor: 1481 [06/20/2022-16:24:38] [V] [TRT] Gather_895 [Gather] outputs: [1481 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Shape_896 [Shape] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1478 [06/20/2022-16:24:38] [V] [TRT] Shape_896 [Shape] inputs: [1478 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: Shape_896 for ONNX node: Shape_896 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1482 for ONNX tensor: 1482 [06/20/2022-16:24:38] [V] [TRT] Shape_896 [Shape] outputs: [1482 -> (3)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Constant_897 [Constant] [06/20/2022-16:24:38] [V] [TRT] Constant_897 [Constant] inputs: [06/20/2022-16:24:38] [V] [TRT] Constant_897 [Constant] outputs: [1483 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Gather_898 [Gather] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1482 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1483 [06/20/2022-16:24:38] [V] [TRT] Gather_898 [Gather] inputs: [1482 -> (3)[INT32]], [1483 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 1483 for ONNX node: 1483 [06/20/2022-16:24:38] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Gather_898 for ONNX node: Gather_898 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1484 for ONNX tensor: 1484 [06/20/2022-16:24:38] [V] [TRT] Gather_898 [Gather] outputs: [1484 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_899 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1481 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_899 [Unsqueeze] inputs: [1481 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_899 for ONNX node: Unsqueeze_899 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1487 for ONNX tensor: 1487 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_899 [Unsqueeze] outputs: [1487 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Unsqueeze_900 [Unsqueeze] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1484 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_900 [Unsqueeze] inputs: [1484 -> ()[INT32]], [06/20/2022-16:24:38] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:38] [V] [TRT] Registering layer: Unsqueeze_900 for ONNX node: Unsqueeze_900 [06/20/2022-16:24:38] [V] [TRT] Registering tensor: 1488 for ONNX tensor: 1488 [06/20/2022-16:24:38] [V] [TRT] Unsqueeze_900 [Unsqueeze] outputs: [1488 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Parsing node: Concat_901 [Concat] [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1487 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 1488 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3297 [06/20/2022-16:24:38] [V] [TRT] Searching for input: 3298 [06/20/2022-16:24:38] [V] [TRT] Concat_901 [Concat] inputs: [1487 -> (1)[INT32]], [1488 -> (1)[INT32]], [3297 -> (1)[INT32]], [3298 -> (1)[INT32]], [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3297 for ONNX node: 3297 [06/20/2022-16:24:38] [V] [TRT] Registering layer: 3298 for ONNX node: 3298 [06/20/2022-16:24:38] [V] [TRT] Registering layer: Concat_901 for ONNX node: Concat_901 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1491 for ONNX tensor: 1491 [06/20/2022-16:24:39] [V] [TRT] Concat_901 [Concat] outputs: [1491 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_902 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1478 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1491 [06/20/2022-16:24:39] [V] [TRT] Reshape_902 [Reshape] inputs: [1478 -> (-1, -1, 1024)[FLOAT]], [1491 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_902 for ONNX node: Reshape_902 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1492 for ONNX tensor: 1492 [06/20/2022-16:24:39] [V] [TRT] Reshape_902 [Reshape] outputs: [1492 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_903 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1492 [06/20/2022-16:24:39] [V] [TRT] Transpose_903 [Transpose] inputs: [1492 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_903 for ONNX node: Transpose_903 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1493 for ONNX tensor: 1493 [06/20/2022-16:24:39] [V] [TRT] Transpose_903 [Transpose] outputs: [1493 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_904 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1458 [06/20/2022-16:24:39] [V] [TRT] Shape_904 [Shape] inputs: [1458 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_904 for ONNX node: Shape_904 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1494 for ONNX tensor: 1494 [06/20/2022-16:24:39] [V] [TRT] Shape_904 [Shape] outputs: [1494 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_905 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_905 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_905 [Constant] outputs: [1495 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_906 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1494 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1495 [06/20/2022-16:24:39] [V] [TRT] Gather_906 [Gather] inputs: [1494 -> (3)[INT32]], [1495 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1495 for ONNX node: 1495 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_906 for ONNX node: Gather_906 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1496 for ONNX tensor: 1496 [06/20/2022-16:24:39] [V] [TRT] Gather_906 [Gather] outputs: [1496 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_907 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1458 [06/20/2022-16:24:39] [V] [TRT] Shape_907 [Shape] inputs: [1458 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_907 for ONNX node: Shape_907 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1497 for ONNX tensor: 1497 [06/20/2022-16:24:39] [V] [TRT] Shape_907 [Shape] outputs: [1497 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_908 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_908 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_908 [Constant] outputs: [1498 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_909 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1497 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1498 [06/20/2022-16:24:39] [V] [TRT] Gather_909 [Gather] inputs: [1497 -> (3)[INT32]], [1498 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1498 for ONNX node: 1498 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_909 for ONNX node: Gather_909 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1499 for ONNX tensor: 1499 [06/20/2022-16:24:39] [V] [TRT] Gather_909 [Gather] outputs: [1499 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_910 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1496 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_910 [Unsqueeze] inputs: [1496 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_910 for ONNX node: Unsqueeze_910 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1502 for ONNX tensor: 1502 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_910 [Unsqueeze] outputs: [1502 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_911 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1499 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_911 [Unsqueeze] inputs: [1499 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_911 for ONNX node: Unsqueeze_911 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1503 for ONNX tensor: 1503 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_911 [Unsqueeze] outputs: [1503 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_912 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1502 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1503 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3299 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3300 [06/20/2022-16:24:39] [V] [TRT] Concat_912 [Concat] inputs: [1502 -> (1)[INT32]], [1503 -> (1)[INT32]], [3299 -> (1)[INT32]], [3300 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3299 for ONNX node: 3299 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3300 for ONNX node: 3300 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_912 for ONNX node: Concat_912 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1506 for ONNX tensor: 1506 [06/20/2022-16:24:39] [V] [TRT] Concat_912 [Concat] outputs: [1506 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_913 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1458 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1506 [06/20/2022-16:24:39] [V] [TRT] Reshape_913 [Reshape] inputs: [1458 -> (-1, -1, 1024)[FLOAT]], [1506 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_913 for ONNX node: Reshape_913 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1507 for ONNX tensor: 1507 [06/20/2022-16:24:39] [V] [TRT] Reshape_913 [Reshape] outputs: [1507 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_914 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1507 [06/20/2022-16:24:39] [V] [TRT] Transpose_914 [Transpose] inputs: [1507 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_914 for ONNX node: Transpose_914 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1508 for ONNX tensor: 1508 [06/20/2022-16:24:39] [V] [TRT] Transpose_914 [Transpose] outputs: [1508 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_915 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1475 [06/20/2022-16:24:39] [V] [TRT] Transpose_915 [Transpose] inputs: [1475 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_915 for ONNX node: Transpose_915 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1509 for ONNX tensor: 1509 [06/20/2022-16:24:39] [V] [TRT] Transpose_915 [Transpose] outputs: [1509 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_916 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1508 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1509 [06/20/2022-16:24:39] [V] [TRT] MatMul_916 [MatMul] inputs: [1508 -> (-1, 16, -1, 64)[FLOAT]], [1509 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_916 for ONNX node: MatMul_916 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1510 for ONNX tensor: 1510 [06/20/2022-16:24:39] [V] [TRT] MatMul_916 [MatMul] outputs: [1510 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_917 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_917 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_917 [Constant] outputs: [1511 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_918 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1510 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1511 [06/20/2022-16:24:39] [V] [TRT] Div_918 [Div] inputs: [1510 -> (-1, 16, -1, -1)[FLOAT]], [1511 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1511 for ONNX node: 1511 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_918 for ONNX node: Div_918 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1512 for ONNX tensor: 1512 [06/20/2022-16:24:39] [V] [TRT] Div_918 [Div] outputs: [1512 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_919 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1512 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:39] [V] [TRT] Add_919 [Add] inputs: [1512 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_919 for ONNX node: Add_919 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1513 for ONNX tensor: 1513 [06/20/2022-16:24:39] [V] [TRT] Add_919 [Add] outputs: [1513 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Softmax_920 [Softmax] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1513 [06/20/2022-16:24:39] [V] [TRT] Softmax_920 [Softmax] inputs: [1513 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Softmax_920 for ONNX node: Softmax_920 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1514 for ONNX tensor: 1514 [06/20/2022-16:24:39] [V] [TRT] Softmax_920 [Softmax] outputs: [1514 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_921 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1514 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1493 [06/20/2022-16:24:39] [V] [TRT] MatMul_921 [MatMul] inputs: [1514 -> (-1, 16, -1, -1)[FLOAT]], [1493 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_921 for ONNX node: MatMul_921 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1515 for ONNX tensor: 1515 [06/20/2022-16:24:39] [V] [TRT] MatMul_921 [MatMul] outputs: [1515 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_922 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1515 [06/20/2022-16:24:39] [V] [TRT] Transpose_922 [Transpose] inputs: [1515 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_922 for ONNX node: Transpose_922 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1516 for ONNX tensor: 1516 [06/20/2022-16:24:39] [V] [TRT] Transpose_922 [Transpose] outputs: [1516 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_923 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1516 [06/20/2022-16:24:39] [V] [TRT] Shape_923 [Shape] inputs: [1516 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_923 for ONNX node: Shape_923 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1517 for ONNX tensor: 1517 [06/20/2022-16:24:39] [V] [TRT] Shape_923 [Shape] outputs: [1517 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_924 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_924 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_924 [Constant] outputs: [1518 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_925 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1517 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1518 [06/20/2022-16:24:39] [V] [TRT] Gather_925 [Gather] inputs: [1517 -> (4)[INT32]], [1518 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1518 for ONNX node: 1518 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_925 for ONNX node: Gather_925 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1519 for ONNX tensor: 1519 [06/20/2022-16:24:39] [V] [TRT] Gather_925 [Gather] outputs: [1519 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_926 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1516 [06/20/2022-16:24:39] [V] [TRT] Shape_926 [Shape] inputs: [1516 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_926 for ONNX node: Shape_926 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1520 for ONNX tensor: 1520 [06/20/2022-16:24:39] [V] [TRT] Shape_926 [Shape] outputs: [1520 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_927 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_927 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_927 [Constant] outputs: [1521 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_928 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1520 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1521 [06/20/2022-16:24:39] [V] [TRT] Gather_928 [Gather] inputs: [1520 -> (4)[INT32]], [1521 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1521 for ONNX node: 1521 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_928 for ONNX node: Gather_928 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1522 for ONNX tensor: 1522 [06/20/2022-16:24:39] [V] [TRT] Gather_928 [Gather] outputs: [1522 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_929 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1519 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_929 [Unsqueeze] inputs: [1519 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_929 for ONNX node: Unsqueeze_929 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1524 for ONNX tensor: 1524 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_929 [Unsqueeze] outputs: [1524 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_930 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1522 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_930 [Unsqueeze] inputs: [1522 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_930 for ONNX node: Unsqueeze_930 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1525 for ONNX tensor: 1525 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_930 [Unsqueeze] outputs: [1525 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_931 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1524 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1525 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3301 [06/20/2022-16:24:39] [V] [TRT] Concat_931 [Concat] inputs: [1524 -> (1)[INT32]], [1525 -> (1)[INT32]], [3301 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3301 for ONNX node: 3301 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_931 for ONNX node: Concat_931 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1527 for ONNX tensor: 1527 [06/20/2022-16:24:39] [V] [TRT] Concat_931 [Concat] outputs: [1527 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_932 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1516 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1527 [06/20/2022-16:24:39] [V] [TRT] Reshape_932 [Reshape] inputs: [1516 -> (-1, -1, 16, 64)[FLOAT]], [1527 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_932 for ONNX node: Reshape_932 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1528 for ONNX tensor: 1528 [06/20/2022-16:24:39] [V] [TRT] Reshape_932 [Reshape] outputs: [1528 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_933 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1528 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3302 [06/20/2022-16:24:39] [V] [TRT] MatMul_933 [MatMul] inputs: [1528 -> (-1, -1, 1024)[FLOAT]], [3302 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3302 for ONNX node: 3302 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_933 for ONNX node: MatMul_933 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1530 for ONNX tensor: 1530 [06/20/2022-16:24:39] [V] [TRT] MatMul_933 [MatMul] outputs: [1530 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_934 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.attention.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1530 [06/20/2022-16:24:39] [V] [TRT] Add_934 [Add] inputs: [bert.encoder.layer.9.attention.output.dense.bias -> (1024)[FLOAT]], [1530 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.attention.output.dense.bias for ONNX node: bert.encoder.layer.9.attention.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_934 for ONNX node: Add_934 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1531 for ONNX tensor: 1531 [06/20/2022-16:24:39] [V] [TRT] Add_934 [Add] outputs: [1531 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_935 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1531 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1455 [06/20/2022-16:24:39] [V] [TRT] Add_935 [Add] inputs: [1531 -> (-1, -1, 1024)[FLOAT]], [1455 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_935 for ONNX node: Add_935 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1532 for ONNX tensor: 1532 [06/20/2022-16:24:39] [V] [TRT] Add_935 [Add] outputs: [1532 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_936 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1532 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_936 [ReduceMean] inputs: [1532 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_936 for ONNX node: ReduceMean_936 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1533 for ONNX tensor: 1533 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_936 [ReduceMean] outputs: [1533 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sub_937 [Sub] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1532 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1533 [06/20/2022-16:24:39] [V] [TRT] Sub_937 [Sub] inputs: [1532 -> (-1, -1, 1024)[FLOAT]], [1533 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sub_937 for ONNX node: Sub_937 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1534 for ONNX tensor: 1534 [06/20/2022-16:24:39] [V] [TRT] Sub_937 [Sub] outputs: [1534 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_938 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_938 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_938 [Constant] outputs: [1535 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Pow_939 [Pow] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1534 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1535 [06/20/2022-16:24:39] [V] [TRT] Pow_939 [Pow] inputs: [1534 -> (-1, -1, 1024)[FLOAT]], [1535 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1535 for ONNX node: 1535 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Pow_939 for ONNX node: Pow_939 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1536 for ONNX tensor: 1536 [06/20/2022-16:24:39] [V] [TRT] Pow_939 [Pow] outputs: [1536 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_940 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1536 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_940 [ReduceMean] inputs: [1536 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_940 for ONNX node: ReduceMean_940 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1537 for ONNX tensor: 1537 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_940 [ReduceMean] outputs: [1537 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_941 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_941 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_941 [Constant] outputs: [1538 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_942 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1537 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1538 [06/20/2022-16:24:39] [V] [TRT] Add_942 [Add] inputs: [1537 -> (-1, -1, 1)[FLOAT]], [1538 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1538 for ONNX node: 1538 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_942 for ONNX node: Add_942 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1539 for ONNX tensor: 1539 [06/20/2022-16:24:39] [V] [TRT] Add_942 [Add] outputs: [1539 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sqrt_943 [Sqrt] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1539 [06/20/2022-16:24:39] [V] [TRT] Sqrt_943 [Sqrt] inputs: [1539 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sqrt_943 for ONNX node: Sqrt_943 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1540 for ONNX tensor: 1540 [06/20/2022-16:24:39] [V] [TRT] Sqrt_943 [Sqrt] outputs: [1540 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_944 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1534 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1540 [06/20/2022-16:24:39] [V] [TRT] Div_944 [Div] inputs: [1534 -> (-1, -1, 1024)[FLOAT]], [1540 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_944 for ONNX node: Div_944 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1541 for ONNX tensor: 1541 [06/20/2022-16:24:39] [V] [TRT] Div_944 [Div] outputs: [1541 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_945 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1541 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.attention.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Mul_945 [Mul] inputs: [1541 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.9.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.9.attention.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_945 for ONNX node: Mul_945 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1542 for ONNX tensor: 1542 [06/20/2022-16:24:39] [V] [TRT] Mul_945 [Mul] outputs: [1542 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_946 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1542 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.attention.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Add_946 [Add] inputs: [1542 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.9.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.9.attention.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_946 for ONNX node: Add_946 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1543 for ONNX tensor: 1543 [06/20/2022-16:24:39] [V] [TRT] Add_946 [Add] outputs: [1543 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_947 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1543 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3303 [06/20/2022-16:24:39] [V] [TRT] MatMul_947 [MatMul] inputs: [1543 -> (-1, -1, 1024)[FLOAT]], [3303 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3303 for ONNX node: 3303 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_947 for ONNX node: MatMul_947 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1545 for ONNX tensor: 1545 [06/20/2022-16:24:39] [V] [TRT] MatMul_947 [MatMul] outputs: [1545 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_948 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.intermediate.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1545 [06/20/2022-16:24:39] [V] [TRT] Add_948 [Add] inputs: [bert.encoder.layer.9.intermediate.dense.bias -> (4096)[FLOAT]], [1545 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.intermediate.dense.bias for ONNX node: bert.encoder.layer.9.intermediate.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_948 for ONNX node: Add_948 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1546 for ONNX tensor: 1546 [06/20/2022-16:24:39] [V] [TRT] Add_948 [Add] outputs: [1546 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_949 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_949 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_949 [Constant] outputs: [1547 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_950 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1546 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1547 [06/20/2022-16:24:39] [V] [TRT] Div_950 [Div] inputs: [1546 -> (-1, -1, 4096)[FLOAT]], [1547 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1547 for ONNX node: 1547 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_950 for ONNX node: Div_950 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1548 for ONNX tensor: 1548 [06/20/2022-16:24:39] [V] [TRT] Div_950 [Div] outputs: [1548 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Erf_951 [Erf] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1548 [06/20/2022-16:24:39] [V] [TRT] Erf_951 [Erf] inputs: [1548 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Erf_951 for ONNX node: Erf_951 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1549 for ONNX tensor: 1549 [06/20/2022-16:24:39] [V] [TRT] Erf_951 [Erf] outputs: [1549 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_952 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_952 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_952 [Constant] outputs: [1550 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_953 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1549 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1550 [06/20/2022-16:24:39] [V] [TRT] Add_953 [Add] inputs: [1549 -> (-1, -1, 4096)[FLOAT]], [1550 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1550 for ONNX node: 1550 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_953 for ONNX node: Add_953 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1551 for ONNX tensor: 1551 [06/20/2022-16:24:39] [V] [TRT] Add_953 [Add] outputs: [1551 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_954 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1546 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1551 [06/20/2022-16:24:39] [V] [TRT] Mul_954 [Mul] inputs: [1546 -> (-1, -1, 4096)[FLOAT]], [1551 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_954 for ONNX node: Mul_954 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1552 for ONNX tensor: 1552 [06/20/2022-16:24:39] [V] [TRT] Mul_954 [Mul] outputs: [1552 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_955 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_955 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_955 [Constant] outputs: [1553 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_956 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1552 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1553 [06/20/2022-16:24:39] [V] [TRT] Mul_956 [Mul] inputs: [1552 -> (-1, -1, 4096)[FLOAT]], [1553 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1553 for ONNX node: 1553 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_956 for ONNX node: Mul_956 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1554 for ONNX tensor: 1554 [06/20/2022-16:24:39] [V] [TRT] Mul_956 [Mul] outputs: [1554 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_957 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1554 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3304 [06/20/2022-16:24:39] [V] [TRT] MatMul_957 [MatMul] inputs: [1554 -> (-1, -1, 4096)[FLOAT]], [3304 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3304 for ONNX node: 3304 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_957 for ONNX node: MatMul_957 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1556 for ONNX tensor: 1556 [06/20/2022-16:24:39] [V] [TRT] MatMul_957 [MatMul] outputs: [1556 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_958 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1556 [06/20/2022-16:24:39] [V] [TRT] Add_958 [Add] inputs: [bert.encoder.layer.9.output.dense.bias -> (1024)[FLOAT]], [1556 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.output.dense.bias for ONNX node: bert.encoder.layer.9.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_958 for ONNX node: Add_958 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1557 for ONNX tensor: 1557 [06/20/2022-16:24:39] [V] [TRT] Add_958 [Add] outputs: [1557 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_959 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1557 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1543 [06/20/2022-16:24:39] [V] [TRT] Add_959 [Add] inputs: [1557 -> (-1, -1, 1024)[FLOAT]], [1543 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_959 for ONNX node: Add_959 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1558 for ONNX tensor: 1558 [06/20/2022-16:24:39] [V] [TRT] Add_959 [Add] outputs: [1558 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_960 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1558 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_960 [ReduceMean] inputs: [1558 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_960 for ONNX node: ReduceMean_960 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1559 for ONNX tensor: 1559 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_960 [ReduceMean] outputs: [1559 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sub_961 [Sub] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1558 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1559 [06/20/2022-16:24:39] [V] [TRT] Sub_961 [Sub] inputs: [1558 -> (-1, -1, 1024)[FLOAT]], [1559 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sub_961 for ONNX node: Sub_961 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1560 for ONNX tensor: 1560 [06/20/2022-16:24:39] [V] [TRT] Sub_961 [Sub] outputs: [1560 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_962 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_962 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_962 [Constant] outputs: [1561 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Pow_963 [Pow] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1560 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1561 [06/20/2022-16:24:39] [V] [TRT] Pow_963 [Pow] inputs: [1560 -> (-1, -1, 1024)[FLOAT]], [1561 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1561 for ONNX node: 1561 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Pow_963 for ONNX node: Pow_963 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1562 for ONNX tensor: 1562 [06/20/2022-16:24:39] [V] [TRT] Pow_963 [Pow] outputs: [1562 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_964 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1562 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_964 [ReduceMean] inputs: [1562 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_964 for ONNX node: ReduceMean_964 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1563 for ONNX tensor: 1563 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_964 [ReduceMean] outputs: [1563 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_965 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_965 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_965 [Constant] outputs: [1564 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_966 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1563 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1564 [06/20/2022-16:24:39] [V] [TRT] Add_966 [Add] inputs: [1563 -> (-1, -1, 1)[FLOAT]], [1564 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1564 for ONNX node: 1564 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_966 for ONNX node: Add_966 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1565 for ONNX tensor: 1565 [06/20/2022-16:24:39] [V] [TRT] Add_966 [Add] outputs: [1565 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sqrt_967 [Sqrt] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1565 [06/20/2022-16:24:39] [V] [TRT] Sqrt_967 [Sqrt] inputs: [1565 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sqrt_967 for ONNX node: Sqrt_967 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1566 for ONNX tensor: 1566 [06/20/2022-16:24:39] [V] [TRT] Sqrt_967 [Sqrt] outputs: [1566 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_968 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1560 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1566 [06/20/2022-16:24:39] [V] [TRT] Div_968 [Div] inputs: [1560 -> (-1, -1, 1024)[FLOAT]], [1566 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_968 for ONNX node: Div_968 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1567 for ONNX tensor: 1567 [06/20/2022-16:24:39] [V] [TRT] Div_968 [Div] outputs: [1567 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_969 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1567 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Mul_969 [Mul] inputs: [1567 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.9.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.output.LayerNorm.weight for ONNX node: bert.encoder.layer.9.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_969 for ONNX node: Mul_969 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1568 for ONNX tensor: 1568 [06/20/2022-16:24:39] [V] [TRT] Mul_969 [Mul] outputs: [1568 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_970 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1568 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.9.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Add_970 [Add] inputs: [1568 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.9.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.9.output.LayerNorm.bias for ONNX node: bert.encoder.layer.9.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_970 for ONNX node: Add_970 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1569 for ONNX tensor: 1569 [06/20/2022-16:24:39] [V] [TRT] Add_970 [Add] outputs: [1569 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_971 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1569 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3305 [06/20/2022-16:24:39] [V] [TRT] MatMul_971 [MatMul] inputs: [1569 -> (-1, -1, 1024)[FLOAT]], [3305 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3305 for ONNX node: 3305 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_971 for ONNX node: MatMul_971 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1571 for ONNX tensor: 1571 [06/20/2022-16:24:39] [V] [TRT] MatMul_971 [MatMul] outputs: [1571 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_972 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.attention.self.query.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1571 [06/20/2022-16:24:39] [V] [TRT] Add_972 [Add] inputs: [bert.encoder.layer.10.attention.self.query.bias -> (1024)[FLOAT]], [1571 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.attention.self.query.bias for ONNX node: bert.encoder.layer.10.attention.self.query.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_972 for ONNX node: Add_972 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1572 for ONNX tensor: 1572 [06/20/2022-16:24:39] [V] [TRT] Add_972 [Add] outputs: [1572 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_973 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1569 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3306 [06/20/2022-16:24:39] [V] [TRT] MatMul_973 [MatMul] inputs: [1569 -> (-1, -1, 1024)[FLOAT]], [3306 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3306 for ONNX node: 3306 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_973 for ONNX node: MatMul_973 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1574 for ONNX tensor: 1574 [06/20/2022-16:24:39] [V] [TRT] MatMul_973 [MatMul] outputs: [1574 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_974 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.attention.self.key.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1574 [06/20/2022-16:24:39] [V] [TRT] Add_974 [Add] inputs: [bert.encoder.layer.10.attention.self.key.bias -> (1024)[FLOAT]], [1574 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.attention.self.key.bias for ONNX node: bert.encoder.layer.10.attention.self.key.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_974 for ONNX node: Add_974 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1575 for ONNX tensor: 1575 [06/20/2022-16:24:39] [V] [TRT] Add_974 [Add] outputs: [1575 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_975 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1575 [06/20/2022-16:24:39] [V] [TRT] Shape_975 [Shape] inputs: [1575 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_975 for ONNX node: Shape_975 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1576 for ONNX tensor: 1576 [06/20/2022-16:24:39] [V] [TRT] Shape_975 [Shape] outputs: [1576 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_976 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_976 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_976 [Constant] outputs: [1577 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_977 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1576 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1577 [06/20/2022-16:24:39] [V] [TRT] Gather_977 [Gather] inputs: [1576 -> (3)[INT32]], [1577 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1577 for ONNX node: 1577 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_977 for ONNX node: Gather_977 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1578 for ONNX tensor: 1578 [06/20/2022-16:24:39] [V] [TRT] Gather_977 [Gather] outputs: [1578 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_978 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1575 [06/20/2022-16:24:39] [V] [TRT] Shape_978 [Shape] inputs: [1575 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_978 for ONNX node: Shape_978 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1579 for ONNX tensor: 1579 [06/20/2022-16:24:39] [V] [TRT] Shape_978 [Shape] outputs: [1579 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_979 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_979 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_979 [Constant] outputs: [1580 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_980 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1579 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1580 [06/20/2022-16:24:39] [V] [TRT] Gather_980 [Gather] inputs: [1579 -> (3)[INT32]], [1580 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1580 for ONNX node: 1580 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_980 for ONNX node: Gather_980 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1581 for ONNX tensor: 1581 [06/20/2022-16:24:39] [V] [TRT] Gather_980 [Gather] outputs: [1581 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_981 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1578 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_981 [Unsqueeze] inputs: [1578 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_981 for ONNX node: Unsqueeze_981 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1584 for ONNX tensor: 1584 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_981 [Unsqueeze] outputs: [1584 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_982 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1581 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_982 [Unsqueeze] inputs: [1581 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_982 for ONNX node: Unsqueeze_982 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1585 for ONNX tensor: 1585 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_982 [Unsqueeze] outputs: [1585 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_983 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1584 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1585 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3307 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3308 [06/20/2022-16:24:39] [V] [TRT] Concat_983 [Concat] inputs: [1584 -> (1)[INT32]], [1585 -> (1)[INT32]], [3307 -> (1)[INT32]], [3308 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3307 for ONNX node: 3307 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3308 for ONNX node: 3308 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_983 for ONNX node: Concat_983 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1588 for ONNX tensor: 1588 [06/20/2022-16:24:39] [V] [TRT] Concat_983 [Concat] outputs: [1588 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_984 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1575 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1588 [06/20/2022-16:24:39] [V] [TRT] Reshape_984 [Reshape] inputs: [1575 -> (-1, -1, 1024)[FLOAT]], [1588 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_984 for ONNX node: Reshape_984 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1589 for ONNX tensor: 1589 [06/20/2022-16:24:39] [V] [TRT] Reshape_984 [Reshape] outputs: [1589 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_985 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1569 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3309 [06/20/2022-16:24:39] [V] [TRT] MatMul_985 [MatMul] inputs: [1569 -> (-1, -1, 1024)[FLOAT]], [3309 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3309 for ONNX node: 3309 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_985 for ONNX node: MatMul_985 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1591 for ONNX tensor: 1591 [06/20/2022-16:24:39] [V] [TRT] MatMul_985 [MatMul] outputs: [1591 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_986 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.attention.self.value.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1591 [06/20/2022-16:24:39] [V] [TRT] Add_986 [Add] inputs: [bert.encoder.layer.10.attention.self.value.bias -> (1024)[FLOAT]], [1591 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.attention.self.value.bias for ONNX node: bert.encoder.layer.10.attention.self.value.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_986 for ONNX node: Add_986 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1592 for ONNX tensor: 1592 [06/20/2022-16:24:39] [V] [TRT] Add_986 [Add] outputs: [1592 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_987 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1592 [06/20/2022-16:24:39] [V] [TRT] Shape_987 [Shape] inputs: [1592 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_987 for ONNX node: Shape_987 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1593 for ONNX tensor: 1593 [06/20/2022-16:24:39] [V] [TRT] Shape_987 [Shape] outputs: [1593 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_988 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_988 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_988 [Constant] outputs: [1594 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_989 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1593 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1594 [06/20/2022-16:24:39] [V] [TRT] Gather_989 [Gather] inputs: [1593 -> (3)[INT32]], [1594 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1594 for ONNX node: 1594 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_989 for ONNX node: Gather_989 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1595 for ONNX tensor: 1595 [06/20/2022-16:24:39] [V] [TRT] Gather_989 [Gather] outputs: [1595 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_990 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1592 [06/20/2022-16:24:39] [V] [TRT] Shape_990 [Shape] inputs: [1592 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_990 for ONNX node: Shape_990 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1596 for ONNX tensor: 1596 [06/20/2022-16:24:39] [V] [TRT] Shape_990 [Shape] outputs: [1596 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_991 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_991 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_991 [Constant] outputs: [1597 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_992 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1596 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1597 [06/20/2022-16:24:39] [V] [TRT] Gather_992 [Gather] inputs: [1596 -> (3)[INT32]], [1597 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1597 for ONNX node: 1597 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_992 for ONNX node: Gather_992 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1598 for ONNX tensor: 1598 [06/20/2022-16:24:39] [V] [TRT] Gather_992 [Gather] outputs: [1598 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_993 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1595 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_993 [Unsqueeze] inputs: [1595 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_993 for ONNX node: Unsqueeze_993 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1601 for ONNX tensor: 1601 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_993 [Unsqueeze] outputs: [1601 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_994 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1598 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_994 [Unsqueeze] inputs: [1598 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_994 for ONNX node: Unsqueeze_994 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1602 for ONNX tensor: 1602 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_994 [Unsqueeze] outputs: [1602 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_995 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1601 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1602 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3310 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3311 [06/20/2022-16:24:39] [V] [TRT] Concat_995 [Concat] inputs: [1601 -> (1)[INT32]], [1602 -> (1)[INT32]], [3310 -> (1)[INT32]], [3311 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3310 for ONNX node: 3310 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3311 for ONNX node: 3311 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_995 for ONNX node: Concat_995 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1605 for ONNX tensor: 1605 [06/20/2022-16:24:39] [V] [TRT] Concat_995 [Concat] outputs: [1605 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_996 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1592 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1605 [06/20/2022-16:24:39] [V] [TRT] Reshape_996 [Reshape] inputs: [1592 -> (-1, -1, 1024)[FLOAT]], [1605 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_996 for ONNX node: Reshape_996 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1606 for ONNX tensor: 1606 [06/20/2022-16:24:39] [V] [TRT] Reshape_996 [Reshape] outputs: [1606 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_997 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1606 [06/20/2022-16:24:39] [V] [TRT] Transpose_997 [Transpose] inputs: [1606 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_997 for ONNX node: Transpose_997 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1607 for ONNX tensor: 1607 [06/20/2022-16:24:39] [V] [TRT] Transpose_997 [Transpose] outputs: [1607 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_998 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1572 [06/20/2022-16:24:39] [V] [TRT] Shape_998 [Shape] inputs: [1572 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_998 for ONNX node: Shape_998 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1608 for ONNX tensor: 1608 [06/20/2022-16:24:39] [V] [TRT] Shape_998 [Shape] outputs: [1608 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_999 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_999 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_999 [Constant] outputs: [1609 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1000 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1608 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1609 [06/20/2022-16:24:39] [V] [TRT] Gather_1000 [Gather] inputs: [1608 -> (3)[INT32]], [1609 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1609 for ONNX node: 1609 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1000 for ONNX node: Gather_1000 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1610 for ONNX tensor: 1610 [06/20/2022-16:24:39] [V] [TRT] Gather_1000 [Gather] outputs: [1610 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1001 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1572 [06/20/2022-16:24:39] [V] [TRT] Shape_1001 [Shape] inputs: [1572 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1001 for ONNX node: Shape_1001 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1611 for ONNX tensor: 1611 [06/20/2022-16:24:39] [V] [TRT] Shape_1001 [Shape] outputs: [1611 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1002 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1002 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1002 [Constant] outputs: [1612 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1003 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1611 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1612 [06/20/2022-16:24:39] [V] [TRT] Gather_1003 [Gather] inputs: [1611 -> (3)[INT32]], [1612 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1612 for ONNX node: 1612 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1003 for ONNX node: Gather_1003 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1613 for ONNX tensor: 1613 [06/20/2022-16:24:39] [V] [TRT] Gather_1003 [Gather] outputs: [1613 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1004 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1610 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1004 [Unsqueeze] inputs: [1610 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1004 for ONNX node: Unsqueeze_1004 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1616 for ONNX tensor: 1616 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1004 [Unsqueeze] outputs: [1616 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1005 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1613 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1005 [Unsqueeze] inputs: [1613 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1005 for ONNX node: Unsqueeze_1005 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1617 for ONNX tensor: 1617 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1005 [Unsqueeze] outputs: [1617 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_1006 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1616 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1617 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3312 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3313 [06/20/2022-16:24:39] [V] [TRT] Concat_1006 [Concat] inputs: [1616 -> (1)[INT32]], [1617 -> (1)[INT32]], [3312 -> (1)[INT32]], [3313 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3312 for ONNX node: 3312 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3313 for ONNX node: 3313 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_1006 for ONNX node: Concat_1006 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1620 for ONNX tensor: 1620 [06/20/2022-16:24:39] [V] [TRT] Concat_1006 [Concat] outputs: [1620 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_1007 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1572 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1620 [06/20/2022-16:24:39] [V] [TRT] Reshape_1007 [Reshape] inputs: [1572 -> (-1, -1, 1024)[FLOAT]], [1620 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_1007 for ONNX node: Reshape_1007 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1621 for ONNX tensor: 1621 [06/20/2022-16:24:39] [V] [TRT] Reshape_1007 [Reshape] outputs: [1621 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1008 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1621 [06/20/2022-16:24:39] [V] [TRT] Transpose_1008 [Transpose] inputs: [1621 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1008 for ONNX node: Transpose_1008 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1622 for ONNX tensor: 1622 [06/20/2022-16:24:39] [V] [TRT] Transpose_1008 [Transpose] outputs: [1622 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1009 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1589 [06/20/2022-16:24:39] [V] [TRT] Transpose_1009 [Transpose] inputs: [1589 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1009 for ONNX node: Transpose_1009 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1623 for ONNX tensor: 1623 [06/20/2022-16:24:39] [V] [TRT] Transpose_1009 [Transpose] outputs: [1623 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1010 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1622 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1623 [06/20/2022-16:24:39] [V] [TRT] MatMul_1010 [MatMul] inputs: [1622 -> (-1, 16, -1, 64)[FLOAT]], [1623 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1010 for ONNX node: MatMul_1010 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1624 for ONNX tensor: 1624 [06/20/2022-16:24:39] [V] [TRT] MatMul_1010 [MatMul] outputs: [1624 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1011 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1011 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1011 [Constant] outputs: [1625 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1012 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1624 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1625 [06/20/2022-16:24:39] [V] [TRT] Div_1012 [Div] inputs: [1624 -> (-1, 16, -1, -1)[FLOAT]], [1625 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1625 for ONNX node: 1625 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1012 for ONNX node: Div_1012 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1626 for ONNX tensor: 1626 [06/20/2022-16:24:39] [V] [TRT] Div_1012 [Div] outputs: [1626 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1013 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1626 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:39] [V] [TRT] Add_1013 [Add] inputs: [1626 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1013 for ONNX node: Add_1013 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1627 for ONNX tensor: 1627 [06/20/2022-16:24:39] [V] [TRT] Add_1013 [Add] outputs: [1627 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Softmax_1014 [Softmax] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1627 [06/20/2022-16:24:39] [V] [TRT] Softmax_1014 [Softmax] inputs: [1627 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Softmax_1014 for ONNX node: Softmax_1014 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1628 for ONNX tensor: 1628 [06/20/2022-16:24:39] [V] [TRT] Softmax_1014 [Softmax] outputs: [1628 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1015 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1628 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1607 [06/20/2022-16:24:39] [V] [TRT] MatMul_1015 [MatMul] inputs: [1628 -> (-1, 16, -1, -1)[FLOAT]], [1607 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1015 for ONNX node: MatMul_1015 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1629 for ONNX tensor: 1629 [06/20/2022-16:24:39] [V] [TRT] MatMul_1015 [MatMul] outputs: [1629 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1016 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1629 [06/20/2022-16:24:39] [V] [TRT] Transpose_1016 [Transpose] inputs: [1629 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1016 for ONNX node: Transpose_1016 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1630 for ONNX tensor: 1630 [06/20/2022-16:24:39] [V] [TRT] Transpose_1016 [Transpose] outputs: [1630 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1017 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1630 [06/20/2022-16:24:39] [V] [TRT] Shape_1017 [Shape] inputs: [1630 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1017 for ONNX node: Shape_1017 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1631 for ONNX tensor: 1631 [06/20/2022-16:24:39] [V] [TRT] Shape_1017 [Shape] outputs: [1631 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1018 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1018 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1018 [Constant] outputs: [1632 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1019 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1631 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1632 [06/20/2022-16:24:39] [V] [TRT] Gather_1019 [Gather] inputs: [1631 -> (4)[INT32]], [1632 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1632 for ONNX node: 1632 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1019 for ONNX node: Gather_1019 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1633 for ONNX tensor: 1633 [06/20/2022-16:24:39] [V] [TRT] Gather_1019 [Gather] outputs: [1633 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1020 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1630 [06/20/2022-16:24:39] [V] [TRT] Shape_1020 [Shape] inputs: [1630 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1020 for ONNX node: Shape_1020 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1634 for ONNX tensor: 1634 [06/20/2022-16:24:39] [V] [TRT] Shape_1020 [Shape] outputs: [1634 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1021 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1021 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1021 [Constant] outputs: [1635 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1022 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1634 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1635 [06/20/2022-16:24:39] [V] [TRT] Gather_1022 [Gather] inputs: [1634 -> (4)[INT32]], [1635 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1635 for ONNX node: 1635 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1022 for ONNX node: Gather_1022 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1636 for ONNX tensor: 1636 [06/20/2022-16:24:39] [V] [TRT] Gather_1022 [Gather] outputs: [1636 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1023 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1633 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1023 [Unsqueeze] inputs: [1633 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1023 for ONNX node: Unsqueeze_1023 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1638 for ONNX tensor: 1638 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1023 [Unsqueeze] outputs: [1638 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1024 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1636 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1024 [Unsqueeze] inputs: [1636 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1024 for ONNX node: Unsqueeze_1024 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1639 for ONNX tensor: 1639 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1024 [Unsqueeze] outputs: [1639 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_1025 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1638 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1639 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3314 [06/20/2022-16:24:39] [V] [TRT] Concat_1025 [Concat] inputs: [1638 -> (1)[INT32]], [1639 -> (1)[INT32]], [3314 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3314 for ONNX node: 3314 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_1025 for ONNX node: Concat_1025 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1641 for ONNX tensor: 1641 [06/20/2022-16:24:39] [V] [TRT] Concat_1025 [Concat] outputs: [1641 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_1026 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1630 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1641 [06/20/2022-16:24:39] [V] [TRT] Reshape_1026 [Reshape] inputs: [1630 -> (-1, -1, 16, 64)[FLOAT]], [1641 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_1026 for ONNX node: Reshape_1026 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1642 for ONNX tensor: 1642 [06/20/2022-16:24:39] [V] [TRT] Reshape_1026 [Reshape] outputs: [1642 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1027 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1642 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3315 [06/20/2022-16:24:39] [V] [TRT] MatMul_1027 [MatMul] inputs: [1642 -> (-1, -1, 1024)[FLOAT]], [3315 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3315 for ONNX node: 3315 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1027 for ONNX node: MatMul_1027 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1644 for ONNX tensor: 1644 [06/20/2022-16:24:39] [V] [TRT] MatMul_1027 [MatMul] outputs: [1644 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1028 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.attention.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1644 [06/20/2022-16:24:39] [V] [TRT] Add_1028 [Add] inputs: [bert.encoder.layer.10.attention.output.dense.bias -> (1024)[FLOAT]], [1644 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.attention.output.dense.bias for ONNX node: bert.encoder.layer.10.attention.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1028 for ONNX node: Add_1028 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1645 for ONNX tensor: 1645 [06/20/2022-16:24:39] [V] [TRT] Add_1028 [Add] outputs: [1645 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1029 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1645 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1569 [06/20/2022-16:24:39] [V] [TRT] Add_1029 [Add] inputs: [1645 -> (-1, -1, 1024)[FLOAT]], [1569 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1029 for ONNX node: Add_1029 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1646 for ONNX tensor: 1646 [06/20/2022-16:24:39] [V] [TRT] Add_1029 [Add] outputs: [1646 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1030 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1646 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1030 [ReduceMean] inputs: [1646 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1030 for ONNX node: ReduceMean_1030 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1647 for ONNX tensor: 1647 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1030 [ReduceMean] outputs: [1647 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sub_1031 [Sub] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1646 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1647 [06/20/2022-16:24:39] [V] [TRT] Sub_1031 [Sub] inputs: [1646 -> (-1, -1, 1024)[FLOAT]], [1647 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sub_1031 for ONNX node: Sub_1031 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1648 for ONNX tensor: 1648 [06/20/2022-16:24:39] [V] [TRT] Sub_1031 [Sub] outputs: [1648 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1032 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1032 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1032 [Constant] outputs: [1649 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Pow_1033 [Pow] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1648 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1649 [06/20/2022-16:24:39] [V] [TRT] Pow_1033 [Pow] inputs: [1648 -> (-1, -1, 1024)[FLOAT]], [1649 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1649 for ONNX node: 1649 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Pow_1033 for ONNX node: Pow_1033 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1650 for ONNX tensor: 1650 [06/20/2022-16:24:39] [V] [TRT] Pow_1033 [Pow] outputs: [1650 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1034 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1650 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1034 [ReduceMean] inputs: [1650 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1034 for ONNX node: ReduceMean_1034 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1651 for ONNX tensor: 1651 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1034 [ReduceMean] outputs: [1651 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1035 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1035 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1035 [Constant] outputs: [1652 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1036 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1651 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1652 [06/20/2022-16:24:39] [V] [TRT] Add_1036 [Add] inputs: [1651 -> (-1, -1, 1)[FLOAT]], [1652 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1652 for ONNX node: 1652 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1036 for ONNX node: Add_1036 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1653 for ONNX tensor: 1653 [06/20/2022-16:24:39] [V] [TRT] Add_1036 [Add] outputs: [1653 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sqrt_1037 [Sqrt] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1653 [06/20/2022-16:24:39] [V] [TRT] Sqrt_1037 [Sqrt] inputs: [1653 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sqrt_1037 for ONNX node: Sqrt_1037 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1654 for ONNX tensor: 1654 [06/20/2022-16:24:39] [V] [TRT] Sqrt_1037 [Sqrt] outputs: [1654 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1038 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1648 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1654 [06/20/2022-16:24:39] [V] [TRT] Div_1038 [Div] inputs: [1648 -> (-1, -1, 1024)[FLOAT]], [1654 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1038 for ONNX node: Div_1038 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1655 for ONNX tensor: 1655 [06/20/2022-16:24:39] [V] [TRT] Div_1038 [Div] outputs: [1655 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1039 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1655 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.attention.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Mul_1039 [Mul] inputs: [1655 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.10.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.10.attention.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1039 for ONNX node: Mul_1039 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1656 for ONNX tensor: 1656 [06/20/2022-16:24:39] [V] [TRT] Mul_1039 [Mul] outputs: [1656 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1040 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1656 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.attention.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Add_1040 [Add] inputs: [1656 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.10.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.10.attention.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1040 for ONNX node: Add_1040 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1657 for ONNX tensor: 1657 [06/20/2022-16:24:39] [V] [TRT] Add_1040 [Add] outputs: [1657 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1041 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1657 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3316 [06/20/2022-16:24:39] [V] [TRT] MatMul_1041 [MatMul] inputs: [1657 -> (-1, -1, 1024)[FLOAT]], [3316 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3316 for ONNX node: 3316 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1041 for ONNX node: MatMul_1041 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1659 for ONNX tensor: 1659 [06/20/2022-16:24:39] [V] [TRT] MatMul_1041 [MatMul] outputs: [1659 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1042 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.intermediate.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1659 [06/20/2022-16:24:39] [V] [TRT] Add_1042 [Add] inputs: [bert.encoder.layer.10.intermediate.dense.bias -> (4096)[FLOAT]], [1659 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.intermediate.dense.bias for ONNX node: bert.encoder.layer.10.intermediate.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1042 for ONNX node: Add_1042 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1660 for ONNX tensor: 1660 [06/20/2022-16:24:39] [V] [TRT] Add_1042 [Add] outputs: [1660 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1043 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1043 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1043 [Constant] outputs: [1661 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1044 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1660 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1661 [06/20/2022-16:24:39] [V] [TRT] Div_1044 [Div] inputs: [1660 -> (-1, -1, 4096)[FLOAT]], [1661 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1661 for ONNX node: 1661 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1044 for ONNX node: Div_1044 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1662 for ONNX tensor: 1662 [06/20/2022-16:24:39] [V] [TRT] Div_1044 [Div] outputs: [1662 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Erf_1045 [Erf] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1662 [06/20/2022-16:24:39] [V] [TRT] Erf_1045 [Erf] inputs: [1662 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Erf_1045 for ONNX node: Erf_1045 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1663 for ONNX tensor: 1663 [06/20/2022-16:24:39] [V] [TRT] Erf_1045 [Erf] outputs: [1663 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1046 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1046 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1046 [Constant] outputs: [1664 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1047 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1663 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1664 [06/20/2022-16:24:39] [V] [TRT] Add_1047 [Add] inputs: [1663 -> (-1, -1, 4096)[FLOAT]], [1664 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1664 for ONNX node: 1664 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1047 for ONNX node: Add_1047 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1665 for ONNX tensor: 1665 [06/20/2022-16:24:39] [V] [TRT] Add_1047 [Add] outputs: [1665 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1048 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1660 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1665 [06/20/2022-16:24:39] [V] [TRT] Mul_1048 [Mul] inputs: [1660 -> (-1, -1, 4096)[FLOAT]], [1665 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1048 for ONNX node: Mul_1048 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1666 for ONNX tensor: 1666 [06/20/2022-16:24:39] [V] [TRT] Mul_1048 [Mul] outputs: [1666 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1049 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1049 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1049 [Constant] outputs: [1667 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1050 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1666 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1667 [06/20/2022-16:24:39] [V] [TRT] Mul_1050 [Mul] inputs: [1666 -> (-1, -1, 4096)[FLOAT]], [1667 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1667 for ONNX node: 1667 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1050 for ONNX node: Mul_1050 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1668 for ONNX tensor: 1668 [06/20/2022-16:24:39] [V] [TRT] Mul_1050 [Mul] outputs: [1668 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1051 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1668 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3317 [06/20/2022-16:24:39] [V] [TRT] MatMul_1051 [MatMul] inputs: [1668 -> (-1, -1, 4096)[FLOAT]], [3317 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3317 for ONNX node: 3317 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1051 for ONNX node: MatMul_1051 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1670 for ONNX tensor: 1670 [06/20/2022-16:24:39] [V] [TRT] MatMul_1051 [MatMul] outputs: [1670 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1052 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1670 [06/20/2022-16:24:39] [V] [TRT] Add_1052 [Add] inputs: [bert.encoder.layer.10.output.dense.bias -> (1024)[FLOAT]], [1670 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.output.dense.bias for ONNX node: bert.encoder.layer.10.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1052 for ONNX node: Add_1052 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1671 for ONNX tensor: 1671 [06/20/2022-16:24:39] [V] [TRT] Add_1052 [Add] outputs: [1671 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1053 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1671 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1657 [06/20/2022-16:24:39] [V] [TRT] Add_1053 [Add] inputs: [1671 -> (-1, -1, 1024)[FLOAT]], [1657 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1053 for ONNX node: Add_1053 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1672 for ONNX tensor: 1672 [06/20/2022-16:24:39] [V] [TRT] Add_1053 [Add] outputs: [1672 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1054 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1672 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1054 [ReduceMean] inputs: [1672 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1054 for ONNX node: ReduceMean_1054 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1673 for ONNX tensor: 1673 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1054 [ReduceMean] outputs: [1673 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sub_1055 [Sub] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1672 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1673 [06/20/2022-16:24:39] [V] [TRT] Sub_1055 [Sub] inputs: [1672 -> (-1, -1, 1024)[FLOAT]], [1673 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sub_1055 for ONNX node: Sub_1055 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1674 for ONNX tensor: 1674 [06/20/2022-16:24:39] [V] [TRT] Sub_1055 [Sub] outputs: [1674 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1056 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1056 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1056 [Constant] outputs: [1675 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Pow_1057 [Pow] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1674 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1675 [06/20/2022-16:24:39] [V] [TRT] Pow_1057 [Pow] inputs: [1674 -> (-1, -1, 1024)[FLOAT]], [1675 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1675 for ONNX node: 1675 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Pow_1057 for ONNX node: Pow_1057 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1676 for ONNX tensor: 1676 [06/20/2022-16:24:39] [V] [TRT] Pow_1057 [Pow] outputs: [1676 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1058 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1676 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1058 [ReduceMean] inputs: [1676 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1058 for ONNX node: ReduceMean_1058 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1677 for ONNX tensor: 1677 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1058 [ReduceMean] outputs: [1677 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1059 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1059 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1059 [Constant] outputs: [1678 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1060 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1677 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1678 [06/20/2022-16:24:39] [V] [TRT] Add_1060 [Add] inputs: [1677 -> (-1, -1, 1)[FLOAT]], [1678 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1678 for ONNX node: 1678 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1060 for ONNX node: Add_1060 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1679 for ONNX tensor: 1679 [06/20/2022-16:24:39] [V] [TRT] Add_1060 [Add] outputs: [1679 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sqrt_1061 [Sqrt] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1679 [06/20/2022-16:24:39] [V] [TRT] Sqrt_1061 [Sqrt] inputs: [1679 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sqrt_1061 for ONNX node: Sqrt_1061 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1680 for ONNX tensor: 1680 [06/20/2022-16:24:39] [V] [TRT] Sqrt_1061 [Sqrt] outputs: [1680 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1062 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1674 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1680 [06/20/2022-16:24:39] [V] [TRT] Div_1062 [Div] inputs: [1674 -> (-1, -1, 1024)[FLOAT]], [1680 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1062 for ONNX node: Div_1062 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1681 for ONNX tensor: 1681 [06/20/2022-16:24:39] [V] [TRT] Div_1062 [Div] outputs: [1681 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1063 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1681 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Mul_1063 [Mul] inputs: [1681 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.10.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.output.LayerNorm.weight for ONNX node: bert.encoder.layer.10.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1063 for ONNX node: Mul_1063 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1682 for ONNX tensor: 1682 [06/20/2022-16:24:39] [V] [TRT] Mul_1063 [Mul] outputs: [1682 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1064 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1682 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.10.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Add_1064 [Add] inputs: [1682 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.10.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.10.output.LayerNorm.bias for ONNX node: bert.encoder.layer.10.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1064 for ONNX node: Add_1064 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1683 for ONNX tensor: 1683 [06/20/2022-16:24:39] [V] [TRT] Add_1064 [Add] outputs: [1683 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1065 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1683 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3318 [06/20/2022-16:24:39] [V] [TRT] MatMul_1065 [MatMul] inputs: [1683 -> (-1, -1, 1024)[FLOAT]], [3318 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3318 for ONNX node: 3318 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1065 for ONNX node: MatMul_1065 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1685 for ONNX tensor: 1685 [06/20/2022-16:24:39] [V] [TRT] MatMul_1065 [MatMul] outputs: [1685 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1066 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.attention.self.query.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1685 [06/20/2022-16:24:39] [V] [TRT] Add_1066 [Add] inputs: [bert.encoder.layer.11.attention.self.query.bias -> (1024)[FLOAT]], [1685 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.attention.self.query.bias for ONNX node: bert.encoder.layer.11.attention.self.query.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1066 for ONNX node: Add_1066 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1686 for ONNX tensor: 1686 [06/20/2022-16:24:39] [V] [TRT] Add_1066 [Add] outputs: [1686 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1067 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1683 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3319 [06/20/2022-16:24:39] [V] [TRT] MatMul_1067 [MatMul] inputs: [1683 -> (-1, -1, 1024)[FLOAT]], [3319 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3319 for ONNX node: 3319 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1067 for ONNX node: MatMul_1067 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1688 for ONNX tensor: 1688 [06/20/2022-16:24:39] [V] [TRT] MatMul_1067 [MatMul] outputs: [1688 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1068 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.attention.self.key.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1688 [06/20/2022-16:24:39] [V] [TRT] Add_1068 [Add] inputs: [bert.encoder.layer.11.attention.self.key.bias -> (1024)[FLOAT]], [1688 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.attention.self.key.bias for ONNX node: bert.encoder.layer.11.attention.self.key.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1068 for ONNX node: Add_1068 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1689 for ONNX tensor: 1689 [06/20/2022-16:24:39] [V] [TRT] Add_1068 [Add] outputs: [1689 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1069 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1689 [06/20/2022-16:24:39] [V] [TRT] Shape_1069 [Shape] inputs: [1689 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1069 for ONNX node: Shape_1069 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1690 for ONNX tensor: 1690 [06/20/2022-16:24:39] [V] [TRT] Shape_1069 [Shape] outputs: [1690 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1070 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1070 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1070 [Constant] outputs: [1691 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1071 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1690 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1691 [06/20/2022-16:24:39] [V] [TRT] Gather_1071 [Gather] inputs: [1690 -> (3)[INT32]], [1691 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1691 for ONNX node: 1691 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1071 for ONNX node: Gather_1071 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1692 for ONNX tensor: 1692 [06/20/2022-16:24:39] [V] [TRT] Gather_1071 [Gather] outputs: [1692 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1072 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1689 [06/20/2022-16:24:39] [V] [TRT] Shape_1072 [Shape] inputs: [1689 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1072 for ONNX node: Shape_1072 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1693 for ONNX tensor: 1693 [06/20/2022-16:24:39] [V] [TRT] Shape_1072 [Shape] outputs: [1693 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1073 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1073 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1073 [Constant] outputs: [1694 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1074 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1693 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1694 [06/20/2022-16:24:39] [V] [TRT] Gather_1074 [Gather] inputs: [1693 -> (3)[INT32]], [1694 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1694 for ONNX node: 1694 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1074 for ONNX node: Gather_1074 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1695 for ONNX tensor: 1695 [06/20/2022-16:24:39] [V] [TRT] Gather_1074 [Gather] outputs: [1695 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1075 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1692 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1075 [Unsqueeze] inputs: [1692 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1075 for ONNX node: Unsqueeze_1075 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1698 for ONNX tensor: 1698 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1075 [Unsqueeze] outputs: [1698 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1076 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1695 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1076 [Unsqueeze] inputs: [1695 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1076 for ONNX node: Unsqueeze_1076 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1699 for ONNX tensor: 1699 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1076 [Unsqueeze] outputs: [1699 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_1077 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1698 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1699 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3320 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3321 [06/20/2022-16:24:39] [V] [TRT] Concat_1077 [Concat] inputs: [1698 -> (1)[INT32]], [1699 -> (1)[INT32]], [3320 -> (1)[INT32]], [3321 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3320 for ONNX node: 3320 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3321 for ONNX node: 3321 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_1077 for ONNX node: Concat_1077 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1702 for ONNX tensor: 1702 [06/20/2022-16:24:39] [V] [TRT] Concat_1077 [Concat] outputs: [1702 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_1078 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1689 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1702 [06/20/2022-16:24:39] [V] [TRT] Reshape_1078 [Reshape] inputs: [1689 -> (-1, -1, 1024)[FLOAT]], [1702 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_1078 for ONNX node: Reshape_1078 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1703 for ONNX tensor: 1703 [06/20/2022-16:24:39] [V] [TRT] Reshape_1078 [Reshape] outputs: [1703 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1079 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1683 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3322 [06/20/2022-16:24:39] [V] [TRT] MatMul_1079 [MatMul] inputs: [1683 -> (-1, -1, 1024)[FLOAT]], [3322 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3322 for ONNX node: 3322 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1079 for ONNX node: MatMul_1079 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1705 for ONNX tensor: 1705 [06/20/2022-16:24:39] [V] [TRT] MatMul_1079 [MatMul] outputs: [1705 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1080 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.attention.self.value.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1705 [06/20/2022-16:24:39] [V] [TRT] Add_1080 [Add] inputs: [bert.encoder.layer.11.attention.self.value.bias -> (1024)[FLOAT]], [1705 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.attention.self.value.bias for ONNX node: bert.encoder.layer.11.attention.self.value.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1080 for ONNX node: Add_1080 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1706 for ONNX tensor: 1706 [06/20/2022-16:24:39] [V] [TRT] Add_1080 [Add] outputs: [1706 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1081 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1706 [06/20/2022-16:24:39] [V] [TRT] Shape_1081 [Shape] inputs: [1706 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1081 for ONNX node: Shape_1081 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1707 for ONNX tensor: 1707 [06/20/2022-16:24:39] [V] [TRT] Shape_1081 [Shape] outputs: [1707 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1082 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1082 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1082 [Constant] outputs: [1708 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1083 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1707 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1708 [06/20/2022-16:24:39] [V] [TRT] Gather_1083 [Gather] inputs: [1707 -> (3)[INT32]], [1708 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1708 for ONNX node: 1708 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1083 for ONNX node: Gather_1083 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1709 for ONNX tensor: 1709 [06/20/2022-16:24:39] [V] [TRT] Gather_1083 [Gather] outputs: [1709 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1084 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1706 [06/20/2022-16:24:39] [V] [TRT] Shape_1084 [Shape] inputs: [1706 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1084 for ONNX node: Shape_1084 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1710 for ONNX tensor: 1710 [06/20/2022-16:24:39] [V] [TRT] Shape_1084 [Shape] outputs: [1710 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1085 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1085 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1085 [Constant] outputs: [1711 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1086 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1710 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1711 [06/20/2022-16:24:39] [V] [TRT] Gather_1086 [Gather] inputs: [1710 -> (3)[INT32]], [1711 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1711 for ONNX node: 1711 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1086 for ONNX node: Gather_1086 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1712 for ONNX tensor: 1712 [06/20/2022-16:24:39] [V] [TRT] Gather_1086 [Gather] outputs: [1712 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1087 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1709 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1087 [Unsqueeze] inputs: [1709 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1087 for ONNX node: Unsqueeze_1087 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1715 for ONNX tensor: 1715 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1087 [Unsqueeze] outputs: [1715 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1088 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1712 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1088 [Unsqueeze] inputs: [1712 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1088 for ONNX node: Unsqueeze_1088 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1716 for ONNX tensor: 1716 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1088 [Unsqueeze] outputs: [1716 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_1089 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1715 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1716 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3323 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3324 [06/20/2022-16:24:39] [V] [TRT] Concat_1089 [Concat] inputs: [1715 -> (1)[INT32]], [1716 -> (1)[INT32]], [3323 -> (1)[INT32]], [3324 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3323 for ONNX node: 3323 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3324 for ONNX node: 3324 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_1089 for ONNX node: Concat_1089 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1719 for ONNX tensor: 1719 [06/20/2022-16:24:39] [V] [TRT] Concat_1089 [Concat] outputs: [1719 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_1090 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1706 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1719 [06/20/2022-16:24:39] [V] [TRT] Reshape_1090 [Reshape] inputs: [1706 -> (-1, -1, 1024)[FLOAT]], [1719 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_1090 for ONNX node: Reshape_1090 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1720 for ONNX tensor: 1720 [06/20/2022-16:24:39] [V] [TRT] Reshape_1090 [Reshape] outputs: [1720 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1091 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1720 [06/20/2022-16:24:39] [V] [TRT] Transpose_1091 [Transpose] inputs: [1720 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1091 for ONNX node: Transpose_1091 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1721 for ONNX tensor: 1721 [06/20/2022-16:24:39] [V] [TRT] Transpose_1091 [Transpose] outputs: [1721 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1092 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1686 [06/20/2022-16:24:39] [V] [TRT] Shape_1092 [Shape] inputs: [1686 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1092 for ONNX node: Shape_1092 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1722 for ONNX tensor: 1722 [06/20/2022-16:24:39] [V] [TRT] Shape_1092 [Shape] outputs: [1722 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1093 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1093 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1093 [Constant] outputs: [1723 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1094 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1722 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1723 [06/20/2022-16:24:39] [V] [TRT] Gather_1094 [Gather] inputs: [1722 -> (3)[INT32]], [1723 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1723 for ONNX node: 1723 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1094 for ONNX node: Gather_1094 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1724 for ONNX tensor: 1724 [06/20/2022-16:24:39] [V] [TRT] Gather_1094 [Gather] outputs: [1724 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1095 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1686 [06/20/2022-16:24:39] [V] [TRT] Shape_1095 [Shape] inputs: [1686 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1095 for ONNX node: Shape_1095 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1725 for ONNX tensor: 1725 [06/20/2022-16:24:39] [V] [TRT] Shape_1095 [Shape] outputs: [1725 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1096 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1096 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1096 [Constant] outputs: [1726 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1097 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1725 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1726 [06/20/2022-16:24:39] [V] [TRT] Gather_1097 [Gather] inputs: [1725 -> (3)[INT32]], [1726 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1726 for ONNX node: 1726 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1097 for ONNX node: Gather_1097 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1727 for ONNX tensor: 1727 [06/20/2022-16:24:39] [V] [TRT] Gather_1097 [Gather] outputs: [1727 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1098 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1724 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1098 [Unsqueeze] inputs: [1724 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1098 for ONNX node: Unsqueeze_1098 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1730 for ONNX tensor: 1730 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1098 [Unsqueeze] outputs: [1730 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1099 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1727 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1099 [Unsqueeze] inputs: [1727 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1099 for ONNX node: Unsqueeze_1099 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1731 for ONNX tensor: 1731 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1099 [Unsqueeze] outputs: [1731 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_1100 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1730 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1731 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3325 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3326 [06/20/2022-16:24:39] [V] [TRT] Concat_1100 [Concat] inputs: [1730 -> (1)[INT32]], [1731 -> (1)[INT32]], [3325 -> (1)[INT32]], [3326 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3325 for ONNX node: 3325 [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3326 for ONNX node: 3326 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_1100 for ONNX node: Concat_1100 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1734 for ONNX tensor: 1734 [06/20/2022-16:24:39] [V] [TRT] Concat_1100 [Concat] outputs: [1734 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_1101 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1686 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1734 [06/20/2022-16:24:39] [V] [TRT] Reshape_1101 [Reshape] inputs: [1686 -> (-1, -1, 1024)[FLOAT]], [1734 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_1101 for ONNX node: Reshape_1101 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1735 for ONNX tensor: 1735 [06/20/2022-16:24:39] [V] [TRT] Reshape_1101 [Reshape] outputs: [1735 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1102 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1735 [06/20/2022-16:24:39] [V] [TRT] Transpose_1102 [Transpose] inputs: [1735 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1102 for ONNX node: Transpose_1102 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1736 for ONNX tensor: 1736 [06/20/2022-16:24:39] [V] [TRT] Transpose_1102 [Transpose] outputs: [1736 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1103 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1703 [06/20/2022-16:24:39] [V] [TRT] Transpose_1103 [Transpose] inputs: [1703 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1103 for ONNX node: Transpose_1103 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1737 for ONNX tensor: 1737 [06/20/2022-16:24:39] [V] [TRT] Transpose_1103 [Transpose] outputs: [1737 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1104 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1736 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1737 [06/20/2022-16:24:39] [V] [TRT] MatMul_1104 [MatMul] inputs: [1736 -> (-1, 16, -1, 64)[FLOAT]], [1737 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1104 for ONNX node: MatMul_1104 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1738 for ONNX tensor: 1738 [06/20/2022-16:24:39] [V] [TRT] MatMul_1104 [MatMul] outputs: [1738 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1105 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1105 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1105 [Constant] outputs: [1739 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1106 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1738 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1739 [06/20/2022-16:24:39] [V] [TRT] Div_1106 [Div] inputs: [1738 -> (-1, 16, -1, -1)[FLOAT]], [1739 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1739 for ONNX node: 1739 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1106 for ONNX node: Div_1106 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1740 for ONNX tensor: 1740 [06/20/2022-16:24:39] [V] [TRT] Div_1106 [Div] outputs: [1740 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1107 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1740 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:39] [V] [TRT] Add_1107 [Add] inputs: [1740 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1107 for ONNX node: Add_1107 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1741 for ONNX tensor: 1741 [06/20/2022-16:24:39] [V] [TRT] Add_1107 [Add] outputs: [1741 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Softmax_1108 [Softmax] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1741 [06/20/2022-16:24:39] [V] [TRT] Softmax_1108 [Softmax] inputs: [1741 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Softmax_1108 for ONNX node: Softmax_1108 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1742 for ONNX tensor: 1742 [06/20/2022-16:24:39] [V] [TRT] Softmax_1108 [Softmax] outputs: [1742 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1109 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1742 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1721 [06/20/2022-16:24:39] [V] [TRT] MatMul_1109 [MatMul] inputs: [1742 -> (-1, 16, -1, -1)[FLOAT]], [1721 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1109 for ONNX node: MatMul_1109 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1743 for ONNX tensor: 1743 [06/20/2022-16:24:39] [V] [TRT] MatMul_1109 [MatMul] outputs: [1743 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Transpose_1110 [Transpose] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1743 [06/20/2022-16:24:39] [V] [TRT] Transpose_1110 [Transpose] inputs: [1743 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Transpose_1110 for ONNX node: Transpose_1110 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1744 for ONNX tensor: 1744 [06/20/2022-16:24:39] [V] [TRT] Transpose_1110 [Transpose] outputs: [1744 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1111 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1744 [06/20/2022-16:24:39] [V] [TRT] Shape_1111 [Shape] inputs: [1744 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1111 for ONNX node: Shape_1111 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1745 for ONNX tensor: 1745 [06/20/2022-16:24:39] [V] [TRT] Shape_1111 [Shape] outputs: [1745 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1112 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1112 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1112 [Constant] outputs: [1746 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1113 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1745 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1746 [06/20/2022-16:24:39] [V] [TRT] Gather_1113 [Gather] inputs: [1745 -> (4)[INT32]], [1746 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1746 for ONNX node: 1746 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1113 for ONNX node: Gather_1113 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1747 for ONNX tensor: 1747 [06/20/2022-16:24:39] [V] [TRT] Gather_1113 [Gather] outputs: [1747 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Shape_1114 [Shape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1744 [06/20/2022-16:24:39] [V] [TRT] Shape_1114 [Shape] inputs: [1744 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Shape_1114 for ONNX node: Shape_1114 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1748 for ONNX tensor: 1748 [06/20/2022-16:24:39] [V] [TRT] Shape_1114 [Shape] outputs: [1748 -> (4)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1115 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1115 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1115 [Constant] outputs: [1749 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Gather_1116 [Gather] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1748 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1749 [06/20/2022-16:24:39] [V] [TRT] Gather_1116 [Gather] inputs: [1748 -> (4)[INT32]], [1749 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1749 for ONNX node: 1749 [06/20/2022-16:24:39] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Gather_1116 for ONNX node: Gather_1116 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1750 for ONNX tensor: 1750 [06/20/2022-16:24:39] [V] [TRT] Gather_1116 [Gather] outputs: [1750 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1117 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1747 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1117 [Unsqueeze] inputs: [1747 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1117 for ONNX node: Unsqueeze_1117 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1752 for ONNX tensor: 1752 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1117 [Unsqueeze] outputs: [1752 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Unsqueeze_1118 [Unsqueeze] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1750 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1118 [Unsqueeze] inputs: [1750 -> ()[INT32]], [06/20/2022-16:24:39] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:39] [V] [TRT] Registering layer: Unsqueeze_1118 for ONNX node: Unsqueeze_1118 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1753 for ONNX tensor: 1753 [06/20/2022-16:24:39] [V] [TRT] Unsqueeze_1118 [Unsqueeze] outputs: [1753 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Concat_1119 [Concat] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1752 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1753 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3327 [06/20/2022-16:24:39] [V] [TRT] Concat_1119 [Concat] inputs: [1752 -> (1)[INT32]], [1753 -> (1)[INT32]], [3327 -> (1)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3327 for ONNX node: 3327 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Concat_1119 for ONNX node: Concat_1119 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1755 for ONNX tensor: 1755 [06/20/2022-16:24:39] [V] [TRT] Concat_1119 [Concat] outputs: [1755 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Reshape_1120 [Reshape] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1744 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1755 [06/20/2022-16:24:39] [V] [TRT] Reshape_1120 [Reshape] inputs: [1744 -> (-1, -1, 16, 64)[FLOAT]], [1755 -> (3)[INT32]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Reshape_1120 for ONNX node: Reshape_1120 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1756 for ONNX tensor: 1756 [06/20/2022-16:24:39] [V] [TRT] Reshape_1120 [Reshape] outputs: [1756 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1121 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1756 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3328 [06/20/2022-16:24:39] [V] [TRT] MatMul_1121 [MatMul] inputs: [1756 -> (-1, -1, 1024)[FLOAT]], [3328 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3328 for ONNX node: 3328 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1121 for ONNX node: MatMul_1121 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1758 for ONNX tensor: 1758 [06/20/2022-16:24:39] [V] [TRT] MatMul_1121 [MatMul] outputs: [1758 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1122 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.attention.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1758 [06/20/2022-16:24:39] [V] [TRT] Add_1122 [Add] inputs: [bert.encoder.layer.11.attention.output.dense.bias -> (1024)[FLOAT]], [1758 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.attention.output.dense.bias for ONNX node: bert.encoder.layer.11.attention.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1122 for ONNX node: Add_1122 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1759 for ONNX tensor: 1759 [06/20/2022-16:24:39] [V] [TRT] Add_1122 [Add] outputs: [1759 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1123 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1759 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1683 [06/20/2022-16:24:39] [V] [TRT] Add_1123 [Add] inputs: [1759 -> (-1, -1, 1024)[FLOAT]], [1683 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1123 for ONNX node: Add_1123 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1760 for ONNX tensor: 1760 [06/20/2022-16:24:39] [V] [TRT] Add_1123 [Add] outputs: [1760 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1124 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1760 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1124 [ReduceMean] inputs: [1760 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1124 for ONNX node: ReduceMean_1124 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1761 for ONNX tensor: 1761 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1124 [ReduceMean] outputs: [1761 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sub_1125 [Sub] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1760 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1761 [06/20/2022-16:24:39] [V] [TRT] Sub_1125 [Sub] inputs: [1760 -> (-1, -1, 1024)[FLOAT]], [1761 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sub_1125 for ONNX node: Sub_1125 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1762 for ONNX tensor: 1762 [06/20/2022-16:24:39] [V] [TRT] Sub_1125 [Sub] outputs: [1762 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1126 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1126 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1126 [Constant] outputs: [1763 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Pow_1127 [Pow] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1762 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1763 [06/20/2022-16:24:39] [V] [TRT] Pow_1127 [Pow] inputs: [1762 -> (-1, -1, 1024)[FLOAT]], [1763 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1763 for ONNX node: 1763 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Pow_1127 for ONNX node: Pow_1127 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1764 for ONNX tensor: 1764 [06/20/2022-16:24:39] [V] [TRT] Pow_1127 [Pow] outputs: [1764 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1128 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1764 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1128 [ReduceMean] inputs: [1764 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1128 for ONNX node: ReduceMean_1128 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1765 for ONNX tensor: 1765 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1128 [ReduceMean] outputs: [1765 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1129 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1129 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1129 [Constant] outputs: [1766 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1130 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1765 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1766 [06/20/2022-16:24:39] [V] [TRT] Add_1130 [Add] inputs: [1765 -> (-1, -1, 1)[FLOAT]], [1766 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1766 for ONNX node: 1766 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1130 for ONNX node: Add_1130 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1767 for ONNX tensor: 1767 [06/20/2022-16:24:39] [V] [TRT] Add_1130 [Add] outputs: [1767 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sqrt_1131 [Sqrt] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1767 [06/20/2022-16:24:39] [V] [TRT] Sqrt_1131 [Sqrt] inputs: [1767 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sqrt_1131 for ONNX node: Sqrt_1131 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1768 for ONNX tensor: 1768 [06/20/2022-16:24:39] [V] [TRT] Sqrt_1131 [Sqrt] outputs: [1768 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1132 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1762 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1768 [06/20/2022-16:24:39] [V] [TRT] Div_1132 [Div] inputs: [1762 -> (-1, -1, 1024)[FLOAT]], [1768 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1132 for ONNX node: Div_1132 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1769 for ONNX tensor: 1769 [06/20/2022-16:24:39] [V] [TRT] Div_1132 [Div] outputs: [1769 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1133 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1769 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.attention.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Mul_1133 [Mul] inputs: [1769 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.11.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.11.attention.output.LayerNorm.weight [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1133 for ONNX node: Mul_1133 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1770 for ONNX tensor: 1770 [06/20/2022-16:24:39] [V] [TRT] Mul_1133 [Mul] outputs: [1770 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1134 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1770 [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.attention.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Add_1134 [Add] inputs: [1770 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.11.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.11.attention.output.LayerNorm.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1134 for ONNX node: Add_1134 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1771 for ONNX tensor: 1771 [06/20/2022-16:24:39] [V] [TRT] Add_1134 [Add] outputs: [1771 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1135 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1771 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3329 [06/20/2022-16:24:39] [V] [TRT] MatMul_1135 [MatMul] inputs: [1771 -> (-1, -1, 1024)[FLOAT]], [3329 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3329 for ONNX node: 3329 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1135 for ONNX node: MatMul_1135 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1773 for ONNX tensor: 1773 [06/20/2022-16:24:39] [V] [TRT] MatMul_1135 [MatMul] outputs: [1773 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1136 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.intermediate.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1773 [06/20/2022-16:24:39] [V] [TRT] Add_1136 [Add] inputs: [bert.encoder.layer.11.intermediate.dense.bias -> (4096)[FLOAT]], [1773 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.intermediate.dense.bias for ONNX node: bert.encoder.layer.11.intermediate.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1136 for ONNX node: Add_1136 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1774 for ONNX tensor: 1774 [06/20/2022-16:24:39] [V] [TRT] Add_1136 [Add] outputs: [1774 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1137 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1137 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1137 [Constant] outputs: [1775 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Div_1138 [Div] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1774 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1775 [06/20/2022-16:24:39] [V] [TRT] Div_1138 [Div] inputs: [1774 -> (-1, -1, 4096)[FLOAT]], [1775 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1775 for ONNX node: 1775 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Div_1138 for ONNX node: Div_1138 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1776 for ONNX tensor: 1776 [06/20/2022-16:24:39] [V] [TRT] Div_1138 [Div] outputs: [1776 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Erf_1139 [Erf] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1776 [06/20/2022-16:24:39] [V] [TRT] Erf_1139 [Erf] inputs: [1776 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Erf_1139 for ONNX node: Erf_1139 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1777 for ONNX tensor: 1777 [06/20/2022-16:24:39] [V] [TRT] Erf_1139 [Erf] outputs: [1777 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1140 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1140 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1140 [Constant] outputs: [1778 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1141 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1777 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1778 [06/20/2022-16:24:39] [V] [TRT] Add_1141 [Add] inputs: [1777 -> (-1, -1, 4096)[FLOAT]], [1778 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1778 for ONNX node: 1778 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1141 for ONNX node: Add_1141 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1779 for ONNX tensor: 1779 [06/20/2022-16:24:39] [V] [TRT] Add_1141 [Add] outputs: [1779 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1142 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1774 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1779 [06/20/2022-16:24:39] [V] [TRT] Mul_1142 [Mul] inputs: [1774 -> (-1, -1, 4096)[FLOAT]], [1779 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1142 for ONNX node: Mul_1142 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1780 for ONNX tensor: 1780 [06/20/2022-16:24:39] [V] [TRT] Mul_1142 [Mul] outputs: [1780 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1143 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1143 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1143 [Constant] outputs: [1781 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Mul_1144 [Mul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1780 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1781 [06/20/2022-16:24:39] [V] [TRT] Mul_1144 [Mul] inputs: [1780 -> (-1, -1, 4096)[FLOAT]], [1781 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1781 for ONNX node: 1781 [06/20/2022-16:24:39] [V] [TRT] Registering layer: Mul_1144 for ONNX node: Mul_1144 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1782 for ONNX tensor: 1782 [06/20/2022-16:24:39] [V] [TRT] Mul_1144 [Mul] outputs: [1782 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: MatMul_1145 [MatMul] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1782 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 3330 [06/20/2022-16:24:39] [V] [TRT] MatMul_1145 [MatMul] inputs: [1782 -> (-1, -1, 4096)[FLOAT]], [3330 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 3330 for ONNX node: 3330 [06/20/2022-16:24:39] [V] [TRT] Registering layer: MatMul_1145 for ONNX node: MatMul_1145 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1784 for ONNX tensor: 1784 [06/20/2022-16:24:39] [V] [TRT] MatMul_1145 [MatMul] outputs: [1784 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1146 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: bert.encoder.layer.11.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1784 [06/20/2022-16:24:39] [V] [TRT] Add_1146 [Add] inputs: [bert.encoder.layer.11.output.dense.bias -> (1024)[FLOAT]], [1784 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: bert.encoder.layer.11.output.dense.bias for ONNX node: bert.encoder.layer.11.output.dense.bias [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1146 for ONNX node: Add_1146 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1785 for ONNX tensor: 1785 [06/20/2022-16:24:39] [V] [TRT] Add_1146 [Add] outputs: [1785 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Add_1147 [Add] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1785 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1771 [06/20/2022-16:24:39] [V] [TRT] Add_1147 [Add] inputs: [1785 -> (-1, -1, 1024)[FLOAT]], [1771 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Add_1147 for ONNX node: Add_1147 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1786 for ONNX tensor: 1786 [06/20/2022-16:24:39] [V] [TRT] Add_1147 [Add] outputs: [1786 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: ReduceMean_1148 [ReduceMean] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1786 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1148 [ReduceMean] inputs: [1786 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: ReduceMean_1148 for ONNX node: ReduceMean_1148 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1787 for ONNX tensor: 1787 [06/20/2022-16:24:39] [V] [TRT] ReduceMean_1148 [ReduceMean] outputs: [1787 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Sub_1149 [Sub] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1786 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1787 [06/20/2022-16:24:39] [V] [TRT] Sub_1149 [Sub] inputs: [1786 -> (-1, -1, 1024)[FLOAT]], [1787 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: Sub_1149 for ONNX node: Sub_1149 [06/20/2022-16:24:39] [V] [TRT] Registering tensor: 1788 for ONNX tensor: 1788 [06/20/2022-16:24:39] [V] [TRT] Sub_1149 [Sub] outputs: [1788 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Constant_1150 [Constant] [06/20/2022-16:24:39] [V] [TRT] Constant_1150 [Constant] inputs: [06/20/2022-16:24:39] [V] [TRT] Constant_1150 [Constant] outputs: [1789 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Parsing node: Pow_1151 [Pow] [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1788 [06/20/2022-16:24:39] [V] [TRT] Searching for input: 1789 [06/20/2022-16:24:39] [V] [TRT] Pow_1151 [Pow] inputs: [1788 -> (-1, -1, 1024)[FLOAT]], [1789 -> ()[FLOAT]], [06/20/2022-16:24:39] [V] [TRT] Registering layer: 1789 for ONNX node: 1789 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Pow_1151 for ONNX node: Pow_1151 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1790 for ONNX tensor: 1790 [06/20/2022-16:24:40] [V] [TRT] Pow_1151 [Pow] outputs: [1790 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1152 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1790 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1152 [ReduceMean] inputs: [1790 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1152 for ONNX node: ReduceMean_1152 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1791 for ONNX tensor: 1791 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1152 [ReduceMean] outputs: [1791 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1153 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1153 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1153 [Constant] outputs: [1792 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1154 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1791 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1792 [06/20/2022-16:24:40] [V] [TRT] Add_1154 [Add] inputs: [1791 -> (-1, -1, 1)[FLOAT]], [1792 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1792 for ONNX node: 1792 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1154 for ONNX node: Add_1154 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1793 for ONNX tensor: 1793 [06/20/2022-16:24:40] [V] [TRT] Add_1154 [Add] outputs: [1793 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sqrt_1155 [Sqrt] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1793 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1155 [Sqrt] inputs: [1793 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sqrt_1155 for ONNX node: Sqrt_1155 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1794 for ONNX tensor: 1794 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1155 [Sqrt] outputs: [1794 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1156 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1788 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1794 [06/20/2022-16:24:40] [V] [TRT] Div_1156 [Div] inputs: [1788 -> (-1, -1, 1024)[FLOAT]], [1794 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1156 for ONNX node: Div_1156 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1795 for ONNX tensor: 1795 [06/20/2022-16:24:40] [V] [TRT] Div_1156 [Div] outputs: [1795 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1157 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1795 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.11.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Mul_1157 [Mul] inputs: [1795 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.11.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.11.output.LayerNorm.weight for ONNX node: bert.encoder.layer.11.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1157 for ONNX node: Mul_1157 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1796 for ONNX tensor: 1796 [06/20/2022-16:24:40] [V] [TRT] Mul_1157 [Mul] outputs: [1796 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1158 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1796 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.11.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Add_1158 [Add] inputs: [1796 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.11.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.11.output.LayerNorm.bias for ONNX node: bert.encoder.layer.11.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1158 for ONNX node: Add_1158 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1797 for ONNX tensor: 1797 [06/20/2022-16:24:40] [V] [TRT] Add_1158 [Add] outputs: [1797 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1159 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1797 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3331 [06/20/2022-16:24:40] [V] [TRT] MatMul_1159 [MatMul] inputs: [1797 -> (-1, -1, 1024)[FLOAT]], [3331 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3331 for ONNX node: 3331 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1159 for ONNX node: MatMul_1159 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1799 for ONNX tensor: 1799 [06/20/2022-16:24:40] [V] [TRT] MatMul_1159 [MatMul] outputs: [1799 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1160 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.attention.self.query.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1799 [06/20/2022-16:24:40] [V] [TRT] Add_1160 [Add] inputs: [bert.encoder.layer.12.attention.self.query.bias -> (1024)[FLOAT]], [1799 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.attention.self.query.bias for ONNX node: bert.encoder.layer.12.attention.self.query.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1160 for ONNX node: Add_1160 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1800 for ONNX tensor: 1800 [06/20/2022-16:24:40] [V] [TRT] Add_1160 [Add] outputs: [1800 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1161 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1797 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3332 [06/20/2022-16:24:40] [V] [TRT] MatMul_1161 [MatMul] inputs: [1797 -> (-1, -1, 1024)[FLOAT]], [3332 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3332 for ONNX node: 3332 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1161 for ONNX node: MatMul_1161 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1802 for ONNX tensor: 1802 [06/20/2022-16:24:40] [V] [TRT] MatMul_1161 [MatMul] outputs: [1802 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1162 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.attention.self.key.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1802 [06/20/2022-16:24:40] [V] [TRT] Add_1162 [Add] inputs: [bert.encoder.layer.12.attention.self.key.bias -> (1024)[FLOAT]], [1802 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.attention.self.key.bias for ONNX node: bert.encoder.layer.12.attention.self.key.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1162 for ONNX node: Add_1162 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1803 for ONNX tensor: 1803 [06/20/2022-16:24:40] [V] [TRT] Add_1162 [Add] outputs: [1803 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1163 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1803 [06/20/2022-16:24:40] [V] [TRT] Shape_1163 [Shape] inputs: [1803 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1163 for ONNX node: Shape_1163 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1804 for ONNX tensor: 1804 [06/20/2022-16:24:40] [V] [TRT] Shape_1163 [Shape] outputs: [1804 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1164 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1164 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1164 [Constant] outputs: [1805 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1165 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1804 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1805 [06/20/2022-16:24:40] [V] [TRT] Gather_1165 [Gather] inputs: [1804 -> (3)[INT32]], [1805 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1805 for ONNX node: 1805 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1165 for ONNX node: Gather_1165 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1806 for ONNX tensor: 1806 [06/20/2022-16:24:40] [V] [TRT] Gather_1165 [Gather] outputs: [1806 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1166 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1803 [06/20/2022-16:24:40] [V] [TRT] Shape_1166 [Shape] inputs: [1803 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1166 for ONNX node: Shape_1166 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1807 for ONNX tensor: 1807 [06/20/2022-16:24:40] [V] [TRT] Shape_1166 [Shape] outputs: [1807 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1167 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1167 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1167 [Constant] outputs: [1808 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1168 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1807 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1808 [06/20/2022-16:24:40] [V] [TRT] Gather_1168 [Gather] inputs: [1807 -> (3)[INT32]], [1808 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1808 for ONNX node: 1808 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1168 for ONNX node: Gather_1168 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1809 for ONNX tensor: 1809 [06/20/2022-16:24:40] [V] [TRT] Gather_1168 [Gather] outputs: [1809 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1169 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1806 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1169 [Unsqueeze] inputs: [1806 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1169 for ONNX node: Unsqueeze_1169 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1812 for ONNX tensor: 1812 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1169 [Unsqueeze] outputs: [1812 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1170 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1809 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1170 [Unsqueeze] inputs: [1809 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1170 for ONNX node: Unsqueeze_1170 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1813 for ONNX tensor: 1813 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1170 [Unsqueeze] outputs: [1813 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1171 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1812 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1813 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3333 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3334 [06/20/2022-16:24:40] [V] [TRT] Concat_1171 [Concat] inputs: [1812 -> (1)[INT32]], [1813 -> (1)[INT32]], [3333 -> (1)[INT32]], [3334 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3333 for ONNX node: 3333 [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3334 for ONNX node: 3334 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1171 for ONNX node: Concat_1171 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1816 for ONNX tensor: 1816 [06/20/2022-16:24:40] [V] [TRT] Concat_1171 [Concat] outputs: [1816 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1172 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1803 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1816 [06/20/2022-16:24:40] [V] [TRT] Reshape_1172 [Reshape] inputs: [1803 -> (-1, -1, 1024)[FLOAT]], [1816 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1172 for ONNX node: Reshape_1172 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1817 for ONNX tensor: 1817 [06/20/2022-16:24:40] [V] [TRT] Reshape_1172 [Reshape] outputs: [1817 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1173 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1797 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3335 [06/20/2022-16:24:40] [V] [TRT] MatMul_1173 [MatMul] inputs: [1797 -> (-1, -1, 1024)[FLOAT]], [3335 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3335 for ONNX node: 3335 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1173 for ONNX node: MatMul_1173 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1819 for ONNX tensor: 1819 [06/20/2022-16:24:40] [V] [TRT] MatMul_1173 [MatMul] outputs: [1819 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1174 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.attention.self.value.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1819 [06/20/2022-16:24:40] [V] [TRT] Add_1174 [Add] inputs: [bert.encoder.layer.12.attention.self.value.bias -> (1024)[FLOAT]], [1819 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.attention.self.value.bias for ONNX node: bert.encoder.layer.12.attention.self.value.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1174 for ONNX node: Add_1174 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1820 for ONNX tensor: 1820 [06/20/2022-16:24:40] [V] [TRT] Add_1174 [Add] outputs: [1820 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1175 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1820 [06/20/2022-16:24:40] [V] [TRT] Shape_1175 [Shape] inputs: [1820 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1175 for ONNX node: Shape_1175 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1821 for ONNX tensor: 1821 [06/20/2022-16:24:40] [V] [TRT] Shape_1175 [Shape] outputs: [1821 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1176 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1176 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1176 [Constant] outputs: [1822 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1177 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1821 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1822 [06/20/2022-16:24:40] [V] [TRT] Gather_1177 [Gather] inputs: [1821 -> (3)[INT32]], [1822 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1822 for ONNX node: 1822 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1177 for ONNX node: Gather_1177 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1823 for ONNX tensor: 1823 [06/20/2022-16:24:40] [V] [TRT] Gather_1177 [Gather] outputs: [1823 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1178 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1820 [06/20/2022-16:24:40] [V] [TRT] Shape_1178 [Shape] inputs: [1820 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1178 for ONNX node: Shape_1178 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1824 for ONNX tensor: 1824 [06/20/2022-16:24:40] [V] [TRT] Shape_1178 [Shape] outputs: [1824 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1179 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1179 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1179 [Constant] outputs: [1825 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1180 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1824 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1825 [06/20/2022-16:24:40] [V] [TRT] Gather_1180 [Gather] inputs: [1824 -> (3)[INT32]], [1825 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1825 for ONNX node: 1825 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1180 for ONNX node: Gather_1180 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1826 for ONNX tensor: 1826 [06/20/2022-16:24:40] [V] [TRT] Gather_1180 [Gather] outputs: [1826 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1181 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1823 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1181 [Unsqueeze] inputs: [1823 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1181 for ONNX node: Unsqueeze_1181 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1829 for ONNX tensor: 1829 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1181 [Unsqueeze] outputs: [1829 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1182 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1826 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1182 [Unsqueeze] inputs: [1826 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1182 for ONNX node: Unsqueeze_1182 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1830 for ONNX tensor: 1830 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1182 [Unsqueeze] outputs: [1830 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1183 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1829 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1830 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3336 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3337 [06/20/2022-16:24:40] [V] [TRT] Concat_1183 [Concat] inputs: [1829 -> (1)[INT32]], [1830 -> (1)[INT32]], [3336 -> (1)[INT32]], [3337 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3336 for ONNX node: 3336 [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3337 for ONNX node: 3337 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1183 for ONNX node: Concat_1183 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1833 for ONNX tensor: 1833 [06/20/2022-16:24:40] [V] [TRT] Concat_1183 [Concat] outputs: [1833 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1184 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1820 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1833 [06/20/2022-16:24:40] [V] [TRT] Reshape_1184 [Reshape] inputs: [1820 -> (-1, -1, 1024)[FLOAT]], [1833 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1184 for ONNX node: Reshape_1184 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1834 for ONNX tensor: 1834 [06/20/2022-16:24:40] [V] [TRT] Reshape_1184 [Reshape] outputs: [1834 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1185 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1834 [06/20/2022-16:24:40] [V] [TRT] Transpose_1185 [Transpose] inputs: [1834 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1185 for ONNX node: Transpose_1185 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1835 for ONNX tensor: 1835 [06/20/2022-16:24:40] [V] [TRT] Transpose_1185 [Transpose] outputs: [1835 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1186 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1800 [06/20/2022-16:24:40] [V] [TRT] Shape_1186 [Shape] inputs: [1800 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1186 for ONNX node: Shape_1186 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1836 for ONNX tensor: 1836 [06/20/2022-16:24:40] [V] [TRT] Shape_1186 [Shape] outputs: [1836 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1187 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1187 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1187 [Constant] outputs: [1837 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1188 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1836 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1837 [06/20/2022-16:24:40] [V] [TRT] Gather_1188 [Gather] inputs: [1836 -> (3)[INT32]], [1837 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1837 for ONNX node: 1837 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1188 for ONNX node: Gather_1188 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1838 for ONNX tensor: 1838 [06/20/2022-16:24:40] [V] [TRT] Gather_1188 [Gather] outputs: [1838 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1189 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1800 [06/20/2022-16:24:40] [V] [TRT] Shape_1189 [Shape] inputs: [1800 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1189 for ONNX node: Shape_1189 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1839 for ONNX tensor: 1839 [06/20/2022-16:24:40] [V] [TRT] Shape_1189 [Shape] outputs: [1839 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1190 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1190 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1190 [Constant] outputs: [1840 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1191 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1839 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1840 [06/20/2022-16:24:40] [V] [TRT] Gather_1191 [Gather] inputs: [1839 -> (3)[INT32]], [1840 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1840 for ONNX node: 1840 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1191 for ONNX node: Gather_1191 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1841 for ONNX tensor: 1841 [06/20/2022-16:24:40] [V] [TRT] Gather_1191 [Gather] outputs: [1841 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1192 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1838 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1192 [Unsqueeze] inputs: [1838 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1192 for ONNX node: Unsqueeze_1192 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1844 for ONNX tensor: 1844 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1192 [Unsqueeze] outputs: [1844 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1193 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1841 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1193 [Unsqueeze] inputs: [1841 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1193 for ONNX node: Unsqueeze_1193 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1845 for ONNX tensor: 1845 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1193 [Unsqueeze] outputs: [1845 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1194 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1844 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1845 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3338 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3339 [06/20/2022-16:24:40] [V] [TRT] Concat_1194 [Concat] inputs: [1844 -> (1)[INT32]], [1845 -> (1)[INT32]], [3338 -> (1)[INT32]], [3339 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3338 for ONNX node: 3338 [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3339 for ONNX node: 3339 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1194 for ONNX node: Concat_1194 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1848 for ONNX tensor: 1848 [06/20/2022-16:24:40] [V] [TRT] Concat_1194 [Concat] outputs: [1848 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1195 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1800 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1848 [06/20/2022-16:24:40] [V] [TRT] Reshape_1195 [Reshape] inputs: [1800 -> (-1, -1, 1024)[FLOAT]], [1848 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1195 for ONNX node: Reshape_1195 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1849 for ONNX tensor: 1849 [06/20/2022-16:24:40] [V] [TRT] Reshape_1195 [Reshape] outputs: [1849 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1196 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1849 [06/20/2022-16:24:40] [V] [TRT] Transpose_1196 [Transpose] inputs: [1849 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1196 for ONNX node: Transpose_1196 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1850 for ONNX tensor: 1850 [06/20/2022-16:24:40] [V] [TRT] Transpose_1196 [Transpose] outputs: [1850 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1197 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1817 [06/20/2022-16:24:40] [V] [TRT] Transpose_1197 [Transpose] inputs: [1817 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1197 for ONNX node: Transpose_1197 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1851 for ONNX tensor: 1851 [06/20/2022-16:24:40] [V] [TRT] Transpose_1197 [Transpose] outputs: [1851 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1198 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1850 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1851 [06/20/2022-16:24:40] [V] [TRT] MatMul_1198 [MatMul] inputs: [1850 -> (-1, 16, -1, 64)[FLOAT]], [1851 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1198 for ONNX node: MatMul_1198 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1852 for ONNX tensor: 1852 [06/20/2022-16:24:40] [V] [TRT] MatMul_1198 [MatMul] outputs: [1852 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1199 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1199 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1199 [Constant] outputs: [1853 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1200 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1852 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1853 [06/20/2022-16:24:40] [V] [TRT] Div_1200 [Div] inputs: [1852 -> (-1, 16, -1, -1)[FLOAT]], [1853 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1853 for ONNX node: 1853 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1200 for ONNX node: Div_1200 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1854 for ONNX tensor: 1854 [06/20/2022-16:24:40] [V] [TRT] Div_1200 [Div] outputs: [1854 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1201 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1854 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:40] [V] [TRT] Add_1201 [Add] inputs: [1854 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1201 for ONNX node: Add_1201 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1855 for ONNX tensor: 1855 [06/20/2022-16:24:40] [V] [TRT] Add_1201 [Add] outputs: [1855 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Softmax_1202 [Softmax] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1855 [06/20/2022-16:24:40] [V] [TRT] Softmax_1202 [Softmax] inputs: [1855 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Softmax_1202 for ONNX node: Softmax_1202 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1856 for ONNX tensor: 1856 [06/20/2022-16:24:40] [V] [TRT] Softmax_1202 [Softmax] outputs: [1856 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1203 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1856 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1835 [06/20/2022-16:24:40] [V] [TRT] MatMul_1203 [MatMul] inputs: [1856 -> (-1, 16, -1, -1)[FLOAT]], [1835 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1203 for ONNX node: MatMul_1203 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1857 for ONNX tensor: 1857 [06/20/2022-16:24:40] [V] [TRT] MatMul_1203 [MatMul] outputs: [1857 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1204 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1857 [06/20/2022-16:24:40] [V] [TRT] Transpose_1204 [Transpose] inputs: [1857 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1204 for ONNX node: Transpose_1204 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1858 for ONNX tensor: 1858 [06/20/2022-16:24:40] [V] [TRT] Transpose_1204 [Transpose] outputs: [1858 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1205 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1858 [06/20/2022-16:24:40] [V] [TRT] Shape_1205 [Shape] inputs: [1858 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1205 for ONNX node: Shape_1205 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1859 for ONNX tensor: 1859 [06/20/2022-16:24:40] [V] [TRT] Shape_1205 [Shape] outputs: [1859 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1206 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1206 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1206 [Constant] outputs: [1860 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1207 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1859 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1860 [06/20/2022-16:24:40] [V] [TRT] Gather_1207 [Gather] inputs: [1859 -> (4)[INT32]], [1860 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1860 for ONNX node: 1860 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1207 for ONNX node: Gather_1207 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1861 for ONNX tensor: 1861 [06/20/2022-16:24:40] [V] [TRT] Gather_1207 [Gather] outputs: [1861 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1208 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1858 [06/20/2022-16:24:40] [V] [TRT] Shape_1208 [Shape] inputs: [1858 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1208 for ONNX node: Shape_1208 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1862 for ONNX tensor: 1862 [06/20/2022-16:24:40] [V] [TRT] Shape_1208 [Shape] outputs: [1862 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1209 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1209 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1209 [Constant] outputs: [1863 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1210 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1862 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1863 [06/20/2022-16:24:40] [V] [TRT] Gather_1210 [Gather] inputs: [1862 -> (4)[INT32]], [1863 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1863 for ONNX node: 1863 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1210 for ONNX node: Gather_1210 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1864 for ONNX tensor: 1864 [06/20/2022-16:24:40] [V] [TRT] Gather_1210 [Gather] outputs: [1864 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1211 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1861 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1211 [Unsqueeze] inputs: [1861 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1211 for ONNX node: Unsqueeze_1211 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1866 for ONNX tensor: 1866 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1211 [Unsqueeze] outputs: [1866 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1212 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1864 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1212 [Unsqueeze] inputs: [1864 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1212 for ONNX node: Unsqueeze_1212 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1867 for ONNX tensor: 1867 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1212 [Unsqueeze] outputs: [1867 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1213 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1866 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1867 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3340 [06/20/2022-16:24:40] [V] [TRT] Concat_1213 [Concat] inputs: [1866 -> (1)[INT32]], [1867 -> (1)[INT32]], [3340 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3340 for ONNX node: 3340 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1213 for ONNX node: Concat_1213 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1869 for ONNX tensor: 1869 [06/20/2022-16:24:40] [V] [TRT] Concat_1213 [Concat] outputs: [1869 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1214 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1858 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1869 [06/20/2022-16:24:40] [V] [TRT] Reshape_1214 [Reshape] inputs: [1858 -> (-1, -1, 16, 64)[FLOAT]], [1869 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1214 for ONNX node: Reshape_1214 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1870 for ONNX tensor: 1870 [06/20/2022-16:24:40] [V] [TRT] Reshape_1214 [Reshape] outputs: [1870 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1215 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1870 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3341 [06/20/2022-16:24:40] [V] [TRT] MatMul_1215 [MatMul] inputs: [1870 -> (-1, -1, 1024)[FLOAT]], [3341 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3341 for ONNX node: 3341 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1215 for ONNX node: MatMul_1215 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1872 for ONNX tensor: 1872 [06/20/2022-16:24:40] [V] [TRT] MatMul_1215 [MatMul] outputs: [1872 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1216 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.attention.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1872 [06/20/2022-16:24:40] [V] [TRT] Add_1216 [Add] inputs: [bert.encoder.layer.12.attention.output.dense.bias -> (1024)[FLOAT]], [1872 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.attention.output.dense.bias for ONNX node: bert.encoder.layer.12.attention.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1216 for ONNX node: Add_1216 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1873 for ONNX tensor: 1873 [06/20/2022-16:24:40] [V] [TRT] Add_1216 [Add] outputs: [1873 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1217 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1873 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1797 [06/20/2022-16:24:40] [V] [TRT] Add_1217 [Add] inputs: [1873 -> (-1, -1, 1024)[FLOAT]], [1797 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1217 for ONNX node: Add_1217 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1874 for ONNX tensor: 1874 [06/20/2022-16:24:40] [V] [TRT] Add_1217 [Add] outputs: [1874 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1218 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1874 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1218 [ReduceMean] inputs: [1874 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1218 for ONNX node: ReduceMean_1218 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1875 for ONNX tensor: 1875 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1218 [ReduceMean] outputs: [1875 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sub_1219 [Sub] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1874 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1875 [06/20/2022-16:24:40] [V] [TRT] Sub_1219 [Sub] inputs: [1874 -> (-1, -1, 1024)[FLOAT]], [1875 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sub_1219 for ONNX node: Sub_1219 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1876 for ONNX tensor: 1876 [06/20/2022-16:24:40] [V] [TRT] Sub_1219 [Sub] outputs: [1876 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1220 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1220 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1220 [Constant] outputs: [1877 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Pow_1221 [Pow] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1876 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1877 [06/20/2022-16:24:40] [V] [TRT] Pow_1221 [Pow] inputs: [1876 -> (-1, -1, 1024)[FLOAT]], [1877 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1877 for ONNX node: 1877 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Pow_1221 for ONNX node: Pow_1221 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1878 for ONNX tensor: 1878 [06/20/2022-16:24:40] [V] [TRT] Pow_1221 [Pow] outputs: [1878 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1222 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1878 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1222 [ReduceMean] inputs: [1878 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1222 for ONNX node: ReduceMean_1222 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1879 for ONNX tensor: 1879 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1222 [ReduceMean] outputs: [1879 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1223 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1223 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1223 [Constant] outputs: [1880 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1224 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1879 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1880 [06/20/2022-16:24:40] [V] [TRT] Add_1224 [Add] inputs: [1879 -> (-1, -1, 1)[FLOAT]], [1880 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1880 for ONNX node: 1880 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1224 for ONNX node: Add_1224 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1881 for ONNX tensor: 1881 [06/20/2022-16:24:40] [V] [TRT] Add_1224 [Add] outputs: [1881 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sqrt_1225 [Sqrt] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1881 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1225 [Sqrt] inputs: [1881 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sqrt_1225 for ONNX node: Sqrt_1225 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1882 for ONNX tensor: 1882 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1225 [Sqrt] outputs: [1882 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1226 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1876 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1882 [06/20/2022-16:24:40] [V] [TRT] Div_1226 [Div] inputs: [1876 -> (-1, -1, 1024)[FLOAT]], [1882 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1226 for ONNX node: Div_1226 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1883 for ONNX tensor: 1883 [06/20/2022-16:24:40] [V] [TRT] Div_1226 [Div] outputs: [1883 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1227 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1883 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.attention.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Mul_1227 [Mul] inputs: [1883 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.12.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.12.attention.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1227 for ONNX node: Mul_1227 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1884 for ONNX tensor: 1884 [06/20/2022-16:24:40] [V] [TRT] Mul_1227 [Mul] outputs: [1884 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1228 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1884 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.attention.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Add_1228 [Add] inputs: [1884 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.12.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.12.attention.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1228 for ONNX node: Add_1228 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1885 for ONNX tensor: 1885 [06/20/2022-16:24:40] [V] [TRT] Add_1228 [Add] outputs: [1885 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1229 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1885 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3342 [06/20/2022-16:24:40] [V] [TRT] MatMul_1229 [MatMul] inputs: [1885 -> (-1, -1, 1024)[FLOAT]], [3342 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3342 for ONNX node: 3342 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1229 for ONNX node: MatMul_1229 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1887 for ONNX tensor: 1887 [06/20/2022-16:24:40] [V] [TRT] MatMul_1229 [MatMul] outputs: [1887 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1230 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.intermediate.dense.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1887 [06/20/2022-16:24:40] [V] [TRT] Add_1230 [Add] inputs: [bert.encoder.layer.12.intermediate.dense.bias -> (4096)[FLOAT]], [1887 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.intermediate.dense.bias for ONNX node: bert.encoder.layer.12.intermediate.dense.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1230 for ONNX node: Add_1230 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1888 for ONNX tensor: 1888 [06/20/2022-16:24:40] [V] [TRT] Add_1230 [Add] outputs: [1888 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1231 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1231 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1231 [Constant] outputs: [1889 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1232 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1888 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1889 [06/20/2022-16:24:40] [V] [TRT] Div_1232 [Div] inputs: [1888 -> (-1, -1, 4096)[FLOAT]], [1889 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1889 for ONNX node: 1889 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1232 for ONNX node: Div_1232 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1890 for ONNX tensor: 1890 [06/20/2022-16:24:40] [V] [TRT] Div_1232 [Div] outputs: [1890 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Erf_1233 [Erf] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1890 [06/20/2022-16:24:40] [V] [TRT] Erf_1233 [Erf] inputs: [1890 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Erf_1233 for ONNX node: Erf_1233 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1891 for ONNX tensor: 1891 [06/20/2022-16:24:40] [V] [TRT] Erf_1233 [Erf] outputs: [1891 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1234 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1234 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1234 [Constant] outputs: [1892 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1235 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1891 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1892 [06/20/2022-16:24:40] [V] [TRT] Add_1235 [Add] inputs: [1891 -> (-1, -1, 4096)[FLOAT]], [1892 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1892 for ONNX node: 1892 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1235 for ONNX node: Add_1235 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1893 for ONNX tensor: 1893 [06/20/2022-16:24:40] [V] [TRT] Add_1235 [Add] outputs: [1893 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1236 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1888 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1893 [06/20/2022-16:24:40] [V] [TRT] Mul_1236 [Mul] inputs: [1888 -> (-1, -1, 4096)[FLOAT]], [1893 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1236 for ONNX node: Mul_1236 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1894 for ONNX tensor: 1894 [06/20/2022-16:24:40] [V] [TRT] Mul_1236 [Mul] outputs: [1894 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1237 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1237 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1237 [Constant] outputs: [1895 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1238 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1894 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1895 [06/20/2022-16:24:40] [V] [TRT] Mul_1238 [Mul] inputs: [1894 -> (-1, -1, 4096)[FLOAT]], [1895 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1895 for ONNX node: 1895 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1238 for ONNX node: Mul_1238 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1896 for ONNX tensor: 1896 [06/20/2022-16:24:40] [V] [TRT] Mul_1238 [Mul] outputs: [1896 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1239 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1896 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3343 [06/20/2022-16:24:40] [V] [TRT] MatMul_1239 [MatMul] inputs: [1896 -> (-1, -1, 4096)[FLOAT]], [3343 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3343 for ONNX node: 3343 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1239 for ONNX node: MatMul_1239 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1898 for ONNX tensor: 1898 [06/20/2022-16:24:40] [V] [TRT] MatMul_1239 [MatMul] outputs: [1898 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1240 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1898 [06/20/2022-16:24:40] [V] [TRT] Add_1240 [Add] inputs: [bert.encoder.layer.12.output.dense.bias -> (1024)[FLOAT]], [1898 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.output.dense.bias for ONNX node: bert.encoder.layer.12.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1240 for ONNX node: Add_1240 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1899 for ONNX tensor: 1899 [06/20/2022-16:24:40] [V] [TRT] Add_1240 [Add] outputs: [1899 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1241 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1899 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1885 [06/20/2022-16:24:40] [V] [TRT] Add_1241 [Add] inputs: [1899 -> (-1, -1, 1024)[FLOAT]], [1885 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1241 for ONNX node: Add_1241 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1900 for ONNX tensor: 1900 [06/20/2022-16:24:40] [V] [TRT] Add_1241 [Add] outputs: [1900 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1242 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1900 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1242 [ReduceMean] inputs: [1900 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1242 for ONNX node: ReduceMean_1242 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1901 for ONNX tensor: 1901 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1242 [ReduceMean] outputs: [1901 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sub_1243 [Sub] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1900 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1901 [06/20/2022-16:24:40] [V] [TRT] Sub_1243 [Sub] inputs: [1900 -> (-1, -1, 1024)[FLOAT]], [1901 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sub_1243 for ONNX node: Sub_1243 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1902 for ONNX tensor: 1902 [06/20/2022-16:24:40] [V] [TRT] Sub_1243 [Sub] outputs: [1902 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1244 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1244 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1244 [Constant] outputs: [1903 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Pow_1245 [Pow] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1902 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1903 [06/20/2022-16:24:40] [V] [TRT] Pow_1245 [Pow] inputs: [1902 -> (-1, -1, 1024)[FLOAT]], [1903 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1903 for ONNX node: 1903 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Pow_1245 for ONNX node: Pow_1245 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1904 for ONNX tensor: 1904 [06/20/2022-16:24:40] [V] [TRT] Pow_1245 [Pow] outputs: [1904 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1246 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1904 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1246 [ReduceMean] inputs: [1904 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1246 for ONNX node: ReduceMean_1246 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1905 for ONNX tensor: 1905 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1246 [ReduceMean] outputs: [1905 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1247 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1247 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1247 [Constant] outputs: [1906 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1248 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1905 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1906 [06/20/2022-16:24:40] [V] [TRT] Add_1248 [Add] inputs: [1905 -> (-1, -1, 1)[FLOAT]], [1906 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1906 for ONNX node: 1906 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1248 for ONNX node: Add_1248 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1907 for ONNX tensor: 1907 [06/20/2022-16:24:40] [V] [TRT] Add_1248 [Add] outputs: [1907 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sqrt_1249 [Sqrt] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1907 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1249 [Sqrt] inputs: [1907 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sqrt_1249 for ONNX node: Sqrt_1249 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1908 for ONNX tensor: 1908 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1249 [Sqrt] outputs: [1908 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1250 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1902 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1908 [06/20/2022-16:24:40] [V] [TRT] Div_1250 [Div] inputs: [1902 -> (-1, -1, 1024)[FLOAT]], [1908 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1250 for ONNX node: Div_1250 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1909 for ONNX tensor: 1909 [06/20/2022-16:24:40] [V] [TRT] Div_1250 [Div] outputs: [1909 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1251 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1909 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Mul_1251 [Mul] inputs: [1909 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.12.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.output.LayerNorm.weight for ONNX node: bert.encoder.layer.12.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1251 for ONNX node: Mul_1251 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1910 for ONNX tensor: 1910 [06/20/2022-16:24:40] [V] [TRT] Mul_1251 [Mul] outputs: [1910 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1252 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1910 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.12.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Add_1252 [Add] inputs: [1910 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.12.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.12.output.LayerNorm.bias for ONNX node: bert.encoder.layer.12.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1252 for ONNX node: Add_1252 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1911 for ONNX tensor: 1911 [06/20/2022-16:24:40] [V] [TRT] Add_1252 [Add] outputs: [1911 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1253 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1911 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3344 [06/20/2022-16:24:40] [V] [TRT] MatMul_1253 [MatMul] inputs: [1911 -> (-1, -1, 1024)[FLOAT]], [3344 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3344 for ONNX node: 3344 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1253 for ONNX node: MatMul_1253 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1913 for ONNX tensor: 1913 [06/20/2022-16:24:40] [V] [TRT] MatMul_1253 [MatMul] outputs: [1913 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1254 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.attention.self.query.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1913 [06/20/2022-16:24:40] [V] [TRT] Add_1254 [Add] inputs: [bert.encoder.layer.13.attention.self.query.bias -> (1024)[FLOAT]], [1913 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.attention.self.query.bias for ONNX node: bert.encoder.layer.13.attention.self.query.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1254 for ONNX node: Add_1254 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1914 for ONNX tensor: 1914 [06/20/2022-16:24:40] [V] [TRT] Add_1254 [Add] outputs: [1914 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1255 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1911 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3345 [06/20/2022-16:24:40] [V] [TRT] MatMul_1255 [MatMul] inputs: [1911 -> (-1, -1, 1024)[FLOAT]], [3345 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3345 for ONNX node: 3345 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1255 for ONNX node: MatMul_1255 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1916 for ONNX tensor: 1916 [06/20/2022-16:24:40] [V] [TRT] MatMul_1255 [MatMul] outputs: [1916 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1256 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.attention.self.key.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1916 [06/20/2022-16:24:40] [V] [TRT] Add_1256 [Add] inputs: [bert.encoder.layer.13.attention.self.key.bias -> (1024)[FLOAT]], [1916 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.attention.self.key.bias for ONNX node: bert.encoder.layer.13.attention.self.key.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1256 for ONNX node: Add_1256 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1917 for ONNX tensor: 1917 [06/20/2022-16:24:40] [V] [TRT] Add_1256 [Add] outputs: [1917 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1257 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1917 [06/20/2022-16:24:40] [V] [TRT] Shape_1257 [Shape] inputs: [1917 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1257 for ONNX node: Shape_1257 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1918 for ONNX tensor: 1918 [06/20/2022-16:24:40] [V] [TRT] Shape_1257 [Shape] outputs: [1918 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1258 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1258 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1258 [Constant] outputs: [1919 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1259 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1918 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1919 [06/20/2022-16:24:40] [V] [TRT] Gather_1259 [Gather] inputs: [1918 -> (3)[INT32]], [1919 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1919 for ONNX node: 1919 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1259 for ONNX node: Gather_1259 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1920 for ONNX tensor: 1920 [06/20/2022-16:24:40] [V] [TRT] Gather_1259 [Gather] outputs: [1920 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1260 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1917 [06/20/2022-16:24:40] [V] [TRT] Shape_1260 [Shape] inputs: [1917 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1260 for ONNX node: Shape_1260 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1921 for ONNX tensor: 1921 [06/20/2022-16:24:40] [V] [TRT] Shape_1260 [Shape] outputs: [1921 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1261 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1261 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1261 [Constant] outputs: [1922 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1262 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1921 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1922 [06/20/2022-16:24:40] [V] [TRT] Gather_1262 [Gather] inputs: [1921 -> (3)[INT32]], [1922 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1922 for ONNX node: 1922 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1262 for ONNX node: Gather_1262 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1923 for ONNX tensor: 1923 [06/20/2022-16:24:40] [V] [TRT] Gather_1262 [Gather] outputs: [1923 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1263 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1920 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1263 [Unsqueeze] inputs: [1920 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1263 for ONNX node: Unsqueeze_1263 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1926 for ONNX tensor: 1926 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1263 [Unsqueeze] outputs: [1926 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1264 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1923 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1264 [Unsqueeze] inputs: [1923 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1264 for ONNX node: Unsqueeze_1264 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1927 for ONNX tensor: 1927 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1264 [Unsqueeze] outputs: [1927 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1265 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1926 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1927 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3346 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3347 [06/20/2022-16:24:40] [V] [TRT] Concat_1265 [Concat] inputs: [1926 -> (1)[INT32]], [1927 -> (1)[INT32]], [3346 -> (1)[INT32]], [3347 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3346 for ONNX node: 3346 [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3347 for ONNX node: 3347 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1265 for ONNX node: Concat_1265 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1930 for ONNX tensor: 1930 [06/20/2022-16:24:40] [V] [TRT] Concat_1265 [Concat] outputs: [1930 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1266 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1917 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1930 [06/20/2022-16:24:40] [V] [TRT] Reshape_1266 [Reshape] inputs: [1917 -> (-1, -1, 1024)[FLOAT]], [1930 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1266 for ONNX node: Reshape_1266 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1931 for ONNX tensor: 1931 [06/20/2022-16:24:40] [V] [TRT] Reshape_1266 [Reshape] outputs: [1931 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1267 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1911 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3348 [06/20/2022-16:24:40] [V] [TRT] MatMul_1267 [MatMul] inputs: [1911 -> (-1, -1, 1024)[FLOAT]], [3348 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3348 for ONNX node: 3348 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1267 for ONNX node: MatMul_1267 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1933 for ONNX tensor: 1933 [06/20/2022-16:24:40] [V] [TRT] MatMul_1267 [MatMul] outputs: [1933 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1268 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.attention.self.value.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1933 [06/20/2022-16:24:40] [V] [TRT] Add_1268 [Add] inputs: [bert.encoder.layer.13.attention.self.value.bias -> (1024)[FLOAT]], [1933 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.attention.self.value.bias for ONNX node: bert.encoder.layer.13.attention.self.value.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1268 for ONNX node: Add_1268 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1934 for ONNX tensor: 1934 [06/20/2022-16:24:40] [V] [TRT] Add_1268 [Add] outputs: [1934 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1269 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1934 [06/20/2022-16:24:40] [V] [TRT] Shape_1269 [Shape] inputs: [1934 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1269 for ONNX node: Shape_1269 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1935 for ONNX tensor: 1935 [06/20/2022-16:24:40] [V] [TRT] Shape_1269 [Shape] outputs: [1935 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1270 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1270 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1270 [Constant] outputs: [1936 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1271 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1935 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1936 [06/20/2022-16:24:40] [V] [TRT] Gather_1271 [Gather] inputs: [1935 -> (3)[INT32]], [1936 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1936 for ONNX node: 1936 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1271 for ONNX node: Gather_1271 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1937 for ONNX tensor: 1937 [06/20/2022-16:24:40] [V] [TRT] Gather_1271 [Gather] outputs: [1937 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1272 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1934 [06/20/2022-16:24:40] [V] [TRT] Shape_1272 [Shape] inputs: [1934 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1272 for ONNX node: Shape_1272 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1938 for ONNX tensor: 1938 [06/20/2022-16:24:40] [V] [TRT] Shape_1272 [Shape] outputs: [1938 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1273 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1273 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1273 [Constant] outputs: [1939 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1274 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1938 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1939 [06/20/2022-16:24:40] [V] [TRT] Gather_1274 [Gather] inputs: [1938 -> (3)[INT32]], [1939 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1939 for ONNX node: 1939 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1274 for ONNX node: Gather_1274 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1940 for ONNX tensor: 1940 [06/20/2022-16:24:40] [V] [TRT] Gather_1274 [Gather] outputs: [1940 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1275 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1937 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1275 [Unsqueeze] inputs: [1937 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1275 for ONNX node: Unsqueeze_1275 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1943 for ONNX tensor: 1943 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1275 [Unsqueeze] outputs: [1943 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1276 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1940 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1276 [Unsqueeze] inputs: [1940 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1276 for ONNX node: Unsqueeze_1276 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1944 for ONNX tensor: 1944 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1276 [Unsqueeze] outputs: [1944 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1277 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1943 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1944 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3349 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3350 [06/20/2022-16:24:40] [V] [TRT] Concat_1277 [Concat] inputs: [1943 -> (1)[INT32]], [1944 -> (1)[INT32]], [3349 -> (1)[INT32]], [3350 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3349 for ONNX node: 3349 [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3350 for ONNX node: 3350 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1277 for ONNX node: Concat_1277 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1947 for ONNX tensor: 1947 [06/20/2022-16:24:40] [V] [TRT] Concat_1277 [Concat] outputs: [1947 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1278 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1934 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1947 [06/20/2022-16:24:40] [V] [TRT] Reshape_1278 [Reshape] inputs: [1934 -> (-1, -1, 1024)[FLOAT]], [1947 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1278 for ONNX node: Reshape_1278 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1948 for ONNX tensor: 1948 [06/20/2022-16:24:40] [V] [TRT] Reshape_1278 [Reshape] outputs: [1948 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1279 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1948 [06/20/2022-16:24:40] [V] [TRT] Transpose_1279 [Transpose] inputs: [1948 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1279 for ONNX node: Transpose_1279 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1949 for ONNX tensor: 1949 [06/20/2022-16:24:40] [V] [TRT] Transpose_1279 [Transpose] outputs: [1949 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1280 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1914 [06/20/2022-16:24:40] [V] [TRT] Shape_1280 [Shape] inputs: [1914 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1280 for ONNX node: Shape_1280 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1950 for ONNX tensor: 1950 [06/20/2022-16:24:40] [V] [TRT] Shape_1280 [Shape] outputs: [1950 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1281 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1281 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1281 [Constant] outputs: [1951 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1282 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1950 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1951 [06/20/2022-16:24:40] [V] [TRT] Gather_1282 [Gather] inputs: [1950 -> (3)[INT32]], [1951 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1951 for ONNX node: 1951 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1282 for ONNX node: Gather_1282 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1952 for ONNX tensor: 1952 [06/20/2022-16:24:40] [V] [TRT] Gather_1282 [Gather] outputs: [1952 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1283 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1914 [06/20/2022-16:24:40] [V] [TRT] Shape_1283 [Shape] inputs: [1914 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1283 for ONNX node: Shape_1283 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1953 for ONNX tensor: 1953 [06/20/2022-16:24:40] [V] [TRT] Shape_1283 [Shape] outputs: [1953 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1284 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1284 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1284 [Constant] outputs: [1954 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1285 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1953 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1954 [06/20/2022-16:24:40] [V] [TRT] Gather_1285 [Gather] inputs: [1953 -> (3)[INT32]], [1954 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1954 for ONNX node: 1954 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1285 for ONNX node: Gather_1285 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1955 for ONNX tensor: 1955 [06/20/2022-16:24:40] [V] [TRT] Gather_1285 [Gather] outputs: [1955 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1286 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1952 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1286 [Unsqueeze] inputs: [1952 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1286 for ONNX node: Unsqueeze_1286 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1958 for ONNX tensor: 1958 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1286 [Unsqueeze] outputs: [1958 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1287 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1955 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1287 [Unsqueeze] inputs: [1955 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1287 for ONNX node: Unsqueeze_1287 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1959 for ONNX tensor: 1959 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1287 [Unsqueeze] outputs: [1959 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1288 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1958 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1959 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3351 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3352 [06/20/2022-16:24:40] [V] [TRT] Concat_1288 [Concat] inputs: [1958 -> (1)[INT32]], [1959 -> (1)[INT32]], [3351 -> (1)[INT32]], [3352 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3351 for ONNX node: 3351 [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3352 for ONNX node: 3352 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1288 for ONNX node: Concat_1288 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1962 for ONNX tensor: 1962 [06/20/2022-16:24:40] [V] [TRT] Concat_1288 [Concat] outputs: [1962 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1289 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1914 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1962 [06/20/2022-16:24:40] [V] [TRT] Reshape_1289 [Reshape] inputs: [1914 -> (-1, -1, 1024)[FLOAT]], [1962 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1289 for ONNX node: Reshape_1289 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1963 for ONNX tensor: 1963 [06/20/2022-16:24:40] [V] [TRT] Reshape_1289 [Reshape] outputs: [1963 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1290 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1963 [06/20/2022-16:24:40] [V] [TRT] Transpose_1290 [Transpose] inputs: [1963 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1290 for ONNX node: Transpose_1290 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1964 for ONNX tensor: 1964 [06/20/2022-16:24:40] [V] [TRT] Transpose_1290 [Transpose] outputs: [1964 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1291 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1931 [06/20/2022-16:24:40] [V] [TRT] Transpose_1291 [Transpose] inputs: [1931 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1291 for ONNX node: Transpose_1291 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1965 for ONNX tensor: 1965 [06/20/2022-16:24:40] [V] [TRT] Transpose_1291 [Transpose] outputs: [1965 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1292 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1964 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1965 [06/20/2022-16:24:40] [V] [TRT] MatMul_1292 [MatMul] inputs: [1964 -> (-1, 16, -1, 64)[FLOAT]], [1965 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1292 for ONNX node: MatMul_1292 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1966 for ONNX tensor: 1966 [06/20/2022-16:24:40] [V] [TRT] MatMul_1292 [MatMul] outputs: [1966 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1293 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1293 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1293 [Constant] outputs: [1967 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1294 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1966 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1967 [06/20/2022-16:24:40] [V] [TRT] Div_1294 [Div] inputs: [1966 -> (-1, 16, -1, -1)[FLOAT]], [1967 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1967 for ONNX node: 1967 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1294 for ONNX node: Div_1294 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1968 for ONNX tensor: 1968 [06/20/2022-16:24:40] [V] [TRT] Div_1294 [Div] outputs: [1968 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1295 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1968 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:40] [V] [TRT] Add_1295 [Add] inputs: [1968 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1295 for ONNX node: Add_1295 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1969 for ONNX tensor: 1969 [06/20/2022-16:24:40] [V] [TRT] Add_1295 [Add] outputs: [1969 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Softmax_1296 [Softmax] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1969 [06/20/2022-16:24:40] [V] [TRT] Softmax_1296 [Softmax] inputs: [1969 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Softmax_1296 for ONNX node: Softmax_1296 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1970 for ONNX tensor: 1970 [06/20/2022-16:24:40] [V] [TRT] Softmax_1296 [Softmax] outputs: [1970 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1297 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1970 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1949 [06/20/2022-16:24:40] [V] [TRT] MatMul_1297 [MatMul] inputs: [1970 -> (-1, 16, -1, -1)[FLOAT]], [1949 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1297 for ONNX node: MatMul_1297 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1971 for ONNX tensor: 1971 [06/20/2022-16:24:40] [V] [TRT] MatMul_1297 [MatMul] outputs: [1971 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Transpose_1298 [Transpose] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1971 [06/20/2022-16:24:40] [V] [TRT] Transpose_1298 [Transpose] inputs: [1971 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Transpose_1298 for ONNX node: Transpose_1298 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1972 for ONNX tensor: 1972 [06/20/2022-16:24:40] [V] [TRT] Transpose_1298 [Transpose] outputs: [1972 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1299 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1972 [06/20/2022-16:24:40] [V] [TRT] Shape_1299 [Shape] inputs: [1972 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1299 for ONNX node: Shape_1299 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1973 for ONNX tensor: 1973 [06/20/2022-16:24:40] [V] [TRT] Shape_1299 [Shape] outputs: [1973 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1300 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1300 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1300 [Constant] outputs: [1974 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1301 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1973 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1974 [06/20/2022-16:24:40] [V] [TRT] Gather_1301 [Gather] inputs: [1973 -> (4)[INT32]], [1974 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1974 for ONNX node: 1974 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1301 for ONNX node: Gather_1301 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1975 for ONNX tensor: 1975 [06/20/2022-16:24:40] [V] [TRT] Gather_1301 [Gather] outputs: [1975 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Shape_1302 [Shape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1972 [06/20/2022-16:24:40] [V] [TRT] Shape_1302 [Shape] inputs: [1972 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Shape_1302 for ONNX node: Shape_1302 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1976 for ONNX tensor: 1976 [06/20/2022-16:24:40] [V] [TRT] Shape_1302 [Shape] outputs: [1976 -> (4)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1303 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1303 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1303 [Constant] outputs: [1977 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Gather_1304 [Gather] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1976 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1977 [06/20/2022-16:24:40] [V] [TRT] Gather_1304 [Gather] inputs: [1976 -> (4)[INT32]], [1977 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1977 for ONNX node: 1977 [06/20/2022-16:24:40] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Gather_1304 for ONNX node: Gather_1304 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1978 for ONNX tensor: 1978 [06/20/2022-16:24:40] [V] [TRT] Gather_1304 [Gather] outputs: [1978 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1305 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1975 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1305 [Unsqueeze] inputs: [1975 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1305 for ONNX node: Unsqueeze_1305 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1980 for ONNX tensor: 1980 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1305 [Unsqueeze] outputs: [1980 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Unsqueeze_1306 [Unsqueeze] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1978 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1306 [Unsqueeze] inputs: [1978 -> ()[INT32]], [06/20/2022-16:24:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:40] [V] [TRT] Registering layer: Unsqueeze_1306 for ONNX node: Unsqueeze_1306 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1981 for ONNX tensor: 1981 [06/20/2022-16:24:40] [V] [TRT] Unsqueeze_1306 [Unsqueeze] outputs: [1981 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Concat_1307 [Concat] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1980 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1981 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3353 [06/20/2022-16:24:40] [V] [TRT] Concat_1307 [Concat] inputs: [1980 -> (1)[INT32]], [1981 -> (1)[INT32]], [3353 -> (1)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3353 for ONNX node: 3353 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Concat_1307 for ONNX node: Concat_1307 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1983 for ONNX tensor: 1983 [06/20/2022-16:24:40] [V] [TRT] Concat_1307 [Concat] outputs: [1983 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Reshape_1308 [Reshape] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1972 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1983 [06/20/2022-16:24:40] [V] [TRT] Reshape_1308 [Reshape] inputs: [1972 -> (-1, -1, 16, 64)[FLOAT]], [1983 -> (3)[INT32]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Reshape_1308 for ONNX node: Reshape_1308 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1984 for ONNX tensor: 1984 [06/20/2022-16:24:40] [V] [TRT] Reshape_1308 [Reshape] outputs: [1984 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1309 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1984 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3354 [06/20/2022-16:24:40] [V] [TRT] MatMul_1309 [MatMul] inputs: [1984 -> (-1, -1, 1024)[FLOAT]], [3354 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3354 for ONNX node: 3354 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1309 for ONNX node: MatMul_1309 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1986 for ONNX tensor: 1986 [06/20/2022-16:24:40] [V] [TRT] MatMul_1309 [MatMul] outputs: [1986 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1310 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.attention.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1986 [06/20/2022-16:24:40] [V] [TRT] Add_1310 [Add] inputs: [bert.encoder.layer.13.attention.output.dense.bias -> (1024)[FLOAT]], [1986 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.attention.output.dense.bias for ONNX node: bert.encoder.layer.13.attention.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1310 for ONNX node: Add_1310 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1987 for ONNX tensor: 1987 [06/20/2022-16:24:40] [V] [TRT] Add_1310 [Add] outputs: [1987 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1311 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1987 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1911 [06/20/2022-16:24:40] [V] [TRT] Add_1311 [Add] inputs: [1987 -> (-1, -1, 1024)[FLOAT]], [1911 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1311 for ONNX node: Add_1311 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1988 for ONNX tensor: 1988 [06/20/2022-16:24:40] [V] [TRT] Add_1311 [Add] outputs: [1988 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1312 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1988 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1312 [ReduceMean] inputs: [1988 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1312 for ONNX node: ReduceMean_1312 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1989 for ONNX tensor: 1989 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1312 [ReduceMean] outputs: [1989 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sub_1313 [Sub] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1988 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1989 [06/20/2022-16:24:40] [V] [TRT] Sub_1313 [Sub] inputs: [1988 -> (-1, -1, 1024)[FLOAT]], [1989 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sub_1313 for ONNX node: Sub_1313 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1990 for ONNX tensor: 1990 [06/20/2022-16:24:40] [V] [TRT] Sub_1313 [Sub] outputs: [1990 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1314 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1314 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1314 [Constant] outputs: [1991 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Pow_1315 [Pow] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1990 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1991 [06/20/2022-16:24:40] [V] [TRT] Pow_1315 [Pow] inputs: [1990 -> (-1, -1, 1024)[FLOAT]], [1991 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1991 for ONNX node: 1991 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Pow_1315 for ONNX node: Pow_1315 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1992 for ONNX tensor: 1992 [06/20/2022-16:24:40] [V] [TRT] Pow_1315 [Pow] outputs: [1992 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1316 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1992 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1316 [ReduceMean] inputs: [1992 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1316 for ONNX node: ReduceMean_1316 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1993 for ONNX tensor: 1993 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1316 [ReduceMean] outputs: [1993 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1317 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1317 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1317 [Constant] outputs: [1994 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1318 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1993 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1994 [06/20/2022-16:24:40] [V] [TRT] Add_1318 [Add] inputs: [1993 -> (-1, -1, 1)[FLOAT]], [1994 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 1994 for ONNX node: 1994 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1318 for ONNX node: Add_1318 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1995 for ONNX tensor: 1995 [06/20/2022-16:24:40] [V] [TRT] Add_1318 [Add] outputs: [1995 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sqrt_1319 [Sqrt] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1995 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1319 [Sqrt] inputs: [1995 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sqrt_1319 for ONNX node: Sqrt_1319 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1996 for ONNX tensor: 1996 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1319 [Sqrt] outputs: [1996 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1320 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1990 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1996 [06/20/2022-16:24:40] [V] [TRT] Div_1320 [Div] inputs: [1990 -> (-1, -1, 1024)[FLOAT]], [1996 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1320 for ONNX node: Div_1320 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1997 for ONNX tensor: 1997 [06/20/2022-16:24:40] [V] [TRT] Div_1320 [Div] outputs: [1997 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1321 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1997 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.attention.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Mul_1321 [Mul] inputs: [1997 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.13.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.13.attention.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1321 for ONNX node: Mul_1321 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1998 for ONNX tensor: 1998 [06/20/2022-16:24:40] [V] [TRT] Mul_1321 [Mul] outputs: [1998 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1322 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1998 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.attention.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Add_1322 [Add] inputs: [1998 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.13.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.13.attention.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1322 for ONNX node: Add_1322 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 1999 for ONNX tensor: 1999 [06/20/2022-16:24:40] [V] [TRT] Add_1322 [Add] outputs: [1999 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1323 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1999 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3355 [06/20/2022-16:24:40] [V] [TRT] MatMul_1323 [MatMul] inputs: [1999 -> (-1, -1, 1024)[FLOAT]], [3355 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3355 for ONNX node: 3355 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1323 for ONNX node: MatMul_1323 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2001 for ONNX tensor: 2001 [06/20/2022-16:24:40] [V] [TRT] MatMul_1323 [MatMul] outputs: [2001 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1324 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.intermediate.dense.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2001 [06/20/2022-16:24:40] [V] [TRT] Add_1324 [Add] inputs: [bert.encoder.layer.13.intermediate.dense.bias -> (4096)[FLOAT]], [2001 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.intermediate.dense.bias for ONNX node: bert.encoder.layer.13.intermediate.dense.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1324 for ONNX node: Add_1324 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2002 for ONNX tensor: 2002 [06/20/2022-16:24:40] [V] [TRT] Add_1324 [Add] outputs: [2002 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1325 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1325 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1325 [Constant] outputs: [2003 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1326 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2002 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2003 [06/20/2022-16:24:40] [V] [TRT] Div_1326 [Div] inputs: [2002 -> (-1, -1, 4096)[FLOAT]], [2003 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 2003 for ONNX node: 2003 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1326 for ONNX node: Div_1326 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2004 for ONNX tensor: 2004 [06/20/2022-16:24:40] [V] [TRT] Div_1326 [Div] outputs: [2004 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Erf_1327 [Erf] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2004 [06/20/2022-16:24:40] [V] [TRT] Erf_1327 [Erf] inputs: [2004 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Erf_1327 for ONNX node: Erf_1327 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2005 for ONNX tensor: 2005 [06/20/2022-16:24:40] [V] [TRT] Erf_1327 [Erf] outputs: [2005 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1328 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1328 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1328 [Constant] outputs: [2006 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1329 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2005 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2006 [06/20/2022-16:24:40] [V] [TRT] Add_1329 [Add] inputs: [2005 -> (-1, -1, 4096)[FLOAT]], [2006 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 2006 for ONNX node: 2006 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1329 for ONNX node: Add_1329 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2007 for ONNX tensor: 2007 [06/20/2022-16:24:40] [V] [TRT] Add_1329 [Add] outputs: [2007 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1330 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2002 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2007 [06/20/2022-16:24:40] [V] [TRT] Mul_1330 [Mul] inputs: [2002 -> (-1, -1, 4096)[FLOAT]], [2007 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1330 for ONNX node: Mul_1330 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2008 for ONNX tensor: 2008 [06/20/2022-16:24:40] [V] [TRT] Mul_1330 [Mul] outputs: [2008 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1331 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1331 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1331 [Constant] outputs: [2009 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1332 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2008 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2009 [06/20/2022-16:24:40] [V] [TRT] Mul_1332 [Mul] inputs: [2008 -> (-1, -1, 4096)[FLOAT]], [2009 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 2009 for ONNX node: 2009 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1332 for ONNX node: Mul_1332 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2010 for ONNX tensor: 2010 [06/20/2022-16:24:40] [V] [TRT] Mul_1332 [Mul] outputs: [2010 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1333 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2010 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3356 [06/20/2022-16:24:40] [V] [TRT] MatMul_1333 [MatMul] inputs: [2010 -> (-1, -1, 4096)[FLOAT]], [3356 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3356 for ONNX node: 3356 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1333 for ONNX node: MatMul_1333 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2012 for ONNX tensor: 2012 [06/20/2022-16:24:40] [V] [TRT] MatMul_1333 [MatMul] outputs: [2012 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1334 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2012 [06/20/2022-16:24:40] [V] [TRT] Add_1334 [Add] inputs: [bert.encoder.layer.13.output.dense.bias -> (1024)[FLOAT]], [2012 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.output.dense.bias for ONNX node: bert.encoder.layer.13.output.dense.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1334 for ONNX node: Add_1334 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2013 for ONNX tensor: 2013 [06/20/2022-16:24:40] [V] [TRT] Add_1334 [Add] outputs: [2013 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1335 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2013 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 1999 [06/20/2022-16:24:40] [V] [TRT] Add_1335 [Add] inputs: [2013 -> (-1, -1, 1024)[FLOAT]], [1999 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1335 for ONNX node: Add_1335 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2014 for ONNX tensor: 2014 [06/20/2022-16:24:40] [V] [TRT] Add_1335 [Add] outputs: [2014 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1336 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2014 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1336 [ReduceMean] inputs: [2014 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1336 for ONNX node: ReduceMean_1336 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2015 for ONNX tensor: 2015 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1336 [ReduceMean] outputs: [2015 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sub_1337 [Sub] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2014 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2015 [06/20/2022-16:24:40] [V] [TRT] Sub_1337 [Sub] inputs: [2014 -> (-1, -1, 1024)[FLOAT]], [2015 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sub_1337 for ONNX node: Sub_1337 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2016 for ONNX tensor: 2016 [06/20/2022-16:24:40] [V] [TRT] Sub_1337 [Sub] outputs: [2016 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1338 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1338 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1338 [Constant] outputs: [2017 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Pow_1339 [Pow] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2016 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2017 [06/20/2022-16:24:40] [V] [TRT] Pow_1339 [Pow] inputs: [2016 -> (-1, -1, 1024)[FLOAT]], [2017 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 2017 for ONNX node: 2017 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Pow_1339 for ONNX node: Pow_1339 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2018 for ONNX tensor: 2018 [06/20/2022-16:24:40] [V] [TRT] Pow_1339 [Pow] outputs: [2018 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: ReduceMean_1340 [ReduceMean] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2018 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1340 [ReduceMean] inputs: [2018 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: ReduceMean_1340 for ONNX node: ReduceMean_1340 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2019 for ONNX tensor: 2019 [06/20/2022-16:24:40] [V] [TRT] ReduceMean_1340 [ReduceMean] outputs: [2019 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Constant_1341 [Constant] [06/20/2022-16:24:40] [V] [TRT] Constant_1341 [Constant] inputs: [06/20/2022-16:24:40] [V] [TRT] Constant_1341 [Constant] outputs: [2020 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1342 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2019 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2020 [06/20/2022-16:24:40] [V] [TRT] Add_1342 [Add] inputs: [2019 -> (-1, -1, 1)[FLOAT]], [2020 -> ()[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 2020 for ONNX node: 2020 [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1342 for ONNX node: Add_1342 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2021 for ONNX tensor: 2021 [06/20/2022-16:24:40] [V] [TRT] Add_1342 [Add] outputs: [2021 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Sqrt_1343 [Sqrt] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2021 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1343 [Sqrt] inputs: [2021 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Sqrt_1343 for ONNX node: Sqrt_1343 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2022 for ONNX tensor: 2022 [06/20/2022-16:24:40] [V] [TRT] Sqrt_1343 [Sqrt] outputs: [2022 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Div_1344 [Div] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2016 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2022 [06/20/2022-16:24:40] [V] [TRT] Div_1344 [Div] inputs: [2016 -> (-1, -1, 1024)[FLOAT]], [2022 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: Div_1344 for ONNX node: Div_1344 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2023 for ONNX tensor: 2023 [06/20/2022-16:24:40] [V] [TRT] Div_1344 [Div] outputs: [2023 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Mul_1345 [Mul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2023 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Mul_1345 [Mul] inputs: [2023 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.13.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.output.LayerNorm.weight for ONNX node: bert.encoder.layer.13.output.LayerNorm.weight [06/20/2022-16:24:40] [V] [TRT] Registering layer: Mul_1345 for ONNX node: Mul_1345 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2024 for ONNX tensor: 2024 [06/20/2022-16:24:40] [V] [TRT] Mul_1345 [Mul] outputs: [2024 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1346 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2024 [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.13.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Add_1346 [Add] inputs: [2024 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.13.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.13.output.LayerNorm.bias for ONNX node: bert.encoder.layer.13.output.LayerNorm.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1346 for ONNX node: Add_1346 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2025 for ONNX tensor: 2025 [06/20/2022-16:24:40] [V] [TRT] Add_1346 [Add] outputs: [2025 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1347 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2025 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3357 [06/20/2022-16:24:40] [V] [TRT] MatMul_1347 [MatMul] inputs: [2025 -> (-1, -1, 1024)[FLOAT]], [3357 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3357 for ONNX node: 3357 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1347 for ONNX node: MatMul_1347 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2027 for ONNX tensor: 2027 [06/20/2022-16:24:40] [V] [TRT] MatMul_1347 [MatMul] outputs: [2027 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: Add_1348 [Add] [06/20/2022-16:24:40] [V] [TRT] Searching for input: bert.encoder.layer.14.attention.self.query.bias [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2027 [06/20/2022-16:24:40] [V] [TRT] Add_1348 [Add] inputs: [bert.encoder.layer.14.attention.self.query.bias -> (1024)[FLOAT]], [2027 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: bert.encoder.layer.14.attention.self.query.bias for ONNX node: bert.encoder.layer.14.attention.self.query.bias [06/20/2022-16:24:40] [V] [TRT] Registering layer: Add_1348 for ONNX node: Add_1348 [06/20/2022-16:24:40] [V] [TRT] Registering tensor: 2028 for ONNX tensor: 2028 [06/20/2022-16:24:40] [V] [TRT] Add_1348 [Add] outputs: [2028 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Parsing node: MatMul_1349 [MatMul] [06/20/2022-16:24:40] [V] [TRT] Searching for input: 2025 [06/20/2022-16:24:40] [V] [TRT] Searching for input: 3358 [06/20/2022-16:24:40] [V] [TRT] MatMul_1349 [MatMul] inputs: [2025 -> (-1, -1, 1024)[FLOAT]], [3358 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:40] [V] [TRT] Registering layer: 3358 for ONNX node: 3358 [06/20/2022-16:24:40] [V] [TRT] Registering layer: MatMul_1349 for ONNX node: MatMul_1349 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2030 for ONNX tensor: 2030 [06/20/2022-16:24:41] [V] [TRT] MatMul_1349 [MatMul] outputs: [2030 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1350 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.attention.self.key.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2030 [06/20/2022-16:24:41] [V] [TRT] Add_1350 [Add] inputs: [bert.encoder.layer.14.attention.self.key.bias -> (1024)[FLOAT]], [2030 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.attention.self.key.bias for ONNX node: bert.encoder.layer.14.attention.self.key.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1350 for ONNX node: Add_1350 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2031 for ONNX tensor: 2031 [06/20/2022-16:24:41] [V] [TRT] Add_1350 [Add] outputs: [2031 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1351 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2031 [06/20/2022-16:24:41] [V] [TRT] Shape_1351 [Shape] inputs: [2031 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1351 for ONNX node: Shape_1351 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2032 for ONNX tensor: 2032 [06/20/2022-16:24:41] [V] [TRT] Shape_1351 [Shape] outputs: [2032 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1352 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1352 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1352 [Constant] outputs: [2033 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1353 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2032 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2033 [06/20/2022-16:24:41] [V] [TRT] Gather_1353 [Gather] inputs: [2032 -> (3)[INT32]], [2033 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2033 for ONNX node: 2033 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1353 for ONNX node: Gather_1353 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2034 for ONNX tensor: 2034 [06/20/2022-16:24:41] [V] [TRT] Gather_1353 [Gather] outputs: [2034 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1354 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2031 [06/20/2022-16:24:41] [V] [TRT] Shape_1354 [Shape] inputs: [2031 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1354 for ONNX node: Shape_1354 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2035 for ONNX tensor: 2035 [06/20/2022-16:24:41] [V] [TRT] Shape_1354 [Shape] outputs: [2035 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1355 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1355 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1355 [Constant] outputs: [2036 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1356 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2035 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2036 [06/20/2022-16:24:41] [V] [TRT] Gather_1356 [Gather] inputs: [2035 -> (3)[INT32]], [2036 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2036 for ONNX node: 2036 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1356 for ONNX node: Gather_1356 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2037 for ONNX tensor: 2037 [06/20/2022-16:24:41] [V] [TRT] Gather_1356 [Gather] outputs: [2037 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1357 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2034 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1357 [Unsqueeze] inputs: [2034 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1357 for ONNX node: Unsqueeze_1357 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2040 for ONNX tensor: 2040 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1357 [Unsqueeze] outputs: [2040 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1358 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2037 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1358 [Unsqueeze] inputs: [2037 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1358 for ONNX node: Unsqueeze_1358 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2041 for ONNX tensor: 2041 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1358 [Unsqueeze] outputs: [2041 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1359 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2040 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2041 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3359 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3360 [06/20/2022-16:24:41] [V] [TRT] Concat_1359 [Concat] inputs: [2040 -> (1)[INT32]], [2041 -> (1)[INT32]], [3359 -> (1)[INT32]], [3360 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3359 for ONNX node: 3359 [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3360 for ONNX node: 3360 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1359 for ONNX node: Concat_1359 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2044 for ONNX tensor: 2044 [06/20/2022-16:24:41] [V] [TRT] Concat_1359 [Concat] outputs: [2044 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1360 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2031 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2044 [06/20/2022-16:24:41] [V] [TRT] Reshape_1360 [Reshape] inputs: [2031 -> (-1, -1, 1024)[FLOAT]], [2044 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1360 for ONNX node: Reshape_1360 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2045 for ONNX tensor: 2045 [06/20/2022-16:24:41] [V] [TRT] Reshape_1360 [Reshape] outputs: [2045 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1361 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2025 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3361 [06/20/2022-16:24:41] [V] [TRT] MatMul_1361 [MatMul] inputs: [2025 -> (-1, -1, 1024)[FLOAT]], [3361 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3361 for ONNX node: 3361 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1361 for ONNX node: MatMul_1361 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2047 for ONNX tensor: 2047 [06/20/2022-16:24:41] [V] [TRT] MatMul_1361 [MatMul] outputs: [2047 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1362 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.attention.self.value.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2047 [06/20/2022-16:24:41] [V] [TRT] Add_1362 [Add] inputs: [bert.encoder.layer.14.attention.self.value.bias -> (1024)[FLOAT]], [2047 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.attention.self.value.bias for ONNX node: bert.encoder.layer.14.attention.self.value.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1362 for ONNX node: Add_1362 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2048 for ONNX tensor: 2048 [06/20/2022-16:24:41] [V] [TRT] Add_1362 [Add] outputs: [2048 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1363 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2048 [06/20/2022-16:24:41] [V] [TRT] Shape_1363 [Shape] inputs: [2048 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1363 for ONNX node: Shape_1363 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2049 for ONNX tensor: 2049 [06/20/2022-16:24:41] [V] [TRT] Shape_1363 [Shape] outputs: [2049 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1364 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1364 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1364 [Constant] outputs: [2050 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1365 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2049 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2050 [06/20/2022-16:24:41] [V] [TRT] Gather_1365 [Gather] inputs: [2049 -> (3)[INT32]], [2050 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2050 for ONNX node: 2050 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1365 for ONNX node: Gather_1365 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2051 for ONNX tensor: 2051 [06/20/2022-16:24:41] [V] [TRT] Gather_1365 [Gather] outputs: [2051 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1366 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2048 [06/20/2022-16:24:41] [V] [TRT] Shape_1366 [Shape] inputs: [2048 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1366 for ONNX node: Shape_1366 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2052 for ONNX tensor: 2052 [06/20/2022-16:24:41] [V] [TRT] Shape_1366 [Shape] outputs: [2052 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1367 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1367 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1367 [Constant] outputs: [2053 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1368 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2052 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2053 [06/20/2022-16:24:41] [V] [TRT] Gather_1368 [Gather] inputs: [2052 -> (3)[INT32]], [2053 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2053 for ONNX node: 2053 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1368 for ONNX node: Gather_1368 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2054 for ONNX tensor: 2054 [06/20/2022-16:24:41] [V] [TRT] Gather_1368 [Gather] outputs: [2054 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1369 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2051 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1369 [Unsqueeze] inputs: [2051 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1369 for ONNX node: Unsqueeze_1369 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2057 for ONNX tensor: 2057 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1369 [Unsqueeze] outputs: [2057 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1370 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2054 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1370 [Unsqueeze] inputs: [2054 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1370 for ONNX node: Unsqueeze_1370 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2058 for ONNX tensor: 2058 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1370 [Unsqueeze] outputs: [2058 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1371 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2057 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2058 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3362 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3363 [06/20/2022-16:24:41] [V] [TRT] Concat_1371 [Concat] inputs: [2057 -> (1)[INT32]], [2058 -> (1)[INT32]], [3362 -> (1)[INT32]], [3363 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3362 for ONNX node: 3362 [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3363 for ONNX node: 3363 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1371 for ONNX node: Concat_1371 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2061 for ONNX tensor: 2061 [06/20/2022-16:24:41] [V] [TRT] Concat_1371 [Concat] outputs: [2061 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1372 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2048 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2061 [06/20/2022-16:24:41] [V] [TRT] Reshape_1372 [Reshape] inputs: [2048 -> (-1, -1, 1024)[FLOAT]], [2061 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1372 for ONNX node: Reshape_1372 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2062 for ONNX tensor: 2062 [06/20/2022-16:24:41] [V] [TRT] Reshape_1372 [Reshape] outputs: [2062 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1373 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2062 [06/20/2022-16:24:41] [V] [TRT] Transpose_1373 [Transpose] inputs: [2062 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1373 for ONNX node: Transpose_1373 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2063 for ONNX tensor: 2063 [06/20/2022-16:24:41] [V] [TRT] Transpose_1373 [Transpose] outputs: [2063 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1374 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2028 [06/20/2022-16:24:41] [V] [TRT] Shape_1374 [Shape] inputs: [2028 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1374 for ONNX node: Shape_1374 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2064 for ONNX tensor: 2064 [06/20/2022-16:24:41] [V] [TRT] Shape_1374 [Shape] outputs: [2064 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1375 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1375 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1375 [Constant] outputs: [2065 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1376 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2064 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2065 [06/20/2022-16:24:41] [V] [TRT] Gather_1376 [Gather] inputs: [2064 -> (3)[INT32]], [2065 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2065 for ONNX node: 2065 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1376 for ONNX node: Gather_1376 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2066 for ONNX tensor: 2066 [06/20/2022-16:24:41] [V] [TRT] Gather_1376 [Gather] outputs: [2066 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1377 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2028 [06/20/2022-16:24:41] [V] [TRT] Shape_1377 [Shape] inputs: [2028 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1377 for ONNX node: Shape_1377 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2067 for ONNX tensor: 2067 [06/20/2022-16:24:41] [V] [TRT] Shape_1377 [Shape] outputs: [2067 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1378 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1378 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1378 [Constant] outputs: [2068 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1379 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2067 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2068 [06/20/2022-16:24:41] [V] [TRT] Gather_1379 [Gather] inputs: [2067 -> (3)[INT32]], [2068 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2068 for ONNX node: 2068 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1379 for ONNX node: Gather_1379 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2069 for ONNX tensor: 2069 [06/20/2022-16:24:41] [V] [TRT] Gather_1379 [Gather] outputs: [2069 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1380 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2066 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1380 [Unsqueeze] inputs: [2066 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1380 for ONNX node: Unsqueeze_1380 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2072 for ONNX tensor: 2072 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1380 [Unsqueeze] outputs: [2072 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1381 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2069 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1381 [Unsqueeze] inputs: [2069 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1381 for ONNX node: Unsqueeze_1381 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2073 for ONNX tensor: 2073 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1381 [Unsqueeze] outputs: [2073 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1382 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2072 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2073 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3364 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3365 [06/20/2022-16:24:41] [V] [TRT] Concat_1382 [Concat] inputs: [2072 -> (1)[INT32]], [2073 -> (1)[INT32]], [3364 -> (1)[INT32]], [3365 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3364 for ONNX node: 3364 [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3365 for ONNX node: 3365 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1382 for ONNX node: Concat_1382 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2076 for ONNX tensor: 2076 [06/20/2022-16:24:41] [V] [TRT] Concat_1382 [Concat] outputs: [2076 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1383 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2028 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2076 [06/20/2022-16:24:41] [V] [TRT] Reshape_1383 [Reshape] inputs: [2028 -> (-1, -1, 1024)[FLOAT]], [2076 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1383 for ONNX node: Reshape_1383 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2077 for ONNX tensor: 2077 [06/20/2022-16:24:41] [V] [TRT] Reshape_1383 [Reshape] outputs: [2077 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1384 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2077 [06/20/2022-16:24:41] [V] [TRT] Transpose_1384 [Transpose] inputs: [2077 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1384 for ONNX node: Transpose_1384 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2078 for ONNX tensor: 2078 [06/20/2022-16:24:41] [V] [TRT] Transpose_1384 [Transpose] outputs: [2078 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1385 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2045 [06/20/2022-16:24:41] [V] [TRT] Transpose_1385 [Transpose] inputs: [2045 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1385 for ONNX node: Transpose_1385 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2079 for ONNX tensor: 2079 [06/20/2022-16:24:41] [V] [TRT] Transpose_1385 [Transpose] outputs: [2079 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1386 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2078 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2079 [06/20/2022-16:24:41] [V] [TRT] MatMul_1386 [MatMul] inputs: [2078 -> (-1, 16, -1, 64)[FLOAT]], [2079 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1386 for ONNX node: MatMul_1386 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2080 for ONNX tensor: 2080 [06/20/2022-16:24:41] [V] [TRT] MatMul_1386 [MatMul] outputs: [2080 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1387 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1387 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1387 [Constant] outputs: [2081 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1388 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2080 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2081 [06/20/2022-16:24:41] [V] [TRT] Div_1388 [Div] inputs: [2080 -> (-1, 16, -1, -1)[FLOAT]], [2081 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2081 for ONNX node: 2081 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1388 for ONNX node: Div_1388 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2082 for ONNX tensor: 2082 [06/20/2022-16:24:41] [V] [TRT] Div_1388 [Div] outputs: [2082 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1389 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2082 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:41] [V] [TRT] Add_1389 [Add] inputs: [2082 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1389 for ONNX node: Add_1389 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2083 for ONNX tensor: 2083 [06/20/2022-16:24:41] [V] [TRT] Add_1389 [Add] outputs: [2083 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Softmax_1390 [Softmax] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2083 [06/20/2022-16:24:41] [V] [TRT] Softmax_1390 [Softmax] inputs: [2083 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Softmax_1390 for ONNX node: Softmax_1390 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2084 for ONNX tensor: 2084 [06/20/2022-16:24:41] [V] [TRT] Softmax_1390 [Softmax] outputs: [2084 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1391 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2084 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2063 [06/20/2022-16:24:41] [V] [TRT] MatMul_1391 [MatMul] inputs: [2084 -> (-1, 16, -1, -1)[FLOAT]], [2063 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1391 for ONNX node: MatMul_1391 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2085 for ONNX tensor: 2085 [06/20/2022-16:24:41] [V] [TRT] MatMul_1391 [MatMul] outputs: [2085 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1392 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2085 [06/20/2022-16:24:41] [V] [TRT] Transpose_1392 [Transpose] inputs: [2085 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1392 for ONNX node: Transpose_1392 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2086 for ONNX tensor: 2086 [06/20/2022-16:24:41] [V] [TRT] Transpose_1392 [Transpose] outputs: [2086 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1393 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2086 [06/20/2022-16:24:41] [V] [TRT] Shape_1393 [Shape] inputs: [2086 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1393 for ONNX node: Shape_1393 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2087 for ONNX tensor: 2087 [06/20/2022-16:24:41] [V] [TRT] Shape_1393 [Shape] outputs: [2087 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1394 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1394 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1394 [Constant] outputs: [2088 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1395 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2087 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2088 [06/20/2022-16:24:41] [V] [TRT] Gather_1395 [Gather] inputs: [2087 -> (4)[INT32]], [2088 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2088 for ONNX node: 2088 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1395 for ONNX node: Gather_1395 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2089 for ONNX tensor: 2089 [06/20/2022-16:24:41] [V] [TRT] Gather_1395 [Gather] outputs: [2089 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1396 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2086 [06/20/2022-16:24:41] [V] [TRT] Shape_1396 [Shape] inputs: [2086 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1396 for ONNX node: Shape_1396 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2090 for ONNX tensor: 2090 [06/20/2022-16:24:41] [V] [TRT] Shape_1396 [Shape] outputs: [2090 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1397 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1397 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1397 [Constant] outputs: [2091 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1398 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2090 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2091 [06/20/2022-16:24:41] [V] [TRT] Gather_1398 [Gather] inputs: [2090 -> (4)[INT32]], [2091 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2091 for ONNX node: 2091 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1398 for ONNX node: Gather_1398 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2092 for ONNX tensor: 2092 [06/20/2022-16:24:41] [V] [TRT] Gather_1398 [Gather] outputs: [2092 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1399 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2089 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1399 [Unsqueeze] inputs: [2089 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1399 for ONNX node: Unsqueeze_1399 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2094 for ONNX tensor: 2094 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1399 [Unsqueeze] outputs: [2094 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1400 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2092 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1400 [Unsqueeze] inputs: [2092 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1400 for ONNX node: Unsqueeze_1400 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2095 for ONNX tensor: 2095 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1400 [Unsqueeze] outputs: [2095 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1401 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2094 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2095 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3366 [06/20/2022-16:24:41] [V] [TRT] Concat_1401 [Concat] inputs: [2094 -> (1)[INT32]], [2095 -> (1)[INT32]], [3366 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3366 for ONNX node: 3366 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1401 for ONNX node: Concat_1401 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2097 for ONNX tensor: 2097 [06/20/2022-16:24:41] [V] [TRT] Concat_1401 [Concat] outputs: [2097 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1402 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2086 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2097 [06/20/2022-16:24:41] [V] [TRT] Reshape_1402 [Reshape] inputs: [2086 -> (-1, -1, 16, 64)[FLOAT]], [2097 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1402 for ONNX node: Reshape_1402 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2098 for ONNX tensor: 2098 [06/20/2022-16:24:41] [V] [TRT] Reshape_1402 [Reshape] outputs: [2098 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1403 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2098 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3367 [06/20/2022-16:24:41] [V] [TRT] MatMul_1403 [MatMul] inputs: [2098 -> (-1, -1, 1024)[FLOAT]], [3367 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3367 for ONNX node: 3367 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1403 for ONNX node: MatMul_1403 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2100 for ONNX tensor: 2100 [06/20/2022-16:24:41] [V] [TRT] MatMul_1403 [MatMul] outputs: [2100 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1404 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.attention.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2100 [06/20/2022-16:24:41] [V] [TRT] Add_1404 [Add] inputs: [bert.encoder.layer.14.attention.output.dense.bias -> (1024)[FLOAT]], [2100 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.attention.output.dense.bias for ONNX node: bert.encoder.layer.14.attention.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1404 for ONNX node: Add_1404 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2101 for ONNX tensor: 2101 [06/20/2022-16:24:41] [V] [TRT] Add_1404 [Add] outputs: [2101 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1405 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2101 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2025 [06/20/2022-16:24:41] [V] [TRT] Add_1405 [Add] inputs: [2101 -> (-1, -1, 1024)[FLOAT]], [2025 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1405 for ONNX node: Add_1405 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2102 for ONNX tensor: 2102 [06/20/2022-16:24:41] [V] [TRT] Add_1405 [Add] outputs: [2102 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1406 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2102 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1406 [ReduceMean] inputs: [2102 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1406 for ONNX node: ReduceMean_1406 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2103 for ONNX tensor: 2103 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1406 [ReduceMean] outputs: [2103 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sub_1407 [Sub] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2102 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2103 [06/20/2022-16:24:41] [V] [TRT] Sub_1407 [Sub] inputs: [2102 -> (-1, -1, 1024)[FLOAT]], [2103 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sub_1407 for ONNX node: Sub_1407 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2104 for ONNX tensor: 2104 [06/20/2022-16:24:41] [V] [TRT] Sub_1407 [Sub] outputs: [2104 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1408 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1408 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1408 [Constant] outputs: [2105 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Pow_1409 [Pow] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2104 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2105 [06/20/2022-16:24:41] [V] [TRT] Pow_1409 [Pow] inputs: [2104 -> (-1, -1, 1024)[FLOAT]], [2105 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2105 for ONNX node: 2105 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Pow_1409 for ONNX node: Pow_1409 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2106 for ONNX tensor: 2106 [06/20/2022-16:24:41] [V] [TRT] Pow_1409 [Pow] outputs: [2106 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1410 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2106 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1410 [ReduceMean] inputs: [2106 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1410 for ONNX node: ReduceMean_1410 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2107 for ONNX tensor: 2107 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1410 [ReduceMean] outputs: [2107 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1411 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1411 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1411 [Constant] outputs: [2108 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1412 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2107 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2108 [06/20/2022-16:24:41] [V] [TRT] Add_1412 [Add] inputs: [2107 -> (-1, -1, 1)[FLOAT]], [2108 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2108 for ONNX node: 2108 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1412 for ONNX node: Add_1412 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2109 for ONNX tensor: 2109 [06/20/2022-16:24:41] [V] [TRT] Add_1412 [Add] outputs: [2109 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sqrt_1413 [Sqrt] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2109 [06/20/2022-16:24:41] [V] [TRT] Sqrt_1413 [Sqrt] inputs: [2109 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sqrt_1413 for ONNX node: Sqrt_1413 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2110 for ONNX tensor: 2110 [06/20/2022-16:24:41] [V] [TRT] Sqrt_1413 [Sqrt] outputs: [2110 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1414 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2104 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2110 [06/20/2022-16:24:41] [V] [TRT] Div_1414 [Div] inputs: [2104 -> (-1, -1, 1024)[FLOAT]], [2110 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1414 for ONNX node: Div_1414 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2111 for ONNX tensor: 2111 [06/20/2022-16:24:41] [V] [TRT] Div_1414 [Div] outputs: [2111 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1415 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2111 [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.attention.output.LayerNorm.weight [06/20/2022-16:24:41] [V] [TRT] Mul_1415 [Mul] inputs: [2111 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.14.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.14.attention.output.LayerNorm.weight [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1415 for ONNX node: Mul_1415 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2112 for ONNX tensor: 2112 [06/20/2022-16:24:41] [V] [TRT] Mul_1415 [Mul] outputs: [2112 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1416 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2112 [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.attention.output.LayerNorm.bias [06/20/2022-16:24:41] [V] [TRT] Add_1416 [Add] inputs: [2112 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.14.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.14.attention.output.LayerNorm.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1416 for ONNX node: Add_1416 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2113 for ONNX tensor: 2113 [06/20/2022-16:24:41] [V] [TRT] Add_1416 [Add] outputs: [2113 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1417 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2113 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3368 [06/20/2022-16:24:41] [V] [TRT] MatMul_1417 [MatMul] inputs: [2113 -> (-1, -1, 1024)[FLOAT]], [3368 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3368 for ONNX node: 3368 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1417 for ONNX node: MatMul_1417 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2115 for ONNX tensor: 2115 [06/20/2022-16:24:41] [V] [TRT] MatMul_1417 [MatMul] outputs: [2115 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1418 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.intermediate.dense.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2115 [06/20/2022-16:24:41] [V] [TRT] Add_1418 [Add] inputs: [bert.encoder.layer.14.intermediate.dense.bias -> (4096)[FLOAT]], [2115 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.intermediate.dense.bias for ONNX node: bert.encoder.layer.14.intermediate.dense.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1418 for ONNX node: Add_1418 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2116 for ONNX tensor: 2116 [06/20/2022-16:24:41] [V] [TRT] Add_1418 [Add] outputs: [2116 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1419 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1419 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1419 [Constant] outputs: [2117 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1420 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2116 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2117 [06/20/2022-16:24:41] [V] [TRT] Div_1420 [Div] inputs: [2116 -> (-1, -1, 4096)[FLOAT]], [2117 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2117 for ONNX node: 2117 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1420 for ONNX node: Div_1420 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2118 for ONNX tensor: 2118 [06/20/2022-16:24:41] [V] [TRT] Div_1420 [Div] outputs: [2118 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Erf_1421 [Erf] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2118 [06/20/2022-16:24:41] [V] [TRT] Erf_1421 [Erf] inputs: [2118 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Erf_1421 for ONNX node: Erf_1421 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2119 for ONNX tensor: 2119 [06/20/2022-16:24:41] [V] [TRT] Erf_1421 [Erf] outputs: [2119 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1422 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1422 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1422 [Constant] outputs: [2120 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1423 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2119 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2120 [06/20/2022-16:24:41] [V] [TRT] Add_1423 [Add] inputs: [2119 -> (-1, -1, 4096)[FLOAT]], [2120 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2120 for ONNX node: 2120 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1423 for ONNX node: Add_1423 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2121 for ONNX tensor: 2121 [06/20/2022-16:24:41] [V] [TRT] Add_1423 [Add] outputs: [2121 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1424 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2116 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2121 [06/20/2022-16:24:41] [V] [TRT] Mul_1424 [Mul] inputs: [2116 -> (-1, -1, 4096)[FLOAT]], [2121 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1424 for ONNX node: Mul_1424 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2122 for ONNX tensor: 2122 [06/20/2022-16:24:41] [V] [TRT] Mul_1424 [Mul] outputs: [2122 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1425 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1425 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1425 [Constant] outputs: [2123 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1426 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2122 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2123 [06/20/2022-16:24:41] [V] [TRT] Mul_1426 [Mul] inputs: [2122 -> (-1, -1, 4096)[FLOAT]], [2123 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2123 for ONNX node: 2123 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1426 for ONNX node: Mul_1426 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2124 for ONNX tensor: 2124 [06/20/2022-16:24:41] [V] [TRT] Mul_1426 [Mul] outputs: [2124 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1427 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2124 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3369 [06/20/2022-16:24:41] [V] [TRT] MatMul_1427 [MatMul] inputs: [2124 -> (-1, -1, 4096)[FLOAT]], [3369 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3369 for ONNX node: 3369 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1427 for ONNX node: MatMul_1427 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2126 for ONNX tensor: 2126 [06/20/2022-16:24:41] [V] [TRT] MatMul_1427 [MatMul] outputs: [2126 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1428 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2126 [06/20/2022-16:24:41] [V] [TRT] Add_1428 [Add] inputs: [bert.encoder.layer.14.output.dense.bias -> (1024)[FLOAT]], [2126 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.output.dense.bias for ONNX node: bert.encoder.layer.14.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1428 for ONNX node: Add_1428 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2127 for ONNX tensor: 2127 [06/20/2022-16:24:41] [V] [TRT] Add_1428 [Add] outputs: [2127 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1429 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2127 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2113 [06/20/2022-16:24:41] [V] [TRT] Add_1429 [Add] inputs: [2127 -> (-1, -1, 1024)[FLOAT]], [2113 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1429 for ONNX node: Add_1429 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2128 for ONNX tensor: 2128 [06/20/2022-16:24:41] [V] [TRT] Add_1429 [Add] outputs: [2128 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1430 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2128 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1430 [ReduceMean] inputs: [2128 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1430 for ONNX node: ReduceMean_1430 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2129 for ONNX tensor: 2129 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1430 [ReduceMean] outputs: [2129 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sub_1431 [Sub] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2128 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2129 [06/20/2022-16:24:41] [V] [TRT] Sub_1431 [Sub] inputs: [2128 -> (-1, -1, 1024)[FLOAT]], [2129 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sub_1431 for ONNX node: Sub_1431 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2130 for ONNX tensor: 2130 [06/20/2022-16:24:41] [V] [TRT] Sub_1431 [Sub] outputs: [2130 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1432 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1432 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1432 [Constant] outputs: [2131 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Pow_1433 [Pow] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2130 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2131 [06/20/2022-16:24:41] [V] [TRT] Pow_1433 [Pow] inputs: [2130 -> (-1, -1, 1024)[FLOAT]], [2131 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2131 for ONNX node: 2131 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Pow_1433 for ONNX node: Pow_1433 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2132 for ONNX tensor: 2132 [06/20/2022-16:24:41] [V] [TRT] Pow_1433 [Pow] outputs: [2132 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1434 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2132 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1434 [ReduceMean] inputs: [2132 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1434 for ONNX node: ReduceMean_1434 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2133 for ONNX tensor: 2133 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1434 [ReduceMean] outputs: [2133 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1435 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1435 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1435 [Constant] outputs: [2134 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1436 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2133 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2134 [06/20/2022-16:24:41] [V] [TRT] Add_1436 [Add] inputs: [2133 -> (-1, -1, 1)[FLOAT]], [2134 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2134 for ONNX node: 2134 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1436 for ONNX node: Add_1436 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2135 for ONNX tensor: 2135 [06/20/2022-16:24:41] [V] [TRT] Add_1436 [Add] outputs: [2135 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sqrt_1437 [Sqrt] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2135 [06/20/2022-16:24:41] [V] [TRT] Sqrt_1437 [Sqrt] inputs: [2135 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sqrt_1437 for ONNX node: Sqrt_1437 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2136 for ONNX tensor: 2136 [06/20/2022-16:24:41] [V] [TRT] Sqrt_1437 [Sqrt] outputs: [2136 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1438 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2130 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2136 [06/20/2022-16:24:41] [V] [TRT] Div_1438 [Div] inputs: [2130 -> (-1, -1, 1024)[FLOAT]], [2136 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1438 for ONNX node: Div_1438 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2137 for ONNX tensor: 2137 [06/20/2022-16:24:41] [V] [TRT] Div_1438 [Div] outputs: [2137 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1439 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2137 [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.output.LayerNorm.weight [06/20/2022-16:24:41] [V] [TRT] Mul_1439 [Mul] inputs: [2137 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.14.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.output.LayerNorm.weight for ONNX node: bert.encoder.layer.14.output.LayerNorm.weight [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1439 for ONNX node: Mul_1439 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2138 for ONNX tensor: 2138 [06/20/2022-16:24:41] [V] [TRT] Mul_1439 [Mul] outputs: [2138 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1440 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2138 [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.14.output.LayerNorm.bias [06/20/2022-16:24:41] [V] [TRT] Add_1440 [Add] inputs: [2138 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.14.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.14.output.LayerNorm.bias for ONNX node: bert.encoder.layer.14.output.LayerNorm.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1440 for ONNX node: Add_1440 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2139 for ONNX tensor: 2139 [06/20/2022-16:24:41] [V] [TRT] Add_1440 [Add] outputs: [2139 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1441 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2139 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3370 [06/20/2022-16:24:41] [V] [TRT] MatMul_1441 [MatMul] inputs: [2139 -> (-1, -1, 1024)[FLOAT]], [3370 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3370 for ONNX node: 3370 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1441 for ONNX node: MatMul_1441 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2141 for ONNX tensor: 2141 [06/20/2022-16:24:41] [V] [TRT] MatMul_1441 [MatMul] outputs: [2141 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1442 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.attention.self.query.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2141 [06/20/2022-16:24:41] [V] [TRT] Add_1442 [Add] inputs: [bert.encoder.layer.15.attention.self.query.bias -> (1024)[FLOAT]], [2141 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.attention.self.query.bias for ONNX node: bert.encoder.layer.15.attention.self.query.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1442 for ONNX node: Add_1442 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2142 for ONNX tensor: 2142 [06/20/2022-16:24:41] [V] [TRT] Add_1442 [Add] outputs: [2142 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1443 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2139 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3371 [06/20/2022-16:24:41] [V] [TRT] MatMul_1443 [MatMul] inputs: [2139 -> (-1, -1, 1024)[FLOAT]], [3371 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3371 for ONNX node: 3371 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1443 for ONNX node: MatMul_1443 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2144 for ONNX tensor: 2144 [06/20/2022-16:24:41] [V] [TRT] MatMul_1443 [MatMul] outputs: [2144 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1444 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.attention.self.key.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2144 [06/20/2022-16:24:41] [V] [TRT] Add_1444 [Add] inputs: [bert.encoder.layer.15.attention.self.key.bias -> (1024)[FLOAT]], [2144 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.attention.self.key.bias for ONNX node: bert.encoder.layer.15.attention.self.key.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1444 for ONNX node: Add_1444 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2145 for ONNX tensor: 2145 [06/20/2022-16:24:41] [V] [TRT] Add_1444 [Add] outputs: [2145 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1445 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2145 [06/20/2022-16:24:41] [V] [TRT] Shape_1445 [Shape] inputs: [2145 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1445 for ONNX node: Shape_1445 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2146 for ONNX tensor: 2146 [06/20/2022-16:24:41] [V] [TRT] Shape_1445 [Shape] outputs: [2146 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1446 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1446 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1446 [Constant] outputs: [2147 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1447 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2146 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2147 [06/20/2022-16:24:41] [V] [TRT] Gather_1447 [Gather] inputs: [2146 -> (3)[INT32]], [2147 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2147 for ONNX node: 2147 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1447 for ONNX node: Gather_1447 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2148 for ONNX tensor: 2148 [06/20/2022-16:24:41] [V] [TRT] Gather_1447 [Gather] outputs: [2148 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1448 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2145 [06/20/2022-16:24:41] [V] [TRT] Shape_1448 [Shape] inputs: [2145 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1448 for ONNX node: Shape_1448 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2149 for ONNX tensor: 2149 [06/20/2022-16:24:41] [V] [TRT] Shape_1448 [Shape] outputs: [2149 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1449 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1449 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1449 [Constant] outputs: [2150 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1450 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2149 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2150 [06/20/2022-16:24:41] [V] [TRT] Gather_1450 [Gather] inputs: [2149 -> (3)[INT32]], [2150 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2150 for ONNX node: 2150 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1450 for ONNX node: Gather_1450 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2151 for ONNX tensor: 2151 [06/20/2022-16:24:41] [V] [TRT] Gather_1450 [Gather] outputs: [2151 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1451 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2148 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1451 [Unsqueeze] inputs: [2148 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1451 for ONNX node: Unsqueeze_1451 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2154 for ONNX tensor: 2154 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1451 [Unsqueeze] outputs: [2154 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1452 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2151 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1452 [Unsqueeze] inputs: [2151 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1452 for ONNX node: Unsqueeze_1452 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2155 for ONNX tensor: 2155 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1452 [Unsqueeze] outputs: [2155 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1453 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2154 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2155 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3372 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3373 [06/20/2022-16:24:41] [V] [TRT] Concat_1453 [Concat] inputs: [2154 -> (1)[INT32]], [2155 -> (1)[INT32]], [3372 -> (1)[INT32]], [3373 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3372 for ONNX node: 3372 [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3373 for ONNX node: 3373 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1453 for ONNX node: Concat_1453 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2158 for ONNX tensor: 2158 [06/20/2022-16:24:41] [V] [TRT] Concat_1453 [Concat] outputs: [2158 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1454 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2145 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2158 [06/20/2022-16:24:41] [V] [TRT] Reshape_1454 [Reshape] inputs: [2145 -> (-1, -1, 1024)[FLOAT]], [2158 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1454 for ONNX node: Reshape_1454 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2159 for ONNX tensor: 2159 [06/20/2022-16:24:41] [V] [TRT] Reshape_1454 [Reshape] outputs: [2159 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1455 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2139 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3374 [06/20/2022-16:24:41] [V] [TRT] MatMul_1455 [MatMul] inputs: [2139 -> (-1, -1, 1024)[FLOAT]], [3374 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3374 for ONNX node: 3374 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1455 for ONNX node: MatMul_1455 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2161 for ONNX tensor: 2161 [06/20/2022-16:24:41] [V] [TRT] MatMul_1455 [MatMul] outputs: [2161 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1456 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.attention.self.value.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2161 [06/20/2022-16:24:41] [V] [TRT] Add_1456 [Add] inputs: [bert.encoder.layer.15.attention.self.value.bias -> (1024)[FLOAT]], [2161 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.attention.self.value.bias for ONNX node: bert.encoder.layer.15.attention.self.value.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1456 for ONNX node: Add_1456 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2162 for ONNX tensor: 2162 [06/20/2022-16:24:41] [V] [TRT] Add_1456 [Add] outputs: [2162 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1457 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2162 [06/20/2022-16:24:41] [V] [TRT] Shape_1457 [Shape] inputs: [2162 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1457 for ONNX node: Shape_1457 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2163 for ONNX tensor: 2163 [06/20/2022-16:24:41] [V] [TRT] Shape_1457 [Shape] outputs: [2163 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1458 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1458 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1458 [Constant] outputs: [2164 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1459 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2163 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2164 [06/20/2022-16:24:41] [V] [TRT] Gather_1459 [Gather] inputs: [2163 -> (3)[INT32]], [2164 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2164 for ONNX node: 2164 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1459 for ONNX node: Gather_1459 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2165 for ONNX tensor: 2165 [06/20/2022-16:24:41] [V] [TRT] Gather_1459 [Gather] outputs: [2165 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1460 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2162 [06/20/2022-16:24:41] [V] [TRT] Shape_1460 [Shape] inputs: [2162 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1460 for ONNX node: Shape_1460 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2166 for ONNX tensor: 2166 [06/20/2022-16:24:41] [V] [TRT] Shape_1460 [Shape] outputs: [2166 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1461 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1461 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1461 [Constant] outputs: [2167 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1462 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2166 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2167 [06/20/2022-16:24:41] [V] [TRT] Gather_1462 [Gather] inputs: [2166 -> (3)[INT32]], [2167 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2167 for ONNX node: 2167 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1462 for ONNX node: Gather_1462 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2168 for ONNX tensor: 2168 [06/20/2022-16:24:41] [V] [TRT] Gather_1462 [Gather] outputs: [2168 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1463 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2165 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1463 [Unsqueeze] inputs: [2165 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1463 for ONNX node: Unsqueeze_1463 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2171 for ONNX tensor: 2171 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1463 [Unsqueeze] outputs: [2171 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1464 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2168 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1464 [Unsqueeze] inputs: [2168 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1464 for ONNX node: Unsqueeze_1464 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2172 for ONNX tensor: 2172 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1464 [Unsqueeze] outputs: [2172 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1465 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2171 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2172 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3375 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3376 [06/20/2022-16:24:41] [V] [TRT] Concat_1465 [Concat] inputs: [2171 -> (1)[INT32]], [2172 -> (1)[INT32]], [3375 -> (1)[INT32]], [3376 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3375 for ONNX node: 3375 [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3376 for ONNX node: 3376 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1465 for ONNX node: Concat_1465 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2175 for ONNX tensor: 2175 [06/20/2022-16:24:41] [V] [TRT] Concat_1465 [Concat] outputs: [2175 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1466 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2162 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2175 [06/20/2022-16:24:41] [V] [TRT] Reshape_1466 [Reshape] inputs: [2162 -> (-1, -1, 1024)[FLOAT]], [2175 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1466 for ONNX node: Reshape_1466 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2176 for ONNX tensor: 2176 [06/20/2022-16:24:41] [V] [TRT] Reshape_1466 [Reshape] outputs: [2176 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1467 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2176 [06/20/2022-16:24:41] [V] [TRT] Transpose_1467 [Transpose] inputs: [2176 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1467 for ONNX node: Transpose_1467 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2177 for ONNX tensor: 2177 [06/20/2022-16:24:41] [V] [TRT] Transpose_1467 [Transpose] outputs: [2177 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1468 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2142 [06/20/2022-16:24:41] [V] [TRT] Shape_1468 [Shape] inputs: [2142 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1468 for ONNX node: Shape_1468 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2178 for ONNX tensor: 2178 [06/20/2022-16:24:41] [V] [TRT] Shape_1468 [Shape] outputs: [2178 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1469 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1469 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1469 [Constant] outputs: [2179 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1470 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2178 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2179 [06/20/2022-16:24:41] [V] [TRT] Gather_1470 [Gather] inputs: [2178 -> (3)[INT32]], [2179 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2179 for ONNX node: 2179 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1470 for ONNX node: Gather_1470 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2180 for ONNX tensor: 2180 [06/20/2022-16:24:41] [V] [TRT] Gather_1470 [Gather] outputs: [2180 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1471 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2142 [06/20/2022-16:24:41] [V] [TRT] Shape_1471 [Shape] inputs: [2142 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1471 for ONNX node: Shape_1471 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2181 for ONNX tensor: 2181 [06/20/2022-16:24:41] [V] [TRT] Shape_1471 [Shape] outputs: [2181 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1472 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1472 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1472 [Constant] outputs: [2182 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1473 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2181 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2182 [06/20/2022-16:24:41] [V] [TRT] Gather_1473 [Gather] inputs: [2181 -> (3)[INT32]], [2182 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2182 for ONNX node: 2182 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1473 for ONNX node: Gather_1473 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2183 for ONNX tensor: 2183 [06/20/2022-16:24:41] [V] [TRT] Gather_1473 [Gather] outputs: [2183 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1474 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2180 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1474 [Unsqueeze] inputs: [2180 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1474 for ONNX node: Unsqueeze_1474 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2186 for ONNX tensor: 2186 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1474 [Unsqueeze] outputs: [2186 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1475 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2183 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1475 [Unsqueeze] inputs: [2183 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1475 for ONNX node: Unsqueeze_1475 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2187 for ONNX tensor: 2187 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1475 [Unsqueeze] outputs: [2187 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1476 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2186 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2187 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3377 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3378 [06/20/2022-16:24:41] [V] [TRT] Concat_1476 [Concat] inputs: [2186 -> (1)[INT32]], [2187 -> (1)[INT32]], [3377 -> (1)[INT32]], [3378 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3377 for ONNX node: 3377 [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3378 for ONNX node: 3378 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1476 for ONNX node: Concat_1476 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2190 for ONNX tensor: 2190 [06/20/2022-16:24:41] [V] [TRT] Concat_1476 [Concat] outputs: [2190 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1477 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2142 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2190 [06/20/2022-16:24:41] [V] [TRT] Reshape_1477 [Reshape] inputs: [2142 -> (-1, -1, 1024)[FLOAT]], [2190 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1477 for ONNX node: Reshape_1477 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2191 for ONNX tensor: 2191 [06/20/2022-16:24:41] [V] [TRT] Reshape_1477 [Reshape] outputs: [2191 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1478 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2191 [06/20/2022-16:24:41] [V] [TRT] Transpose_1478 [Transpose] inputs: [2191 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1478 for ONNX node: Transpose_1478 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2192 for ONNX tensor: 2192 [06/20/2022-16:24:41] [V] [TRT] Transpose_1478 [Transpose] outputs: [2192 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1479 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2159 [06/20/2022-16:24:41] [V] [TRT] Transpose_1479 [Transpose] inputs: [2159 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1479 for ONNX node: Transpose_1479 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2193 for ONNX tensor: 2193 [06/20/2022-16:24:41] [V] [TRT] Transpose_1479 [Transpose] outputs: [2193 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1480 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2192 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2193 [06/20/2022-16:24:41] [V] [TRT] MatMul_1480 [MatMul] inputs: [2192 -> (-1, 16, -1, 64)[FLOAT]], [2193 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1480 for ONNX node: MatMul_1480 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2194 for ONNX tensor: 2194 [06/20/2022-16:24:41] [V] [TRT] MatMul_1480 [MatMul] outputs: [2194 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1481 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1481 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1481 [Constant] outputs: [2195 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1482 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2194 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2195 [06/20/2022-16:24:41] [V] [TRT] Div_1482 [Div] inputs: [2194 -> (-1, 16, -1, -1)[FLOAT]], [2195 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2195 for ONNX node: 2195 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1482 for ONNX node: Div_1482 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2196 for ONNX tensor: 2196 [06/20/2022-16:24:41] [V] [TRT] Div_1482 [Div] outputs: [2196 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1483 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2196 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:41] [V] [TRT] Add_1483 [Add] inputs: [2196 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1483 for ONNX node: Add_1483 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2197 for ONNX tensor: 2197 [06/20/2022-16:24:41] [V] [TRT] Add_1483 [Add] outputs: [2197 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Softmax_1484 [Softmax] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2197 [06/20/2022-16:24:41] [V] [TRT] Softmax_1484 [Softmax] inputs: [2197 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Softmax_1484 for ONNX node: Softmax_1484 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2198 for ONNX tensor: 2198 [06/20/2022-16:24:41] [V] [TRT] Softmax_1484 [Softmax] outputs: [2198 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1485 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2198 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2177 [06/20/2022-16:24:41] [V] [TRT] MatMul_1485 [MatMul] inputs: [2198 -> (-1, 16, -1, -1)[FLOAT]], [2177 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1485 for ONNX node: MatMul_1485 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2199 for ONNX tensor: 2199 [06/20/2022-16:24:41] [V] [TRT] MatMul_1485 [MatMul] outputs: [2199 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Transpose_1486 [Transpose] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2199 [06/20/2022-16:24:41] [V] [TRT] Transpose_1486 [Transpose] inputs: [2199 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Transpose_1486 for ONNX node: Transpose_1486 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2200 for ONNX tensor: 2200 [06/20/2022-16:24:41] [V] [TRT] Transpose_1486 [Transpose] outputs: [2200 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1487 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2200 [06/20/2022-16:24:41] [V] [TRT] Shape_1487 [Shape] inputs: [2200 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1487 for ONNX node: Shape_1487 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2201 for ONNX tensor: 2201 [06/20/2022-16:24:41] [V] [TRT] Shape_1487 [Shape] outputs: [2201 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1488 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1488 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1488 [Constant] outputs: [2202 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1489 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2201 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2202 [06/20/2022-16:24:41] [V] [TRT] Gather_1489 [Gather] inputs: [2201 -> (4)[INT32]], [2202 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2202 for ONNX node: 2202 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1489 for ONNX node: Gather_1489 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2203 for ONNX tensor: 2203 [06/20/2022-16:24:41] [V] [TRT] Gather_1489 [Gather] outputs: [2203 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Shape_1490 [Shape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2200 [06/20/2022-16:24:41] [V] [TRT] Shape_1490 [Shape] inputs: [2200 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Shape_1490 for ONNX node: Shape_1490 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2204 for ONNX tensor: 2204 [06/20/2022-16:24:41] [V] [TRT] Shape_1490 [Shape] outputs: [2204 -> (4)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1491 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1491 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1491 [Constant] outputs: [2205 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Gather_1492 [Gather] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2204 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2205 [06/20/2022-16:24:41] [V] [TRT] Gather_1492 [Gather] inputs: [2204 -> (4)[INT32]], [2205 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2205 for ONNX node: 2205 [06/20/2022-16:24:41] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Gather_1492 for ONNX node: Gather_1492 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2206 for ONNX tensor: 2206 [06/20/2022-16:24:41] [V] [TRT] Gather_1492 [Gather] outputs: [2206 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1493 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2203 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1493 [Unsqueeze] inputs: [2203 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1493 for ONNX node: Unsqueeze_1493 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2208 for ONNX tensor: 2208 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1493 [Unsqueeze] outputs: [2208 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Unsqueeze_1494 [Unsqueeze] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2206 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1494 [Unsqueeze] inputs: [2206 -> ()[INT32]], [06/20/2022-16:24:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:41] [V] [TRT] Registering layer: Unsqueeze_1494 for ONNX node: Unsqueeze_1494 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2209 for ONNX tensor: 2209 [06/20/2022-16:24:41] [V] [TRT] Unsqueeze_1494 [Unsqueeze] outputs: [2209 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Concat_1495 [Concat] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2208 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2209 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3379 [06/20/2022-16:24:41] [V] [TRT] Concat_1495 [Concat] inputs: [2208 -> (1)[INT32]], [2209 -> (1)[INT32]], [3379 -> (1)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3379 for ONNX node: 3379 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Concat_1495 for ONNX node: Concat_1495 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2211 for ONNX tensor: 2211 [06/20/2022-16:24:41] [V] [TRT] Concat_1495 [Concat] outputs: [2211 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Reshape_1496 [Reshape] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2200 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2211 [06/20/2022-16:24:41] [V] [TRT] Reshape_1496 [Reshape] inputs: [2200 -> (-1, -1, 16, 64)[FLOAT]], [2211 -> (3)[INT32]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Reshape_1496 for ONNX node: Reshape_1496 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2212 for ONNX tensor: 2212 [06/20/2022-16:24:41] [V] [TRT] Reshape_1496 [Reshape] outputs: [2212 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1497 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2212 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3380 [06/20/2022-16:24:41] [V] [TRT] MatMul_1497 [MatMul] inputs: [2212 -> (-1, -1, 1024)[FLOAT]], [3380 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3380 for ONNX node: 3380 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1497 for ONNX node: MatMul_1497 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2214 for ONNX tensor: 2214 [06/20/2022-16:24:41] [V] [TRT] MatMul_1497 [MatMul] outputs: [2214 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1498 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.attention.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2214 [06/20/2022-16:24:41] [V] [TRT] Add_1498 [Add] inputs: [bert.encoder.layer.15.attention.output.dense.bias -> (1024)[FLOAT]], [2214 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.attention.output.dense.bias for ONNX node: bert.encoder.layer.15.attention.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1498 for ONNX node: Add_1498 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2215 for ONNX tensor: 2215 [06/20/2022-16:24:41] [V] [TRT] Add_1498 [Add] outputs: [2215 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1499 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2215 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2139 [06/20/2022-16:24:41] [V] [TRT] Add_1499 [Add] inputs: [2215 -> (-1, -1, 1024)[FLOAT]], [2139 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1499 for ONNX node: Add_1499 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2216 for ONNX tensor: 2216 [06/20/2022-16:24:41] [V] [TRT] Add_1499 [Add] outputs: [2216 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1500 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2216 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1500 [ReduceMean] inputs: [2216 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1500 for ONNX node: ReduceMean_1500 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2217 for ONNX tensor: 2217 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1500 [ReduceMean] outputs: [2217 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sub_1501 [Sub] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2216 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2217 [06/20/2022-16:24:41] [V] [TRT] Sub_1501 [Sub] inputs: [2216 -> (-1, -1, 1024)[FLOAT]], [2217 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sub_1501 for ONNX node: Sub_1501 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2218 for ONNX tensor: 2218 [06/20/2022-16:24:41] [V] [TRT] Sub_1501 [Sub] outputs: [2218 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1502 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1502 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1502 [Constant] outputs: [2219 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Pow_1503 [Pow] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2218 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2219 [06/20/2022-16:24:41] [V] [TRT] Pow_1503 [Pow] inputs: [2218 -> (-1, -1, 1024)[FLOAT]], [2219 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2219 for ONNX node: 2219 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Pow_1503 for ONNX node: Pow_1503 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2220 for ONNX tensor: 2220 [06/20/2022-16:24:41] [V] [TRT] Pow_1503 [Pow] outputs: [2220 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1504 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2220 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1504 [ReduceMean] inputs: [2220 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1504 for ONNX node: ReduceMean_1504 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2221 for ONNX tensor: 2221 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1504 [ReduceMean] outputs: [2221 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1505 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1505 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1505 [Constant] outputs: [2222 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1506 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2221 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2222 [06/20/2022-16:24:41] [V] [TRT] Add_1506 [Add] inputs: [2221 -> (-1, -1, 1)[FLOAT]], [2222 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2222 for ONNX node: 2222 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1506 for ONNX node: Add_1506 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2223 for ONNX tensor: 2223 [06/20/2022-16:24:41] [V] [TRT] Add_1506 [Add] outputs: [2223 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sqrt_1507 [Sqrt] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2223 [06/20/2022-16:24:41] [V] [TRT] Sqrt_1507 [Sqrt] inputs: [2223 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sqrt_1507 for ONNX node: Sqrt_1507 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2224 for ONNX tensor: 2224 [06/20/2022-16:24:41] [V] [TRT] Sqrt_1507 [Sqrt] outputs: [2224 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1508 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2218 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2224 [06/20/2022-16:24:41] [V] [TRT] Div_1508 [Div] inputs: [2218 -> (-1, -1, 1024)[FLOAT]], [2224 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1508 for ONNX node: Div_1508 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2225 for ONNX tensor: 2225 [06/20/2022-16:24:41] [V] [TRT] Div_1508 [Div] outputs: [2225 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1509 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2225 [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.attention.output.LayerNorm.weight [06/20/2022-16:24:41] [V] [TRT] Mul_1509 [Mul] inputs: [2225 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.15.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.15.attention.output.LayerNorm.weight [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1509 for ONNX node: Mul_1509 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2226 for ONNX tensor: 2226 [06/20/2022-16:24:41] [V] [TRT] Mul_1509 [Mul] outputs: [2226 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1510 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2226 [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.attention.output.LayerNorm.bias [06/20/2022-16:24:41] [V] [TRT] Add_1510 [Add] inputs: [2226 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.15.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.15.attention.output.LayerNorm.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1510 for ONNX node: Add_1510 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2227 for ONNX tensor: 2227 [06/20/2022-16:24:41] [V] [TRT] Add_1510 [Add] outputs: [2227 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1511 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2227 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3381 [06/20/2022-16:24:41] [V] [TRT] MatMul_1511 [MatMul] inputs: [2227 -> (-1, -1, 1024)[FLOAT]], [3381 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3381 for ONNX node: 3381 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1511 for ONNX node: MatMul_1511 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2229 for ONNX tensor: 2229 [06/20/2022-16:24:41] [V] [TRT] MatMul_1511 [MatMul] outputs: [2229 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1512 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.intermediate.dense.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2229 [06/20/2022-16:24:41] [V] [TRT] Add_1512 [Add] inputs: [bert.encoder.layer.15.intermediate.dense.bias -> (4096)[FLOAT]], [2229 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.intermediate.dense.bias for ONNX node: bert.encoder.layer.15.intermediate.dense.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1512 for ONNX node: Add_1512 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2230 for ONNX tensor: 2230 [06/20/2022-16:24:41] [V] [TRT] Add_1512 [Add] outputs: [2230 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1513 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1513 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1513 [Constant] outputs: [2231 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Div_1514 [Div] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2230 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2231 [06/20/2022-16:24:41] [V] [TRT] Div_1514 [Div] inputs: [2230 -> (-1, -1, 4096)[FLOAT]], [2231 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2231 for ONNX node: 2231 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Div_1514 for ONNX node: Div_1514 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2232 for ONNX tensor: 2232 [06/20/2022-16:24:41] [V] [TRT] Div_1514 [Div] outputs: [2232 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Erf_1515 [Erf] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2232 [06/20/2022-16:24:41] [V] [TRT] Erf_1515 [Erf] inputs: [2232 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Erf_1515 for ONNX node: Erf_1515 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2233 for ONNX tensor: 2233 [06/20/2022-16:24:41] [V] [TRT] Erf_1515 [Erf] outputs: [2233 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1516 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1516 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1516 [Constant] outputs: [2234 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1517 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2233 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2234 [06/20/2022-16:24:41] [V] [TRT] Add_1517 [Add] inputs: [2233 -> (-1, -1, 4096)[FLOAT]], [2234 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2234 for ONNX node: 2234 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1517 for ONNX node: Add_1517 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2235 for ONNX tensor: 2235 [06/20/2022-16:24:41] [V] [TRT] Add_1517 [Add] outputs: [2235 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1518 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2230 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2235 [06/20/2022-16:24:41] [V] [TRT] Mul_1518 [Mul] inputs: [2230 -> (-1, -1, 4096)[FLOAT]], [2235 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1518 for ONNX node: Mul_1518 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2236 for ONNX tensor: 2236 [06/20/2022-16:24:41] [V] [TRT] Mul_1518 [Mul] outputs: [2236 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1519 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1519 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1519 [Constant] outputs: [2237 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Mul_1520 [Mul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2236 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2237 [06/20/2022-16:24:41] [V] [TRT] Mul_1520 [Mul] inputs: [2236 -> (-1, -1, 4096)[FLOAT]], [2237 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2237 for ONNX node: 2237 [06/20/2022-16:24:41] [V] [TRT] Registering layer: Mul_1520 for ONNX node: Mul_1520 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2238 for ONNX tensor: 2238 [06/20/2022-16:24:41] [V] [TRT] Mul_1520 [Mul] outputs: [2238 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: MatMul_1521 [MatMul] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2238 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 3382 [06/20/2022-16:24:41] [V] [TRT] MatMul_1521 [MatMul] inputs: [2238 -> (-1, -1, 4096)[FLOAT]], [3382 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 3382 for ONNX node: 3382 [06/20/2022-16:24:41] [V] [TRT] Registering layer: MatMul_1521 for ONNX node: MatMul_1521 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2240 for ONNX tensor: 2240 [06/20/2022-16:24:41] [V] [TRT] MatMul_1521 [MatMul] outputs: [2240 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1522 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: bert.encoder.layer.15.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2240 [06/20/2022-16:24:41] [V] [TRT] Add_1522 [Add] inputs: [bert.encoder.layer.15.output.dense.bias -> (1024)[FLOAT]], [2240 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: bert.encoder.layer.15.output.dense.bias for ONNX node: bert.encoder.layer.15.output.dense.bias [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1522 for ONNX node: Add_1522 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2241 for ONNX tensor: 2241 [06/20/2022-16:24:41] [V] [TRT] Add_1522 [Add] outputs: [2241 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Add_1523 [Add] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2241 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2227 [06/20/2022-16:24:41] [V] [TRT] Add_1523 [Add] inputs: [2241 -> (-1, -1, 1024)[FLOAT]], [2227 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Add_1523 for ONNX node: Add_1523 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2242 for ONNX tensor: 2242 [06/20/2022-16:24:41] [V] [TRT] Add_1523 [Add] outputs: [2242 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: ReduceMean_1524 [ReduceMean] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2242 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1524 [ReduceMean] inputs: [2242 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: ReduceMean_1524 for ONNX node: ReduceMean_1524 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2243 for ONNX tensor: 2243 [06/20/2022-16:24:41] [V] [TRT] ReduceMean_1524 [ReduceMean] outputs: [2243 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Sub_1525 [Sub] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2242 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2243 [06/20/2022-16:24:41] [V] [TRT] Sub_1525 [Sub] inputs: [2242 -> (-1, -1, 1024)[FLOAT]], [2243 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: Sub_1525 for ONNX node: Sub_1525 [06/20/2022-16:24:41] [V] [TRT] Registering tensor: 2244 for ONNX tensor: 2244 [06/20/2022-16:24:41] [V] [TRT] Sub_1525 [Sub] outputs: [2244 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Constant_1526 [Constant] [06/20/2022-16:24:41] [V] [TRT] Constant_1526 [Constant] inputs: [06/20/2022-16:24:41] [V] [TRT] Constant_1526 [Constant] outputs: [2245 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Parsing node: Pow_1527 [Pow] [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2244 [06/20/2022-16:24:41] [V] [TRT] Searching for input: 2245 [06/20/2022-16:24:41] [V] [TRT] Pow_1527 [Pow] inputs: [2244 -> (-1, -1, 1024)[FLOAT]], [2245 -> ()[FLOAT]], [06/20/2022-16:24:41] [V] [TRT] Registering layer: 2245 for ONNX node: 2245 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Pow_1527 for ONNX node: Pow_1527 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2246 for ONNX tensor: 2246 [06/20/2022-16:24:42] [V] [TRT] Pow_1527 [Pow] outputs: [2246 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: ReduceMean_1528 [ReduceMean] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2246 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1528 [ReduceMean] inputs: [2246 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: ReduceMean_1528 for ONNX node: ReduceMean_1528 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2247 for ONNX tensor: 2247 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1528 [ReduceMean] outputs: [2247 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1529 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1529 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1529 [Constant] outputs: [2248 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1530 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2247 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2248 [06/20/2022-16:24:42] [V] [TRT] Add_1530 [Add] inputs: [2247 -> (-1, -1, 1)[FLOAT]], [2248 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2248 for ONNX node: 2248 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1530 for ONNX node: Add_1530 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2249 for ONNX tensor: 2249 [06/20/2022-16:24:42] [V] [TRT] Add_1530 [Add] outputs: [2249 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Sqrt_1531 [Sqrt] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2249 [06/20/2022-16:24:42] [V] [TRT] Sqrt_1531 [Sqrt] inputs: [2249 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Sqrt_1531 for ONNX node: Sqrt_1531 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2250 for ONNX tensor: 2250 [06/20/2022-16:24:42] [V] [TRT] Sqrt_1531 [Sqrt] outputs: [2250 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Div_1532 [Div] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2244 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2250 [06/20/2022-16:24:42] [V] [TRT] Div_1532 [Div] inputs: [2244 -> (-1, -1, 1024)[FLOAT]], [2250 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Div_1532 for ONNX node: Div_1532 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2251 for ONNX tensor: 2251 [06/20/2022-16:24:42] [V] [TRT] Div_1532 [Div] outputs: [2251 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Mul_1533 [Mul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2251 [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.15.output.LayerNorm.weight [06/20/2022-16:24:42] [V] [TRT] Mul_1533 [Mul] inputs: [2251 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.15.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.15.output.LayerNorm.weight for ONNX node: bert.encoder.layer.15.output.LayerNorm.weight [06/20/2022-16:24:42] [V] [TRT] Registering layer: Mul_1533 for ONNX node: Mul_1533 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2252 for ONNX tensor: 2252 [06/20/2022-16:24:42] [V] [TRT] Mul_1533 [Mul] outputs: [2252 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1534 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2252 [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.15.output.LayerNorm.bias [06/20/2022-16:24:42] [V] [TRT] Add_1534 [Add] inputs: [2252 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.15.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.15.output.LayerNorm.bias for ONNX node: bert.encoder.layer.15.output.LayerNorm.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1534 for ONNX node: Add_1534 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2253 for ONNX tensor: 2253 [06/20/2022-16:24:42] [V] [TRT] Add_1534 [Add] outputs: [2253 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1535 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2253 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3383 [06/20/2022-16:24:42] [V] [TRT] MatMul_1535 [MatMul] inputs: [2253 -> (-1, -1, 1024)[FLOAT]], [3383 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3383 for ONNX node: 3383 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1535 for ONNX node: MatMul_1535 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2255 for ONNX tensor: 2255 [06/20/2022-16:24:42] [V] [TRT] MatMul_1535 [MatMul] outputs: [2255 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1536 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.attention.self.query.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2255 [06/20/2022-16:24:42] [V] [TRT] Add_1536 [Add] inputs: [bert.encoder.layer.16.attention.self.query.bias -> (1024)[FLOAT]], [2255 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.attention.self.query.bias for ONNX node: bert.encoder.layer.16.attention.self.query.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1536 for ONNX node: Add_1536 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2256 for ONNX tensor: 2256 [06/20/2022-16:24:42] [V] [TRT] Add_1536 [Add] outputs: [2256 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1537 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2253 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3384 [06/20/2022-16:24:42] [V] [TRT] MatMul_1537 [MatMul] inputs: [2253 -> (-1, -1, 1024)[FLOAT]], [3384 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3384 for ONNX node: 3384 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1537 for ONNX node: MatMul_1537 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2258 for ONNX tensor: 2258 [06/20/2022-16:24:42] [V] [TRT] MatMul_1537 [MatMul] outputs: [2258 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1538 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.attention.self.key.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2258 [06/20/2022-16:24:42] [V] [TRT] Add_1538 [Add] inputs: [bert.encoder.layer.16.attention.self.key.bias -> (1024)[FLOAT]], [2258 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.attention.self.key.bias for ONNX node: bert.encoder.layer.16.attention.self.key.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1538 for ONNX node: Add_1538 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2259 for ONNX tensor: 2259 [06/20/2022-16:24:42] [V] [TRT] Add_1538 [Add] outputs: [2259 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1539 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2259 [06/20/2022-16:24:42] [V] [TRT] Shape_1539 [Shape] inputs: [2259 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1539 for ONNX node: Shape_1539 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2260 for ONNX tensor: 2260 [06/20/2022-16:24:42] [V] [TRT] Shape_1539 [Shape] outputs: [2260 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1540 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1540 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1540 [Constant] outputs: [2261 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1541 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2260 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2261 [06/20/2022-16:24:42] [V] [TRT] Gather_1541 [Gather] inputs: [2260 -> (3)[INT32]], [2261 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2261 for ONNX node: 2261 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1541 for ONNX node: Gather_1541 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2262 for ONNX tensor: 2262 [06/20/2022-16:24:42] [V] [TRT] Gather_1541 [Gather] outputs: [2262 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1542 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2259 [06/20/2022-16:24:42] [V] [TRT] Shape_1542 [Shape] inputs: [2259 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1542 for ONNX node: Shape_1542 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2263 for ONNX tensor: 2263 [06/20/2022-16:24:42] [V] [TRT] Shape_1542 [Shape] outputs: [2263 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1543 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1543 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1543 [Constant] outputs: [2264 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1544 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2263 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2264 [06/20/2022-16:24:42] [V] [TRT] Gather_1544 [Gather] inputs: [2263 -> (3)[INT32]], [2264 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2264 for ONNX node: 2264 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1544 for ONNX node: Gather_1544 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2265 for ONNX tensor: 2265 [06/20/2022-16:24:42] [V] [TRT] Gather_1544 [Gather] outputs: [2265 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1545 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2262 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1545 [Unsqueeze] inputs: [2262 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1545 for ONNX node: Unsqueeze_1545 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2268 for ONNX tensor: 2268 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1545 [Unsqueeze] outputs: [2268 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1546 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2265 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1546 [Unsqueeze] inputs: [2265 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1546 for ONNX node: Unsqueeze_1546 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2269 for ONNX tensor: 2269 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1546 [Unsqueeze] outputs: [2269 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1547 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2268 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2269 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3385 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3386 [06/20/2022-16:24:42] [V] [TRT] Concat_1547 [Concat] inputs: [2268 -> (1)[INT32]], [2269 -> (1)[INT32]], [3385 -> (1)[INT32]], [3386 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3385 for ONNX node: 3385 [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3386 for ONNX node: 3386 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1547 for ONNX node: Concat_1547 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2272 for ONNX tensor: 2272 [06/20/2022-16:24:42] [V] [TRT] Concat_1547 [Concat] outputs: [2272 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1548 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2259 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2272 [06/20/2022-16:24:42] [V] [TRT] Reshape_1548 [Reshape] inputs: [2259 -> (-1, -1, 1024)[FLOAT]], [2272 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1548 for ONNX node: Reshape_1548 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2273 for ONNX tensor: 2273 [06/20/2022-16:24:42] [V] [TRT] Reshape_1548 [Reshape] outputs: [2273 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1549 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2253 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3387 [06/20/2022-16:24:42] [V] [TRT] MatMul_1549 [MatMul] inputs: [2253 -> (-1, -1, 1024)[FLOAT]], [3387 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3387 for ONNX node: 3387 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1549 for ONNX node: MatMul_1549 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2275 for ONNX tensor: 2275 [06/20/2022-16:24:42] [V] [TRT] MatMul_1549 [MatMul] outputs: [2275 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1550 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.attention.self.value.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2275 [06/20/2022-16:24:42] [V] [TRT] Add_1550 [Add] inputs: [bert.encoder.layer.16.attention.self.value.bias -> (1024)[FLOAT]], [2275 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.attention.self.value.bias for ONNX node: bert.encoder.layer.16.attention.self.value.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1550 for ONNX node: Add_1550 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2276 for ONNX tensor: 2276 [06/20/2022-16:24:42] [V] [TRT] Add_1550 [Add] outputs: [2276 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1551 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2276 [06/20/2022-16:24:42] [V] [TRT] Shape_1551 [Shape] inputs: [2276 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1551 for ONNX node: Shape_1551 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2277 for ONNX tensor: 2277 [06/20/2022-16:24:42] [V] [TRT] Shape_1551 [Shape] outputs: [2277 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1552 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1552 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1552 [Constant] outputs: [2278 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1553 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2277 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2278 [06/20/2022-16:24:42] [V] [TRT] Gather_1553 [Gather] inputs: [2277 -> (3)[INT32]], [2278 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2278 for ONNX node: 2278 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1553 for ONNX node: Gather_1553 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2279 for ONNX tensor: 2279 [06/20/2022-16:24:42] [V] [TRT] Gather_1553 [Gather] outputs: [2279 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1554 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2276 [06/20/2022-16:24:42] [V] [TRT] Shape_1554 [Shape] inputs: [2276 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1554 for ONNX node: Shape_1554 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2280 for ONNX tensor: 2280 [06/20/2022-16:24:42] [V] [TRT] Shape_1554 [Shape] outputs: [2280 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1555 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1555 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1555 [Constant] outputs: [2281 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1556 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2280 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2281 [06/20/2022-16:24:42] [V] [TRT] Gather_1556 [Gather] inputs: [2280 -> (3)[INT32]], [2281 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2281 for ONNX node: 2281 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1556 for ONNX node: Gather_1556 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2282 for ONNX tensor: 2282 [06/20/2022-16:24:42] [V] [TRT] Gather_1556 [Gather] outputs: [2282 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1557 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2279 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1557 [Unsqueeze] inputs: [2279 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1557 for ONNX node: Unsqueeze_1557 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2285 for ONNX tensor: 2285 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1557 [Unsqueeze] outputs: [2285 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1558 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2282 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1558 [Unsqueeze] inputs: [2282 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1558 for ONNX node: Unsqueeze_1558 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2286 for ONNX tensor: 2286 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1558 [Unsqueeze] outputs: [2286 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1559 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2285 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2286 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3388 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3389 [06/20/2022-16:24:42] [V] [TRT] Concat_1559 [Concat] inputs: [2285 -> (1)[INT32]], [2286 -> (1)[INT32]], [3388 -> (1)[INT32]], [3389 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3388 for ONNX node: 3388 [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3389 for ONNX node: 3389 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1559 for ONNX node: Concat_1559 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2289 for ONNX tensor: 2289 [06/20/2022-16:24:42] [V] [TRT] Concat_1559 [Concat] outputs: [2289 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1560 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2276 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2289 [06/20/2022-16:24:42] [V] [TRT] Reshape_1560 [Reshape] inputs: [2276 -> (-1, -1, 1024)[FLOAT]], [2289 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1560 for ONNX node: Reshape_1560 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2290 for ONNX tensor: 2290 [06/20/2022-16:24:42] [V] [TRT] Reshape_1560 [Reshape] outputs: [2290 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1561 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2290 [06/20/2022-16:24:42] [V] [TRT] Transpose_1561 [Transpose] inputs: [2290 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1561 for ONNX node: Transpose_1561 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2291 for ONNX tensor: 2291 [06/20/2022-16:24:42] [V] [TRT] Transpose_1561 [Transpose] outputs: [2291 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1562 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2256 [06/20/2022-16:24:42] [V] [TRT] Shape_1562 [Shape] inputs: [2256 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1562 for ONNX node: Shape_1562 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2292 for ONNX tensor: 2292 [06/20/2022-16:24:42] [V] [TRT] Shape_1562 [Shape] outputs: [2292 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1563 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1563 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1563 [Constant] outputs: [2293 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1564 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2292 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2293 [06/20/2022-16:24:42] [V] [TRT] Gather_1564 [Gather] inputs: [2292 -> (3)[INT32]], [2293 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2293 for ONNX node: 2293 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1564 for ONNX node: Gather_1564 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2294 for ONNX tensor: 2294 [06/20/2022-16:24:42] [V] [TRT] Gather_1564 [Gather] outputs: [2294 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1565 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2256 [06/20/2022-16:24:42] [V] [TRT] Shape_1565 [Shape] inputs: [2256 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1565 for ONNX node: Shape_1565 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2295 for ONNX tensor: 2295 [06/20/2022-16:24:42] [V] [TRT] Shape_1565 [Shape] outputs: [2295 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1566 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1566 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1566 [Constant] outputs: [2296 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1567 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2295 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2296 [06/20/2022-16:24:42] [V] [TRT] Gather_1567 [Gather] inputs: [2295 -> (3)[INT32]], [2296 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2296 for ONNX node: 2296 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1567 for ONNX node: Gather_1567 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2297 for ONNX tensor: 2297 [06/20/2022-16:24:42] [V] [TRT] Gather_1567 [Gather] outputs: [2297 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1568 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2294 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1568 [Unsqueeze] inputs: [2294 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1568 for ONNX node: Unsqueeze_1568 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2300 for ONNX tensor: 2300 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1568 [Unsqueeze] outputs: [2300 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1569 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2297 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1569 [Unsqueeze] inputs: [2297 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1569 for ONNX node: Unsqueeze_1569 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2301 for ONNX tensor: 2301 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1569 [Unsqueeze] outputs: [2301 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1570 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2300 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2301 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3390 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3391 [06/20/2022-16:24:42] [V] [TRT] Concat_1570 [Concat] inputs: [2300 -> (1)[INT32]], [2301 -> (1)[INT32]], [3390 -> (1)[INT32]], [3391 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3390 for ONNX node: 3390 [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3391 for ONNX node: 3391 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1570 for ONNX node: Concat_1570 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2304 for ONNX tensor: 2304 [06/20/2022-16:24:42] [V] [TRT] Concat_1570 [Concat] outputs: [2304 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1571 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2256 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2304 [06/20/2022-16:24:42] [V] [TRT] Reshape_1571 [Reshape] inputs: [2256 -> (-1, -1, 1024)[FLOAT]], [2304 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1571 for ONNX node: Reshape_1571 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2305 for ONNX tensor: 2305 [06/20/2022-16:24:42] [V] [TRT] Reshape_1571 [Reshape] outputs: [2305 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1572 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2305 [06/20/2022-16:24:42] [V] [TRT] Transpose_1572 [Transpose] inputs: [2305 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1572 for ONNX node: Transpose_1572 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2306 for ONNX tensor: 2306 [06/20/2022-16:24:42] [V] [TRT] Transpose_1572 [Transpose] outputs: [2306 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1573 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2273 [06/20/2022-16:24:42] [V] [TRT] Transpose_1573 [Transpose] inputs: [2273 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1573 for ONNX node: Transpose_1573 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2307 for ONNX tensor: 2307 [06/20/2022-16:24:42] [V] [TRT] Transpose_1573 [Transpose] outputs: [2307 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1574 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2306 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2307 [06/20/2022-16:24:42] [V] [TRT] MatMul_1574 [MatMul] inputs: [2306 -> (-1, 16, -1, 64)[FLOAT]], [2307 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1574 for ONNX node: MatMul_1574 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2308 for ONNX tensor: 2308 [06/20/2022-16:24:42] [V] [TRT] MatMul_1574 [MatMul] outputs: [2308 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1575 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1575 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1575 [Constant] outputs: [2309 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Div_1576 [Div] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2308 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2309 [06/20/2022-16:24:42] [V] [TRT] Div_1576 [Div] inputs: [2308 -> (-1, 16, -1, -1)[FLOAT]], [2309 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2309 for ONNX node: 2309 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Div_1576 for ONNX node: Div_1576 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2310 for ONNX tensor: 2310 [06/20/2022-16:24:42] [V] [TRT] Div_1576 [Div] outputs: [2310 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1577 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2310 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:42] [V] [TRT] Add_1577 [Add] inputs: [2310 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1577 for ONNX node: Add_1577 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2311 for ONNX tensor: 2311 [06/20/2022-16:24:42] [V] [TRT] Add_1577 [Add] outputs: [2311 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Softmax_1578 [Softmax] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2311 [06/20/2022-16:24:42] [V] [TRT] Softmax_1578 [Softmax] inputs: [2311 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Softmax_1578 for ONNX node: Softmax_1578 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2312 for ONNX tensor: 2312 [06/20/2022-16:24:42] [V] [TRT] Softmax_1578 [Softmax] outputs: [2312 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1579 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2312 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2291 [06/20/2022-16:24:42] [V] [TRT] MatMul_1579 [MatMul] inputs: [2312 -> (-1, 16, -1, -1)[FLOAT]], [2291 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1579 for ONNX node: MatMul_1579 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2313 for ONNX tensor: 2313 [06/20/2022-16:24:42] [V] [TRT] MatMul_1579 [MatMul] outputs: [2313 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1580 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2313 [06/20/2022-16:24:42] [V] [TRT] Transpose_1580 [Transpose] inputs: [2313 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1580 for ONNX node: Transpose_1580 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2314 for ONNX tensor: 2314 [06/20/2022-16:24:42] [V] [TRT] Transpose_1580 [Transpose] outputs: [2314 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1581 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2314 [06/20/2022-16:24:42] [V] [TRT] Shape_1581 [Shape] inputs: [2314 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1581 for ONNX node: Shape_1581 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2315 for ONNX tensor: 2315 [06/20/2022-16:24:42] [V] [TRT] Shape_1581 [Shape] outputs: [2315 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1582 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1582 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1582 [Constant] outputs: [2316 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1583 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2315 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2316 [06/20/2022-16:24:42] [V] [TRT] Gather_1583 [Gather] inputs: [2315 -> (4)[INT32]], [2316 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2316 for ONNX node: 2316 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1583 for ONNX node: Gather_1583 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2317 for ONNX tensor: 2317 [06/20/2022-16:24:42] [V] [TRT] Gather_1583 [Gather] outputs: [2317 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1584 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2314 [06/20/2022-16:24:42] [V] [TRT] Shape_1584 [Shape] inputs: [2314 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1584 for ONNX node: Shape_1584 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2318 for ONNX tensor: 2318 [06/20/2022-16:24:42] [V] [TRT] Shape_1584 [Shape] outputs: [2318 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1585 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1585 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1585 [Constant] outputs: [2319 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1586 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2318 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2319 [06/20/2022-16:24:42] [V] [TRT] Gather_1586 [Gather] inputs: [2318 -> (4)[INT32]], [2319 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2319 for ONNX node: 2319 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1586 for ONNX node: Gather_1586 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2320 for ONNX tensor: 2320 [06/20/2022-16:24:42] [V] [TRT] Gather_1586 [Gather] outputs: [2320 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1587 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2317 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1587 [Unsqueeze] inputs: [2317 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1587 for ONNX node: Unsqueeze_1587 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2322 for ONNX tensor: 2322 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1587 [Unsqueeze] outputs: [2322 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1588 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2320 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1588 [Unsqueeze] inputs: [2320 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1588 for ONNX node: Unsqueeze_1588 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2323 for ONNX tensor: 2323 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1588 [Unsqueeze] outputs: [2323 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1589 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2322 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2323 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3392 [06/20/2022-16:24:42] [V] [TRT] Concat_1589 [Concat] inputs: [2322 -> (1)[INT32]], [2323 -> (1)[INT32]], [3392 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3392 for ONNX node: 3392 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1589 for ONNX node: Concat_1589 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2325 for ONNX tensor: 2325 [06/20/2022-16:24:42] [V] [TRT] Concat_1589 [Concat] outputs: [2325 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1590 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2314 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2325 [06/20/2022-16:24:42] [V] [TRT] Reshape_1590 [Reshape] inputs: [2314 -> (-1, -1, 16, 64)[FLOAT]], [2325 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1590 for ONNX node: Reshape_1590 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2326 for ONNX tensor: 2326 [06/20/2022-16:24:42] [V] [TRT] Reshape_1590 [Reshape] outputs: [2326 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1591 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2326 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3393 [06/20/2022-16:24:42] [V] [TRT] MatMul_1591 [MatMul] inputs: [2326 -> (-1, -1, 1024)[FLOAT]], [3393 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3393 for ONNX node: 3393 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1591 for ONNX node: MatMul_1591 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2328 for ONNX tensor: 2328 [06/20/2022-16:24:42] [V] [TRT] MatMul_1591 [MatMul] outputs: [2328 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1592 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.attention.output.dense.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2328 [06/20/2022-16:24:42] [V] [TRT] Add_1592 [Add] inputs: [bert.encoder.layer.16.attention.output.dense.bias -> (1024)[FLOAT]], [2328 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.attention.output.dense.bias for ONNX node: bert.encoder.layer.16.attention.output.dense.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1592 for ONNX node: Add_1592 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2329 for ONNX tensor: 2329 [06/20/2022-16:24:42] [V] [TRT] Add_1592 [Add] outputs: [2329 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1593 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2329 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2253 [06/20/2022-16:24:42] [V] [TRT] Add_1593 [Add] inputs: [2329 -> (-1, -1, 1024)[FLOAT]], [2253 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1593 for ONNX node: Add_1593 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2330 for ONNX tensor: 2330 [06/20/2022-16:24:42] [V] [TRT] Add_1593 [Add] outputs: [2330 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: ReduceMean_1594 [ReduceMean] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2330 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1594 [ReduceMean] inputs: [2330 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: ReduceMean_1594 for ONNX node: ReduceMean_1594 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2331 for ONNX tensor: 2331 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1594 [ReduceMean] outputs: [2331 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Sub_1595 [Sub] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2330 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2331 [06/20/2022-16:24:42] [V] [TRT] Sub_1595 [Sub] inputs: [2330 -> (-1, -1, 1024)[FLOAT]], [2331 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Sub_1595 for ONNX node: Sub_1595 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2332 for ONNX tensor: 2332 [06/20/2022-16:24:42] [V] [TRT] Sub_1595 [Sub] outputs: [2332 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1596 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1596 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1596 [Constant] outputs: [2333 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Pow_1597 [Pow] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2332 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2333 [06/20/2022-16:24:42] [V] [TRT] Pow_1597 [Pow] inputs: [2332 -> (-1, -1, 1024)[FLOAT]], [2333 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2333 for ONNX node: 2333 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Pow_1597 for ONNX node: Pow_1597 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2334 for ONNX tensor: 2334 [06/20/2022-16:24:42] [V] [TRT] Pow_1597 [Pow] outputs: [2334 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: ReduceMean_1598 [ReduceMean] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2334 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1598 [ReduceMean] inputs: [2334 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: ReduceMean_1598 for ONNX node: ReduceMean_1598 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2335 for ONNX tensor: 2335 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1598 [ReduceMean] outputs: [2335 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1599 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1599 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1599 [Constant] outputs: [2336 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1600 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2335 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2336 [06/20/2022-16:24:42] [V] [TRT] Add_1600 [Add] inputs: [2335 -> (-1, -1, 1)[FLOAT]], [2336 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2336 for ONNX node: 2336 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1600 for ONNX node: Add_1600 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2337 for ONNX tensor: 2337 [06/20/2022-16:24:42] [V] [TRT] Add_1600 [Add] outputs: [2337 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Sqrt_1601 [Sqrt] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2337 [06/20/2022-16:24:42] [V] [TRT] Sqrt_1601 [Sqrt] inputs: [2337 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Sqrt_1601 for ONNX node: Sqrt_1601 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2338 for ONNX tensor: 2338 [06/20/2022-16:24:42] [V] [TRT] Sqrt_1601 [Sqrt] outputs: [2338 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Div_1602 [Div] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2332 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2338 [06/20/2022-16:24:42] [V] [TRT] Div_1602 [Div] inputs: [2332 -> (-1, -1, 1024)[FLOAT]], [2338 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Div_1602 for ONNX node: Div_1602 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2339 for ONNX tensor: 2339 [06/20/2022-16:24:42] [V] [TRT] Div_1602 [Div] outputs: [2339 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Mul_1603 [Mul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2339 [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.attention.output.LayerNorm.weight [06/20/2022-16:24:42] [V] [TRT] Mul_1603 [Mul] inputs: [2339 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.16.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.16.attention.output.LayerNorm.weight [06/20/2022-16:24:42] [V] [TRT] Registering layer: Mul_1603 for ONNX node: Mul_1603 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2340 for ONNX tensor: 2340 [06/20/2022-16:24:42] [V] [TRT] Mul_1603 [Mul] outputs: [2340 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1604 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2340 [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.attention.output.LayerNorm.bias [06/20/2022-16:24:42] [V] [TRT] Add_1604 [Add] inputs: [2340 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.16.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.16.attention.output.LayerNorm.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1604 for ONNX node: Add_1604 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2341 for ONNX tensor: 2341 [06/20/2022-16:24:42] [V] [TRT] Add_1604 [Add] outputs: [2341 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1605 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2341 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3394 [06/20/2022-16:24:42] [V] [TRT] MatMul_1605 [MatMul] inputs: [2341 -> (-1, -1, 1024)[FLOAT]], [3394 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3394 for ONNX node: 3394 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1605 for ONNX node: MatMul_1605 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2343 for ONNX tensor: 2343 [06/20/2022-16:24:42] [V] [TRT] MatMul_1605 [MatMul] outputs: [2343 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1606 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.intermediate.dense.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2343 [06/20/2022-16:24:42] [V] [TRT] Add_1606 [Add] inputs: [bert.encoder.layer.16.intermediate.dense.bias -> (4096)[FLOAT]], [2343 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.intermediate.dense.bias for ONNX node: bert.encoder.layer.16.intermediate.dense.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1606 for ONNX node: Add_1606 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2344 for ONNX tensor: 2344 [06/20/2022-16:24:42] [V] [TRT] Add_1606 [Add] outputs: [2344 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1607 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1607 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1607 [Constant] outputs: [2345 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Div_1608 [Div] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2344 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2345 [06/20/2022-16:24:42] [V] [TRT] Div_1608 [Div] inputs: [2344 -> (-1, -1, 4096)[FLOAT]], [2345 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2345 for ONNX node: 2345 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Div_1608 for ONNX node: Div_1608 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2346 for ONNX tensor: 2346 [06/20/2022-16:24:42] [V] [TRT] Div_1608 [Div] outputs: [2346 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Erf_1609 [Erf] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2346 [06/20/2022-16:24:42] [V] [TRT] Erf_1609 [Erf] inputs: [2346 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Erf_1609 for ONNX node: Erf_1609 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2347 for ONNX tensor: 2347 [06/20/2022-16:24:42] [V] [TRT] Erf_1609 [Erf] outputs: [2347 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1610 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1610 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1610 [Constant] outputs: [2348 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1611 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2347 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2348 [06/20/2022-16:24:42] [V] [TRT] Add_1611 [Add] inputs: [2347 -> (-1, -1, 4096)[FLOAT]], [2348 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2348 for ONNX node: 2348 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1611 for ONNX node: Add_1611 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2349 for ONNX tensor: 2349 [06/20/2022-16:24:42] [V] [TRT] Add_1611 [Add] outputs: [2349 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Mul_1612 [Mul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2344 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2349 [06/20/2022-16:24:42] [V] [TRT] Mul_1612 [Mul] inputs: [2344 -> (-1, -1, 4096)[FLOAT]], [2349 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Mul_1612 for ONNX node: Mul_1612 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2350 for ONNX tensor: 2350 [06/20/2022-16:24:42] [V] [TRT] Mul_1612 [Mul] outputs: [2350 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1613 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1613 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1613 [Constant] outputs: [2351 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Mul_1614 [Mul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2350 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2351 [06/20/2022-16:24:42] [V] [TRT] Mul_1614 [Mul] inputs: [2350 -> (-1, -1, 4096)[FLOAT]], [2351 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2351 for ONNX node: 2351 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Mul_1614 for ONNX node: Mul_1614 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2352 for ONNX tensor: 2352 [06/20/2022-16:24:42] [V] [TRT] Mul_1614 [Mul] outputs: [2352 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1615 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2352 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3395 [06/20/2022-16:24:42] [V] [TRT] MatMul_1615 [MatMul] inputs: [2352 -> (-1, -1, 4096)[FLOAT]], [3395 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3395 for ONNX node: 3395 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1615 for ONNX node: MatMul_1615 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2354 for ONNX tensor: 2354 [06/20/2022-16:24:42] [V] [TRT] MatMul_1615 [MatMul] outputs: [2354 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1616 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.output.dense.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2354 [06/20/2022-16:24:42] [V] [TRT] Add_1616 [Add] inputs: [bert.encoder.layer.16.output.dense.bias -> (1024)[FLOAT]], [2354 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.output.dense.bias for ONNX node: bert.encoder.layer.16.output.dense.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1616 for ONNX node: Add_1616 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2355 for ONNX tensor: 2355 [06/20/2022-16:24:42] [V] [TRT] Add_1616 [Add] outputs: [2355 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1617 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2355 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2341 [06/20/2022-16:24:42] [V] [TRT] Add_1617 [Add] inputs: [2355 -> (-1, -1, 1024)[FLOAT]], [2341 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1617 for ONNX node: Add_1617 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2356 for ONNX tensor: 2356 [06/20/2022-16:24:42] [V] [TRT] Add_1617 [Add] outputs: [2356 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: ReduceMean_1618 [ReduceMean] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2356 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1618 [ReduceMean] inputs: [2356 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: ReduceMean_1618 for ONNX node: ReduceMean_1618 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2357 for ONNX tensor: 2357 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1618 [ReduceMean] outputs: [2357 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Sub_1619 [Sub] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2356 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2357 [06/20/2022-16:24:42] [V] [TRT] Sub_1619 [Sub] inputs: [2356 -> (-1, -1, 1024)[FLOAT]], [2357 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Sub_1619 for ONNX node: Sub_1619 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2358 for ONNX tensor: 2358 [06/20/2022-16:24:42] [V] [TRT] Sub_1619 [Sub] outputs: [2358 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1620 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1620 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1620 [Constant] outputs: [2359 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Pow_1621 [Pow] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2358 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2359 [06/20/2022-16:24:42] [V] [TRT] Pow_1621 [Pow] inputs: [2358 -> (-1, -1, 1024)[FLOAT]], [2359 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2359 for ONNX node: 2359 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Pow_1621 for ONNX node: Pow_1621 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2360 for ONNX tensor: 2360 [06/20/2022-16:24:42] [V] [TRT] Pow_1621 [Pow] outputs: [2360 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: ReduceMean_1622 [ReduceMean] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2360 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1622 [ReduceMean] inputs: [2360 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: ReduceMean_1622 for ONNX node: ReduceMean_1622 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2361 for ONNX tensor: 2361 [06/20/2022-16:24:42] [V] [TRT] ReduceMean_1622 [ReduceMean] outputs: [2361 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1623 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1623 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1623 [Constant] outputs: [2362 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1624 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2361 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2362 [06/20/2022-16:24:42] [V] [TRT] Add_1624 [Add] inputs: [2361 -> (-1, -1, 1)[FLOAT]], [2362 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2362 for ONNX node: 2362 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1624 for ONNX node: Add_1624 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2363 for ONNX tensor: 2363 [06/20/2022-16:24:42] [V] [TRT] Add_1624 [Add] outputs: [2363 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Sqrt_1625 [Sqrt] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2363 [06/20/2022-16:24:42] [V] [TRT] Sqrt_1625 [Sqrt] inputs: [2363 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Sqrt_1625 for ONNX node: Sqrt_1625 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2364 for ONNX tensor: 2364 [06/20/2022-16:24:42] [V] [TRT] Sqrt_1625 [Sqrt] outputs: [2364 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Div_1626 [Div] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2358 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2364 [06/20/2022-16:24:42] [V] [TRT] Div_1626 [Div] inputs: [2358 -> (-1, -1, 1024)[FLOAT]], [2364 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Div_1626 for ONNX node: Div_1626 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2365 for ONNX tensor: 2365 [06/20/2022-16:24:42] [V] [TRT] Div_1626 [Div] outputs: [2365 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Mul_1627 [Mul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2365 [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.output.LayerNorm.weight [06/20/2022-16:24:42] [V] [TRT] Mul_1627 [Mul] inputs: [2365 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.16.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.output.LayerNorm.weight for ONNX node: bert.encoder.layer.16.output.LayerNorm.weight [06/20/2022-16:24:42] [V] [TRT] Registering layer: Mul_1627 for ONNX node: Mul_1627 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2366 for ONNX tensor: 2366 [06/20/2022-16:24:42] [V] [TRT] Mul_1627 [Mul] outputs: [2366 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1628 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2366 [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.16.output.LayerNorm.bias [06/20/2022-16:24:42] [V] [TRT] Add_1628 [Add] inputs: [2366 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.16.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.16.output.LayerNorm.bias for ONNX node: bert.encoder.layer.16.output.LayerNorm.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1628 for ONNX node: Add_1628 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2367 for ONNX tensor: 2367 [06/20/2022-16:24:42] [V] [TRT] Add_1628 [Add] outputs: [2367 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1629 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2367 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3396 [06/20/2022-16:24:42] [V] [TRT] MatMul_1629 [MatMul] inputs: [2367 -> (-1, -1, 1024)[FLOAT]], [3396 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3396 for ONNX node: 3396 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1629 for ONNX node: MatMul_1629 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2369 for ONNX tensor: 2369 [06/20/2022-16:24:42] [V] [TRT] MatMul_1629 [MatMul] outputs: [2369 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1630 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.17.attention.self.query.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2369 [06/20/2022-16:24:42] [V] [TRT] Add_1630 [Add] inputs: [bert.encoder.layer.17.attention.self.query.bias -> (1024)[FLOAT]], [2369 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.17.attention.self.query.bias for ONNX node: bert.encoder.layer.17.attention.self.query.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1630 for ONNX node: Add_1630 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2370 for ONNX tensor: 2370 [06/20/2022-16:24:42] [V] [TRT] Add_1630 [Add] outputs: [2370 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1631 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2367 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3397 [06/20/2022-16:24:42] [V] [TRT] MatMul_1631 [MatMul] inputs: [2367 -> (-1, -1, 1024)[FLOAT]], [3397 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3397 for ONNX node: 3397 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1631 for ONNX node: MatMul_1631 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2372 for ONNX tensor: 2372 [06/20/2022-16:24:42] [V] [TRT] MatMul_1631 [MatMul] outputs: [2372 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1632 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.17.attention.self.key.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2372 [06/20/2022-16:24:42] [V] [TRT] Add_1632 [Add] inputs: [bert.encoder.layer.17.attention.self.key.bias -> (1024)[FLOAT]], [2372 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.17.attention.self.key.bias for ONNX node: bert.encoder.layer.17.attention.self.key.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1632 for ONNX node: Add_1632 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2373 for ONNX tensor: 2373 [06/20/2022-16:24:42] [V] [TRT] Add_1632 [Add] outputs: [2373 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1633 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2373 [06/20/2022-16:24:42] [V] [TRT] Shape_1633 [Shape] inputs: [2373 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1633 for ONNX node: Shape_1633 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2374 for ONNX tensor: 2374 [06/20/2022-16:24:42] [V] [TRT] Shape_1633 [Shape] outputs: [2374 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1634 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1634 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1634 [Constant] outputs: [2375 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1635 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2374 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2375 [06/20/2022-16:24:42] [V] [TRT] Gather_1635 [Gather] inputs: [2374 -> (3)[INT32]], [2375 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2375 for ONNX node: 2375 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1635 for ONNX node: Gather_1635 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2376 for ONNX tensor: 2376 [06/20/2022-16:24:42] [V] [TRT] Gather_1635 [Gather] outputs: [2376 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1636 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2373 [06/20/2022-16:24:42] [V] [TRT] Shape_1636 [Shape] inputs: [2373 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1636 for ONNX node: Shape_1636 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2377 for ONNX tensor: 2377 [06/20/2022-16:24:42] [V] [TRT] Shape_1636 [Shape] outputs: [2377 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1637 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1637 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1637 [Constant] outputs: [2378 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1638 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2377 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2378 [06/20/2022-16:24:42] [V] [TRT] Gather_1638 [Gather] inputs: [2377 -> (3)[INT32]], [2378 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2378 for ONNX node: 2378 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1638 for ONNX node: Gather_1638 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2379 for ONNX tensor: 2379 [06/20/2022-16:24:42] [V] [TRT] Gather_1638 [Gather] outputs: [2379 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1639 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2376 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1639 [Unsqueeze] inputs: [2376 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1639 for ONNX node: Unsqueeze_1639 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2382 for ONNX tensor: 2382 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1639 [Unsqueeze] outputs: [2382 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1640 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2379 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1640 [Unsqueeze] inputs: [2379 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1640 for ONNX node: Unsqueeze_1640 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2383 for ONNX tensor: 2383 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1640 [Unsqueeze] outputs: [2383 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1641 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2382 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2383 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3398 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3399 [06/20/2022-16:24:42] [V] [TRT] Concat_1641 [Concat] inputs: [2382 -> (1)[INT32]], [2383 -> (1)[INT32]], [3398 -> (1)[INT32]], [3399 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3398 for ONNX node: 3398 [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3399 for ONNX node: 3399 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1641 for ONNX node: Concat_1641 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2386 for ONNX tensor: 2386 [06/20/2022-16:24:42] [V] [TRT] Concat_1641 [Concat] outputs: [2386 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1642 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2373 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2386 [06/20/2022-16:24:42] [V] [TRT] Reshape_1642 [Reshape] inputs: [2373 -> (-1, -1, 1024)[FLOAT]], [2386 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1642 for ONNX node: Reshape_1642 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2387 for ONNX tensor: 2387 [06/20/2022-16:24:42] [V] [TRT] Reshape_1642 [Reshape] outputs: [2387 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1643 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2367 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3400 [06/20/2022-16:24:42] [V] [TRT] MatMul_1643 [MatMul] inputs: [2367 -> (-1, -1, 1024)[FLOAT]], [3400 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3400 for ONNX node: 3400 [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1643 for ONNX node: MatMul_1643 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2389 for ONNX tensor: 2389 [06/20/2022-16:24:42] [V] [TRT] MatMul_1643 [MatMul] outputs: [2389 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1644 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: bert.encoder.layer.17.attention.self.value.bias [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2389 [06/20/2022-16:24:42] [V] [TRT] Add_1644 [Add] inputs: [bert.encoder.layer.17.attention.self.value.bias -> (1024)[FLOAT]], [2389 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: bert.encoder.layer.17.attention.self.value.bias for ONNX node: bert.encoder.layer.17.attention.self.value.bias [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1644 for ONNX node: Add_1644 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2390 for ONNX tensor: 2390 [06/20/2022-16:24:42] [V] [TRT] Add_1644 [Add] outputs: [2390 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1645 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2390 [06/20/2022-16:24:42] [V] [TRT] Shape_1645 [Shape] inputs: [2390 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1645 for ONNX node: Shape_1645 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2391 for ONNX tensor: 2391 [06/20/2022-16:24:42] [V] [TRT] Shape_1645 [Shape] outputs: [2391 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1646 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1646 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1646 [Constant] outputs: [2392 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1647 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2391 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2392 [06/20/2022-16:24:42] [V] [TRT] Gather_1647 [Gather] inputs: [2391 -> (3)[INT32]], [2392 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2392 for ONNX node: 2392 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1647 for ONNX node: Gather_1647 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2393 for ONNX tensor: 2393 [06/20/2022-16:24:42] [V] [TRT] Gather_1647 [Gather] outputs: [2393 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1648 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2390 [06/20/2022-16:24:42] [V] [TRT] Shape_1648 [Shape] inputs: [2390 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1648 for ONNX node: Shape_1648 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2394 for ONNX tensor: 2394 [06/20/2022-16:24:42] [V] [TRT] Shape_1648 [Shape] outputs: [2394 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1649 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1649 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1649 [Constant] outputs: [2395 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1650 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2394 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2395 [06/20/2022-16:24:42] [V] [TRT] Gather_1650 [Gather] inputs: [2394 -> (3)[INT32]], [2395 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2395 for ONNX node: 2395 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1650 for ONNX node: Gather_1650 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2396 for ONNX tensor: 2396 [06/20/2022-16:24:42] [V] [TRT] Gather_1650 [Gather] outputs: [2396 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1651 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2393 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1651 [Unsqueeze] inputs: [2393 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1651 for ONNX node: Unsqueeze_1651 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2399 for ONNX tensor: 2399 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1651 [Unsqueeze] outputs: [2399 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1652 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2396 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1652 [Unsqueeze] inputs: [2396 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1652 for ONNX node: Unsqueeze_1652 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2400 for ONNX tensor: 2400 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1652 [Unsqueeze] outputs: [2400 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1653 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2399 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2400 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3401 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3402 [06/20/2022-16:24:42] [V] [TRT] Concat_1653 [Concat] inputs: [2399 -> (1)[INT32]], [2400 -> (1)[INT32]], [3401 -> (1)[INT32]], [3402 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3401 for ONNX node: 3401 [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3402 for ONNX node: 3402 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1653 for ONNX node: Concat_1653 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2403 for ONNX tensor: 2403 [06/20/2022-16:24:42] [V] [TRT] Concat_1653 [Concat] outputs: [2403 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1654 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2390 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2403 [06/20/2022-16:24:42] [V] [TRT] Reshape_1654 [Reshape] inputs: [2390 -> (-1, -1, 1024)[FLOAT]], [2403 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1654 for ONNX node: Reshape_1654 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2404 for ONNX tensor: 2404 [06/20/2022-16:24:42] [V] [TRT] Reshape_1654 [Reshape] outputs: [2404 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1655 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2404 [06/20/2022-16:24:42] [V] [TRT] Transpose_1655 [Transpose] inputs: [2404 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1655 for ONNX node: Transpose_1655 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2405 for ONNX tensor: 2405 [06/20/2022-16:24:42] [V] [TRT] Transpose_1655 [Transpose] outputs: [2405 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1656 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2370 [06/20/2022-16:24:42] [V] [TRT] Shape_1656 [Shape] inputs: [2370 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1656 for ONNX node: Shape_1656 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2406 for ONNX tensor: 2406 [06/20/2022-16:24:42] [V] [TRT] Shape_1656 [Shape] outputs: [2406 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1657 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1657 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1657 [Constant] outputs: [2407 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1658 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2406 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2407 [06/20/2022-16:24:42] [V] [TRT] Gather_1658 [Gather] inputs: [2406 -> (3)[INT32]], [2407 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2407 for ONNX node: 2407 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1658 for ONNX node: Gather_1658 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2408 for ONNX tensor: 2408 [06/20/2022-16:24:42] [V] [TRT] Gather_1658 [Gather] outputs: [2408 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1659 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2370 [06/20/2022-16:24:42] [V] [TRT] Shape_1659 [Shape] inputs: [2370 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1659 for ONNX node: Shape_1659 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2409 for ONNX tensor: 2409 [06/20/2022-16:24:42] [V] [TRT] Shape_1659 [Shape] outputs: [2409 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1660 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1660 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1660 [Constant] outputs: [2410 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1661 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2409 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2410 [06/20/2022-16:24:42] [V] [TRT] Gather_1661 [Gather] inputs: [2409 -> (3)[INT32]], [2410 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2410 for ONNX node: 2410 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1661 for ONNX node: Gather_1661 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2411 for ONNX tensor: 2411 [06/20/2022-16:24:42] [V] [TRT] Gather_1661 [Gather] outputs: [2411 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1662 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2408 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1662 [Unsqueeze] inputs: [2408 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1662 for ONNX node: Unsqueeze_1662 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2414 for ONNX tensor: 2414 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1662 [Unsqueeze] outputs: [2414 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1663 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2411 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1663 [Unsqueeze] inputs: [2411 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1663 for ONNX node: Unsqueeze_1663 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2415 for ONNX tensor: 2415 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1663 [Unsqueeze] outputs: [2415 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1664 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2414 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2415 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3403 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3404 [06/20/2022-16:24:42] [V] [TRT] Concat_1664 [Concat] inputs: [2414 -> (1)[INT32]], [2415 -> (1)[INT32]], [3403 -> (1)[INT32]], [3404 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3403 for ONNX node: 3403 [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3404 for ONNX node: 3404 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1664 for ONNX node: Concat_1664 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2418 for ONNX tensor: 2418 [06/20/2022-16:24:42] [V] [TRT] Concat_1664 [Concat] outputs: [2418 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1665 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2370 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2418 [06/20/2022-16:24:42] [V] [TRT] Reshape_1665 [Reshape] inputs: [2370 -> (-1, -1, 1024)[FLOAT]], [2418 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1665 for ONNX node: Reshape_1665 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2419 for ONNX tensor: 2419 [06/20/2022-16:24:42] [V] [TRT] Reshape_1665 [Reshape] outputs: [2419 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1666 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2419 [06/20/2022-16:24:42] [V] [TRT] Transpose_1666 [Transpose] inputs: [2419 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1666 for ONNX node: Transpose_1666 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2420 for ONNX tensor: 2420 [06/20/2022-16:24:42] [V] [TRT] Transpose_1666 [Transpose] outputs: [2420 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1667 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2387 [06/20/2022-16:24:42] [V] [TRT] Transpose_1667 [Transpose] inputs: [2387 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1667 for ONNX node: Transpose_1667 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2421 for ONNX tensor: 2421 [06/20/2022-16:24:42] [V] [TRT] Transpose_1667 [Transpose] outputs: [2421 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1668 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2420 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2421 [06/20/2022-16:24:42] [V] [TRT] MatMul_1668 [MatMul] inputs: [2420 -> (-1, 16, -1, 64)[FLOAT]], [2421 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1668 for ONNX node: MatMul_1668 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2422 for ONNX tensor: 2422 [06/20/2022-16:24:42] [V] [TRT] MatMul_1668 [MatMul] outputs: [2422 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1669 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1669 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1669 [Constant] outputs: [2423 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Div_1670 [Div] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2422 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2423 [06/20/2022-16:24:42] [V] [TRT] Div_1670 [Div] inputs: [2422 -> (-1, 16, -1, -1)[FLOAT]], [2423 -> ()[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2423 for ONNX node: 2423 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Div_1670 for ONNX node: Div_1670 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2424 for ONNX tensor: 2424 [06/20/2022-16:24:42] [V] [TRT] Div_1670 [Div] outputs: [2424 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Add_1671 [Add] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2424 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:42] [V] [TRT] Add_1671 [Add] inputs: [2424 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Add_1671 for ONNX node: Add_1671 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2425 for ONNX tensor: 2425 [06/20/2022-16:24:42] [V] [TRT] Add_1671 [Add] outputs: [2425 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Softmax_1672 [Softmax] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2425 [06/20/2022-16:24:42] [V] [TRT] Softmax_1672 [Softmax] inputs: [2425 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Softmax_1672 for ONNX node: Softmax_1672 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2426 for ONNX tensor: 2426 [06/20/2022-16:24:42] [V] [TRT] Softmax_1672 [Softmax] outputs: [2426 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: MatMul_1673 [MatMul] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2426 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2405 [06/20/2022-16:24:42] [V] [TRT] MatMul_1673 [MatMul] inputs: [2426 -> (-1, 16, -1, -1)[FLOAT]], [2405 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: MatMul_1673 for ONNX node: MatMul_1673 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2427 for ONNX tensor: 2427 [06/20/2022-16:24:42] [V] [TRT] MatMul_1673 [MatMul] outputs: [2427 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Transpose_1674 [Transpose] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2427 [06/20/2022-16:24:42] [V] [TRT] Transpose_1674 [Transpose] inputs: [2427 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Transpose_1674 for ONNX node: Transpose_1674 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2428 for ONNX tensor: 2428 [06/20/2022-16:24:42] [V] [TRT] Transpose_1674 [Transpose] outputs: [2428 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1675 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2428 [06/20/2022-16:24:42] [V] [TRT] Shape_1675 [Shape] inputs: [2428 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1675 for ONNX node: Shape_1675 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2429 for ONNX tensor: 2429 [06/20/2022-16:24:42] [V] [TRT] Shape_1675 [Shape] outputs: [2429 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1676 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1676 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1676 [Constant] outputs: [2430 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1677 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2429 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2430 [06/20/2022-16:24:42] [V] [TRT] Gather_1677 [Gather] inputs: [2429 -> (4)[INT32]], [2430 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2430 for ONNX node: 2430 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1677 for ONNX node: Gather_1677 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2431 for ONNX tensor: 2431 [06/20/2022-16:24:42] [V] [TRT] Gather_1677 [Gather] outputs: [2431 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Shape_1678 [Shape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2428 [06/20/2022-16:24:42] [V] [TRT] Shape_1678 [Shape] inputs: [2428 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Shape_1678 for ONNX node: Shape_1678 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2432 for ONNX tensor: 2432 [06/20/2022-16:24:42] [V] [TRT] Shape_1678 [Shape] outputs: [2432 -> (4)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Constant_1679 [Constant] [06/20/2022-16:24:42] [V] [TRT] Constant_1679 [Constant] inputs: [06/20/2022-16:24:42] [V] [TRT] Constant_1679 [Constant] outputs: [2433 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Gather_1680 [Gather] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2432 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2433 [06/20/2022-16:24:42] [V] [TRT] Gather_1680 [Gather] inputs: [2432 -> (4)[INT32]], [2433 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 2433 for ONNX node: 2433 [06/20/2022-16:24:42] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Gather_1680 for ONNX node: Gather_1680 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2434 for ONNX tensor: 2434 [06/20/2022-16:24:42] [V] [TRT] Gather_1680 [Gather] outputs: [2434 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1681 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2431 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1681 [Unsqueeze] inputs: [2431 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1681 for ONNX node: Unsqueeze_1681 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2436 for ONNX tensor: 2436 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1681 [Unsqueeze] outputs: [2436 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Unsqueeze_1682 [Unsqueeze] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2434 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1682 [Unsqueeze] inputs: [2434 -> ()[INT32]], [06/20/2022-16:24:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:42] [V] [TRT] Registering layer: Unsqueeze_1682 for ONNX node: Unsqueeze_1682 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2437 for ONNX tensor: 2437 [06/20/2022-16:24:42] [V] [TRT] Unsqueeze_1682 [Unsqueeze] outputs: [2437 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Concat_1683 [Concat] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2436 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2437 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 3405 [06/20/2022-16:24:42] [V] [TRT] Concat_1683 [Concat] inputs: [2436 -> (1)[INT32]], [2437 -> (1)[INT32]], [3405 -> (1)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: 3405 for ONNX node: 3405 [06/20/2022-16:24:42] [V] [TRT] Registering layer: Concat_1683 for ONNX node: Concat_1683 [06/20/2022-16:24:42] [V] [TRT] Registering tensor: 2439 for ONNX tensor: 2439 [06/20/2022-16:24:42] [V] [TRT] Concat_1683 [Concat] outputs: [2439 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Parsing node: Reshape_1684 [Reshape] [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2428 [06/20/2022-16:24:42] [V] [TRT] Searching for input: 2439 [06/20/2022-16:24:42] [V] [TRT] Reshape_1684 [Reshape] inputs: [2428 -> (-1, -1, 16, 64)[FLOAT]], [2439 -> (3)[INT32]], [06/20/2022-16:24:42] [V] [TRT] Registering layer: Reshape_1684 for ONNX node: Reshape_1684 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2440 for ONNX tensor: 2440 [06/20/2022-16:24:43] [V] [TRT] Reshape_1684 [Reshape] outputs: [2440 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1685 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2440 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3406 [06/20/2022-16:24:43] [V] [TRT] MatMul_1685 [MatMul] inputs: [2440 -> (-1, -1, 1024)[FLOAT]], [3406 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3406 for ONNX node: 3406 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1685 for ONNX node: MatMul_1685 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2442 for ONNX tensor: 2442 [06/20/2022-16:24:43] [V] [TRT] MatMul_1685 [MatMul] outputs: [2442 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1686 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.attention.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2442 [06/20/2022-16:24:43] [V] [TRT] Add_1686 [Add] inputs: [bert.encoder.layer.17.attention.output.dense.bias -> (1024)[FLOAT]], [2442 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.attention.output.dense.bias for ONNX node: bert.encoder.layer.17.attention.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1686 for ONNX node: Add_1686 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2443 for ONNX tensor: 2443 [06/20/2022-16:24:43] [V] [TRT] Add_1686 [Add] outputs: [2443 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1687 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2443 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2367 [06/20/2022-16:24:43] [V] [TRT] Add_1687 [Add] inputs: [2443 -> (-1, -1, 1024)[FLOAT]], [2367 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1687 for ONNX node: Add_1687 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2444 for ONNX tensor: 2444 [06/20/2022-16:24:43] [V] [TRT] Add_1687 [Add] outputs: [2444 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1688 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2444 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1688 [ReduceMean] inputs: [2444 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1688 for ONNX node: ReduceMean_1688 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2445 for ONNX tensor: 2445 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1688 [ReduceMean] outputs: [2445 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sub_1689 [Sub] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2444 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2445 [06/20/2022-16:24:43] [V] [TRT] Sub_1689 [Sub] inputs: [2444 -> (-1, -1, 1024)[FLOAT]], [2445 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sub_1689 for ONNX node: Sub_1689 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2446 for ONNX tensor: 2446 [06/20/2022-16:24:43] [V] [TRT] Sub_1689 [Sub] outputs: [2446 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1690 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1690 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1690 [Constant] outputs: [2447 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Pow_1691 [Pow] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2446 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2447 [06/20/2022-16:24:43] [V] [TRT] Pow_1691 [Pow] inputs: [2446 -> (-1, -1, 1024)[FLOAT]], [2447 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2447 for ONNX node: 2447 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Pow_1691 for ONNX node: Pow_1691 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2448 for ONNX tensor: 2448 [06/20/2022-16:24:43] [V] [TRT] Pow_1691 [Pow] outputs: [2448 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1692 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2448 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1692 [ReduceMean] inputs: [2448 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1692 for ONNX node: ReduceMean_1692 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2449 for ONNX tensor: 2449 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1692 [ReduceMean] outputs: [2449 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1693 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1693 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1693 [Constant] outputs: [2450 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1694 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2449 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2450 [06/20/2022-16:24:43] [V] [TRT] Add_1694 [Add] inputs: [2449 -> (-1, -1, 1)[FLOAT]], [2450 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2450 for ONNX node: 2450 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1694 for ONNX node: Add_1694 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2451 for ONNX tensor: 2451 [06/20/2022-16:24:43] [V] [TRT] Add_1694 [Add] outputs: [2451 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sqrt_1695 [Sqrt] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2451 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1695 [Sqrt] inputs: [2451 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sqrt_1695 for ONNX node: Sqrt_1695 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2452 for ONNX tensor: 2452 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1695 [Sqrt] outputs: [2452 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1696 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2446 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2452 [06/20/2022-16:24:43] [V] [TRT] Div_1696 [Div] inputs: [2446 -> (-1, -1, 1024)[FLOAT]], [2452 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1696 for ONNX node: Div_1696 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2453 for ONNX tensor: 2453 [06/20/2022-16:24:43] [V] [TRT] Div_1696 [Div] outputs: [2453 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1697 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2453 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.attention.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Mul_1697 [Mul] inputs: [2453 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.17.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.17.attention.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1697 for ONNX node: Mul_1697 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2454 for ONNX tensor: 2454 [06/20/2022-16:24:43] [V] [TRT] Mul_1697 [Mul] outputs: [2454 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1698 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2454 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.attention.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Add_1698 [Add] inputs: [2454 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.17.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.17.attention.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1698 for ONNX node: Add_1698 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2455 for ONNX tensor: 2455 [06/20/2022-16:24:43] [V] [TRT] Add_1698 [Add] outputs: [2455 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1699 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2455 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3407 [06/20/2022-16:24:43] [V] [TRT] MatMul_1699 [MatMul] inputs: [2455 -> (-1, -1, 1024)[FLOAT]], [3407 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3407 for ONNX node: 3407 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1699 for ONNX node: MatMul_1699 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2457 for ONNX tensor: 2457 [06/20/2022-16:24:43] [V] [TRT] MatMul_1699 [MatMul] outputs: [2457 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1700 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.intermediate.dense.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2457 [06/20/2022-16:24:43] [V] [TRT] Add_1700 [Add] inputs: [bert.encoder.layer.17.intermediate.dense.bias -> (4096)[FLOAT]], [2457 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.intermediate.dense.bias for ONNX node: bert.encoder.layer.17.intermediate.dense.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1700 for ONNX node: Add_1700 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2458 for ONNX tensor: 2458 [06/20/2022-16:24:43] [V] [TRT] Add_1700 [Add] outputs: [2458 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1701 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1701 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1701 [Constant] outputs: [2459 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1702 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2458 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2459 [06/20/2022-16:24:43] [V] [TRT] Div_1702 [Div] inputs: [2458 -> (-1, -1, 4096)[FLOAT]], [2459 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2459 for ONNX node: 2459 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1702 for ONNX node: Div_1702 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2460 for ONNX tensor: 2460 [06/20/2022-16:24:43] [V] [TRT] Div_1702 [Div] outputs: [2460 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Erf_1703 [Erf] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2460 [06/20/2022-16:24:43] [V] [TRT] Erf_1703 [Erf] inputs: [2460 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Erf_1703 for ONNX node: Erf_1703 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2461 for ONNX tensor: 2461 [06/20/2022-16:24:43] [V] [TRT] Erf_1703 [Erf] outputs: [2461 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1704 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1704 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1704 [Constant] outputs: [2462 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1705 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2461 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2462 [06/20/2022-16:24:43] [V] [TRT] Add_1705 [Add] inputs: [2461 -> (-1, -1, 4096)[FLOAT]], [2462 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2462 for ONNX node: 2462 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1705 for ONNX node: Add_1705 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2463 for ONNX tensor: 2463 [06/20/2022-16:24:43] [V] [TRT] Add_1705 [Add] outputs: [2463 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1706 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2458 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2463 [06/20/2022-16:24:43] [V] [TRT] Mul_1706 [Mul] inputs: [2458 -> (-1, -1, 4096)[FLOAT]], [2463 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1706 for ONNX node: Mul_1706 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2464 for ONNX tensor: 2464 [06/20/2022-16:24:43] [V] [TRT] Mul_1706 [Mul] outputs: [2464 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1707 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1707 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1707 [Constant] outputs: [2465 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1708 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2464 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2465 [06/20/2022-16:24:43] [V] [TRT] Mul_1708 [Mul] inputs: [2464 -> (-1, -1, 4096)[FLOAT]], [2465 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2465 for ONNX node: 2465 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1708 for ONNX node: Mul_1708 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2466 for ONNX tensor: 2466 [06/20/2022-16:24:43] [V] [TRT] Mul_1708 [Mul] outputs: [2466 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1709 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2466 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3408 [06/20/2022-16:24:43] [V] [TRT] MatMul_1709 [MatMul] inputs: [2466 -> (-1, -1, 4096)[FLOAT]], [3408 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3408 for ONNX node: 3408 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1709 for ONNX node: MatMul_1709 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2468 for ONNX tensor: 2468 [06/20/2022-16:24:43] [V] [TRT] MatMul_1709 [MatMul] outputs: [2468 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1710 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2468 [06/20/2022-16:24:43] [V] [TRT] Add_1710 [Add] inputs: [bert.encoder.layer.17.output.dense.bias -> (1024)[FLOAT]], [2468 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.output.dense.bias for ONNX node: bert.encoder.layer.17.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1710 for ONNX node: Add_1710 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2469 for ONNX tensor: 2469 [06/20/2022-16:24:43] [V] [TRT] Add_1710 [Add] outputs: [2469 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1711 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2469 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2455 [06/20/2022-16:24:43] [V] [TRT] Add_1711 [Add] inputs: [2469 -> (-1, -1, 1024)[FLOAT]], [2455 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1711 for ONNX node: Add_1711 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2470 for ONNX tensor: 2470 [06/20/2022-16:24:43] [V] [TRT] Add_1711 [Add] outputs: [2470 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1712 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2470 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1712 [ReduceMean] inputs: [2470 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1712 for ONNX node: ReduceMean_1712 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2471 for ONNX tensor: 2471 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1712 [ReduceMean] outputs: [2471 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sub_1713 [Sub] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2470 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2471 [06/20/2022-16:24:43] [V] [TRT] Sub_1713 [Sub] inputs: [2470 -> (-1, -1, 1024)[FLOAT]], [2471 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sub_1713 for ONNX node: Sub_1713 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2472 for ONNX tensor: 2472 [06/20/2022-16:24:43] [V] [TRT] Sub_1713 [Sub] outputs: [2472 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1714 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1714 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1714 [Constant] outputs: [2473 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Pow_1715 [Pow] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2472 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2473 [06/20/2022-16:24:43] [V] [TRT] Pow_1715 [Pow] inputs: [2472 -> (-1, -1, 1024)[FLOAT]], [2473 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2473 for ONNX node: 2473 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Pow_1715 for ONNX node: Pow_1715 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2474 for ONNX tensor: 2474 [06/20/2022-16:24:43] [V] [TRT] Pow_1715 [Pow] outputs: [2474 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1716 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2474 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1716 [ReduceMean] inputs: [2474 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1716 for ONNX node: ReduceMean_1716 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2475 for ONNX tensor: 2475 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1716 [ReduceMean] outputs: [2475 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1717 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1717 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1717 [Constant] outputs: [2476 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1718 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2475 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2476 [06/20/2022-16:24:43] [V] [TRT] Add_1718 [Add] inputs: [2475 -> (-1, -1, 1)[FLOAT]], [2476 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2476 for ONNX node: 2476 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1718 for ONNX node: Add_1718 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2477 for ONNX tensor: 2477 [06/20/2022-16:24:43] [V] [TRT] Add_1718 [Add] outputs: [2477 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sqrt_1719 [Sqrt] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2477 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1719 [Sqrt] inputs: [2477 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sqrt_1719 for ONNX node: Sqrt_1719 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2478 for ONNX tensor: 2478 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1719 [Sqrt] outputs: [2478 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1720 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2472 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2478 [06/20/2022-16:24:43] [V] [TRT] Div_1720 [Div] inputs: [2472 -> (-1, -1, 1024)[FLOAT]], [2478 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1720 for ONNX node: Div_1720 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2479 for ONNX tensor: 2479 [06/20/2022-16:24:43] [V] [TRT] Div_1720 [Div] outputs: [2479 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1721 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2479 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Mul_1721 [Mul] inputs: [2479 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.17.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.output.LayerNorm.weight for ONNX node: bert.encoder.layer.17.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1721 for ONNX node: Mul_1721 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2480 for ONNX tensor: 2480 [06/20/2022-16:24:43] [V] [TRT] Mul_1721 [Mul] outputs: [2480 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1722 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2480 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.17.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Add_1722 [Add] inputs: [2480 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.17.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.17.output.LayerNorm.bias for ONNX node: bert.encoder.layer.17.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1722 for ONNX node: Add_1722 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2481 for ONNX tensor: 2481 [06/20/2022-16:24:43] [V] [TRT] Add_1722 [Add] outputs: [2481 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1723 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2481 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3409 [06/20/2022-16:24:43] [V] [TRT] MatMul_1723 [MatMul] inputs: [2481 -> (-1, -1, 1024)[FLOAT]], [3409 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3409 for ONNX node: 3409 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1723 for ONNX node: MatMul_1723 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2483 for ONNX tensor: 2483 [06/20/2022-16:24:43] [V] [TRT] MatMul_1723 [MatMul] outputs: [2483 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1724 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.attention.self.query.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2483 [06/20/2022-16:24:43] [V] [TRT] Add_1724 [Add] inputs: [bert.encoder.layer.18.attention.self.query.bias -> (1024)[FLOAT]], [2483 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.attention.self.query.bias for ONNX node: bert.encoder.layer.18.attention.self.query.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1724 for ONNX node: Add_1724 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2484 for ONNX tensor: 2484 [06/20/2022-16:24:43] [V] [TRT] Add_1724 [Add] outputs: [2484 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1725 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2481 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3410 [06/20/2022-16:24:43] [V] [TRT] MatMul_1725 [MatMul] inputs: [2481 -> (-1, -1, 1024)[FLOAT]], [3410 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3410 for ONNX node: 3410 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1725 for ONNX node: MatMul_1725 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2486 for ONNX tensor: 2486 [06/20/2022-16:24:43] [V] [TRT] MatMul_1725 [MatMul] outputs: [2486 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1726 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.attention.self.key.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2486 [06/20/2022-16:24:43] [V] [TRT] Add_1726 [Add] inputs: [bert.encoder.layer.18.attention.self.key.bias -> (1024)[FLOAT]], [2486 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.attention.self.key.bias for ONNX node: bert.encoder.layer.18.attention.self.key.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1726 for ONNX node: Add_1726 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2487 for ONNX tensor: 2487 [06/20/2022-16:24:43] [V] [TRT] Add_1726 [Add] outputs: [2487 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1727 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2487 [06/20/2022-16:24:43] [V] [TRT] Shape_1727 [Shape] inputs: [2487 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1727 for ONNX node: Shape_1727 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2488 for ONNX tensor: 2488 [06/20/2022-16:24:43] [V] [TRT] Shape_1727 [Shape] outputs: [2488 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1728 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1728 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1728 [Constant] outputs: [2489 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1729 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2488 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2489 [06/20/2022-16:24:43] [V] [TRT] Gather_1729 [Gather] inputs: [2488 -> (3)[INT32]], [2489 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2489 for ONNX node: 2489 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1729 for ONNX node: Gather_1729 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2490 for ONNX tensor: 2490 [06/20/2022-16:24:43] [V] [TRT] Gather_1729 [Gather] outputs: [2490 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1730 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2487 [06/20/2022-16:24:43] [V] [TRT] Shape_1730 [Shape] inputs: [2487 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1730 for ONNX node: Shape_1730 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2491 for ONNX tensor: 2491 [06/20/2022-16:24:43] [V] [TRT] Shape_1730 [Shape] outputs: [2491 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1731 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1731 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1731 [Constant] outputs: [2492 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1732 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2491 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2492 [06/20/2022-16:24:43] [V] [TRT] Gather_1732 [Gather] inputs: [2491 -> (3)[INT32]], [2492 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2492 for ONNX node: 2492 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1732 for ONNX node: Gather_1732 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2493 for ONNX tensor: 2493 [06/20/2022-16:24:43] [V] [TRT] Gather_1732 [Gather] outputs: [2493 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1733 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2490 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1733 [Unsqueeze] inputs: [2490 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1733 for ONNX node: Unsqueeze_1733 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2496 for ONNX tensor: 2496 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1733 [Unsqueeze] outputs: [2496 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1734 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2493 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1734 [Unsqueeze] inputs: [2493 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1734 for ONNX node: Unsqueeze_1734 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2497 for ONNX tensor: 2497 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1734 [Unsqueeze] outputs: [2497 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Concat_1735 [Concat] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2496 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2497 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3411 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3412 [06/20/2022-16:24:43] [V] [TRT] Concat_1735 [Concat] inputs: [2496 -> (1)[INT32]], [2497 -> (1)[INT32]], [3411 -> (1)[INT32]], [3412 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3411 for ONNX node: 3411 [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3412 for ONNX node: 3412 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Concat_1735 for ONNX node: Concat_1735 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2500 for ONNX tensor: 2500 [06/20/2022-16:24:43] [V] [TRT] Concat_1735 [Concat] outputs: [2500 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Reshape_1736 [Reshape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2487 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2500 [06/20/2022-16:24:43] [V] [TRT] Reshape_1736 [Reshape] inputs: [2487 -> (-1, -1, 1024)[FLOAT]], [2500 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Reshape_1736 for ONNX node: Reshape_1736 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2501 for ONNX tensor: 2501 [06/20/2022-16:24:43] [V] [TRT] Reshape_1736 [Reshape] outputs: [2501 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1737 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2481 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3413 [06/20/2022-16:24:43] [V] [TRT] MatMul_1737 [MatMul] inputs: [2481 -> (-1, -1, 1024)[FLOAT]], [3413 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3413 for ONNX node: 3413 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1737 for ONNX node: MatMul_1737 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2503 for ONNX tensor: 2503 [06/20/2022-16:24:43] [V] [TRT] MatMul_1737 [MatMul] outputs: [2503 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1738 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.attention.self.value.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2503 [06/20/2022-16:24:43] [V] [TRT] Add_1738 [Add] inputs: [bert.encoder.layer.18.attention.self.value.bias -> (1024)[FLOAT]], [2503 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.attention.self.value.bias for ONNX node: bert.encoder.layer.18.attention.self.value.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1738 for ONNX node: Add_1738 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2504 for ONNX tensor: 2504 [06/20/2022-16:24:43] [V] [TRT] Add_1738 [Add] outputs: [2504 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1739 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2504 [06/20/2022-16:24:43] [V] [TRT] Shape_1739 [Shape] inputs: [2504 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1739 for ONNX node: Shape_1739 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2505 for ONNX tensor: 2505 [06/20/2022-16:24:43] [V] [TRT] Shape_1739 [Shape] outputs: [2505 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1740 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1740 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1740 [Constant] outputs: [2506 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1741 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2505 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2506 [06/20/2022-16:24:43] [V] [TRT] Gather_1741 [Gather] inputs: [2505 -> (3)[INT32]], [2506 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2506 for ONNX node: 2506 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1741 for ONNX node: Gather_1741 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2507 for ONNX tensor: 2507 [06/20/2022-16:24:43] [V] [TRT] Gather_1741 [Gather] outputs: [2507 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1742 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2504 [06/20/2022-16:24:43] [V] [TRT] Shape_1742 [Shape] inputs: [2504 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1742 for ONNX node: Shape_1742 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2508 for ONNX tensor: 2508 [06/20/2022-16:24:43] [V] [TRT] Shape_1742 [Shape] outputs: [2508 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1743 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1743 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1743 [Constant] outputs: [2509 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1744 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2508 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2509 [06/20/2022-16:24:43] [V] [TRT] Gather_1744 [Gather] inputs: [2508 -> (3)[INT32]], [2509 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2509 for ONNX node: 2509 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1744 for ONNX node: Gather_1744 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2510 for ONNX tensor: 2510 [06/20/2022-16:24:43] [V] [TRT] Gather_1744 [Gather] outputs: [2510 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1745 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2507 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1745 [Unsqueeze] inputs: [2507 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1745 for ONNX node: Unsqueeze_1745 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2513 for ONNX tensor: 2513 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1745 [Unsqueeze] outputs: [2513 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1746 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2510 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1746 [Unsqueeze] inputs: [2510 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1746 for ONNX node: Unsqueeze_1746 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2514 for ONNX tensor: 2514 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1746 [Unsqueeze] outputs: [2514 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Concat_1747 [Concat] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2513 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2514 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3414 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3415 [06/20/2022-16:24:43] [V] [TRT] Concat_1747 [Concat] inputs: [2513 -> (1)[INT32]], [2514 -> (1)[INT32]], [3414 -> (1)[INT32]], [3415 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3414 for ONNX node: 3414 [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3415 for ONNX node: 3415 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Concat_1747 for ONNX node: Concat_1747 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2517 for ONNX tensor: 2517 [06/20/2022-16:24:43] [V] [TRT] Concat_1747 [Concat] outputs: [2517 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Reshape_1748 [Reshape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2504 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2517 [06/20/2022-16:24:43] [V] [TRT] Reshape_1748 [Reshape] inputs: [2504 -> (-1, -1, 1024)[FLOAT]], [2517 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Reshape_1748 for ONNX node: Reshape_1748 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2518 for ONNX tensor: 2518 [06/20/2022-16:24:43] [V] [TRT] Reshape_1748 [Reshape] outputs: [2518 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Transpose_1749 [Transpose] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2518 [06/20/2022-16:24:43] [V] [TRT] Transpose_1749 [Transpose] inputs: [2518 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Transpose_1749 for ONNX node: Transpose_1749 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2519 for ONNX tensor: 2519 [06/20/2022-16:24:43] [V] [TRT] Transpose_1749 [Transpose] outputs: [2519 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1750 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2484 [06/20/2022-16:24:43] [V] [TRT] Shape_1750 [Shape] inputs: [2484 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1750 for ONNX node: Shape_1750 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2520 for ONNX tensor: 2520 [06/20/2022-16:24:43] [V] [TRT] Shape_1750 [Shape] outputs: [2520 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1751 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1751 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1751 [Constant] outputs: [2521 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1752 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2520 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2521 [06/20/2022-16:24:43] [V] [TRT] Gather_1752 [Gather] inputs: [2520 -> (3)[INT32]], [2521 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2521 for ONNX node: 2521 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1752 for ONNX node: Gather_1752 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2522 for ONNX tensor: 2522 [06/20/2022-16:24:43] [V] [TRT] Gather_1752 [Gather] outputs: [2522 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1753 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2484 [06/20/2022-16:24:43] [V] [TRT] Shape_1753 [Shape] inputs: [2484 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1753 for ONNX node: Shape_1753 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2523 for ONNX tensor: 2523 [06/20/2022-16:24:43] [V] [TRT] Shape_1753 [Shape] outputs: [2523 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1754 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1754 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1754 [Constant] outputs: [2524 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1755 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2523 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2524 [06/20/2022-16:24:43] [V] [TRT] Gather_1755 [Gather] inputs: [2523 -> (3)[INT32]], [2524 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2524 for ONNX node: 2524 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1755 for ONNX node: Gather_1755 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2525 for ONNX tensor: 2525 [06/20/2022-16:24:43] [V] [TRT] Gather_1755 [Gather] outputs: [2525 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1756 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2522 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1756 [Unsqueeze] inputs: [2522 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1756 for ONNX node: Unsqueeze_1756 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2528 for ONNX tensor: 2528 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1756 [Unsqueeze] outputs: [2528 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1757 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2525 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1757 [Unsqueeze] inputs: [2525 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1757 for ONNX node: Unsqueeze_1757 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2529 for ONNX tensor: 2529 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1757 [Unsqueeze] outputs: [2529 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Concat_1758 [Concat] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2528 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2529 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3416 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3417 [06/20/2022-16:24:43] [V] [TRT] Concat_1758 [Concat] inputs: [2528 -> (1)[INT32]], [2529 -> (1)[INT32]], [3416 -> (1)[INT32]], [3417 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3416 for ONNX node: 3416 [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3417 for ONNX node: 3417 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Concat_1758 for ONNX node: Concat_1758 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2532 for ONNX tensor: 2532 [06/20/2022-16:24:43] [V] [TRT] Concat_1758 [Concat] outputs: [2532 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Reshape_1759 [Reshape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2484 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2532 [06/20/2022-16:24:43] [V] [TRT] Reshape_1759 [Reshape] inputs: [2484 -> (-1, -1, 1024)[FLOAT]], [2532 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Reshape_1759 for ONNX node: Reshape_1759 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2533 for ONNX tensor: 2533 [06/20/2022-16:24:43] [V] [TRT] Reshape_1759 [Reshape] outputs: [2533 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Transpose_1760 [Transpose] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2533 [06/20/2022-16:24:43] [V] [TRT] Transpose_1760 [Transpose] inputs: [2533 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Transpose_1760 for ONNX node: Transpose_1760 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2534 for ONNX tensor: 2534 [06/20/2022-16:24:43] [V] [TRT] Transpose_1760 [Transpose] outputs: [2534 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Transpose_1761 [Transpose] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2501 [06/20/2022-16:24:43] [V] [TRT] Transpose_1761 [Transpose] inputs: [2501 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Transpose_1761 for ONNX node: Transpose_1761 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2535 for ONNX tensor: 2535 [06/20/2022-16:24:43] [V] [TRT] Transpose_1761 [Transpose] outputs: [2535 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1762 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2534 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2535 [06/20/2022-16:24:43] [V] [TRT] MatMul_1762 [MatMul] inputs: [2534 -> (-1, 16, -1, 64)[FLOAT]], [2535 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1762 for ONNX node: MatMul_1762 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2536 for ONNX tensor: 2536 [06/20/2022-16:24:43] [V] [TRT] MatMul_1762 [MatMul] outputs: [2536 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1763 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1763 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1763 [Constant] outputs: [2537 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1764 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2536 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2537 [06/20/2022-16:24:43] [V] [TRT] Div_1764 [Div] inputs: [2536 -> (-1, 16, -1, -1)[FLOAT]], [2537 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2537 for ONNX node: 2537 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1764 for ONNX node: Div_1764 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2538 for ONNX tensor: 2538 [06/20/2022-16:24:43] [V] [TRT] Div_1764 [Div] outputs: [2538 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1765 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2538 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:43] [V] [TRT] Add_1765 [Add] inputs: [2538 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1765 for ONNX node: Add_1765 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2539 for ONNX tensor: 2539 [06/20/2022-16:24:43] [V] [TRT] Add_1765 [Add] outputs: [2539 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Softmax_1766 [Softmax] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2539 [06/20/2022-16:24:43] [V] [TRT] Softmax_1766 [Softmax] inputs: [2539 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Softmax_1766 for ONNX node: Softmax_1766 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2540 for ONNX tensor: 2540 [06/20/2022-16:24:43] [V] [TRT] Softmax_1766 [Softmax] outputs: [2540 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1767 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2540 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2519 [06/20/2022-16:24:43] [V] [TRT] MatMul_1767 [MatMul] inputs: [2540 -> (-1, 16, -1, -1)[FLOAT]], [2519 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1767 for ONNX node: MatMul_1767 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2541 for ONNX tensor: 2541 [06/20/2022-16:24:43] [V] [TRT] MatMul_1767 [MatMul] outputs: [2541 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Transpose_1768 [Transpose] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2541 [06/20/2022-16:24:43] [V] [TRT] Transpose_1768 [Transpose] inputs: [2541 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Transpose_1768 for ONNX node: Transpose_1768 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2542 for ONNX tensor: 2542 [06/20/2022-16:24:43] [V] [TRT] Transpose_1768 [Transpose] outputs: [2542 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1769 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2542 [06/20/2022-16:24:43] [V] [TRT] Shape_1769 [Shape] inputs: [2542 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1769 for ONNX node: Shape_1769 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2543 for ONNX tensor: 2543 [06/20/2022-16:24:43] [V] [TRT] Shape_1769 [Shape] outputs: [2543 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1770 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1770 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1770 [Constant] outputs: [2544 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1771 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2543 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2544 [06/20/2022-16:24:43] [V] [TRT] Gather_1771 [Gather] inputs: [2543 -> (4)[INT32]], [2544 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2544 for ONNX node: 2544 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1771 for ONNX node: Gather_1771 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2545 for ONNX tensor: 2545 [06/20/2022-16:24:43] [V] [TRT] Gather_1771 [Gather] outputs: [2545 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1772 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2542 [06/20/2022-16:24:43] [V] [TRT] Shape_1772 [Shape] inputs: [2542 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1772 for ONNX node: Shape_1772 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2546 for ONNX tensor: 2546 [06/20/2022-16:24:43] [V] [TRT] Shape_1772 [Shape] outputs: [2546 -> (4)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1773 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1773 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1773 [Constant] outputs: [2547 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1774 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2546 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2547 [06/20/2022-16:24:43] [V] [TRT] Gather_1774 [Gather] inputs: [2546 -> (4)[INT32]], [2547 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2547 for ONNX node: 2547 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1774 for ONNX node: Gather_1774 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2548 for ONNX tensor: 2548 [06/20/2022-16:24:43] [V] [TRT] Gather_1774 [Gather] outputs: [2548 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1775 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2545 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1775 [Unsqueeze] inputs: [2545 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1775 for ONNX node: Unsqueeze_1775 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2550 for ONNX tensor: 2550 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1775 [Unsqueeze] outputs: [2550 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Unsqueeze_1776 [Unsqueeze] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2548 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1776 [Unsqueeze] inputs: [2548 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:43] [V] [TRT] Registering layer: Unsqueeze_1776 for ONNX node: Unsqueeze_1776 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2551 for ONNX tensor: 2551 [06/20/2022-16:24:43] [V] [TRT] Unsqueeze_1776 [Unsqueeze] outputs: [2551 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Concat_1777 [Concat] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2550 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2551 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3418 [06/20/2022-16:24:43] [V] [TRT] Concat_1777 [Concat] inputs: [2550 -> (1)[INT32]], [2551 -> (1)[INT32]], [3418 -> (1)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3418 for ONNX node: 3418 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Concat_1777 for ONNX node: Concat_1777 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2553 for ONNX tensor: 2553 [06/20/2022-16:24:43] [V] [TRT] Concat_1777 [Concat] outputs: [2553 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Reshape_1778 [Reshape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2542 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2553 [06/20/2022-16:24:43] [V] [TRT] Reshape_1778 [Reshape] inputs: [2542 -> (-1, -1, 16, 64)[FLOAT]], [2553 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Reshape_1778 for ONNX node: Reshape_1778 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2554 for ONNX tensor: 2554 [06/20/2022-16:24:43] [V] [TRT] Reshape_1778 [Reshape] outputs: [2554 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1779 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2554 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3419 [06/20/2022-16:24:43] [V] [TRT] MatMul_1779 [MatMul] inputs: [2554 -> (-1, -1, 1024)[FLOAT]], [3419 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3419 for ONNX node: 3419 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1779 for ONNX node: MatMul_1779 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2556 for ONNX tensor: 2556 [06/20/2022-16:24:43] [V] [TRT] MatMul_1779 [MatMul] outputs: [2556 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1780 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.attention.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2556 [06/20/2022-16:24:43] [V] [TRT] Add_1780 [Add] inputs: [bert.encoder.layer.18.attention.output.dense.bias -> (1024)[FLOAT]], [2556 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.attention.output.dense.bias for ONNX node: bert.encoder.layer.18.attention.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1780 for ONNX node: Add_1780 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2557 for ONNX tensor: 2557 [06/20/2022-16:24:43] [V] [TRT] Add_1780 [Add] outputs: [2557 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1781 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2557 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2481 [06/20/2022-16:24:43] [V] [TRT] Add_1781 [Add] inputs: [2557 -> (-1, -1, 1024)[FLOAT]], [2481 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1781 for ONNX node: Add_1781 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2558 for ONNX tensor: 2558 [06/20/2022-16:24:43] [V] [TRT] Add_1781 [Add] outputs: [2558 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1782 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2558 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1782 [ReduceMean] inputs: [2558 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1782 for ONNX node: ReduceMean_1782 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2559 for ONNX tensor: 2559 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1782 [ReduceMean] outputs: [2559 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sub_1783 [Sub] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2558 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2559 [06/20/2022-16:24:43] [V] [TRT] Sub_1783 [Sub] inputs: [2558 -> (-1, -1, 1024)[FLOAT]], [2559 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sub_1783 for ONNX node: Sub_1783 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2560 for ONNX tensor: 2560 [06/20/2022-16:24:43] [V] [TRT] Sub_1783 [Sub] outputs: [2560 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1784 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1784 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1784 [Constant] outputs: [2561 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Pow_1785 [Pow] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2560 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2561 [06/20/2022-16:24:43] [V] [TRT] Pow_1785 [Pow] inputs: [2560 -> (-1, -1, 1024)[FLOAT]], [2561 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2561 for ONNX node: 2561 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Pow_1785 for ONNX node: Pow_1785 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2562 for ONNX tensor: 2562 [06/20/2022-16:24:43] [V] [TRT] Pow_1785 [Pow] outputs: [2562 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1786 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2562 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1786 [ReduceMean] inputs: [2562 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1786 for ONNX node: ReduceMean_1786 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2563 for ONNX tensor: 2563 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1786 [ReduceMean] outputs: [2563 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1787 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1787 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1787 [Constant] outputs: [2564 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1788 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2563 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2564 [06/20/2022-16:24:43] [V] [TRT] Add_1788 [Add] inputs: [2563 -> (-1, -1, 1)[FLOAT]], [2564 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2564 for ONNX node: 2564 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1788 for ONNX node: Add_1788 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2565 for ONNX tensor: 2565 [06/20/2022-16:24:43] [V] [TRT] Add_1788 [Add] outputs: [2565 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sqrt_1789 [Sqrt] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2565 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1789 [Sqrt] inputs: [2565 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sqrt_1789 for ONNX node: Sqrt_1789 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2566 for ONNX tensor: 2566 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1789 [Sqrt] outputs: [2566 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1790 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2560 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2566 [06/20/2022-16:24:43] [V] [TRT] Div_1790 [Div] inputs: [2560 -> (-1, -1, 1024)[FLOAT]], [2566 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1790 for ONNX node: Div_1790 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2567 for ONNX tensor: 2567 [06/20/2022-16:24:43] [V] [TRT] Div_1790 [Div] outputs: [2567 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1791 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2567 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.attention.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Mul_1791 [Mul] inputs: [2567 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.18.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.18.attention.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1791 for ONNX node: Mul_1791 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2568 for ONNX tensor: 2568 [06/20/2022-16:24:43] [V] [TRT] Mul_1791 [Mul] outputs: [2568 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1792 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2568 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.attention.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Add_1792 [Add] inputs: [2568 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.18.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.18.attention.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1792 for ONNX node: Add_1792 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2569 for ONNX tensor: 2569 [06/20/2022-16:24:43] [V] [TRT] Add_1792 [Add] outputs: [2569 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1793 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2569 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3420 [06/20/2022-16:24:43] [V] [TRT] MatMul_1793 [MatMul] inputs: [2569 -> (-1, -1, 1024)[FLOAT]], [3420 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3420 for ONNX node: 3420 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1793 for ONNX node: MatMul_1793 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2571 for ONNX tensor: 2571 [06/20/2022-16:24:43] [V] [TRT] MatMul_1793 [MatMul] outputs: [2571 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1794 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.intermediate.dense.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2571 [06/20/2022-16:24:43] [V] [TRT] Add_1794 [Add] inputs: [bert.encoder.layer.18.intermediate.dense.bias -> (4096)[FLOAT]], [2571 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.intermediate.dense.bias for ONNX node: bert.encoder.layer.18.intermediate.dense.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1794 for ONNX node: Add_1794 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2572 for ONNX tensor: 2572 [06/20/2022-16:24:43] [V] [TRT] Add_1794 [Add] outputs: [2572 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1795 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1795 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1795 [Constant] outputs: [2573 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1796 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2572 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2573 [06/20/2022-16:24:43] [V] [TRT] Div_1796 [Div] inputs: [2572 -> (-1, -1, 4096)[FLOAT]], [2573 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2573 for ONNX node: 2573 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1796 for ONNX node: Div_1796 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2574 for ONNX tensor: 2574 [06/20/2022-16:24:43] [V] [TRT] Div_1796 [Div] outputs: [2574 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Erf_1797 [Erf] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2574 [06/20/2022-16:24:43] [V] [TRT] Erf_1797 [Erf] inputs: [2574 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Erf_1797 for ONNX node: Erf_1797 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2575 for ONNX tensor: 2575 [06/20/2022-16:24:43] [V] [TRT] Erf_1797 [Erf] outputs: [2575 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1798 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1798 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1798 [Constant] outputs: [2576 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1799 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2575 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2576 [06/20/2022-16:24:43] [V] [TRT] Add_1799 [Add] inputs: [2575 -> (-1, -1, 4096)[FLOAT]], [2576 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2576 for ONNX node: 2576 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1799 for ONNX node: Add_1799 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2577 for ONNX tensor: 2577 [06/20/2022-16:24:43] [V] [TRT] Add_1799 [Add] outputs: [2577 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1800 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2572 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2577 [06/20/2022-16:24:43] [V] [TRT] Mul_1800 [Mul] inputs: [2572 -> (-1, -1, 4096)[FLOAT]], [2577 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1800 for ONNX node: Mul_1800 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2578 for ONNX tensor: 2578 [06/20/2022-16:24:43] [V] [TRT] Mul_1800 [Mul] outputs: [2578 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1801 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1801 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1801 [Constant] outputs: [2579 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1802 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2578 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2579 [06/20/2022-16:24:43] [V] [TRT] Mul_1802 [Mul] inputs: [2578 -> (-1, -1, 4096)[FLOAT]], [2579 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2579 for ONNX node: 2579 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1802 for ONNX node: Mul_1802 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2580 for ONNX tensor: 2580 [06/20/2022-16:24:43] [V] [TRT] Mul_1802 [Mul] outputs: [2580 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1803 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2580 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3421 [06/20/2022-16:24:43] [V] [TRT] MatMul_1803 [MatMul] inputs: [2580 -> (-1, -1, 4096)[FLOAT]], [3421 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3421 for ONNX node: 3421 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1803 for ONNX node: MatMul_1803 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2582 for ONNX tensor: 2582 [06/20/2022-16:24:43] [V] [TRT] MatMul_1803 [MatMul] outputs: [2582 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1804 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2582 [06/20/2022-16:24:43] [V] [TRT] Add_1804 [Add] inputs: [bert.encoder.layer.18.output.dense.bias -> (1024)[FLOAT]], [2582 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.output.dense.bias for ONNX node: bert.encoder.layer.18.output.dense.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1804 for ONNX node: Add_1804 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2583 for ONNX tensor: 2583 [06/20/2022-16:24:43] [V] [TRT] Add_1804 [Add] outputs: [2583 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1805 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2583 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2569 [06/20/2022-16:24:43] [V] [TRT] Add_1805 [Add] inputs: [2583 -> (-1, -1, 1024)[FLOAT]], [2569 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1805 for ONNX node: Add_1805 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2584 for ONNX tensor: 2584 [06/20/2022-16:24:43] [V] [TRT] Add_1805 [Add] outputs: [2584 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1806 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2584 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1806 [ReduceMean] inputs: [2584 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1806 for ONNX node: ReduceMean_1806 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2585 for ONNX tensor: 2585 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1806 [ReduceMean] outputs: [2585 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sub_1807 [Sub] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2584 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2585 [06/20/2022-16:24:43] [V] [TRT] Sub_1807 [Sub] inputs: [2584 -> (-1, -1, 1024)[FLOAT]], [2585 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sub_1807 for ONNX node: Sub_1807 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2586 for ONNX tensor: 2586 [06/20/2022-16:24:43] [V] [TRT] Sub_1807 [Sub] outputs: [2586 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1808 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1808 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1808 [Constant] outputs: [2587 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Pow_1809 [Pow] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2586 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2587 [06/20/2022-16:24:43] [V] [TRT] Pow_1809 [Pow] inputs: [2586 -> (-1, -1, 1024)[FLOAT]], [2587 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2587 for ONNX node: 2587 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Pow_1809 for ONNX node: Pow_1809 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2588 for ONNX tensor: 2588 [06/20/2022-16:24:43] [V] [TRT] Pow_1809 [Pow] outputs: [2588 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: ReduceMean_1810 [ReduceMean] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2588 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1810 [ReduceMean] inputs: [2588 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: ReduceMean_1810 for ONNX node: ReduceMean_1810 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2589 for ONNX tensor: 2589 [06/20/2022-16:24:43] [V] [TRT] ReduceMean_1810 [ReduceMean] outputs: [2589 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1811 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1811 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1811 [Constant] outputs: [2590 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1812 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2589 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2590 [06/20/2022-16:24:43] [V] [TRT] Add_1812 [Add] inputs: [2589 -> (-1, -1, 1)[FLOAT]], [2590 -> ()[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2590 for ONNX node: 2590 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1812 for ONNX node: Add_1812 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2591 for ONNX tensor: 2591 [06/20/2022-16:24:43] [V] [TRT] Add_1812 [Add] outputs: [2591 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Sqrt_1813 [Sqrt] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2591 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1813 [Sqrt] inputs: [2591 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Sqrt_1813 for ONNX node: Sqrt_1813 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2592 for ONNX tensor: 2592 [06/20/2022-16:24:43] [V] [TRT] Sqrt_1813 [Sqrt] outputs: [2592 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Div_1814 [Div] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2586 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2592 [06/20/2022-16:24:43] [V] [TRT] Div_1814 [Div] inputs: [2586 -> (-1, -1, 1024)[FLOAT]], [2592 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Div_1814 for ONNX node: Div_1814 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2593 for ONNX tensor: 2593 [06/20/2022-16:24:43] [V] [TRT] Div_1814 [Div] outputs: [2593 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Mul_1815 [Mul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2593 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Mul_1815 [Mul] inputs: [2593 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.18.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.output.LayerNorm.weight for ONNX node: bert.encoder.layer.18.output.LayerNorm.weight [06/20/2022-16:24:43] [V] [TRT] Registering layer: Mul_1815 for ONNX node: Mul_1815 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2594 for ONNX tensor: 2594 [06/20/2022-16:24:43] [V] [TRT] Mul_1815 [Mul] outputs: [2594 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1816 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2594 [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.18.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Add_1816 [Add] inputs: [2594 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.18.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.18.output.LayerNorm.bias for ONNX node: bert.encoder.layer.18.output.LayerNorm.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1816 for ONNX node: Add_1816 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2595 for ONNX tensor: 2595 [06/20/2022-16:24:43] [V] [TRT] Add_1816 [Add] outputs: [2595 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1817 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2595 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3422 [06/20/2022-16:24:43] [V] [TRT] MatMul_1817 [MatMul] inputs: [2595 -> (-1, -1, 1024)[FLOAT]], [3422 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3422 for ONNX node: 3422 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1817 for ONNX node: MatMul_1817 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2597 for ONNX tensor: 2597 [06/20/2022-16:24:43] [V] [TRT] MatMul_1817 [MatMul] outputs: [2597 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1818 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.19.attention.self.query.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2597 [06/20/2022-16:24:43] [V] [TRT] Add_1818 [Add] inputs: [bert.encoder.layer.19.attention.self.query.bias -> (1024)[FLOAT]], [2597 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.19.attention.self.query.bias for ONNX node: bert.encoder.layer.19.attention.self.query.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1818 for ONNX node: Add_1818 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2598 for ONNX tensor: 2598 [06/20/2022-16:24:43] [V] [TRT] Add_1818 [Add] outputs: [2598 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: MatMul_1819 [MatMul] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2595 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 3423 [06/20/2022-16:24:43] [V] [TRT] MatMul_1819 [MatMul] inputs: [2595 -> (-1, -1, 1024)[FLOAT]], [3423 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 3423 for ONNX node: 3423 [06/20/2022-16:24:43] [V] [TRT] Registering layer: MatMul_1819 for ONNX node: MatMul_1819 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2600 for ONNX tensor: 2600 [06/20/2022-16:24:43] [V] [TRT] MatMul_1819 [MatMul] outputs: [2600 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Add_1820 [Add] [06/20/2022-16:24:43] [V] [TRT] Searching for input: bert.encoder.layer.19.attention.self.key.bias [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2600 [06/20/2022-16:24:43] [V] [TRT] Add_1820 [Add] inputs: [bert.encoder.layer.19.attention.self.key.bias -> (1024)[FLOAT]], [2600 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: bert.encoder.layer.19.attention.self.key.bias for ONNX node: bert.encoder.layer.19.attention.self.key.bias [06/20/2022-16:24:43] [V] [TRT] Registering layer: Add_1820 for ONNX node: Add_1820 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2601 for ONNX tensor: 2601 [06/20/2022-16:24:43] [V] [TRT] Add_1820 [Add] outputs: [2601 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1821 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2601 [06/20/2022-16:24:43] [V] [TRT] Shape_1821 [Shape] inputs: [2601 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1821 for ONNX node: Shape_1821 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2602 for ONNX tensor: 2602 [06/20/2022-16:24:43] [V] [TRT] Shape_1821 [Shape] outputs: [2602 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1822 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1822 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1822 [Constant] outputs: [2603 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1823 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2602 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2603 [06/20/2022-16:24:43] [V] [TRT] Gather_1823 [Gather] inputs: [2602 -> (3)[INT32]], [2603 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2603 for ONNX node: 2603 [06/20/2022-16:24:43] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:43] [V] [TRT] Registering layer: Gather_1823 for ONNX node: Gather_1823 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2604 for ONNX tensor: 2604 [06/20/2022-16:24:43] [V] [TRT] Gather_1823 [Gather] outputs: [2604 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Shape_1824 [Shape] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2601 [06/20/2022-16:24:43] [V] [TRT] Shape_1824 [Shape] inputs: [2601 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: Shape_1824 for ONNX node: Shape_1824 [06/20/2022-16:24:43] [V] [TRT] Registering tensor: 2605 for ONNX tensor: 2605 [06/20/2022-16:24:43] [V] [TRT] Shape_1824 [Shape] outputs: [2605 -> (3)[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Constant_1825 [Constant] [06/20/2022-16:24:43] [V] [TRT] Constant_1825 [Constant] inputs: [06/20/2022-16:24:43] [V] [TRT] Constant_1825 [Constant] outputs: [2606 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Parsing node: Gather_1826 [Gather] [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2605 [06/20/2022-16:24:43] [V] [TRT] Searching for input: 2606 [06/20/2022-16:24:43] [V] [TRT] Gather_1826 [Gather] inputs: [2605 -> (3)[INT32]], [2606 -> ()[INT32]], [06/20/2022-16:24:43] [V] [TRT] Registering layer: 2606 for ONNX node: 2606 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1826 for ONNX node: Gather_1826 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2607 for ONNX tensor: 2607 [06/20/2022-16:24:44] [V] [TRT] Gather_1826 [Gather] outputs: [2607 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1827 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2604 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1827 [Unsqueeze] inputs: [2604 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1827 for ONNX node: Unsqueeze_1827 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2610 for ONNX tensor: 2610 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1827 [Unsqueeze] outputs: [2610 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1828 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2607 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1828 [Unsqueeze] inputs: [2607 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1828 for ONNX node: Unsqueeze_1828 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2611 for ONNX tensor: 2611 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1828 [Unsqueeze] outputs: [2611 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1829 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2610 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2611 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3424 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3425 [06/20/2022-16:24:44] [V] [TRT] Concat_1829 [Concat] inputs: [2610 -> (1)[INT32]], [2611 -> (1)[INT32]], [3424 -> (1)[INT32]], [3425 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3424 for ONNX node: 3424 [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3425 for ONNX node: 3425 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1829 for ONNX node: Concat_1829 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2614 for ONNX tensor: 2614 [06/20/2022-16:24:44] [V] [TRT] Concat_1829 [Concat] outputs: [2614 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1830 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2601 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2614 [06/20/2022-16:24:44] [V] [TRT] Reshape_1830 [Reshape] inputs: [2601 -> (-1, -1, 1024)[FLOAT]], [2614 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1830 for ONNX node: Reshape_1830 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2615 for ONNX tensor: 2615 [06/20/2022-16:24:44] [V] [TRT] Reshape_1830 [Reshape] outputs: [2615 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1831 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2595 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3426 [06/20/2022-16:24:44] [V] [TRT] MatMul_1831 [MatMul] inputs: [2595 -> (-1, -1, 1024)[FLOAT]], [3426 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3426 for ONNX node: 3426 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1831 for ONNX node: MatMul_1831 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2617 for ONNX tensor: 2617 [06/20/2022-16:24:44] [V] [TRT] MatMul_1831 [MatMul] outputs: [2617 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1832 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.attention.self.value.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2617 [06/20/2022-16:24:44] [V] [TRT] Add_1832 [Add] inputs: [bert.encoder.layer.19.attention.self.value.bias -> (1024)[FLOAT]], [2617 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.attention.self.value.bias for ONNX node: bert.encoder.layer.19.attention.self.value.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1832 for ONNX node: Add_1832 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2618 for ONNX tensor: 2618 [06/20/2022-16:24:44] [V] [TRT] Add_1832 [Add] outputs: [2618 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1833 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2618 [06/20/2022-16:24:44] [V] [TRT] Shape_1833 [Shape] inputs: [2618 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1833 for ONNX node: Shape_1833 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2619 for ONNX tensor: 2619 [06/20/2022-16:24:44] [V] [TRT] Shape_1833 [Shape] outputs: [2619 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1834 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1834 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1834 [Constant] outputs: [2620 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1835 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2619 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2620 [06/20/2022-16:24:44] [V] [TRT] Gather_1835 [Gather] inputs: [2619 -> (3)[INT32]], [2620 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2620 for ONNX node: 2620 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1835 for ONNX node: Gather_1835 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2621 for ONNX tensor: 2621 [06/20/2022-16:24:44] [V] [TRT] Gather_1835 [Gather] outputs: [2621 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1836 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2618 [06/20/2022-16:24:44] [V] [TRT] Shape_1836 [Shape] inputs: [2618 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1836 for ONNX node: Shape_1836 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2622 for ONNX tensor: 2622 [06/20/2022-16:24:44] [V] [TRT] Shape_1836 [Shape] outputs: [2622 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1837 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1837 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1837 [Constant] outputs: [2623 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1838 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2622 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2623 [06/20/2022-16:24:44] [V] [TRT] Gather_1838 [Gather] inputs: [2622 -> (3)[INT32]], [2623 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2623 for ONNX node: 2623 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1838 for ONNX node: Gather_1838 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2624 for ONNX tensor: 2624 [06/20/2022-16:24:44] [V] [TRT] Gather_1838 [Gather] outputs: [2624 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1839 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2621 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1839 [Unsqueeze] inputs: [2621 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1839 for ONNX node: Unsqueeze_1839 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2627 for ONNX tensor: 2627 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1839 [Unsqueeze] outputs: [2627 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1840 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2624 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1840 [Unsqueeze] inputs: [2624 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1840 for ONNX node: Unsqueeze_1840 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2628 for ONNX tensor: 2628 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1840 [Unsqueeze] outputs: [2628 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1841 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2627 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2628 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3427 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3428 [06/20/2022-16:24:44] [V] [TRT] Concat_1841 [Concat] inputs: [2627 -> (1)[INT32]], [2628 -> (1)[INT32]], [3427 -> (1)[INT32]], [3428 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3427 for ONNX node: 3427 [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3428 for ONNX node: 3428 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1841 for ONNX node: Concat_1841 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2631 for ONNX tensor: 2631 [06/20/2022-16:24:44] [V] [TRT] Concat_1841 [Concat] outputs: [2631 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1842 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2618 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2631 [06/20/2022-16:24:44] [V] [TRT] Reshape_1842 [Reshape] inputs: [2618 -> (-1, -1, 1024)[FLOAT]], [2631 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1842 for ONNX node: Reshape_1842 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2632 for ONNX tensor: 2632 [06/20/2022-16:24:44] [V] [TRT] Reshape_1842 [Reshape] outputs: [2632 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1843 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2632 [06/20/2022-16:24:44] [V] [TRT] Transpose_1843 [Transpose] inputs: [2632 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1843 for ONNX node: Transpose_1843 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2633 for ONNX tensor: 2633 [06/20/2022-16:24:44] [V] [TRT] Transpose_1843 [Transpose] outputs: [2633 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1844 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2598 [06/20/2022-16:24:44] [V] [TRT] Shape_1844 [Shape] inputs: [2598 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1844 for ONNX node: Shape_1844 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2634 for ONNX tensor: 2634 [06/20/2022-16:24:44] [V] [TRT] Shape_1844 [Shape] outputs: [2634 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1845 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1845 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1845 [Constant] outputs: [2635 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1846 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2634 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2635 [06/20/2022-16:24:44] [V] [TRT] Gather_1846 [Gather] inputs: [2634 -> (3)[INT32]], [2635 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2635 for ONNX node: 2635 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1846 for ONNX node: Gather_1846 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2636 for ONNX tensor: 2636 [06/20/2022-16:24:44] [V] [TRT] Gather_1846 [Gather] outputs: [2636 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1847 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2598 [06/20/2022-16:24:44] [V] [TRT] Shape_1847 [Shape] inputs: [2598 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1847 for ONNX node: Shape_1847 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2637 for ONNX tensor: 2637 [06/20/2022-16:24:44] [V] [TRT] Shape_1847 [Shape] outputs: [2637 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1848 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1848 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1848 [Constant] outputs: [2638 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1849 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2637 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2638 [06/20/2022-16:24:44] [V] [TRT] Gather_1849 [Gather] inputs: [2637 -> (3)[INT32]], [2638 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2638 for ONNX node: 2638 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1849 for ONNX node: Gather_1849 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2639 for ONNX tensor: 2639 [06/20/2022-16:24:44] [V] [TRT] Gather_1849 [Gather] outputs: [2639 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1850 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2636 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1850 [Unsqueeze] inputs: [2636 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1850 for ONNX node: Unsqueeze_1850 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2642 for ONNX tensor: 2642 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1850 [Unsqueeze] outputs: [2642 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1851 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2639 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1851 [Unsqueeze] inputs: [2639 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1851 for ONNX node: Unsqueeze_1851 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2643 for ONNX tensor: 2643 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1851 [Unsqueeze] outputs: [2643 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1852 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2642 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2643 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3429 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3430 [06/20/2022-16:24:44] [V] [TRT] Concat_1852 [Concat] inputs: [2642 -> (1)[INT32]], [2643 -> (1)[INT32]], [3429 -> (1)[INT32]], [3430 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3429 for ONNX node: 3429 [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3430 for ONNX node: 3430 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1852 for ONNX node: Concat_1852 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2646 for ONNX tensor: 2646 [06/20/2022-16:24:44] [V] [TRT] Concat_1852 [Concat] outputs: [2646 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1853 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2598 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2646 [06/20/2022-16:24:44] [V] [TRT] Reshape_1853 [Reshape] inputs: [2598 -> (-1, -1, 1024)[FLOAT]], [2646 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1853 for ONNX node: Reshape_1853 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2647 for ONNX tensor: 2647 [06/20/2022-16:24:44] [V] [TRT] Reshape_1853 [Reshape] outputs: [2647 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1854 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2647 [06/20/2022-16:24:44] [V] [TRT] Transpose_1854 [Transpose] inputs: [2647 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1854 for ONNX node: Transpose_1854 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2648 for ONNX tensor: 2648 [06/20/2022-16:24:44] [V] [TRT] Transpose_1854 [Transpose] outputs: [2648 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1855 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2615 [06/20/2022-16:24:44] [V] [TRT] Transpose_1855 [Transpose] inputs: [2615 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1855 for ONNX node: Transpose_1855 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2649 for ONNX tensor: 2649 [06/20/2022-16:24:44] [V] [TRT] Transpose_1855 [Transpose] outputs: [2649 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1856 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2648 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2649 [06/20/2022-16:24:44] [V] [TRT] MatMul_1856 [MatMul] inputs: [2648 -> (-1, 16, -1, 64)[FLOAT]], [2649 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1856 for ONNX node: MatMul_1856 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2650 for ONNX tensor: 2650 [06/20/2022-16:24:44] [V] [TRT] MatMul_1856 [MatMul] outputs: [2650 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1857 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1857 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1857 [Constant] outputs: [2651 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Div_1858 [Div] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2650 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2651 [06/20/2022-16:24:44] [V] [TRT] Div_1858 [Div] inputs: [2650 -> (-1, 16, -1, -1)[FLOAT]], [2651 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2651 for ONNX node: 2651 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Div_1858 for ONNX node: Div_1858 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2652 for ONNX tensor: 2652 [06/20/2022-16:24:44] [V] [TRT] Div_1858 [Div] outputs: [2652 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1859 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2652 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:44] [V] [TRT] Add_1859 [Add] inputs: [2652 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1859 for ONNX node: Add_1859 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2653 for ONNX tensor: 2653 [06/20/2022-16:24:44] [V] [TRT] Add_1859 [Add] outputs: [2653 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Softmax_1860 [Softmax] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2653 [06/20/2022-16:24:44] [V] [TRT] Softmax_1860 [Softmax] inputs: [2653 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Softmax_1860 for ONNX node: Softmax_1860 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2654 for ONNX tensor: 2654 [06/20/2022-16:24:44] [V] [TRT] Softmax_1860 [Softmax] outputs: [2654 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1861 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2654 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2633 [06/20/2022-16:24:44] [V] [TRT] MatMul_1861 [MatMul] inputs: [2654 -> (-1, 16, -1, -1)[FLOAT]], [2633 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1861 for ONNX node: MatMul_1861 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2655 for ONNX tensor: 2655 [06/20/2022-16:24:44] [V] [TRT] MatMul_1861 [MatMul] outputs: [2655 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1862 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2655 [06/20/2022-16:24:44] [V] [TRT] Transpose_1862 [Transpose] inputs: [2655 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1862 for ONNX node: Transpose_1862 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2656 for ONNX tensor: 2656 [06/20/2022-16:24:44] [V] [TRT] Transpose_1862 [Transpose] outputs: [2656 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1863 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2656 [06/20/2022-16:24:44] [V] [TRT] Shape_1863 [Shape] inputs: [2656 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1863 for ONNX node: Shape_1863 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2657 for ONNX tensor: 2657 [06/20/2022-16:24:44] [V] [TRT] Shape_1863 [Shape] outputs: [2657 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1864 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1864 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1864 [Constant] outputs: [2658 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1865 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2657 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2658 [06/20/2022-16:24:44] [V] [TRT] Gather_1865 [Gather] inputs: [2657 -> (4)[INT32]], [2658 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2658 for ONNX node: 2658 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1865 for ONNX node: Gather_1865 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2659 for ONNX tensor: 2659 [06/20/2022-16:24:44] [V] [TRT] Gather_1865 [Gather] outputs: [2659 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1866 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2656 [06/20/2022-16:24:44] [V] [TRT] Shape_1866 [Shape] inputs: [2656 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1866 for ONNX node: Shape_1866 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2660 for ONNX tensor: 2660 [06/20/2022-16:24:44] [V] [TRT] Shape_1866 [Shape] outputs: [2660 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1867 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1867 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1867 [Constant] outputs: [2661 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1868 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2660 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2661 [06/20/2022-16:24:44] [V] [TRT] Gather_1868 [Gather] inputs: [2660 -> (4)[INT32]], [2661 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2661 for ONNX node: 2661 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1868 for ONNX node: Gather_1868 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2662 for ONNX tensor: 2662 [06/20/2022-16:24:44] [V] [TRT] Gather_1868 [Gather] outputs: [2662 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1869 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2659 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1869 [Unsqueeze] inputs: [2659 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1869 for ONNX node: Unsqueeze_1869 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2664 for ONNX tensor: 2664 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1869 [Unsqueeze] outputs: [2664 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1870 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2662 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1870 [Unsqueeze] inputs: [2662 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1870 for ONNX node: Unsqueeze_1870 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2665 for ONNX tensor: 2665 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1870 [Unsqueeze] outputs: [2665 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1871 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2664 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2665 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3431 [06/20/2022-16:24:44] [V] [TRT] Concat_1871 [Concat] inputs: [2664 -> (1)[INT32]], [2665 -> (1)[INT32]], [3431 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3431 for ONNX node: 3431 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1871 for ONNX node: Concat_1871 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2667 for ONNX tensor: 2667 [06/20/2022-16:24:44] [V] [TRT] Concat_1871 [Concat] outputs: [2667 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1872 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2656 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2667 [06/20/2022-16:24:44] [V] [TRT] Reshape_1872 [Reshape] inputs: [2656 -> (-1, -1, 16, 64)[FLOAT]], [2667 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1872 for ONNX node: Reshape_1872 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2668 for ONNX tensor: 2668 [06/20/2022-16:24:44] [V] [TRT] Reshape_1872 [Reshape] outputs: [2668 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1873 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2668 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3432 [06/20/2022-16:24:44] [V] [TRT] MatMul_1873 [MatMul] inputs: [2668 -> (-1, -1, 1024)[FLOAT]], [3432 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3432 for ONNX node: 3432 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1873 for ONNX node: MatMul_1873 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2670 for ONNX tensor: 2670 [06/20/2022-16:24:44] [V] [TRT] MatMul_1873 [MatMul] outputs: [2670 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1874 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.attention.output.dense.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2670 [06/20/2022-16:24:44] [V] [TRT] Add_1874 [Add] inputs: [bert.encoder.layer.19.attention.output.dense.bias -> (1024)[FLOAT]], [2670 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.attention.output.dense.bias for ONNX node: bert.encoder.layer.19.attention.output.dense.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1874 for ONNX node: Add_1874 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2671 for ONNX tensor: 2671 [06/20/2022-16:24:44] [V] [TRT] Add_1874 [Add] outputs: [2671 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1875 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2671 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2595 [06/20/2022-16:24:44] [V] [TRT] Add_1875 [Add] inputs: [2671 -> (-1, -1, 1024)[FLOAT]], [2595 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1875 for ONNX node: Add_1875 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2672 for ONNX tensor: 2672 [06/20/2022-16:24:44] [V] [TRT] Add_1875 [Add] outputs: [2672 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: ReduceMean_1876 [ReduceMean] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2672 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1876 [ReduceMean] inputs: [2672 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: ReduceMean_1876 for ONNX node: ReduceMean_1876 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2673 for ONNX tensor: 2673 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1876 [ReduceMean] outputs: [2673 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Sub_1877 [Sub] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2672 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2673 [06/20/2022-16:24:44] [V] [TRT] Sub_1877 [Sub] inputs: [2672 -> (-1, -1, 1024)[FLOAT]], [2673 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Sub_1877 for ONNX node: Sub_1877 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2674 for ONNX tensor: 2674 [06/20/2022-16:24:44] [V] [TRT] Sub_1877 [Sub] outputs: [2674 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1878 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1878 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1878 [Constant] outputs: [2675 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Pow_1879 [Pow] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2674 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2675 [06/20/2022-16:24:44] [V] [TRT] Pow_1879 [Pow] inputs: [2674 -> (-1, -1, 1024)[FLOAT]], [2675 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2675 for ONNX node: 2675 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Pow_1879 for ONNX node: Pow_1879 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2676 for ONNX tensor: 2676 [06/20/2022-16:24:44] [V] [TRT] Pow_1879 [Pow] outputs: [2676 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: ReduceMean_1880 [ReduceMean] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2676 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1880 [ReduceMean] inputs: [2676 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: ReduceMean_1880 for ONNX node: ReduceMean_1880 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2677 for ONNX tensor: 2677 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1880 [ReduceMean] outputs: [2677 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1881 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1881 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1881 [Constant] outputs: [2678 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1882 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2677 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2678 [06/20/2022-16:24:44] [V] [TRT] Add_1882 [Add] inputs: [2677 -> (-1, -1, 1)[FLOAT]], [2678 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2678 for ONNX node: 2678 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1882 for ONNX node: Add_1882 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2679 for ONNX tensor: 2679 [06/20/2022-16:24:44] [V] [TRT] Add_1882 [Add] outputs: [2679 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Sqrt_1883 [Sqrt] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2679 [06/20/2022-16:24:44] [V] [TRT] Sqrt_1883 [Sqrt] inputs: [2679 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Sqrt_1883 for ONNX node: Sqrt_1883 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2680 for ONNX tensor: 2680 [06/20/2022-16:24:44] [V] [TRT] Sqrt_1883 [Sqrt] outputs: [2680 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Div_1884 [Div] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2674 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2680 [06/20/2022-16:24:44] [V] [TRT] Div_1884 [Div] inputs: [2674 -> (-1, -1, 1024)[FLOAT]], [2680 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Div_1884 for ONNX node: Div_1884 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2681 for ONNX tensor: 2681 [06/20/2022-16:24:44] [V] [TRT] Div_1884 [Div] outputs: [2681 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Mul_1885 [Mul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2681 [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.attention.output.LayerNorm.weight [06/20/2022-16:24:44] [V] [TRT] Mul_1885 [Mul] inputs: [2681 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.19.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.19.attention.output.LayerNorm.weight [06/20/2022-16:24:44] [V] [TRT] Registering layer: Mul_1885 for ONNX node: Mul_1885 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2682 for ONNX tensor: 2682 [06/20/2022-16:24:44] [V] [TRT] Mul_1885 [Mul] outputs: [2682 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1886 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2682 [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.attention.output.LayerNorm.bias [06/20/2022-16:24:44] [V] [TRT] Add_1886 [Add] inputs: [2682 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.19.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.19.attention.output.LayerNorm.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1886 for ONNX node: Add_1886 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2683 for ONNX tensor: 2683 [06/20/2022-16:24:44] [V] [TRT] Add_1886 [Add] outputs: [2683 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1887 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2683 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3433 [06/20/2022-16:24:44] [V] [TRT] MatMul_1887 [MatMul] inputs: [2683 -> (-1, -1, 1024)[FLOAT]], [3433 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3433 for ONNX node: 3433 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1887 for ONNX node: MatMul_1887 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2685 for ONNX tensor: 2685 [06/20/2022-16:24:44] [V] [TRT] MatMul_1887 [MatMul] outputs: [2685 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1888 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.intermediate.dense.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2685 [06/20/2022-16:24:44] [V] [TRT] Add_1888 [Add] inputs: [bert.encoder.layer.19.intermediate.dense.bias -> (4096)[FLOAT]], [2685 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.intermediate.dense.bias for ONNX node: bert.encoder.layer.19.intermediate.dense.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1888 for ONNX node: Add_1888 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2686 for ONNX tensor: 2686 [06/20/2022-16:24:44] [V] [TRT] Add_1888 [Add] outputs: [2686 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1889 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1889 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1889 [Constant] outputs: [2687 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Div_1890 [Div] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2686 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2687 [06/20/2022-16:24:44] [V] [TRT] Div_1890 [Div] inputs: [2686 -> (-1, -1, 4096)[FLOAT]], [2687 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2687 for ONNX node: 2687 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Div_1890 for ONNX node: Div_1890 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2688 for ONNX tensor: 2688 [06/20/2022-16:24:44] [V] [TRT] Div_1890 [Div] outputs: [2688 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Erf_1891 [Erf] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2688 [06/20/2022-16:24:44] [V] [TRT] Erf_1891 [Erf] inputs: [2688 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Erf_1891 for ONNX node: Erf_1891 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2689 for ONNX tensor: 2689 [06/20/2022-16:24:44] [V] [TRT] Erf_1891 [Erf] outputs: [2689 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1892 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1892 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1892 [Constant] outputs: [2690 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1893 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2689 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2690 [06/20/2022-16:24:44] [V] [TRT] Add_1893 [Add] inputs: [2689 -> (-1, -1, 4096)[FLOAT]], [2690 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2690 for ONNX node: 2690 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1893 for ONNX node: Add_1893 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2691 for ONNX tensor: 2691 [06/20/2022-16:24:44] [V] [TRT] Add_1893 [Add] outputs: [2691 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Mul_1894 [Mul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2686 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2691 [06/20/2022-16:24:44] [V] [TRT] Mul_1894 [Mul] inputs: [2686 -> (-1, -1, 4096)[FLOAT]], [2691 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Mul_1894 for ONNX node: Mul_1894 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2692 for ONNX tensor: 2692 [06/20/2022-16:24:44] [V] [TRT] Mul_1894 [Mul] outputs: [2692 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1895 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1895 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1895 [Constant] outputs: [2693 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Mul_1896 [Mul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2692 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2693 [06/20/2022-16:24:44] [V] [TRT] Mul_1896 [Mul] inputs: [2692 -> (-1, -1, 4096)[FLOAT]], [2693 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2693 for ONNX node: 2693 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Mul_1896 for ONNX node: Mul_1896 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2694 for ONNX tensor: 2694 [06/20/2022-16:24:44] [V] [TRT] Mul_1896 [Mul] outputs: [2694 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1897 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2694 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3434 [06/20/2022-16:24:44] [V] [TRT] MatMul_1897 [MatMul] inputs: [2694 -> (-1, -1, 4096)[FLOAT]], [3434 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3434 for ONNX node: 3434 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1897 for ONNX node: MatMul_1897 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2696 for ONNX tensor: 2696 [06/20/2022-16:24:44] [V] [TRT] MatMul_1897 [MatMul] outputs: [2696 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1898 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.output.dense.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2696 [06/20/2022-16:24:44] [V] [TRT] Add_1898 [Add] inputs: [bert.encoder.layer.19.output.dense.bias -> (1024)[FLOAT]], [2696 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.output.dense.bias for ONNX node: bert.encoder.layer.19.output.dense.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1898 for ONNX node: Add_1898 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2697 for ONNX tensor: 2697 [06/20/2022-16:24:44] [V] [TRT] Add_1898 [Add] outputs: [2697 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1899 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2697 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2683 [06/20/2022-16:24:44] [V] [TRT] Add_1899 [Add] inputs: [2697 -> (-1, -1, 1024)[FLOAT]], [2683 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1899 for ONNX node: Add_1899 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2698 for ONNX tensor: 2698 [06/20/2022-16:24:44] [V] [TRT] Add_1899 [Add] outputs: [2698 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: ReduceMean_1900 [ReduceMean] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2698 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1900 [ReduceMean] inputs: [2698 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: ReduceMean_1900 for ONNX node: ReduceMean_1900 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2699 for ONNX tensor: 2699 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1900 [ReduceMean] outputs: [2699 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Sub_1901 [Sub] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2698 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2699 [06/20/2022-16:24:44] [V] [TRT] Sub_1901 [Sub] inputs: [2698 -> (-1, -1, 1024)[FLOAT]], [2699 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Sub_1901 for ONNX node: Sub_1901 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2700 for ONNX tensor: 2700 [06/20/2022-16:24:44] [V] [TRT] Sub_1901 [Sub] outputs: [2700 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1902 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1902 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1902 [Constant] outputs: [2701 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Pow_1903 [Pow] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2700 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2701 [06/20/2022-16:24:44] [V] [TRT] Pow_1903 [Pow] inputs: [2700 -> (-1, -1, 1024)[FLOAT]], [2701 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2701 for ONNX node: 2701 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Pow_1903 for ONNX node: Pow_1903 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2702 for ONNX tensor: 2702 [06/20/2022-16:24:44] [V] [TRT] Pow_1903 [Pow] outputs: [2702 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: ReduceMean_1904 [ReduceMean] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2702 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1904 [ReduceMean] inputs: [2702 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: ReduceMean_1904 for ONNX node: ReduceMean_1904 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2703 for ONNX tensor: 2703 [06/20/2022-16:24:44] [V] [TRT] ReduceMean_1904 [ReduceMean] outputs: [2703 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1905 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1905 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1905 [Constant] outputs: [2704 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1906 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2703 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2704 [06/20/2022-16:24:44] [V] [TRT] Add_1906 [Add] inputs: [2703 -> (-1, -1, 1)[FLOAT]], [2704 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2704 for ONNX node: 2704 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1906 for ONNX node: Add_1906 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2705 for ONNX tensor: 2705 [06/20/2022-16:24:44] [V] [TRT] Add_1906 [Add] outputs: [2705 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Sqrt_1907 [Sqrt] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2705 [06/20/2022-16:24:44] [V] [TRT] Sqrt_1907 [Sqrt] inputs: [2705 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Sqrt_1907 for ONNX node: Sqrt_1907 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2706 for ONNX tensor: 2706 [06/20/2022-16:24:44] [V] [TRT] Sqrt_1907 [Sqrt] outputs: [2706 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Div_1908 [Div] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2700 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2706 [06/20/2022-16:24:44] [V] [TRT] Div_1908 [Div] inputs: [2700 -> (-1, -1, 1024)[FLOAT]], [2706 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Div_1908 for ONNX node: Div_1908 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2707 for ONNX tensor: 2707 [06/20/2022-16:24:44] [V] [TRT] Div_1908 [Div] outputs: [2707 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Mul_1909 [Mul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2707 [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.output.LayerNorm.weight [06/20/2022-16:24:44] [V] [TRT] Mul_1909 [Mul] inputs: [2707 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.19.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.output.LayerNorm.weight for ONNX node: bert.encoder.layer.19.output.LayerNorm.weight [06/20/2022-16:24:44] [V] [TRT] Registering layer: Mul_1909 for ONNX node: Mul_1909 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2708 for ONNX tensor: 2708 [06/20/2022-16:24:44] [V] [TRT] Mul_1909 [Mul] outputs: [2708 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1910 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2708 [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.19.output.LayerNorm.bias [06/20/2022-16:24:44] [V] [TRT] Add_1910 [Add] inputs: [2708 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.19.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.19.output.LayerNorm.bias for ONNX node: bert.encoder.layer.19.output.LayerNorm.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1910 for ONNX node: Add_1910 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2709 for ONNX tensor: 2709 [06/20/2022-16:24:44] [V] [TRT] Add_1910 [Add] outputs: [2709 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1911 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2709 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3435 [06/20/2022-16:24:44] [V] [TRT] MatMul_1911 [MatMul] inputs: [2709 -> (-1, -1, 1024)[FLOAT]], [3435 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3435 for ONNX node: 3435 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1911 for ONNX node: MatMul_1911 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2711 for ONNX tensor: 2711 [06/20/2022-16:24:44] [V] [TRT] MatMul_1911 [MatMul] outputs: [2711 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1912 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.20.attention.self.query.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2711 [06/20/2022-16:24:44] [V] [TRT] Add_1912 [Add] inputs: [bert.encoder.layer.20.attention.self.query.bias -> (1024)[FLOAT]], [2711 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.20.attention.self.query.bias for ONNX node: bert.encoder.layer.20.attention.self.query.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1912 for ONNX node: Add_1912 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2712 for ONNX tensor: 2712 [06/20/2022-16:24:44] [V] [TRT] Add_1912 [Add] outputs: [2712 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1913 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2709 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3436 [06/20/2022-16:24:44] [V] [TRT] MatMul_1913 [MatMul] inputs: [2709 -> (-1, -1, 1024)[FLOAT]], [3436 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3436 for ONNX node: 3436 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1913 for ONNX node: MatMul_1913 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2714 for ONNX tensor: 2714 [06/20/2022-16:24:44] [V] [TRT] MatMul_1913 [MatMul] outputs: [2714 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1914 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.20.attention.self.key.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2714 [06/20/2022-16:24:44] [V] [TRT] Add_1914 [Add] inputs: [bert.encoder.layer.20.attention.self.key.bias -> (1024)[FLOAT]], [2714 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.20.attention.self.key.bias for ONNX node: bert.encoder.layer.20.attention.self.key.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1914 for ONNX node: Add_1914 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2715 for ONNX tensor: 2715 [06/20/2022-16:24:44] [V] [TRT] Add_1914 [Add] outputs: [2715 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1915 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2715 [06/20/2022-16:24:44] [V] [TRT] Shape_1915 [Shape] inputs: [2715 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1915 for ONNX node: Shape_1915 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2716 for ONNX tensor: 2716 [06/20/2022-16:24:44] [V] [TRT] Shape_1915 [Shape] outputs: [2716 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1916 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1916 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1916 [Constant] outputs: [2717 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1917 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2716 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2717 [06/20/2022-16:24:44] [V] [TRT] Gather_1917 [Gather] inputs: [2716 -> (3)[INT32]], [2717 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2717 for ONNX node: 2717 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1917 for ONNX node: Gather_1917 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2718 for ONNX tensor: 2718 [06/20/2022-16:24:44] [V] [TRT] Gather_1917 [Gather] outputs: [2718 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1918 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2715 [06/20/2022-16:24:44] [V] [TRT] Shape_1918 [Shape] inputs: [2715 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1918 for ONNX node: Shape_1918 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2719 for ONNX tensor: 2719 [06/20/2022-16:24:44] [V] [TRT] Shape_1918 [Shape] outputs: [2719 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1919 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1919 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1919 [Constant] outputs: [2720 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1920 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2719 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2720 [06/20/2022-16:24:44] [V] [TRT] Gather_1920 [Gather] inputs: [2719 -> (3)[INT32]], [2720 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2720 for ONNX node: 2720 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1920 for ONNX node: Gather_1920 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2721 for ONNX tensor: 2721 [06/20/2022-16:24:44] [V] [TRT] Gather_1920 [Gather] outputs: [2721 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1921 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2718 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1921 [Unsqueeze] inputs: [2718 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1921 for ONNX node: Unsqueeze_1921 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2724 for ONNX tensor: 2724 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1921 [Unsqueeze] outputs: [2724 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1922 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2721 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1922 [Unsqueeze] inputs: [2721 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1922 for ONNX node: Unsqueeze_1922 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2725 for ONNX tensor: 2725 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1922 [Unsqueeze] outputs: [2725 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1923 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2724 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2725 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3437 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3438 [06/20/2022-16:24:44] [V] [TRT] Concat_1923 [Concat] inputs: [2724 -> (1)[INT32]], [2725 -> (1)[INT32]], [3437 -> (1)[INT32]], [3438 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3437 for ONNX node: 3437 [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3438 for ONNX node: 3438 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1923 for ONNX node: Concat_1923 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2728 for ONNX tensor: 2728 [06/20/2022-16:24:44] [V] [TRT] Concat_1923 [Concat] outputs: [2728 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1924 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2715 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2728 [06/20/2022-16:24:44] [V] [TRT] Reshape_1924 [Reshape] inputs: [2715 -> (-1, -1, 1024)[FLOAT]], [2728 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1924 for ONNX node: Reshape_1924 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2729 for ONNX tensor: 2729 [06/20/2022-16:24:44] [V] [TRT] Reshape_1924 [Reshape] outputs: [2729 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1925 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2709 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3439 [06/20/2022-16:24:44] [V] [TRT] MatMul_1925 [MatMul] inputs: [2709 -> (-1, -1, 1024)[FLOAT]], [3439 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3439 for ONNX node: 3439 [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1925 for ONNX node: MatMul_1925 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2731 for ONNX tensor: 2731 [06/20/2022-16:24:44] [V] [TRT] MatMul_1925 [MatMul] outputs: [2731 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1926 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: bert.encoder.layer.20.attention.self.value.bias [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2731 [06/20/2022-16:24:44] [V] [TRT] Add_1926 [Add] inputs: [bert.encoder.layer.20.attention.self.value.bias -> (1024)[FLOAT]], [2731 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: bert.encoder.layer.20.attention.self.value.bias for ONNX node: bert.encoder.layer.20.attention.self.value.bias [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1926 for ONNX node: Add_1926 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2732 for ONNX tensor: 2732 [06/20/2022-16:24:44] [V] [TRT] Add_1926 [Add] outputs: [2732 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1927 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2732 [06/20/2022-16:24:44] [V] [TRT] Shape_1927 [Shape] inputs: [2732 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1927 for ONNX node: Shape_1927 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2733 for ONNX tensor: 2733 [06/20/2022-16:24:44] [V] [TRT] Shape_1927 [Shape] outputs: [2733 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1928 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1928 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1928 [Constant] outputs: [2734 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1929 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2733 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2734 [06/20/2022-16:24:44] [V] [TRT] Gather_1929 [Gather] inputs: [2733 -> (3)[INT32]], [2734 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2734 for ONNX node: 2734 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1929 for ONNX node: Gather_1929 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2735 for ONNX tensor: 2735 [06/20/2022-16:24:44] [V] [TRT] Gather_1929 [Gather] outputs: [2735 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1930 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2732 [06/20/2022-16:24:44] [V] [TRT] Shape_1930 [Shape] inputs: [2732 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1930 for ONNX node: Shape_1930 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2736 for ONNX tensor: 2736 [06/20/2022-16:24:44] [V] [TRT] Shape_1930 [Shape] outputs: [2736 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1931 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1931 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1931 [Constant] outputs: [2737 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1932 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2736 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2737 [06/20/2022-16:24:44] [V] [TRT] Gather_1932 [Gather] inputs: [2736 -> (3)[INT32]], [2737 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2737 for ONNX node: 2737 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1932 for ONNX node: Gather_1932 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2738 for ONNX tensor: 2738 [06/20/2022-16:24:44] [V] [TRT] Gather_1932 [Gather] outputs: [2738 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1933 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2735 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1933 [Unsqueeze] inputs: [2735 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1933 for ONNX node: Unsqueeze_1933 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2741 for ONNX tensor: 2741 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1933 [Unsqueeze] outputs: [2741 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1934 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2738 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1934 [Unsqueeze] inputs: [2738 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1934 for ONNX node: Unsqueeze_1934 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2742 for ONNX tensor: 2742 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1934 [Unsqueeze] outputs: [2742 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1935 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2741 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2742 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3440 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3441 [06/20/2022-16:24:44] [V] [TRT] Concat_1935 [Concat] inputs: [2741 -> (1)[INT32]], [2742 -> (1)[INT32]], [3440 -> (1)[INT32]], [3441 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3440 for ONNX node: 3440 [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3441 for ONNX node: 3441 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1935 for ONNX node: Concat_1935 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2745 for ONNX tensor: 2745 [06/20/2022-16:24:44] [V] [TRT] Concat_1935 [Concat] outputs: [2745 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1936 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2732 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2745 [06/20/2022-16:24:44] [V] [TRT] Reshape_1936 [Reshape] inputs: [2732 -> (-1, -1, 1024)[FLOAT]], [2745 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1936 for ONNX node: Reshape_1936 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2746 for ONNX tensor: 2746 [06/20/2022-16:24:44] [V] [TRT] Reshape_1936 [Reshape] outputs: [2746 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1937 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2746 [06/20/2022-16:24:44] [V] [TRT] Transpose_1937 [Transpose] inputs: [2746 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1937 for ONNX node: Transpose_1937 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2747 for ONNX tensor: 2747 [06/20/2022-16:24:44] [V] [TRT] Transpose_1937 [Transpose] outputs: [2747 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1938 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2712 [06/20/2022-16:24:44] [V] [TRT] Shape_1938 [Shape] inputs: [2712 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1938 for ONNX node: Shape_1938 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2748 for ONNX tensor: 2748 [06/20/2022-16:24:44] [V] [TRT] Shape_1938 [Shape] outputs: [2748 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1939 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1939 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1939 [Constant] outputs: [2749 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1940 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2748 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2749 [06/20/2022-16:24:44] [V] [TRT] Gather_1940 [Gather] inputs: [2748 -> (3)[INT32]], [2749 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2749 for ONNX node: 2749 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1940 for ONNX node: Gather_1940 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2750 for ONNX tensor: 2750 [06/20/2022-16:24:44] [V] [TRT] Gather_1940 [Gather] outputs: [2750 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1941 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2712 [06/20/2022-16:24:44] [V] [TRT] Shape_1941 [Shape] inputs: [2712 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1941 for ONNX node: Shape_1941 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2751 for ONNX tensor: 2751 [06/20/2022-16:24:44] [V] [TRT] Shape_1941 [Shape] outputs: [2751 -> (3)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1942 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1942 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1942 [Constant] outputs: [2752 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1943 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2751 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2752 [06/20/2022-16:24:44] [V] [TRT] Gather_1943 [Gather] inputs: [2751 -> (3)[INT32]], [2752 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2752 for ONNX node: 2752 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1943 for ONNX node: Gather_1943 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2753 for ONNX tensor: 2753 [06/20/2022-16:24:44] [V] [TRT] Gather_1943 [Gather] outputs: [2753 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1944 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2750 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1944 [Unsqueeze] inputs: [2750 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1944 for ONNX node: Unsqueeze_1944 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2756 for ONNX tensor: 2756 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1944 [Unsqueeze] outputs: [2756 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Unsqueeze_1945 [Unsqueeze] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2753 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1945 [Unsqueeze] inputs: [2753 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:44] [V] [TRT] Registering layer: Unsqueeze_1945 for ONNX node: Unsqueeze_1945 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2757 for ONNX tensor: 2757 [06/20/2022-16:24:44] [V] [TRT] Unsqueeze_1945 [Unsqueeze] outputs: [2757 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Concat_1946 [Concat] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2756 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2757 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3442 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 3443 [06/20/2022-16:24:44] [V] [TRT] Concat_1946 [Concat] inputs: [2756 -> (1)[INT32]], [2757 -> (1)[INT32]], [3442 -> (1)[INT32]], [3443 -> (1)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3442 for ONNX node: 3442 [06/20/2022-16:24:44] [V] [TRT] Registering layer: 3443 for ONNX node: 3443 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Concat_1946 for ONNX node: Concat_1946 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2760 for ONNX tensor: 2760 [06/20/2022-16:24:44] [V] [TRT] Concat_1946 [Concat] outputs: [2760 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Reshape_1947 [Reshape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2712 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2760 [06/20/2022-16:24:44] [V] [TRT] Reshape_1947 [Reshape] inputs: [2712 -> (-1, -1, 1024)[FLOAT]], [2760 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Reshape_1947 for ONNX node: Reshape_1947 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2761 for ONNX tensor: 2761 [06/20/2022-16:24:44] [V] [TRT] Reshape_1947 [Reshape] outputs: [2761 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1948 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2761 [06/20/2022-16:24:44] [V] [TRT] Transpose_1948 [Transpose] inputs: [2761 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1948 for ONNX node: Transpose_1948 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2762 for ONNX tensor: 2762 [06/20/2022-16:24:44] [V] [TRT] Transpose_1948 [Transpose] outputs: [2762 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1949 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2729 [06/20/2022-16:24:44] [V] [TRT] Transpose_1949 [Transpose] inputs: [2729 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1949 for ONNX node: Transpose_1949 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2763 for ONNX tensor: 2763 [06/20/2022-16:24:44] [V] [TRT] Transpose_1949 [Transpose] outputs: [2763 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1950 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2762 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2763 [06/20/2022-16:24:44] [V] [TRT] MatMul_1950 [MatMul] inputs: [2762 -> (-1, 16, -1, 64)[FLOAT]], [2763 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1950 for ONNX node: MatMul_1950 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2764 for ONNX tensor: 2764 [06/20/2022-16:24:44] [V] [TRT] MatMul_1950 [MatMul] outputs: [2764 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1951 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1951 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1951 [Constant] outputs: [2765 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Div_1952 [Div] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2764 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2765 [06/20/2022-16:24:44] [V] [TRT] Div_1952 [Div] inputs: [2764 -> (-1, 16, -1, -1)[FLOAT]], [2765 -> ()[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2765 for ONNX node: 2765 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Div_1952 for ONNX node: Div_1952 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2766 for ONNX tensor: 2766 [06/20/2022-16:24:44] [V] [TRT] Div_1952 [Div] outputs: [2766 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Add_1953 [Add] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2766 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:44] [V] [TRT] Add_1953 [Add] inputs: [2766 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Add_1953 for ONNX node: Add_1953 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2767 for ONNX tensor: 2767 [06/20/2022-16:24:44] [V] [TRT] Add_1953 [Add] outputs: [2767 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Softmax_1954 [Softmax] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2767 [06/20/2022-16:24:44] [V] [TRT] Softmax_1954 [Softmax] inputs: [2767 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Softmax_1954 for ONNX node: Softmax_1954 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2768 for ONNX tensor: 2768 [06/20/2022-16:24:44] [V] [TRT] Softmax_1954 [Softmax] outputs: [2768 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: MatMul_1955 [MatMul] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2768 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2747 [06/20/2022-16:24:44] [V] [TRT] MatMul_1955 [MatMul] inputs: [2768 -> (-1, 16, -1, -1)[FLOAT]], [2747 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: MatMul_1955 for ONNX node: MatMul_1955 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2769 for ONNX tensor: 2769 [06/20/2022-16:24:44] [V] [TRT] MatMul_1955 [MatMul] outputs: [2769 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Transpose_1956 [Transpose] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2769 [06/20/2022-16:24:44] [V] [TRT] Transpose_1956 [Transpose] inputs: [2769 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Transpose_1956 for ONNX node: Transpose_1956 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2770 for ONNX tensor: 2770 [06/20/2022-16:24:44] [V] [TRT] Transpose_1956 [Transpose] outputs: [2770 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Shape_1957 [Shape] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2770 [06/20/2022-16:24:44] [V] [TRT] Shape_1957 [Shape] inputs: [2770 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: Shape_1957 for ONNX node: Shape_1957 [06/20/2022-16:24:44] [V] [TRT] Registering tensor: 2771 for ONNX tensor: 2771 [06/20/2022-16:24:44] [V] [TRT] Shape_1957 [Shape] outputs: [2771 -> (4)[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Constant_1958 [Constant] [06/20/2022-16:24:44] [V] [TRT] Constant_1958 [Constant] inputs: [06/20/2022-16:24:44] [V] [TRT] Constant_1958 [Constant] outputs: [2772 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Parsing node: Gather_1959 [Gather] [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2771 [06/20/2022-16:24:44] [V] [TRT] Searching for input: 2772 [06/20/2022-16:24:44] [V] [TRT] Gather_1959 [Gather] inputs: [2771 -> (4)[INT32]], [2772 -> ()[INT32]], [06/20/2022-16:24:44] [V] [TRT] Registering layer: 2772 for ONNX node: 2772 [06/20/2022-16:24:44] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:44] [V] [TRT] Registering layer: Gather_1959 for ONNX node: Gather_1959 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2773 for ONNX tensor: 2773 [06/20/2022-16:24:45] [V] [TRT] Gather_1959 [Gather] outputs: [2773 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_1960 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2770 [06/20/2022-16:24:45] [V] [TRT] Shape_1960 [Shape] inputs: [2770 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_1960 for ONNX node: Shape_1960 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2774 for ONNX tensor: 2774 [06/20/2022-16:24:45] [V] [TRT] Shape_1960 [Shape] outputs: [2774 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1961 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1961 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1961 [Constant] outputs: [2775 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_1962 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2774 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2775 [06/20/2022-16:24:45] [V] [TRT] Gather_1962 [Gather] inputs: [2774 -> (4)[INT32]], [2775 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2775 for ONNX node: 2775 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_1962 for ONNX node: Gather_1962 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2776 for ONNX tensor: 2776 [06/20/2022-16:24:45] [V] [TRT] Gather_1962 [Gather] outputs: [2776 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_1963 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2773 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_1963 [Unsqueeze] inputs: [2773 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_1963 for ONNX node: Unsqueeze_1963 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2778 for ONNX tensor: 2778 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_1963 [Unsqueeze] outputs: [2778 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_1964 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2776 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_1964 [Unsqueeze] inputs: [2776 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_1964 for ONNX node: Unsqueeze_1964 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2779 for ONNX tensor: 2779 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_1964 [Unsqueeze] outputs: [2779 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Concat_1965 [Concat] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2778 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2779 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3444 [06/20/2022-16:24:45] [V] [TRT] Concat_1965 [Concat] inputs: [2778 -> (1)[INT32]], [2779 -> (1)[INT32]], [3444 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3444 for ONNX node: 3444 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Concat_1965 for ONNX node: Concat_1965 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2781 for ONNX tensor: 2781 [06/20/2022-16:24:45] [V] [TRT] Concat_1965 [Concat] outputs: [2781 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Reshape_1966 [Reshape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2770 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2781 [06/20/2022-16:24:45] [V] [TRT] Reshape_1966 [Reshape] inputs: [2770 -> (-1, -1, 16, 64)[FLOAT]], [2781 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Reshape_1966 for ONNX node: Reshape_1966 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2782 for ONNX tensor: 2782 [06/20/2022-16:24:45] [V] [TRT] Reshape_1966 [Reshape] outputs: [2782 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_1967 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2782 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3445 [06/20/2022-16:24:45] [V] [TRT] MatMul_1967 [MatMul] inputs: [2782 -> (-1, -1, 1024)[FLOAT]], [3445 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3445 for ONNX node: 3445 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_1967 for ONNX node: MatMul_1967 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2784 for ONNX tensor: 2784 [06/20/2022-16:24:45] [V] [TRT] MatMul_1967 [MatMul] outputs: [2784 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1968 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.attention.output.dense.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2784 [06/20/2022-16:24:45] [V] [TRT] Add_1968 [Add] inputs: [bert.encoder.layer.20.attention.output.dense.bias -> (1024)[FLOAT]], [2784 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.attention.output.dense.bias for ONNX node: bert.encoder.layer.20.attention.output.dense.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1968 for ONNX node: Add_1968 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2785 for ONNX tensor: 2785 [06/20/2022-16:24:45] [V] [TRT] Add_1968 [Add] outputs: [2785 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1969 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2785 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2709 [06/20/2022-16:24:45] [V] [TRT] Add_1969 [Add] inputs: [2785 -> (-1, -1, 1024)[FLOAT]], [2709 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1969 for ONNX node: Add_1969 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2786 for ONNX tensor: 2786 [06/20/2022-16:24:45] [V] [TRT] Add_1969 [Add] outputs: [2786 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: ReduceMean_1970 [ReduceMean] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2786 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1970 [ReduceMean] inputs: [2786 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: ReduceMean_1970 for ONNX node: ReduceMean_1970 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2787 for ONNX tensor: 2787 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1970 [ReduceMean] outputs: [2787 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Sub_1971 [Sub] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2786 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2787 [06/20/2022-16:24:45] [V] [TRT] Sub_1971 [Sub] inputs: [2786 -> (-1, -1, 1024)[FLOAT]], [2787 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Sub_1971 for ONNX node: Sub_1971 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2788 for ONNX tensor: 2788 [06/20/2022-16:24:45] [V] [TRT] Sub_1971 [Sub] outputs: [2788 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1972 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1972 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1972 [Constant] outputs: [2789 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Pow_1973 [Pow] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2788 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2789 [06/20/2022-16:24:45] [V] [TRT] Pow_1973 [Pow] inputs: [2788 -> (-1, -1, 1024)[FLOAT]], [2789 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2789 for ONNX node: 2789 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Pow_1973 for ONNX node: Pow_1973 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2790 for ONNX tensor: 2790 [06/20/2022-16:24:45] [V] [TRT] Pow_1973 [Pow] outputs: [2790 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: ReduceMean_1974 [ReduceMean] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2790 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1974 [ReduceMean] inputs: [2790 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: ReduceMean_1974 for ONNX node: ReduceMean_1974 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2791 for ONNX tensor: 2791 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1974 [ReduceMean] outputs: [2791 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1975 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1975 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1975 [Constant] outputs: [2792 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1976 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2791 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2792 [06/20/2022-16:24:45] [V] [TRT] Add_1976 [Add] inputs: [2791 -> (-1, -1, 1)[FLOAT]], [2792 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2792 for ONNX node: 2792 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1976 for ONNX node: Add_1976 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2793 for ONNX tensor: 2793 [06/20/2022-16:24:45] [V] [TRT] Add_1976 [Add] outputs: [2793 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Sqrt_1977 [Sqrt] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2793 [06/20/2022-16:24:45] [V] [TRT] Sqrt_1977 [Sqrt] inputs: [2793 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Sqrt_1977 for ONNX node: Sqrt_1977 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2794 for ONNX tensor: 2794 [06/20/2022-16:24:45] [V] [TRT] Sqrt_1977 [Sqrt] outputs: [2794 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Div_1978 [Div] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2788 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2794 [06/20/2022-16:24:45] [V] [TRT] Div_1978 [Div] inputs: [2788 -> (-1, -1, 1024)[FLOAT]], [2794 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Div_1978 for ONNX node: Div_1978 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2795 for ONNX tensor: 2795 [06/20/2022-16:24:45] [V] [TRT] Div_1978 [Div] outputs: [2795 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_1979 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2795 [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.attention.output.LayerNorm.weight [06/20/2022-16:24:45] [V] [TRT] Mul_1979 [Mul] inputs: [2795 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.20.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.20.attention.output.LayerNorm.weight [06/20/2022-16:24:45] [V] [TRT] Registering layer: Mul_1979 for ONNX node: Mul_1979 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2796 for ONNX tensor: 2796 [06/20/2022-16:24:45] [V] [TRT] Mul_1979 [Mul] outputs: [2796 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1980 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2796 [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.attention.output.LayerNorm.bias [06/20/2022-16:24:45] [V] [TRT] Add_1980 [Add] inputs: [2796 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.20.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.20.attention.output.LayerNorm.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1980 for ONNX node: Add_1980 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2797 for ONNX tensor: 2797 [06/20/2022-16:24:45] [V] [TRT] Add_1980 [Add] outputs: [2797 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_1981 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2797 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3446 [06/20/2022-16:24:45] [V] [TRT] MatMul_1981 [MatMul] inputs: [2797 -> (-1, -1, 1024)[FLOAT]], [3446 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3446 for ONNX node: 3446 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_1981 for ONNX node: MatMul_1981 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2799 for ONNX tensor: 2799 [06/20/2022-16:24:45] [V] [TRT] MatMul_1981 [MatMul] outputs: [2799 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1982 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.intermediate.dense.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2799 [06/20/2022-16:24:45] [V] [TRT] Add_1982 [Add] inputs: [bert.encoder.layer.20.intermediate.dense.bias -> (4096)[FLOAT]], [2799 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.intermediate.dense.bias for ONNX node: bert.encoder.layer.20.intermediate.dense.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1982 for ONNX node: Add_1982 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2800 for ONNX tensor: 2800 [06/20/2022-16:24:45] [V] [TRT] Add_1982 [Add] outputs: [2800 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1983 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1983 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1983 [Constant] outputs: [2801 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Div_1984 [Div] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2800 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2801 [06/20/2022-16:24:45] [V] [TRT] Div_1984 [Div] inputs: [2800 -> (-1, -1, 4096)[FLOAT]], [2801 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2801 for ONNX node: 2801 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Div_1984 for ONNX node: Div_1984 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2802 for ONNX tensor: 2802 [06/20/2022-16:24:45] [V] [TRT] Div_1984 [Div] outputs: [2802 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Erf_1985 [Erf] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2802 [06/20/2022-16:24:45] [V] [TRT] Erf_1985 [Erf] inputs: [2802 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Erf_1985 for ONNX node: Erf_1985 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2803 for ONNX tensor: 2803 [06/20/2022-16:24:45] [V] [TRT] Erf_1985 [Erf] outputs: [2803 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1986 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1986 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1986 [Constant] outputs: [2804 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1987 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2803 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2804 [06/20/2022-16:24:45] [V] [TRT] Add_1987 [Add] inputs: [2803 -> (-1, -1, 4096)[FLOAT]], [2804 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2804 for ONNX node: 2804 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1987 for ONNX node: Add_1987 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2805 for ONNX tensor: 2805 [06/20/2022-16:24:45] [V] [TRT] Add_1987 [Add] outputs: [2805 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_1988 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2800 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2805 [06/20/2022-16:24:45] [V] [TRT] Mul_1988 [Mul] inputs: [2800 -> (-1, -1, 4096)[FLOAT]], [2805 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Mul_1988 for ONNX node: Mul_1988 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2806 for ONNX tensor: 2806 [06/20/2022-16:24:45] [V] [TRT] Mul_1988 [Mul] outputs: [2806 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1989 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1989 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1989 [Constant] outputs: [2807 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_1990 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2806 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2807 [06/20/2022-16:24:45] [V] [TRT] Mul_1990 [Mul] inputs: [2806 -> (-1, -1, 4096)[FLOAT]], [2807 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2807 for ONNX node: 2807 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Mul_1990 for ONNX node: Mul_1990 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2808 for ONNX tensor: 2808 [06/20/2022-16:24:45] [V] [TRT] Mul_1990 [Mul] outputs: [2808 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_1991 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2808 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3447 [06/20/2022-16:24:45] [V] [TRT] MatMul_1991 [MatMul] inputs: [2808 -> (-1, -1, 4096)[FLOAT]], [3447 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3447 for ONNX node: 3447 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_1991 for ONNX node: MatMul_1991 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2810 for ONNX tensor: 2810 [06/20/2022-16:24:45] [V] [TRT] MatMul_1991 [MatMul] outputs: [2810 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1992 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.output.dense.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2810 [06/20/2022-16:24:45] [V] [TRT] Add_1992 [Add] inputs: [bert.encoder.layer.20.output.dense.bias -> (1024)[FLOAT]], [2810 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.output.dense.bias for ONNX node: bert.encoder.layer.20.output.dense.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1992 for ONNX node: Add_1992 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2811 for ONNX tensor: 2811 [06/20/2022-16:24:45] [V] [TRT] Add_1992 [Add] outputs: [2811 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_1993 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2811 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2797 [06/20/2022-16:24:45] [V] [TRT] Add_1993 [Add] inputs: [2811 -> (-1, -1, 1024)[FLOAT]], [2797 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_1993 for ONNX node: Add_1993 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2812 for ONNX tensor: 2812 [06/20/2022-16:24:45] [V] [TRT] Add_1993 [Add] outputs: [2812 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: ReduceMean_1994 [ReduceMean] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2812 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1994 [ReduceMean] inputs: [2812 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: ReduceMean_1994 for ONNX node: ReduceMean_1994 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2813 for ONNX tensor: 2813 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1994 [ReduceMean] outputs: [2813 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Sub_1995 [Sub] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2812 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2813 [06/20/2022-16:24:45] [V] [TRT] Sub_1995 [Sub] inputs: [2812 -> (-1, -1, 1024)[FLOAT]], [2813 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Sub_1995 for ONNX node: Sub_1995 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2814 for ONNX tensor: 2814 [06/20/2022-16:24:45] [V] [TRT] Sub_1995 [Sub] outputs: [2814 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1996 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1996 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1996 [Constant] outputs: [2815 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Pow_1997 [Pow] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2814 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2815 [06/20/2022-16:24:45] [V] [TRT] Pow_1997 [Pow] inputs: [2814 -> (-1, -1, 1024)[FLOAT]], [2815 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2815 for ONNX node: 2815 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Pow_1997 for ONNX node: Pow_1997 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2816 for ONNX tensor: 2816 [06/20/2022-16:24:45] [V] [TRT] Pow_1997 [Pow] outputs: [2816 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: ReduceMean_1998 [ReduceMean] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2816 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1998 [ReduceMean] inputs: [2816 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: ReduceMean_1998 for ONNX node: ReduceMean_1998 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2817 for ONNX tensor: 2817 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_1998 [ReduceMean] outputs: [2817 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_1999 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_1999 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_1999 [Constant] outputs: [2818 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2000 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2817 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2818 [06/20/2022-16:24:45] [V] [TRT] Add_2000 [Add] inputs: [2817 -> (-1, -1, 1)[FLOAT]], [2818 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2818 for ONNX node: 2818 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2000 for ONNX node: Add_2000 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2819 for ONNX tensor: 2819 [06/20/2022-16:24:45] [V] [TRT] Add_2000 [Add] outputs: [2819 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Sqrt_2001 [Sqrt] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2819 [06/20/2022-16:24:45] [V] [TRT] Sqrt_2001 [Sqrt] inputs: [2819 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Sqrt_2001 for ONNX node: Sqrt_2001 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2820 for ONNX tensor: 2820 [06/20/2022-16:24:45] [V] [TRT] Sqrt_2001 [Sqrt] outputs: [2820 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Div_2002 [Div] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2814 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2820 [06/20/2022-16:24:45] [V] [TRT] Div_2002 [Div] inputs: [2814 -> (-1, -1, 1024)[FLOAT]], [2820 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Div_2002 for ONNX node: Div_2002 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2821 for ONNX tensor: 2821 [06/20/2022-16:24:45] [V] [TRT] Div_2002 [Div] outputs: [2821 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_2003 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2821 [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.output.LayerNorm.weight [06/20/2022-16:24:45] [V] [TRT] Mul_2003 [Mul] inputs: [2821 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.20.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.output.LayerNorm.weight for ONNX node: bert.encoder.layer.20.output.LayerNorm.weight [06/20/2022-16:24:45] [V] [TRT] Registering layer: Mul_2003 for ONNX node: Mul_2003 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2822 for ONNX tensor: 2822 [06/20/2022-16:24:45] [V] [TRT] Mul_2003 [Mul] outputs: [2822 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2004 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2822 [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.20.output.LayerNorm.bias [06/20/2022-16:24:45] [V] [TRT] Add_2004 [Add] inputs: [2822 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.20.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.20.output.LayerNorm.bias for ONNX node: bert.encoder.layer.20.output.LayerNorm.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2004 for ONNX node: Add_2004 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2823 for ONNX tensor: 2823 [06/20/2022-16:24:45] [V] [TRT] Add_2004 [Add] outputs: [2823 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2005 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2823 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3448 [06/20/2022-16:24:45] [V] [TRT] MatMul_2005 [MatMul] inputs: [2823 -> (-1, -1, 1024)[FLOAT]], [3448 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3448 for ONNX node: 3448 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2005 for ONNX node: MatMul_2005 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2825 for ONNX tensor: 2825 [06/20/2022-16:24:45] [V] [TRT] MatMul_2005 [MatMul] outputs: [2825 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2006 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.attention.self.query.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2825 [06/20/2022-16:24:45] [V] [TRT] Add_2006 [Add] inputs: [bert.encoder.layer.21.attention.self.query.bias -> (1024)[FLOAT]], [2825 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.attention.self.query.bias for ONNX node: bert.encoder.layer.21.attention.self.query.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2006 for ONNX node: Add_2006 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2826 for ONNX tensor: 2826 [06/20/2022-16:24:45] [V] [TRT] Add_2006 [Add] outputs: [2826 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2007 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2823 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3449 [06/20/2022-16:24:45] [V] [TRT] MatMul_2007 [MatMul] inputs: [2823 -> (-1, -1, 1024)[FLOAT]], [3449 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3449 for ONNX node: 3449 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2007 for ONNX node: MatMul_2007 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2828 for ONNX tensor: 2828 [06/20/2022-16:24:45] [V] [TRT] MatMul_2007 [MatMul] outputs: [2828 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2008 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.attention.self.key.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2828 [06/20/2022-16:24:45] [V] [TRT] Add_2008 [Add] inputs: [bert.encoder.layer.21.attention.self.key.bias -> (1024)[FLOAT]], [2828 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.attention.self.key.bias for ONNX node: bert.encoder.layer.21.attention.self.key.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2008 for ONNX node: Add_2008 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2829 for ONNX tensor: 2829 [06/20/2022-16:24:45] [V] [TRT] Add_2008 [Add] outputs: [2829 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2009 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2829 [06/20/2022-16:24:45] [V] [TRT] Shape_2009 [Shape] inputs: [2829 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2009 for ONNX node: Shape_2009 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2830 for ONNX tensor: 2830 [06/20/2022-16:24:45] [V] [TRT] Shape_2009 [Shape] outputs: [2830 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2010 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2010 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2010 [Constant] outputs: [2831 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2011 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2830 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2831 [06/20/2022-16:24:45] [V] [TRT] Gather_2011 [Gather] inputs: [2830 -> (3)[INT32]], [2831 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2831 for ONNX node: 2831 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2011 for ONNX node: Gather_2011 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2832 for ONNX tensor: 2832 [06/20/2022-16:24:45] [V] [TRT] Gather_2011 [Gather] outputs: [2832 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2012 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2829 [06/20/2022-16:24:45] [V] [TRT] Shape_2012 [Shape] inputs: [2829 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2012 for ONNX node: Shape_2012 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2833 for ONNX tensor: 2833 [06/20/2022-16:24:45] [V] [TRT] Shape_2012 [Shape] outputs: [2833 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2013 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2013 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2013 [Constant] outputs: [2834 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2014 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2833 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2834 [06/20/2022-16:24:45] [V] [TRT] Gather_2014 [Gather] inputs: [2833 -> (3)[INT32]], [2834 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2834 for ONNX node: 2834 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2014 for ONNX node: Gather_2014 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2835 for ONNX tensor: 2835 [06/20/2022-16:24:45] [V] [TRT] Gather_2014 [Gather] outputs: [2835 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2015 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2832 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2015 [Unsqueeze] inputs: [2832 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2015 for ONNX node: Unsqueeze_2015 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2838 for ONNX tensor: 2838 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2015 [Unsqueeze] outputs: [2838 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2016 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2835 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2016 [Unsqueeze] inputs: [2835 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2016 for ONNX node: Unsqueeze_2016 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2839 for ONNX tensor: 2839 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2016 [Unsqueeze] outputs: [2839 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Concat_2017 [Concat] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2838 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2839 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3450 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3451 [06/20/2022-16:24:45] [V] [TRT] Concat_2017 [Concat] inputs: [2838 -> (1)[INT32]], [2839 -> (1)[INT32]], [3450 -> (1)[INT32]], [3451 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3450 for ONNX node: 3450 [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3451 for ONNX node: 3451 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Concat_2017 for ONNX node: Concat_2017 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2842 for ONNX tensor: 2842 [06/20/2022-16:24:45] [V] [TRT] Concat_2017 [Concat] outputs: [2842 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Reshape_2018 [Reshape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2829 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2842 [06/20/2022-16:24:45] [V] [TRT] Reshape_2018 [Reshape] inputs: [2829 -> (-1, -1, 1024)[FLOAT]], [2842 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Reshape_2018 for ONNX node: Reshape_2018 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2843 for ONNX tensor: 2843 [06/20/2022-16:24:45] [V] [TRT] Reshape_2018 [Reshape] outputs: [2843 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2019 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2823 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3452 [06/20/2022-16:24:45] [V] [TRT] MatMul_2019 [MatMul] inputs: [2823 -> (-1, -1, 1024)[FLOAT]], [3452 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3452 for ONNX node: 3452 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2019 for ONNX node: MatMul_2019 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2845 for ONNX tensor: 2845 [06/20/2022-16:24:45] [V] [TRT] MatMul_2019 [MatMul] outputs: [2845 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2020 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.attention.self.value.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2845 [06/20/2022-16:24:45] [V] [TRT] Add_2020 [Add] inputs: [bert.encoder.layer.21.attention.self.value.bias -> (1024)[FLOAT]], [2845 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.attention.self.value.bias for ONNX node: bert.encoder.layer.21.attention.self.value.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2020 for ONNX node: Add_2020 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2846 for ONNX tensor: 2846 [06/20/2022-16:24:45] [V] [TRT] Add_2020 [Add] outputs: [2846 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2021 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2846 [06/20/2022-16:24:45] [V] [TRT] Shape_2021 [Shape] inputs: [2846 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2021 for ONNX node: Shape_2021 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2847 for ONNX tensor: 2847 [06/20/2022-16:24:45] [V] [TRT] Shape_2021 [Shape] outputs: [2847 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2022 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2022 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2022 [Constant] outputs: [2848 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2023 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2847 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2848 [06/20/2022-16:24:45] [V] [TRT] Gather_2023 [Gather] inputs: [2847 -> (3)[INT32]], [2848 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2848 for ONNX node: 2848 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2023 for ONNX node: Gather_2023 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2849 for ONNX tensor: 2849 [06/20/2022-16:24:45] [V] [TRT] Gather_2023 [Gather] outputs: [2849 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2024 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2846 [06/20/2022-16:24:45] [V] [TRT] Shape_2024 [Shape] inputs: [2846 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2024 for ONNX node: Shape_2024 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2850 for ONNX tensor: 2850 [06/20/2022-16:24:45] [V] [TRT] Shape_2024 [Shape] outputs: [2850 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2025 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2025 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2025 [Constant] outputs: [2851 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2026 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2850 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2851 [06/20/2022-16:24:45] [V] [TRT] Gather_2026 [Gather] inputs: [2850 -> (3)[INT32]], [2851 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2851 for ONNX node: 2851 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2026 for ONNX node: Gather_2026 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2852 for ONNX tensor: 2852 [06/20/2022-16:24:45] [V] [TRT] Gather_2026 [Gather] outputs: [2852 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2027 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2849 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2027 [Unsqueeze] inputs: [2849 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2027 for ONNX node: Unsqueeze_2027 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2855 for ONNX tensor: 2855 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2027 [Unsqueeze] outputs: [2855 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2028 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2852 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2028 [Unsqueeze] inputs: [2852 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2028 for ONNX node: Unsqueeze_2028 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2856 for ONNX tensor: 2856 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2028 [Unsqueeze] outputs: [2856 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Concat_2029 [Concat] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2855 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2856 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3453 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3454 [06/20/2022-16:24:45] [V] [TRT] Concat_2029 [Concat] inputs: [2855 -> (1)[INT32]], [2856 -> (1)[INT32]], [3453 -> (1)[INT32]], [3454 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3453 for ONNX node: 3453 [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3454 for ONNX node: 3454 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Concat_2029 for ONNX node: Concat_2029 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2859 for ONNX tensor: 2859 [06/20/2022-16:24:45] [V] [TRT] Concat_2029 [Concat] outputs: [2859 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Reshape_2030 [Reshape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2846 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2859 [06/20/2022-16:24:45] [V] [TRT] Reshape_2030 [Reshape] inputs: [2846 -> (-1, -1, 1024)[FLOAT]], [2859 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Reshape_2030 for ONNX node: Reshape_2030 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2860 for ONNX tensor: 2860 [06/20/2022-16:24:45] [V] [TRT] Reshape_2030 [Reshape] outputs: [2860 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Transpose_2031 [Transpose] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2860 [06/20/2022-16:24:45] [V] [TRT] Transpose_2031 [Transpose] inputs: [2860 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Transpose_2031 for ONNX node: Transpose_2031 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2861 for ONNX tensor: 2861 [06/20/2022-16:24:45] [V] [TRT] Transpose_2031 [Transpose] outputs: [2861 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2032 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2826 [06/20/2022-16:24:45] [V] [TRT] Shape_2032 [Shape] inputs: [2826 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2032 for ONNX node: Shape_2032 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2862 for ONNX tensor: 2862 [06/20/2022-16:24:45] [V] [TRT] Shape_2032 [Shape] outputs: [2862 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2033 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2033 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2033 [Constant] outputs: [2863 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2034 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2862 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2863 [06/20/2022-16:24:45] [V] [TRT] Gather_2034 [Gather] inputs: [2862 -> (3)[INT32]], [2863 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2863 for ONNX node: 2863 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2034 for ONNX node: Gather_2034 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2864 for ONNX tensor: 2864 [06/20/2022-16:24:45] [V] [TRT] Gather_2034 [Gather] outputs: [2864 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2035 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2826 [06/20/2022-16:24:45] [V] [TRT] Shape_2035 [Shape] inputs: [2826 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2035 for ONNX node: Shape_2035 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2865 for ONNX tensor: 2865 [06/20/2022-16:24:45] [V] [TRT] Shape_2035 [Shape] outputs: [2865 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2036 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2036 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2036 [Constant] outputs: [2866 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2037 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2865 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2866 [06/20/2022-16:24:45] [V] [TRT] Gather_2037 [Gather] inputs: [2865 -> (3)[INT32]], [2866 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2866 for ONNX node: 2866 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2037 for ONNX node: Gather_2037 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2867 for ONNX tensor: 2867 [06/20/2022-16:24:45] [V] [TRT] Gather_2037 [Gather] outputs: [2867 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2038 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2864 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2038 [Unsqueeze] inputs: [2864 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2038 for ONNX node: Unsqueeze_2038 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2870 for ONNX tensor: 2870 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2038 [Unsqueeze] outputs: [2870 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2039 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2867 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2039 [Unsqueeze] inputs: [2867 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2039 for ONNX node: Unsqueeze_2039 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2871 for ONNX tensor: 2871 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2039 [Unsqueeze] outputs: [2871 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Concat_2040 [Concat] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2870 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2871 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3455 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3456 [06/20/2022-16:24:45] [V] [TRT] Concat_2040 [Concat] inputs: [2870 -> (1)[INT32]], [2871 -> (1)[INT32]], [3455 -> (1)[INT32]], [3456 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3455 for ONNX node: 3455 [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3456 for ONNX node: 3456 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Concat_2040 for ONNX node: Concat_2040 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2874 for ONNX tensor: 2874 [06/20/2022-16:24:45] [V] [TRT] Concat_2040 [Concat] outputs: [2874 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Reshape_2041 [Reshape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2826 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2874 [06/20/2022-16:24:45] [V] [TRT] Reshape_2041 [Reshape] inputs: [2826 -> (-1, -1, 1024)[FLOAT]], [2874 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Reshape_2041 for ONNX node: Reshape_2041 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2875 for ONNX tensor: 2875 [06/20/2022-16:24:45] [V] [TRT] Reshape_2041 [Reshape] outputs: [2875 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Transpose_2042 [Transpose] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2875 [06/20/2022-16:24:45] [V] [TRT] Transpose_2042 [Transpose] inputs: [2875 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Transpose_2042 for ONNX node: Transpose_2042 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2876 for ONNX tensor: 2876 [06/20/2022-16:24:45] [V] [TRT] Transpose_2042 [Transpose] outputs: [2876 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Transpose_2043 [Transpose] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2843 [06/20/2022-16:24:45] [V] [TRT] Transpose_2043 [Transpose] inputs: [2843 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Transpose_2043 for ONNX node: Transpose_2043 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2877 for ONNX tensor: 2877 [06/20/2022-16:24:45] [V] [TRT] Transpose_2043 [Transpose] outputs: [2877 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2044 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2876 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2877 [06/20/2022-16:24:45] [V] [TRT] MatMul_2044 [MatMul] inputs: [2876 -> (-1, 16, -1, 64)[FLOAT]], [2877 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2044 for ONNX node: MatMul_2044 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2878 for ONNX tensor: 2878 [06/20/2022-16:24:45] [V] [TRT] MatMul_2044 [MatMul] outputs: [2878 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2045 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2045 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2045 [Constant] outputs: [2879 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Div_2046 [Div] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2878 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2879 [06/20/2022-16:24:45] [V] [TRT] Div_2046 [Div] inputs: [2878 -> (-1, 16, -1, -1)[FLOAT]], [2879 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2879 for ONNX node: 2879 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Div_2046 for ONNX node: Div_2046 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2880 for ONNX tensor: 2880 [06/20/2022-16:24:45] [V] [TRT] Div_2046 [Div] outputs: [2880 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2047 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2880 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:45] [V] [TRT] Add_2047 [Add] inputs: [2880 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2047 for ONNX node: Add_2047 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2881 for ONNX tensor: 2881 [06/20/2022-16:24:45] [V] [TRT] Add_2047 [Add] outputs: [2881 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Softmax_2048 [Softmax] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2881 [06/20/2022-16:24:45] [V] [TRT] Softmax_2048 [Softmax] inputs: [2881 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Softmax_2048 for ONNX node: Softmax_2048 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2882 for ONNX tensor: 2882 [06/20/2022-16:24:45] [V] [TRT] Softmax_2048 [Softmax] outputs: [2882 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2049 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2882 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2861 [06/20/2022-16:24:45] [V] [TRT] MatMul_2049 [MatMul] inputs: [2882 -> (-1, 16, -1, -1)[FLOAT]], [2861 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2049 for ONNX node: MatMul_2049 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2883 for ONNX tensor: 2883 [06/20/2022-16:24:45] [V] [TRT] MatMul_2049 [MatMul] outputs: [2883 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Transpose_2050 [Transpose] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2883 [06/20/2022-16:24:45] [V] [TRT] Transpose_2050 [Transpose] inputs: [2883 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Transpose_2050 for ONNX node: Transpose_2050 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2884 for ONNX tensor: 2884 [06/20/2022-16:24:45] [V] [TRT] Transpose_2050 [Transpose] outputs: [2884 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2051 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2884 [06/20/2022-16:24:45] [V] [TRT] Shape_2051 [Shape] inputs: [2884 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2051 for ONNX node: Shape_2051 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2885 for ONNX tensor: 2885 [06/20/2022-16:24:45] [V] [TRT] Shape_2051 [Shape] outputs: [2885 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2052 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2052 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2052 [Constant] outputs: [2886 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2053 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2885 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2886 [06/20/2022-16:24:45] [V] [TRT] Gather_2053 [Gather] inputs: [2885 -> (4)[INT32]], [2886 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2886 for ONNX node: 2886 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2053 for ONNX node: Gather_2053 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2887 for ONNX tensor: 2887 [06/20/2022-16:24:45] [V] [TRT] Gather_2053 [Gather] outputs: [2887 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Shape_2054 [Shape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2884 [06/20/2022-16:24:45] [V] [TRT] Shape_2054 [Shape] inputs: [2884 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Shape_2054 for ONNX node: Shape_2054 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2888 for ONNX tensor: 2888 [06/20/2022-16:24:45] [V] [TRT] Shape_2054 [Shape] outputs: [2888 -> (4)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2055 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2055 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2055 [Constant] outputs: [2889 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Gather_2056 [Gather] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2888 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2889 [06/20/2022-16:24:45] [V] [TRT] Gather_2056 [Gather] inputs: [2888 -> (4)[INT32]], [2889 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2889 for ONNX node: 2889 [06/20/2022-16:24:45] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Gather_2056 for ONNX node: Gather_2056 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2890 for ONNX tensor: 2890 [06/20/2022-16:24:45] [V] [TRT] Gather_2056 [Gather] outputs: [2890 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2057 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2887 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2057 [Unsqueeze] inputs: [2887 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2057 for ONNX node: Unsqueeze_2057 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2892 for ONNX tensor: 2892 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2057 [Unsqueeze] outputs: [2892 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Unsqueeze_2058 [Unsqueeze] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2890 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2058 [Unsqueeze] inputs: [2890 -> ()[INT32]], [06/20/2022-16:24:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:45] [V] [TRT] Registering layer: Unsqueeze_2058 for ONNX node: Unsqueeze_2058 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2893 for ONNX tensor: 2893 [06/20/2022-16:24:45] [V] [TRT] Unsqueeze_2058 [Unsqueeze] outputs: [2893 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Concat_2059 [Concat] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2892 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2893 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3457 [06/20/2022-16:24:45] [V] [TRT] Concat_2059 [Concat] inputs: [2892 -> (1)[INT32]], [2893 -> (1)[INT32]], [3457 -> (1)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3457 for ONNX node: 3457 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Concat_2059 for ONNX node: Concat_2059 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2895 for ONNX tensor: 2895 [06/20/2022-16:24:45] [V] [TRT] Concat_2059 [Concat] outputs: [2895 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Reshape_2060 [Reshape] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2884 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2895 [06/20/2022-16:24:45] [V] [TRT] Reshape_2060 [Reshape] inputs: [2884 -> (-1, -1, 16, 64)[FLOAT]], [2895 -> (3)[INT32]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Reshape_2060 for ONNX node: Reshape_2060 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2896 for ONNX tensor: 2896 [06/20/2022-16:24:45] [V] [TRT] Reshape_2060 [Reshape] outputs: [2896 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2061 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2896 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3458 [06/20/2022-16:24:45] [V] [TRT] MatMul_2061 [MatMul] inputs: [2896 -> (-1, -1, 1024)[FLOAT]], [3458 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3458 for ONNX node: 3458 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2061 for ONNX node: MatMul_2061 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2898 for ONNX tensor: 2898 [06/20/2022-16:24:45] [V] [TRT] MatMul_2061 [MatMul] outputs: [2898 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2062 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.attention.output.dense.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2898 [06/20/2022-16:24:45] [V] [TRT] Add_2062 [Add] inputs: [bert.encoder.layer.21.attention.output.dense.bias -> (1024)[FLOAT]], [2898 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.attention.output.dense.bias for ONNX node: bert.encoder.layer.21.attention.output.dense.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2062 for ONNX node: Add_2062 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2899 for ONNX tensor: 2899 [06/20/2022-16:24:45] [V] [TRT] Add_2062 [Add] outputs: [2899 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2063 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2899 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2823 [06/20/2022-16:24:45] [V] [TRT] Add_2063 [Add] inputs: [2899 -> (-1, -1, 1024)[FLOAT]], [2823 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2063 for ONNX node: Add_2063 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2900 for ONNX tensor: 2900 [06/20/2022-16:24:45] [V] [TRT] Add_2063 [Add] outputs: [2900 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: ReduceMean_2064 [ReduceMean] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2900 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_2064 [ReduceMean] inputs: [2900 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: ReduceMean_2064 for ONNX node: ReduceMean_2064 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2901 for ONNX tensor: 2901 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_2064 [ReduceMean] outputs: [2901 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Sub_2065 [Sub] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2900 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2901 [06/20/2022-16:24:45] [V] [TRT] Sub_2065 [Sub] inputs: [2900 -> (-1, -1, 1024)[FLOAT]], [2901 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Sub_2065 for ONNX node: Sub_2065 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2902 for ONNX tensor: 2902 [06/20/2022-16:24:45] [V] [TRT] Sub_2065 [Sub] outputs: [2902 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2066 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2066 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2066 [Constant] outputs: [2903 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Pow_2067 [Pow] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2902 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2903 [06/20/2022-16:24:45] [V] [TRT] Pow_2067 [Pow] inputs: [2902 -> (-1, -1, 1024)[FLOAT]], [2903 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2903 for ONNX node: 2903 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Pow_2067 for ONNX node: Pow_2067 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2904 for ONNX tensor: 2904 [06/20/2022-16:24:45] [V] [TRT] Pow_2067 [Pow] outputs: [2904 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: ReduceMean_2068 [ReduceMean] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2904 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_2068 [ReduceMean] inputs: [2904 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: ReduceMean_2068 for ONNX node: ReduceMean_2068 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2905 for ONNX tensor: 2905 [06/20/2022-16:24:45] [V] [TRT] ReduceMean_2068 [ReduceMean] outputs: [2905 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2069 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2069 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2069 [Constant] outputs: [2906 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2070 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2905 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2906 [06/20/2022-16:24:45] [V] [TRT] Add_2070 [Add] inputs: [2905 -> (-1, -1, 1)[FLOAT]], [2906 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2906 for ONNX node: 2906 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2070 for ONNX node: Add_2070 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2907 for ONNX tensor: 2907 [06/20/2022-16:24:45] [V] [TRT] Add_2070 [Add] outputs: [2907 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Sqrt_2071 [Sqrt] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2907 [06/20/2022-16:24:45] [V] [TRT] Sqrt_2071 [Sqrt] inputs: [2907 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Sqrt_2071 for ONNX node: Sqrt_2071 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2908 for ONNX tensor: 2908 [06/20/2022-16:24:45] [V] [TRT] Sqrt_2071 [Sqrt] outputs: [2908 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Div_2072 [Div] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2902 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2908 [06/20/2022-16:24:45] [V] [TRT] Div_2072 [Div] inputs: [2902 -> (-1, -1, 1024)[FLOAT]], [2908 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Div_2072 for ONNX node: Div_2072 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2909 for ONNX tensor: 2909 [06/20/2022-16:24:45] [V] [TRT] Div_2072 [Div] outputs: [2909 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_2073 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2909 [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.attention.output.LayerNorm.weight [06/20/2022-16:24:45] [V] [TRT] Mul_2073 [Mul] inputs: [2909 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.21.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.21.attention.output.LayerNorm.weight [06/20/2022-16:24:45] [V] [TRT] Registering layer: Mul_2073 for ONNX node: Mul_2073 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2910 for ONNX tensor: 2910 [06/20/2022-16:24:45] [V] [TRT] Mul_2073 [Mul] outputs: [2910 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2074 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2910 [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.attention.output.LayerNorm.bias [06/20/2022-16:24:45] [V] [TRT] Add_2074 [Add] inputs: [2910 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.21.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.21.attention.output.LayerNorm.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2074 for ONNX node: Add_2074 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2911 for ONNX tensor: 2911 [06/20/2022-16:24:45] [V] [TRT] Add_2074 [Add] outputs: [2911 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: MatMul_2075 [MatMul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2911 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 3459 [06/20/2022-16:24:45] [V] [TRT] MatMul_2075 [MatMul] inputs: [2911 -> (-1, -1, 1024)[FLOAT]], [3459 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 3459 for ONNX node: 3459 [06/20/2022-16:24:45] [V] [TRT] Registering layer: MatMul_2075 for ONNX node: MatMul_2075 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2913 for ONNX tensor: 2913 [06/20/2022-16:24:45] [V] [TRT] MatMul_2075 [MatMul] outputs: [2913 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2076 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: bert.encoder.layer.21.intermediate.dense.bias [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2913 [06/20/2022-16:24:45] [V] [TRT] Add_2076 [Add] inputs: [bert.encoder.layer.21.intermediate.dense.bias -> (4096)[FLOAT]], [2913 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: bert.encoder.layer.21.intermediate.dense.bias for ONNX node: bert.encoder.layer.21.intermediate.dense.bias [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2076 for ONNX node: Add_2076 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2914 for ONNX tensor: 2914 [06/20/2022-16:24:45] [V] [TRT] Add_2076 [Add] outputs: [2914 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2077 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2077 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2077 [Constant] outputs: [2915 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Div_2078 [Div] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2914 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2915 [06/20/2022-16:24:45] [V] [TRT] Div_2078 [Div] inputs: [2914 -> (-1, -1, 4096)[FLOAT]], [2915 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2915 for ONNX node: 2915 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Div_2078 for ONNX node: Div_2078 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2916 for ONNX tensor: 2916 [06/20/2022-16:24:45] [V] [TRT] Div_2078 [Div] outputs: [2916 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Erf_2079 [Erf] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2916 [06/20/2022-16:24:45] [V] [TRT] Erf_2079 [Erf] inputs: [2916 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Erf_2079 for ONNX node: Erf_2079 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2917 for ONNX tensor: 2917 [06/20/2022-16:24:45] [V] [TRT] Erf_2079 [Erf] outputs: [2917 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2080 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2080 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2080 [Constant] outputs: [2918 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Add_2081 [Add] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2917 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2918 [06/20/2022-16:24:45] [V] [TRT] Add_2081 [Add] inputs: [2917 -> (-1, -1, 4096)[FLOAT]], [2918 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2918 for ONNX node: 2918 [06/20/2022-16:24:45] [V] [TRT] Registering layer: Add_2081 for ONNX node: Add_2081 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2919 for ONNX tensor: 2919 [06/20/2022-16:24:45] [V] [TRT] Add_2081 [Add] outputs: [2919 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_2082 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2914 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2919 [06/20/2022-16:24:45] [V] [TRT] Mul_2082 [Mul] inputs: [2914 -> (-1, -1, 4096)[FLOAT]], [2919 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: Mul_2082 for ONNX node: Mul_2082 [06/20/2022-16:24:45] [V] [TRT] Registering tensor: 2920 for ONNX tensor: 2920 [06/20/2022-16:24:45] [V] [TRT] Mul_2082 [Mul] outputs: [2920 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Constant_2083 [Constant] [06/20/2022-16:24:45] [V] [TRT] Constant_2083 [Constant] inputs: [06/20/2022-16:24:45] [V] [TRT] Constant_2083 [Constant] outputs: [2921 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Parsing node: Mul_2084 [Mul] [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2920 [06/20/2022-16:24:45] [V] [TRT] Searching for input: 2921 [06/20/2022-16:24:45] [V] [TRT] Mul_2084 [Mul] inputs: [2920 -> (-1, -1, 4096)[FLOAT]], [2921 -> ()[FLOAT]], [06/20/2022-16:24:45] [V] [TRT] Registering layer: 2921 for ONNX node: 2921 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Mul_2084 for ONNX node: Mul_2084 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2922 for ONNX tensor: 2922 [06/20/2022-16:24:46] [V] [TRT] Mul_2084 [Mul] outputs: [2922 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2085 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2922 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3460 [06/20/2022-16:24:46] [V] [TRT] MatMul_2085 [MatMul] inputs: [2922 -> (-1, -1, 4096)[FLOAT]], [3460 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3460 for ONNX node: 3460 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2085 for ONNX node: MatMul_2085 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2924 for ONNX tensor: 2924 [06/20/2022-16:24:46] [V] [TRT] MatMul_2085 [MatMul] outputs: [2924 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2086 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.21.output.dense.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2924 [06/20/2022-16:24:46] [V] [TRT] Add_2086 [Add] inputs: [bert.encoder.layer.21.output.dense.bias -> (1024)[FLOAT]], [2924 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.21.output.dense.bias for ONNX node: bert.encoder.layer.21.output.dense.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2086 for ONNX node: Add_2086 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2925 for ONNX tensor: 2925 [06/20/2022-16:24:46] [V] [TRT] Add_2086 [Add] outputs: [2925 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2087 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2925 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2911 [06/20/2022-16:24:46] [V] [TRT] Add_2087 [Add] inputs: [2925 -> (-1, -1, 1024)[FLOAT]], [2911 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2087 for ONNX node: Add_2087 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2926 for ONNX tensor: 2926 [06/20/2022-16:24:46] [V] [TRT] Add_2087 [Add] outputs: [2926 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: ReduceMean_2088 [ReduceMean] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2926 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2088 [ReduceMean] inputs: [2926 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: ReduceMean_2088 for ONNX node: ReduceMean_2088 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2927 for ONNX tensor: 2927 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2088 [ReduceMean] outputs: [2927 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Sub_2089 [Sub] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2926 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2927 [06/20/2022-16:24:46] [V] [TRT] Sub_2089 [Sub] inputs: [2926 -> (-1, -1, 1024)[FLOAT]], [2927 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Sub_2089 for ONNX node: Sub_2089 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2928 for ONNX tensor: 2928 [06/20/2022-16:24:46] [V] [TRT] Sub_2089 [Sub] outputs: [2928 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2090 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2090 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2090 [Constant] outputs: [2929 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Pow_2091 [Pow] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2928 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2929 [06/20/2022-16:24:46] [V] [TRT] Pow_2091 [Pow] inputs: [2928 -> (-1, -1, 1024)[FLOAT]], [2929 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2929 for ONNX node: 2929 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Pow_2091 for ONNX node: Pow_2091 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2930 for ONNX tensor: 2930 [06/20/2022-16:24:46] [V] [TRT] Pow_2091 [Pow] outputs: [2930 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: ReduceMean_2092 [ReduceMean] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2930 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2092 [ReduceMean] inputs: [2930 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: ReduceMean_2092 for ONNX node: ReduceMean_2092 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2931 for ONNX tensor: 2931 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2092 [ReduceMean] outputs: [2931 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2093 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2093 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2093 [Constant] outputs: [2932 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2094 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2931 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2932 [06/20/2022-16:24:46] [V] [TRT] Add_2094 [Add] inputs: [2931 -> (-1, -1, 1)[FLOAT]], [2932 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2932 for ONNX node: 2932 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2094 for ONNX node: Add_2094 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2933 for ONNX tensor: 2933 [06/20/2022-16:24:46] [V] [TRT] Add_2094 [Add] outputs: [2933 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Sqrt_2095 [Sqrt] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2933 [06/20/2022-16:24:46] [V] [TRT] Sqrt_2095 [Sqrt] inputs: [2933 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Sqrt_2095 for ONNX node: Sqrt_2095 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2934 for ONNX tensor: 2934 [06/20/2022-16:24:46] [V] [TRT] Sqrt_2095 [Sqrt] outputs: [2934 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Div_2096 [Div] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2928 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2934 [06/20/2022-16:24:46] [V] [TRT] Div_2096 [Div] inputs: [2928 -> (-1, -1, 1024)[FLOAT]], [2934 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Div_2096 for ONNX node: Div_2096 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2935 for ONNX tensor: 2935 [06/20/2022-16:24:46] [V] [TRT] Div_2096 [Div] outputs: [2935 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Mul_2097 [Mul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2935 [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.21.output.LayerNorm.weight [06/20/2022-16:24:46] [V] [TRT] Mul_2097 [Mul] inputs: [2935 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.21.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.21.output.LayerNorm.weight for ONNX node: bert.encoder.layer.21.output.LayerNorm.weight [06/20/2022-16:24:46] [V] [TRT] Registering layer: Mul_2097 for ONNX node: Mul_2097 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2936 for ONNX tensor: 2936 [06/20/2022-16:24:46] [V] [TRT] Mul_2097 [Mul] outputs: [2936 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2098 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2936 [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.21.output.LayerNorm.bias [06/20/2022-16:24:46] [V] [TRT] Add_2098 [Add] inputs: [2936 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.21.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.21.output.LayerNorm.bias for ONNX node: bert.encoder.layer.21.output.LayerNorm.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2098 for ONNX node: Add_2098 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2937 for ONNX tensor: 2937 [06/20/2022-16:24:46] [V] [TRT] Add_2098 [Add] outputs: [2937 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2099 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2937 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3461 [06/20/2022-16:24:46] [V] [TRT] MatMul_2099 [MatMul] inputs: [2937 -> (-1, -1, 1024)[FLOAT]], [3461 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3461 for ONNX node: 3461 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2099 for ONNX node: MatMul_2099 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2939 for ONNX tensor: 2939 [06/20/2022-16:24:46] [V] [TRT] MatMul_2099 [MatMul] outputs: [2939 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2100 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.attention.self.query.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2939 [06/20/2022-16:24:46] [V] [TRT] Add_2100 [Add] inputs: [bert.encoder.layer.22.attention.self.query.bias -> (1024)[FLOAT]], [2939 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.attention.self.query.bias for ONNX node: bert.encoder.layer.22.attention.self.query.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2100 for ONNX node: Add_2100 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2940 for ONNX tensor: 2940 [06/20/2022-16:24:46] [V] [TRT] Add_2100 [Add] outputs: [2940 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2101 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2937 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3462 [06/20/2022-16:24:46] [V] [TRT] MatMul_2101 [MatMul] inputs: [2937 -> (-1, -1, 1024)[FLOAT]], [3462 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3462 for ONNX node: 3462 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2101 for ONNX node: MatMul_2101 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2942 for ONNX tensor: 2942 [06/20/2022-16:24:46] [V] [TRT] MatMul_2101 [MatMul] outputs: [2942 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2102 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.attention.self.key.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2942 [06/20/2022-16:24:46] [V] [TRT] Add_2102 [Add] inputs: [bert.encoder.layer.22.attention.self.key.bias -> (1024)[FLOAT]], [2942 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.attention.self.key.bias for ONNX node: bert.encoder.layer.22.attention.self.key.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2102 for ONNX node: Add_2102 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2943 for ONNX tensor: 2943 [06/20/2022-16:24:46] [V] [TRT] Add_2102 [Add] outputs: [2943 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2103 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2943 [06/20/2022-16:24:46] [V] [TRT] Shape_2103 [Shape] inputs: [2943 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2103 for ONNX node: Shape_2103 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2944 for ONNX tensor: 2944 [06/20/2022-16:24:46] [V] [TRT] Shape_2103 [Shape] outputs: [2944 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2104 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2104 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2104 [Constant] outputs: [2945 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2105 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2944 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2945 [06/20/2022-16:24:46] [V] [TRT] Gather_2105 [Gather] inputs: [2944 -> (3)[INT32]], [2945 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2945 for ONNX node: 2945 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2105 for ONNX node: Gather_2105 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2946 for ONNX tensor: 2946 [06/20/2022-16:24:46] [V] [TRT] Gather_2105 [Gather] outputs: [2946 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2106 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2943 [06/20/2022-16:24:46] [V] [TRT] Shape_2106 [Shape] inputs: [2943 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2106 for ONNX node: Shape_2106 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2947 for ONNX tensor: 2947 [06/20/2022-16:24:46] [V] [TRT] Shape_2106 [Shape] outputs: [2947 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2107 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2107 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2107 [Constant] outputs: [2948 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2108 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2947 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2948 [06/20/2022-16:24:46] [V] [TRT] Gather_2108 [Gather] inputs: [2947 -> (3)[INT32]], [2948 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2948 for ONNX node: 2948 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2108 for ONNX node: Gather_2108 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2949 for ONNX tensor: 2949 [06/20/2022-16:24:46] [V] [TRT] Gather_2108 [Gather] outputs: [2949 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2109 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2946 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2109 [Unsqueeze] inputs: [2946 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2109 for ONNX node: Unsqueeze_2109 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2952 for ONNX tensor: 2952 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2109 [Unsqueeze] outputs: [2952 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2110 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2949 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2110 [Unsqueeze] inputs: [2949 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2110 for ONNX node: Unsqueeze_2110 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2953 for ONNX tensor: 2953 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2110 [Unsqueeze] outputs: [2953 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Concat_2111 [Concat] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2952 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2953 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3463 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3464 [06/20/2022-16:24:46] [V] [TRT] Concat_2111 [Concat] inputs: [2952 -> (1)[INT32]], [2953 -> (1)[INT32]], [3463 -> (1)[INT32]], [3464 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3463 for ONNX node: 3463 [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3464 for ONNX node: 3464 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Concat_2111 for ONNX node: Concat_2111 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2956 for ONNX tensor: 2956 [06/20/2022-16:24:46] [V] [TRT] Concat_2111 [Concat] outputs: [2956 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Reshape_2112 [Reshape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2943 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2956 [06/20/2022-16:24:46] [V] [TRT] Reshape_2112 [Reshape] inputs: [2943 -> (-1, -1, 1024)[FLOAT]], [2956 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Reshape_2112 for ONNX node: Reshape_2112 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2957 for ONNX tensor: 2957 [06/20/2022-16:24:46] [V] [TRT] Reshape_2112 [Reshape] outputs: [2957 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2113 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2937 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3465 [06/20/2022-16:24:46] [V] [TRT] MatMul_2113 [MatMul] inputs: [2937 -> (-1, -1, 1024)[FLOAT]], [3465 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3465 for ONNX node: 3465 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2113 for ONNX node: MatMul_2113 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2959 for ONNX tensor: 2959 [06/20/2022-16:24:46] [V] [TRT] MatMul_2113 [MatMul] outputs: [2959 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2114 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.attention.self.value.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2959 [06/20/2022-16:24:46] [V] [TRT] Add_2114 [Add] inputs: [bert.encoder.layer.22.attention.self.value.bias -> (1024)[FLOAT]], [2959 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.attention.self.value.bias for ONNX node: bert.encoder.layer.22.attention.self.value.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2114 for ONNX node: Add_2114 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2960 for ONNX tensor: 2960 [06/20/2022-16:24:46] [V] [TRT] Add_2114 [Add] outputs: [2960 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2115 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2960 [06/20/2022-16:24:46] [V] [TRT] Shape_2115 [Shape] inputs: [2960 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2115 for ONNX node: Shape_2115 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2961 for ONNX tensor: 2961 [06/20/2022-16:24:46] [V] [TRT] Shape_2115 [Shape] outputs: [2961 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2116 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2116 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2116 [Constant] outputs: [2962 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2117 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2961 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2962 [06/20/2022-16:24:46] [V] [TRT] Gather_2117 [Gather] inputs: [2961 -> (3)[INT32]], [2962 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2962 for ONNX node: 2962 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2117 for ONNX node: Gather_2117 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2963 for ONNX tensor: 2963 [06/20/2022-16:24:46] [V] [TRT] Gather_2117 [Gather] outputs: [2963 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2118 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2960 [06/20/2022-16:24:46] [V] [TRT] Shape_2118 [Shape] inputs: [2960 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2118 for ONNX node: Shape_2118 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2964 for ONNX tensor: 2964 [06/20/2022-16:24:46] [V] [TRT] Shape_2118 [Shape] outputs: [2964 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2119 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2119 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2119 [Constant] outputs: [2965 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2120 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2964 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2965 [06/20/2022-16:24:46] [V] [TRT] Gather_2120 [Gather] inputs: [2964 -> (3)[INT32]], [2965 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2965 for ONNX node: 2965 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2120 for ONNX node: Gather_2120 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2966 for ONNX tensor: 2966 [06/20/2022-16:24:46] [V] [TRT] Gather_2120 [Gather] outputs: [2966 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2121 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2963 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2121 [Unsqueeze] inputs: [2963 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2121 for ONNX node: Unsqueeze_2121 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2969 for ONNX tensor: 2969 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2121 [Unsqueeze] outputs: [2969 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2122 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2966 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2122 [Unsqueeze] inputs: [2966 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2122 for ONNX node: Unsqueeze_2122 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2970 for ONNX tensor: 2970 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2122 [Unsqueeze] outputs: [2970 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Concat_2123 [Concat] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2969 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2970 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3466 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3467 [06/20/2022-16:24:46] [V] [TRT] Concat_2123 [Concat] inputs: [2969 -> (1)[INT32]], [2970 -> (1)[INT32]], [3466 -> (1)[INT32]], [3467 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3466 for ONNX node: 3466 [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3467 for ONNX node: 3467 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Concat_2123 for ONNX node: Concat_2123 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2973 for ONNX tensor: 2973 [06/20/2022-16:24:46] [V] [TRT] Concat_2123 [Concat] outputs: [2973 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Reshape_2124 [Reshape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2960 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2973 [06/20/2022-16:24:46] [V] [TRT] Reshape_2124 [Reshape] inputs: [2960 -> (-1, -1, 1024)[FLOAT]], [2973 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Reshape_2124 for ONNX node: Reshape_2124 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2974 for ONNX tensor: 2974 [06/20/2022-16:24:46] [V] [TRT] Reshape_2124 [Reshape] outputs: [2974 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Transpose_2125 [Transpose] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2974 [06/20/2022-16:24:46] [V] [TRT] Transpose_2125 [Transpose] inputs: [2974 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Transpose_2125 for ONNX node: Transpose_2125 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2975 for ONNX tensor: 2975 [06/20/2022-16:24:46] [V] [TRT] Transpose_2125 [Transpose] outputs: [2975 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2126 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2940 [06/20/2022-16:24:46] [V] [TRT] Shape_2126 [Shape] inputs: [2940 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2126 for ONNX node: Shape_2126 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2976 for ONNX tensor: 2976 [06/20/2022-16:24:46] [V] [TRT] Shape_2126 [Shape] outputs: [2976 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2127 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2127 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2127 [Constant] outputs: [2977 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2128 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2976 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2977 [06/20/2022-16:24:46] [V] [TRT] Gather_2128 [Gather] inputs: [2976 -> (3)[INT32]], [2977 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2977 for ONNX node: 2977 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2128 for ONNX node: Gather_2128 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2978 for ONNX tensor: 2978 [06/20/2022-16:24:46] [V] [TRT] Gather_2128 [Gather] outputs: [2978 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2129 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2940 [06/20/2022-16:24:46] [V] [TRT] Shape_2129 [Shape] inputs: [2940 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2129 for ONNX node: Shape_2129 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2979 for ONNX tensor: 2979 [06/20/2022-16:24:46] [V] [TRT] Shape_2129 [Shape] outputs: [2979 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2130 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2130 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2130 [Constant] outputs: [2980 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2131 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2979 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2980 [06/20/2022-16:24:46] [V] [TRT] Gather_2131 [Gather] inputs: [2979 -> (3)[INT32]], [2980 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2980 for ONNX node: 2980 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2131 for ONNX node: Gather_2131 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2981 for ONNX tensor: 2981 [06/20/2022-16:24:46] [V] [TRT] Gather_2131 [Gather] outputs: [2981 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2132 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2978 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2132 [Unsqueeze] inputs: [2978 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2132 for ONNX node: Unsqueeze_2132 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2984 for ONNX tensor: 2984 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2132 [Unsqueeze] outputs: [2984 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2133 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2981 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2133 [Unsqueeze] inputs: [2981 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2133 for ONNX node: Unsqueeze_2133 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2985 for ONNX tensor: 2985 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2133 [Unsqueeze] outputs: [2985 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Concat_2134 [Concat] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2984 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2985 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3468 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3469 [06/20/2022-16:24:46] [V] [TRT] Concat_2134 [Concat] inputs: [2984 -> (1)[INT32]], [2985 -> (1)[INT32]], [3468 -> (1)[INT32]], [3469 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3468 for ONNX node: 3468 [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3469 for ONNX node: 3469 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Concat_2134 for ONNX node: Concat_2134 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2988 for ONNX tensor: 2988 [06/20/2022-16:24:46] [V] [TRT] Concat_2134 [Concat] outputs: [2988 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Reshape_2135 [Reshape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2940 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2988 [06/20/2022-16:24:46] [V] [TRT] Reshape_2135 [Reshape] inputs: [2940 -> (-1, -1, 1024)[FLOAT]], [2988 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Reshape_2135 for ONNX node: Reshape_2135 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2989 for ONNX tensor: 2989 [06/20/2022-16:24:46] [V] [TRT] Reshape_2135 [Reshape] outputs: [2989 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Transpose_2136 [Transpose] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2989 [06/20/2022-16:24:46] [V] [TRT] Transpose_2136 [Transpose] inputs: [2989 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Transpose_2136 for ONNX node: Transpose_2136 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2990 for ONNX tensor: 2990 [06/20/2022-16:24:46] [V] [TRT] Transpose_2136 [Transpose] outputs: [2990 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Transpose_2137 [Transpose] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2957 [06/20/2022-16:24:46] [V] [TRT] Transpose_2137 [Transpose] inputs: [2957 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Transpose_2137 for ONNX node: Transpose_2137 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2991 for ONNX tensor: 2991 [06/20/2022-16:24:46] [V] [TRT] Transpose_2137 [Transpose] outputs: [2991 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2138 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2990 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2991 [06/20/2022-16:24:46] [V] [TRT] MatMul_2138 [MatMul] inputs: [2990 -> (-1, 16, -1, 64)[FLOAT]], [2991 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2138 for ONNX node: MatMul_2138 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2992 for ONNX tensor: 2992 [06/20/2022-16:24:46] [V] [TRT] MatMul_2138 [MatMul] outputs: [2992 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2139 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2139 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2139 [Constant] outputs: [2993 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Div_2140 [Div] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2992 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2993 [06/20/2022-16:24:46] [V] [TRT] Div_2140 [Div] inputs: [2992 -> (-1, 16, -1, -1)[FLOAT]], [2993 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 2993 for ONNX node: 2993 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Div_2140 for ONNX node: Div_2140 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2994 for ONNX tensor: 2994 [06/20/2022-16:24:46] [V] [TRT] Div_2140 [Div] outputs: [2994 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2141 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2994 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:46] [V] [TRT] Add_2141 [Add] inputs: [2994 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2141 for ONNX node: Add_2141 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2995 for ONNX tensor: 2995 [06/20/2022-16:24:46] [V] [TRT] Add_2141 [Add] outputs: [2995 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Softmax_2142 [Softmax] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2995 [06/20/2022-16:24:46] [V] [TRT] Softmax_2142 [Softmax] inputs: [2995 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Softmax_2142 for ONNX node: Softmax_2142 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2996 for ONNX tensor: 2996 [06/20/2022-16:24:46] [V] [TRT] Softmax_2142 [Softmax] outputs: [2996 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2143 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2996 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2975 [06/20/2022-16:24:46] [V] [TRT] MatMul_2143 [MatMul] inputs: [2996 -> (-1, 16, -1, -1)[FLOAT]], [2975 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2143 for ONNX node: MatMul_2143 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2997 for ONNX tensor: 2997 [06/20/2022-16:24:46] [V] [TRT] MatMul_2143 [MatMul] outputs: [2997 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Transpose_2144 [Transpose] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2997 [06/20/2022-16:24:46] [V] [TRT] Transpose_2144 [Transpose] inputs: [2997 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Transpose_2144 for ONNX node: Transpose_2144 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2998 for ONNX tensor: 2998 [06/20/2022-16:24:46] [V] [TRT] Transpose_2144 [Transpose] outputs: [2998 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2145 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2998 [06/20/2022-16:24:46] [V] [TRT] Shape_2145 [Shape] inputs: [2998 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2145 for ONNX node: Shape_2145 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 2999 for ONNX tensor: 2999 [06/20/2022-16:24:46] [V] [TRT] Shape_2145 [Shape] outputs: [2999 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2146 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2146 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2146 [Constant] outputs: [3000 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2147 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2999 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3000 [06/20/2022-16:24:46] [V] [TRT] Gather_2147 [Gather] inputs: [2999 -> (4)[INT32]], [3000 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3000 for ONNX node: 3000 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2147 for ONNX node: Gather_2147 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3001 for ONNX tensor: 3001 [06/20/2022-16:24:46] [V] [TRT] Gather_2147 [Gather] outputs: [3001 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Shape_2148 [Shape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2998 [06/20/2022-16:24:46] [V] [TRT] Shape_2148 [Shape] inputs: [2998 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Shape_2148 for ONNX node: Shape_2148 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3002 for ONNX tensor: 3002 [06/20/2022-16:24:46] [V] [TRT] Shape_2148 [Shape] outputs: [3002 -> (4)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2149 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2149 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2149 [Constant] outputs: [3003 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Gather_2150 [Gather] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3002 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3003 [06/20/2022-16:24:46] [V] [TRT] Gather_2150 [Gather] inputs: [3002 -> (4)[INT32]], [3003 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3003 for ONNX node: 3003 [06/20/2022-16:24:46] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Gather_2150 for ONNX node: Gather_2150 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3004 for ONNX tensor: 3004 [06/20/2022-16:24:46] [V] [TRT] Gather_2150 [Gather] outputs: [3004 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2151 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3001 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2151 [Unsqueeze] inputs: [3001 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2151 for ONNX node: Unsqueeze_2151 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3006 for ONNX tensor: 3006 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2151 [Unsqueeze] outputs: [3006 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Unsqueeze_2152 [Unsqueeze] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3004 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2152 [Unsqueeze] inputs: [3004 -> ()[INT32]], [06/20/2022-16:24:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:46] [V] [TRT] Registering layer: Unsqueeze_2152 for ONNX node: Unsqueeze_2152 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3007 for ONNX tensor: 3007 [06/20/2022-16:24:46] [V] [TRT] Unsqueeze_2152 [Unsqueeze] outputs: [3007 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Concat_2153 [Concat] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3006 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3007 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3470 [06/20/2022-16:24:46] [V] [TRT] Concat_2153 [Concat] inputs: [3006 -> (1)[INT32]], [3007 -> (1)[INT32]], [3470 -> (1)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3470 for ONNX node: 3470 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Concat_2153 for ONNX node: Concat_2153 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3009 for ONNX tensor: 3009 [06/20/2022-16:24:46] [V] [TRT] Concat_2153 [Concat] outputs: [3009 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Reshape_2154 [Reshape] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2998 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3009 [06/20/2022-16:24:46] [V] [TRT] Reshape_2154 [Reshape] inputs: [2998 -> (-1, -1, 16, 64)[FLOAT]], [3009 -> (3)[INT32]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Reshape_2154 for ONNX node: Reshape_2154 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3010 for ONNX tensor: 3010 [06/20/2022-16:24:46] [V] [TRT] Reshape_2154 [Reshape] outputs: [3010 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2155 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3010 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3471 [06/20/2022-16:24:46] [V] [TRT] MatMul_2155 [MatMul] inputs: [3010 -> (-1, -1, 1024)[FLOAT]], [3471 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3471 for ONNX node: 3471 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2155 for ONNX node: MatMul_2155 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3012 for ONNX tensor: 3012 [06/20/2022-16:24:46] [V] [TRT] MatMul_2155 [MatMul] outputs: [3012 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2156 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.attention.output.dense.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3012 [06/20/2022-16:24:46] [V] [TRT] Add_2156 [Add] inputs: [bert.encoder.layer.22.attention.output.dense.bias -> (1024)[FLOAT]], [3012 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.attention.output.dense.bias for ONNX node: bert.encoder.layer.22.attention.output.dense.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2156 for ONNX node: Add_2156 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3013 for ONNX tensor: 3013 [06/20/2022-16:24:46] [V] [TRT] Add_2156 [Add] outputs: [3013 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2157 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3013 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 2937 [06/20/2022-16:24:46] [V] [TRT] Add_2157 [Add] inputs: [3013 -> (-1, -1, 1024)[FLOAT]], [2937 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2157 for ONNX node: Add_2157 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3014 for ONNX tensor: 3014 [06/20/2022-16:24:46] [V] [TRT] Add_2157 [Add] outputs: [3014 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: ReduceMean_2158 [ReduceMean] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3014 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2158 [ReduceMean] inputs: [3014 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: ReduceMean_2158 for ONNX node: ReduceMean_2158 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3015 for ONNX tensor: 3015 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2158 [ReduceMean] outputs: [3015 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Sub_2159 [Sub] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3014 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3015 [06/20/2022-16:24:46] [V] [TRT] Sub_2159 [Sub] inputs: [3014 -> (-1, -1, 1024)[FLOAT]], [3015 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Sub_2159 for ONNX node: Sub_2159 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3016 for ONNX tensor: 3016 [06/20/2022-16:24:46] [V] [TRT] Sub_2159 [Sub] outputs: [3016 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2160 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2160 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2160 [Constant] outputs: [3017 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Pow_2161 [Pow] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3016 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3017 [06/20/2022-16:24:46] [V] [TRT] Pow_2161 [Pow] inputs: [3016 -> (-1, -1, 1024)[FLOAT]], [3017 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3017 for ONNX node: 3017 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Pow_2161 for ONNX node: Pow_2161 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3018 for ONNX tensor: 3018 [06/20/2022-16:24:46] [V] [TRT] Pow_2161 [Pow] outputs: [3018 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: ReduceMean_2162 [ReduceMean] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3018 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2162 [ReduceMean] inputs: [3018 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: ReduceMean_2162 for ONNX node: ReduceMean_2162 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3019 for ONNX tensor: 3019 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2162 [ReduceMean] outputs: [3019 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2163 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2163 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2163 [Constant] outputs: [3020 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2164 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3019 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3020 [06/20/2022-16:24:46] [V] [TRT] Add_2164 [Add] inputs: [3019 -> (-1, -1, 1)[FLOAT]], [3020 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3020 for ONNX node: 3020 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2164 for ONNX node: Add_2164 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3021 for ONNX tensor: 3021 [06/20/2022-16:24:46] [V] [TRT] Add_2164 [Add] outputs: [3021 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Sqrt_2165 [Sqrt] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3021 [06/20/2022-16:24:46] [V] [TRT] Sqrt_2165 [Sqrt] inputs: [3021 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Sqrt_2165 for ONNX node: Sqrt_2165 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3022 for ONNX tensor: 3022 [06/20/2022-16:24:46] [V] [TRT] Sqrt_2165 [Sqrt] outputs: [3022 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Div_2166 [Div] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3016 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3022 [06/20/2022-16:24:46] [V] [TRT] Div_2166 [Div] inputs: [3016 -> (-1, -1, 1024)[FLOAT]], [3022 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Div_2166 for ONNX node: Div_2166 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3023 for ONNX tensor: 3023 [06/20/2022-16:24:46] [V] [TRT] Div_2166 [Div] outputs: [3023 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Mul_2167 [Mul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3023 [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.attention.output.LayerNorm.weight [06/20/2022-16:24:46] [V] [TRT] Mul_2167 [Mul] inputs: [3023 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.22.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.22.attention.output.LayerNorm.weight [06/20/2022-16:24:46] [V] [TRT] Registering layer: Mul_2167 for ONNX node: Mul_2167 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3024 for ONNX tensor: 3024 [06/20/2022-16:24:46] [V] [TRT] Mul_2167 [Mul] outputs: [3024 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2168 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3024 [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.attention.output.LayerNorm.bias [06/20/2022-16:24:46] [V] [TRT] Add_2168 [Add] inputs: [3024 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.22.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.22.attention.output.LayerNorm.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2168 for ONNX node: Add_2168 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3025 for ONNX tensor: 3025 [06/20/2022-16:24:46] [V] [TRT] Add_2168 [Add] outputs: [3025 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2169 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3025 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3472 [06/20/2022-16:24:46] [V] [TRT] MatMul_2169 [MatMul] inputs: [3025 -> (-1, -1, 1024)[FLOAT]], [3472 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3472 for ONNX node: 3472 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2169 for ONNX node: MatMul_2169 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3027 for ONNX tensor: 3027 [06/20/2022-16:24:46] [V] [TRT] MatMul_2169 [MatMul] outputs: [3027 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2170 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.intermediate.dense.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3027 [06/20/2022-16:24:46] [V] [TRT] Add_2170 [Add] inputs: [bert.encoder.layer.22.intermediate.dense.bias -> (4096)[FLOAT]], [3027 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.intermediate.dense.bias for ONNX node: bert.encoder.layer.22.intermediate.dense.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2170 for ONNX node: Add_2170 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3028 for ONNX tensor: 3028 [06/20/2022-16:24:46] [V] [TRT] Add_2170 [Add] outputs: [3028 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2171 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2171 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2171 [Constant] outputs: [3029 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Div_2172 [Div] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3028 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3029 [06/20/2022-16:24:46] [V] [TRT] Div_2172 [Div] inputs: [3028 -> (-1, -1, 4096)[FLOAT]], [3029 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3029 for ONNX node: 3029 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Div_2172 for ONNX node: Div_2172 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3030 for ONNX tensor: 3030 [06/20/2022-16:24:46] [V] [TRT] Div_2172 [Div] outputs: [3030 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Erf_2173 [Erf] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3030 [06/20/2022-16:24:46] [V] [TRT] Erf_2173 [Erf] inputs: [3030 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Erf_2173 for ONNX node: Erf_2173 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3031 for ONNX tensor: 3031 [06/20/2022-16:24:46] [V] [TRT] Erf_2173 [Erf] outputs: [3031 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2174 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2174 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2174 [Constant] outputs: [3032 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2175 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3031 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3032 [06/20/2022-16:24:46] [V] [TRT] Add_2175 [Add] inputs: [3031 -> (-1, -1, 4096)[FLOAT]], [3032 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3032 for ONNX node: 3032 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2175 for ONNX node: Add_2175 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3033 for ONNX tensor: 3033 [06/20/2022-16:24:46] [V] [TRT] Add_2175 [Add] outputs: [3033 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Mul_2176 [Mul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3028 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3033 [06/20/2022-16:24:46] [V] [TRT] Mul_2176 [Mul] inputs: [3028 -> (-1, -1, 4096)[FLOAT]], [3033 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Mul_2176 for ONNX node: Mul_2176 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3034 for ONNX tensor: 3034 [06/20/2022-16:24:46] [V] [TRT] Mul_2176 [Mul] outputs: [3034 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2177 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2177 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2177 [Constant] outputs: [3035 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Mul_2178 [Mul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3034 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3035 [06/20/2022-16:24:46] [V] [TRT] Mul_2178 [Mul] inputs: [3034 -> (-1, -1, 4096)[FLOAT]], [3035 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3035 for ONNX node: 3035 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Mul_2178 for ONNX node: Mul_2178 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3036 for ONNX tensor: 3036 [06/20/2022-16:24:46] [V] [TRT] Mul_2178 [Mul] outputs: [3036 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2179 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3036 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3473 [06/20/2022-16:24:46] [V] [TRT] MatMul_2179 [MatMul] inputs: [3036 -> (-1, -1, 4096)[FLOAT]], [3473 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3473 for ONNX node: 3473 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2179 for ONNX node: MatMul_2179 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3038 for ONNX tensor: 3038 [06/20/2022-16:24:46] [V] [TRT] MatMul_2179 [MatMul] outputs: [3038 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2180 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.output.dense.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3038 [06/20/2022-16:24:46] [V] [TRT] Add_2180 [Add] inputs: [bert.encoder.layer.22.output.dense.bias -> (1024)[FLOAT]], [3038 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.output.dense.bias for ONNX node: bert.encoder.layer.22.output.dense.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2180 for ONNX node: Add_2180 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3039 for ONNX tensor: 3039 [06/20/2022-16:24:46] [V] [TRT] Add_2180 [Add] outputs: [3039 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2181 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3039 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3025 [06/20/2022-16:24:46] [V] [TRT] Add_2181 [Add] inputs: [3039 -> (-1, -1, 1024)[FLOAT]], [3025 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2181 for ONNX node: Add_2181 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3040 for ONNX tensor: 3040 [06/20/2022-16:24:46] [V] [TRT] Add_2181 [Add] outputs: [3040 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: ReduceMean_2182 [ReduceMean] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3040 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2182 [ReduceMean] inputs: [3040 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: ReduceMean_2182 for ONNX node: ReduceMean_2182 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3041 for ONNX tensor: 3041 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2182 [ReduceMean] outputs: [3041 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Sub_2183 [Sub] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3040 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3041 [06/20/2022-16:24:46] [V] [TRT] Sub_2183 [Sub] inputs: [3040 -> (-1, -1, 1024)[FLOAT]], [3041 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Sub_2183 for ONNX node: Sub_2183 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3042 for ONNX tensor: 3042 [06/20/2022-16:24:46] [V] [TRT] Sub_2183 [Sub] outputs: [3042 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2184 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2184 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2184 [Constant] outputs: [3043 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Pow_2185 [Pow] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3042 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3043 [06/20/2022-16:24:46] [V] [TRT] Pow_2185 [Pow] inputs: [3042 -> (-1, -1, 1024)[FLOAT]], [3043 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3043 for ONNX node: 3043 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Pow_2185 for ONNX node: Pow_2185 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3044 for ONNX tensor: 3044 [06/20/2022-16:24:46] [V] [TRT] Pow_2185 [Pow] outputs: [3044 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: ReduceMean_2186 [ReduceMean] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3044 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2186 [ReduceMean] inputs: [3044 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: ReduceMean_2186 for ONNX node: ReduceMean_2186 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3045 for ONNX tensor: 3045 [06/20/2022-16:24:46] [V] [TRT] ReduceMean_2186 [ReduceMean] outputs: [3045 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Constant_2187 [Constant] [06/20/2022-16:24:46] [V] [TRT] Constant_2187 [Constant] inputs: [06/20/2022-16:24:46] [V] [TRT] Constant_2187 [Constant] outputs: [3046 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2188 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3045 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3046 [06/20/2022-16:24:46] [V] [TRT] Add_2188 [Add] inputs: [3045 -> (-1, -1, 1)[FLOAT]], [3046 -> ()[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3046 for ONNX node: 3046 [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2188 for ONNX node: Add_2188 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3047 for ONNX tensor: 3047 [06/20/2022-16:24:46] [V] [TRT] Add_2188 [Add] outputs: [3047 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Sqrt_2189 [Sqrt] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3047 [06/20/2022-16:24:46] [V] [TRT] Sqrt_2189 [Sqrt] inputs: [3047 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Sqrt_2189 for ONNX node: Sqrt_2189 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3048 for ONNX tensor: 3048 [06/20/2022-16:24:46] [V] [TRT] Sqrt_2189 [Sqrt] outputs: [3048 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Div_2190 [Div] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3042 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3048 [06/20/2022-16:24:46] [V] [TRT] Div_2190 [Div] inputs: [3042 -> (-1, -1, 1024)[FLOAT]], [3048 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: Div_2190 for ONNX node: Div_2190 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3049 for ONNX tensor: 3049 [06/20/2022-16:24:46] [V] [TRT] Div_2190 [Div] outputs: [3049 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Mul_2191 [Mul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3049 [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.output.LayerNorm.weight [06/20/2022-16:24:46] [V] [TRT] Mul_2191 [Mul] inputs: [3049 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.22.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.output.LayerNorm.weight for ONNX node: bert.encoder.layer.22.output.LayerNorm.weight [06/20/2022-16:24:46] [V] [TRT] Registering layer: Mul_2191 for ONNX node: Mul_2191 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3050 for ONNX tensor: 3050 [06/20/2022-16:24:46] [V] [TRT] Mul_2191 [Mul] outputs: [3050 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2192 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3050 [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.22.output.LayerNorm.bias [06/20/2022-16:24:46] [V] [TRT] Add_2192 [Add] inputs: [3050 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.22.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.22.output.LayerNorm.bias for ONNX node: bert.encoder.layer.22.output.LayerNorm.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2192 for ONNX node: Add_2192 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3051 for ONNX tensor: 3051 [06/20/2022-16:24:46] [V] [TRT] Add_2192 [Add] outputs: [3051 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2193 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3051 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3474 [06/20/2022-16:24:46] [V] [TRT] MatMul_2193 [MatMul] inputs: [3051 -> (-1, -1, 1024)[FLOAT]], [3474 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3474 for ONNX node: 3474 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2193 for ONNX node: MatMul_2193 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3053 for ONNX tensor: 3053 [06/20/2022-16:24:46] [V] [TRT] MatMul_2193 [MatMul] outputs: [3053 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2194 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.23.attention.self.query.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3053 [06/20/2022-16:24:46] [V] [TRT] Add_2194 [Add] inputs: [bert.encoder.layer.23.attention.self.query.bias -> (1024)[FLOAT]], [3053 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.23.attention.self.query.bias for ONNX node: bert.encoder.layer.23.attention.self.query.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2194 for ONNX node: Add_2194 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3054 for ONNX tensor: 3054 [06/20/2022-16:24:46] [V] [TRT] Add_2194 [Add] outputs: [3054 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: MatMul_2195 [MatMul] [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3051 [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3475 [06/20/2022-16:24:46] [V] [TRT] MatMul_2195 [MatMul] inputs: [3051 -> (-1, -1, 1024)[FLOAT]], [3475 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: 3475 for ONNX node: 3475 [06/20/2022-16:24:46] [V] [TRT] Registering layer: MatMul_2195 for ONNX node: MatMul_2195 [06/20/2022-16:24:46] [V] [TRT] Registering tensor: 3056 for ONNX tensor: 3056 [06/20/2022-16:24:46] [V] [TRT] MatMul_2195 [MatMul] outputs: [3056 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Parsing node: Add_2196 [Add] [06/20/2022-16:24:46] [V] [TRT] Searching for input: bert.encoder.layer.23.attention.self.key.bias [06/20/2022-16:24:46] [V] [TRT] Searching for input: 3056 [06/20/2022-16:24:46] [V] [TRT] Add_2196 [Add] inputs: [bert.encoder.layer.23.attention.self.key.bias -> (1024)[FLOAT]], [3056 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:46] [V] [TRT] Registering layer: bert.encoder.layer.23.attention.self.key.bias for ONNX node: bert.encoder.layer.23.attention.self.key.bias [06/20/2022-16:24:46] [V] [TRT] Registering layer: Add_2196 for ONNX node: Add_2196 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3057 for ONNX tensor: 3057 [06/20/2022-16:24:47] [V] [TRT] Add_2196 [Add] outputs: [3057 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2197 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3057 [06/20/2022-16:24:47] [V] [TRT] Shape_2197 [Shape] inputs: [3057 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2197 for ONNX node: Shape_2197 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3058 for ONNX tensor: 3058 [06/20/2022-16:24:47] [V] [TRT] Shape_2197 [Shape] outputs: [3058 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2198 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2198 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2198 [Constant] outputs: [3059 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2199 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3058 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3059 [06/20/2022-16:24:47] [V] [TRT] Gather_2199 [Gather] inputs: [3058 -> (3)[INT32]], [3059 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3059 for ONNX node: 3059 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2199 for ONNX node: Gather_2199 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3060 for ONNX tensor: 3060 [06/20/2022-16:24:47] [V] [TRT] Gather_2199 [Gather] outputs: [3060 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2200 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3057 [06/20/2022-16:24:47] [V] [TRT] Shape_2200 [Shape] inputs: [3057 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2200 for ONNX node: Shape_2200 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3061 for ONNX tensor: 3061 [06/20/2022-16:24:47] [V] [TRT] Shape_2200 [Shape] outputs: [3061 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2201 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2201 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2201 [Constant] outputs: [3062 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2202 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3061 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3062 [06/20/2022-16:24:47] [V] [TRT] Gather_2202 [Gather] inputs: [3061 -> (3)[INT32]], [3062 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3062 for ONNX node: 3062 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2202 for ONNX node: Gather_2202 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3063 for ONNX tensor: 3063 [06/20/2022-16:24:47] [V] [TRT] Gather_2202 [Gather] outputs: [3063 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2203 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3060 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2203 [Unsqueeze] inputs: [3060 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2203 for ONNX node: Unsqueeze_2203 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3066 for ONNX tensor: 3066 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2203 [Unsqueeze] outputs: [3066 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2204 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3063 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2204 [Unsqueeze] inputs: [3063 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2204 for ONNX node: Unsqueeze_2204 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3067 for ONNX tensor: 3067 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2204 [Unsqueeze] outputs: [3067 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Concat_2205 [Concat] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3066 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3067 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3476 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3477 [06/20/2022-16:24:47] [V] [TRT] Concat_2205 [Concat] inputs: [3066 -> (1)[INT32]], [3067 -> (1)[INT32]], [3476 -> (1)[INT32]], [3477 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3476 for ONNX node: 3476 [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3477 for ONNX node: 3477 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Concat_2205 for ONNX node: Concat_2205 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3070 for ONNX tensor: 3070 [06/20/2022-16:24:47] [V] [TRT] Concat_2205 [Concat] outputs: [3070 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Reshape_2206 [Reshape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3057 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3070 [06/20/2022-16:24:47] [V] [TRT] Reshape_2206 [Reshape] inputs: [3057 -> (-1, -1, 1024)[FLOAT]], [3070 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Reshape_2206 for ONNX node: Reshape_2206 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3071 for ONNX tensor: 3071 [06/20/2022-16:24:47] [V] [TRT] Reshape_2206 [Reshape] outputs: [3071 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2207 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3051 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3478 [06/20/2022-16:24:47] [V] [TRT] MatMul_2207 [MatMul] inputs: [3051 -> (-1, -1, 1024)[FLOAT]], [3478 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3478 for ONNX node: 3478 [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2207 for ONNX node: MatMul_2207 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3073 for ONNX tensor: 3073 [06/20/2022-16:24:47] [V] [TRT] MatMul_2207 [MatMul] outputs: [3073 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2208 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.attention.self.value.bias [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3073 [06/20/2022-16:24:47] [V] [TRT] Add_2208 [Add] inputs: [bert.encoder.layer.23.attention.self.value.bias -> (1024)[FLOAT]], [3073 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.attention.self.value.bias for ONNX node: bert.encoder.layer.23.attention.self.value.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2208 for ONNX node: Add_2208 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3074 for ONNX tensor: 3074 [06/20/2022-16:24:47] [V] [TRT] Add_2208 [Add] outputs: [3074 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2209 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3074 [06/20/2022-16:24:47] [V] [TRT] Shape_2209 [Shape] inputs: [3074 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2209 for ONNX node: Shape_2209 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3075 for ONNX tensor: 3075 [06/20/2022-16:24:47] [V] [TRT] Shape_2209 [Shape] outputs: [3075 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2210 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2210 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2210 [Constant] outputs: [3076 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2211 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3075 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3076 [06/20/2022-16:24:47] [V] [TRT] Gather_2211 [Gather] inputs: [3075 -> (3)[INT32]], [3076 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3076 for ONNX node: 3076 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2211 for ONNX node: Gather_2211 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3077 for ONNX tensor: 3077 [06/20/2022-16:24:47] [V] [TRT] Gather_2211 [Gather] outputs: [3077 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2212 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3074 [06/20/2022-16:24:47] [V] [TRT] Shape_2212 [Shape] inputs: [3074 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2212 for ONNX node: Shape_2212 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3078 for ONNX tensor: 3078 [06/20/2022-16:24:47] [V] [TRT] Shape_2212 [Shape] outputs: [3078 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2213 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2213 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2213 [Constant] outputs: [3079 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2214 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3078 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3079 [06/20/2022-16:24:47] [V] [TRT] Gather_2214 [Gather] inputs: [3078 -> (3)[INT32]], [3079 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3079 for ONNX node: 3079 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2214 for ONNX node: Gather_2214 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3080 for ONNX tensor: 3080 [06/20/2022-16:24:47] [V] [TRT] Gather_2214 [Gather] outputs: [3080 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2215 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3077 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2215 [Unsqueeze] inputs: [3077 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2215 for ONNX node: Unsqueeze_2215 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3083 for ONNX tensor: 3083 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2215 [Unsqueeze] outputs: [3083 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2216 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3080 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2216 [Unsqueeze] inputs: [3080 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2216 for ONNX node: Unsqueeze_2216 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3084 for ONNX tensor: 3084 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2216 [Unsqueeze] outputs: [3084 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Concat_2217 [Concat] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3083 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3084 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3479 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3480 [06/20/2022-16:24:47] [V] [TRT] Concat_2217 [Concat] inputs: [3083 -> (1)[INT32]], [3084 -> (1)[INT32]], [3479 -> (1)[INT32]], [3480 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3479 for ONNX node: 3479 [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3480 for ONNX node: 3480 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Concat_2217 for ONNX node: Concat_2217 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3087 for ONNX tensor: 3087 [06/20/2022-16:24:47] [V] [TRT] Concat_2217 [Concat] outputs: [3087 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Reshape_2218 [Reshape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3074 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3087 [06/20/2022-16:24:47] [V] [TRT] Reshape_2218 [Reshape] inputs: [3074 -> (-1, -1, 1024)[FLOAT]], [3087 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Reshape_2218 for ONNX node: Reshape_2218 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3088 for ONNX tensor: 3088 [06/20/2022-16:24:47] [V] [TRT] Reshape_2218 [Reshape] outputs: [3088 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Transpose_2219 [Transpose] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3088 [06/20/2022-16:24:47] [V] [TRT] Transpose_2219 [Transpose] inputs: [3088 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Transpose_2219 for ONNX node: Transpose_2219 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3089 for ONNX tensor: 3089 [06/20/2022-16:24:47] [V] [TRT] Transpose_2219 [Transpose] outputs: [3089 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2220 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3054 [06/20/2022-16:24:47] [V] [TRT] Shape_2220 [Shape] inputs: [3054 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2220 for ONNX node: Shape_2220 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3090 for ONNX tensor: 3090 [06/20/2022-16:24:47] [V] [TRT] Shape_2220 [Shape] outputs: [3090 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2221 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2221 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2221 [Constant] outputs: [3091 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2222 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3090 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3091 [06/20/2022-16:24:47] [V] [TRT] Gather_2222 [Gather] inputs: [3090 -> (3)[INT32]], [3091 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3091 for ONNX node: 3091 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2222 for ONNX node: Gather_2222 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3092 for ONNX tensor: 3092 [06/20/2022-16:24:47] [V] [TRT] Gather_2222 [Gather] outputs: [3092 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2223 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3054 [06/20/2022-16:24:47] [V] [TRT] Shape_2223 [Shape] inputs: [3054 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2223 for ONNX node: Shape_2223 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3093 for ONNX tensor: 3093 [06/20/2022-16:24:47] [V] [TRT] Shape_2223 [Shape] outputs: [3093 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2224 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2224 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2224 [Constant] outputs: [3094 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2225 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3093 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3094 [06/20/2022-16:24:47] [V] [TRT] Gather_2225 [Gather] inputs: [3093 -> (3)[INT32]], [3094 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3094 for ONNX node: 3094 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2225 for ONNX node: Gather_2225 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3095 for ONNX tensor: 3095 [06/20/2022-16:24:47] [V] [TRT] Gather_2225 [Gather] outputs: [3095 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2226 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3092 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2226 [Unsqueeze] inputs: [3092 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2226 for ONNX node: Unsqueeze_2226 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3098 for ONNX tensor: 3098 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2226 [Unsqueeze] outputs: [3098 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2227 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3095 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2227 [Unsqueeze] inputs: [3095 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2227 for ONNX node: Unsqueeze_2227 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3099 for ONNX tensor: 3099 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2227 [Unsqueeze] outputs: [3099 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Concat_2228 [Concat] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3098 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3099 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3481 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3482 [06/20/2022-16:24:47] [V] [TRT] Concat_2228 [Concat] inputs: [3098 -> (1)[INT32]], [3099 -> (1)[INT32]], [3481 -> (1)[INT32]], [3482 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3481 for ONNX node: 3481 [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3482 for ONNX node: 3482 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Concat_2228 for ONNX node: Concat_2228 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3102 for ONNX tensor: 3102 [06/20/2022-16:24:47] [V] [TRT] Concat_2228 [Concat] outputs: [3102 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Reshape_2229 [Reshape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3054 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3102 [06/20/2022-16:24:47] [V] [TRT] Reshape_2229 [Reshape] inputs: [3054 -> (-1, -1, 1024)[FLOAT]], [3102 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Reshape_2229 for ONNX node: Reshape_2229 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3103 for ONNX tensor: 3103 [06/20/2022-16:24:47] [V] [TRT] Reshape_2229 [Reshape] outputs: [3103 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Transpose_2230 [Transpose] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3103 [06/20/2022-16:24:47] [V] [TRT] Transpose_2230 [Transpose] inputs: [3103 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Transpose_2230 for ONNX node: Transpose_2230 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3104 for ONNX tensor: 3104 [06/20/2022-16:24:47] [V] [TRT] Transpose_2230 [Transpose] outputs: [3104 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Transpose_2231 [Transpose] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3071 [06/20/2022-16:24:47] [V] [TRT] Transpose_2231 [Transpose] inputs: [3071 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Transpose_2231 for ONNX node: Transpose_2231 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3105 for ONNX tensor: 3105 [06/20/2022-16:24:47] [V] [TRT] Transpose_2231 [Transpose] outputs: [3105 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2232 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3104 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3105 [06/20/2022-16:24:47] [V] [TRT] MatMul_2232 [MatMul] inputs: [3104 -> (-1, 16, -1, 64)[FLOAT]], [3105 -> (-1, 16, 64, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2232 for ONNX node: MatMul_2232 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3106 for ONNX tensor: 3106 [06/20/2022-16:24:47] [V] [TRT] MatMul_2232 [MatMul] outputs: [3106 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2233 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2233 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2233 [Constant] outputs: [3107 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Div_2234 [Div] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3106 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3107 [06/20/2022-16:24:47] [V] [TRT] Div_2234 [Div] inputs: [3106 -> (-1, 16, -1, -1)[FLOAT]], [3107 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3107 for ONNX node: 3107 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Div_2234 for ONNX node: Div_2234 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3108 for ONNX tensor: 3108 [06/20/2022-16:24:47] [V] [TRT] Div_2234 [Div] outputs: [3108 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2235 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3108 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 401 [06/20/2022-16:24:47] [V] [TRT] Add_2235 [Add] inputs: [3108 -> (-1, 16, -1, -1)[FLOAT]], [401 -> (-1, 1, 1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2235 for ONNX node: Add_2235 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3109 for ONNX tensor: 3109 [06/20/2022-16:24:47] [V] [TRT] Add_2235 [Add] outputs: [3109 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Softmax_2236 [Softmax] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3109 [06/20/2022-16:24:47] [V] [TRT] Softmax_2236 [Softmax] inputs: [3109 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Softmax_2236 for ONNX node: Softmax_2236 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3110 for ONNX tensor: 3110 [06/20/2022-16:24:47] [V] [TRT] Softmax_2236 [Softmax] outputs: [3110 -> (-1, 16, -1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2237 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3110 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3089 [06/20/2022-16:24:47] [V] [TRT] MatMul_2237 [MatMul] inputs: [3110 -> (-1, 16, -1, -1)[FLOAT]], [3089 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2237 for ONNX node: MatMul_2237 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3111 for ONNX tensor: 3111 [06/20/2022-16:24:47] [V] [TRT] MatMul_2237 [MatMul] outputs: [3111 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Transpose_2238 [Transpose] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3111 [06/20/2022-16:24:47] [V] [TRT] Transpose_2238 [Transpose] inputs: [3111 -> (-1, 16, -1, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Transpose_2238 for ONNX node: Transpose_2238 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3112 for ONNX tensor: 3112 [06/20/2022-16:24:47] [V] [TRT] Transpose_2238 [Transpose] outputs: [3112 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2239 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3112 [06/20/2022-16:24:47] [V] [TRT] Shape_2239 [Shape] inputs: [3112 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2239 for ONNX node: Shape_2239 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3113 for ONNX tensor: 3113 [06/20/2022-16:24:47] [V] [TRT] Shape_2239 [Shape] outputs: [3113 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2240 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2240 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2240 [Constant] outputs: [3114 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2241 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3113 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3114 [06/20/2022-16:24:47] [V] [TRT] Gather_2241 [Gather] inputs: [3113 -> (4)[INT32]], [3114 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3114 for ONNX node: 3114 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2241 for ONNX node: Gather_2241 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3115 for ONNX tensor: 3115 [06/20/2022-16:24:47] [V] [TRT] Gather_2241 [Gather] outputs: [3115 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Shape_2242 [Shape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3112 [06/20/2022-16:24:47] [V] [TRT] Shape_2242 [Shape] inputs: [3112 -> (-1, -1, 16, 64)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Shape_2242 for ONNX node: Shape_2242 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3116 for ONNX tensor: 3116 [06/20/2022-16:24:47] [V] [TRT] Shape_2242 [Shape] outputs: [3116 -> (4)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2243 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2243 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2243 [Constant] outputs: [3117 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Gather_2244 [Gather] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3116 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3117 [06/20/2022-16:24:47] [V] [TRT] Gather_2244 [Gather] inputs: [3116 -> (4)[INT32]], [3117 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3117 for ONNX node: 3117 [06/20/2022-16:24:47] [V] [TRT] Using Gather axis: 0 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Gather_2244 for ONNX node: Gather_2244 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3118 for ONNX tensor: 3118 [06/20/2022-16:24:47] [V] [TRT] Gather_2244 [Gather] outputs: [3118 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2245 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3115 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2245 [Unsqueeze] inputs: [3115 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2245 for ONNX node: Unsqueeze_2245 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3120 for ONNX tensor: 3120 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2245 [Unsqueeze] outputs: [3120 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Unsqueeze_2246 [Unsqueeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3118 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2246 [Unsqueeze] inputs: [3118 -> ()[INT32]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Unsqueeze_2246 for ONNX node: Unsqueeze_2246 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3121 for ONNX tensor: 3121 [06/20/2022-16:24:47] [V] [TRT] Unsqueeze_2246 [Unsqueeze] outputs: [3121 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Concat_2247 [Concat] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3120 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3121 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3483 [06/20/2022-16:24:47] [V] [TRT] Concat_2247 [Concat] inputs: [3120 -> (1)[INT32]], [3121 -> (1)[INT32]], [3483 -> (1)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3483 for ONNX node: 3483 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Concat_2247 for ONNX node: Concat_2247 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3123 for ONNX tensor: 3123 [06/20/2022-16:24:47] [V] [TRT] Concat_2247 [Concat] outputs: [3123 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Reshape_2248 [Reshape] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3112 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3123 [06/20/2022-16:24:47] [V] [TRT] Reshape_2248 [Reshape] inputs: [3112 -> (-1, -1, 16, 64)[FLOAT]], [3123 -> (3)[INT32]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Reshape_2248 for ONNX node: Reshape_2248 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3124 for ONNX tensor: 3124 [06/20/2022-16:24:47] [V] [TRT] Reshape_2248 [Reshape] outputs: [3124 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2249 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3124 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3484 [06/20/2022-16:24:47] [V] [TRT] MatMul_2249 [MatMul] inputs: [3124 -> (-1, -1, 1024)[FLOAT]], [3484 -> (1024, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3484 for ONNX node: 3484 [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2249 for ONNX node: MatMul_2249 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3126 for ONNX tensor: 3126 [06/20/2022-16:24:47] [V] [TRT] MatMul_2249 [MatMul] outputs: [3126 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2250 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.attention.output.dense.bias [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3126 [06/20/2022-16:24:47] [V] [TRT] Add_2250 [Add] inputs: [bert.encoder.layer.23.attention.output.dense.bias -> (1024)[FLOAT]], [3126 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.attention.output.dense.bias for ONNX node: bert.encoder.layer.23.attention.output.dense.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2250 for ONNX node: Add_2250 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3127 for ONNX tensor: 3127 [06/20/2022-16:24:47] [V] [TRT] Add_2250 [Add] outputs: [3127 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2251 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3127 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3051 [06/20/2022-16:24:47] [V] [TRT] Add_2251 [Add] inputs: [3127 -> (-1, -1, 1024)[FLOAT]], [3051 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2251 for ONNX node: Add_2251 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3128 for ONNX tensor: 3128 [06/20/2022-16:24:47] [V] [TRT] Add_2251 [Add] outputs: [3128 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: ReduceMean_2252 [ReduceMean] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3128 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2252 [ReduceMean] inputs: [3128 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: ReduceMean_2252 for ONNX node: ReduceMean_2252 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3129 for ONNX tensor: 3129 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2252 [ReduceMean] outputs: [3129 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Sub_2253 [Sub] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3128 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3129 [06/20/2022-16:24:47] [V] [TRT] Sub_2253 [Sub] inputs: [3128 -> (-1, -1, 1024)[FLOAT]], [3129 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Sub_2253 for ONNX node: Sub_2253 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3130 for ONNX tensor: 3130 [06/20/2022-16:24:47] [V] [TRT] Sub_2253 [Sub] outputs: [3130 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2254 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2254 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2254 [Constant] outputs: [3131 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Pow_2255 [Pow] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3130 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3131 [06/20/2022-16:24:47] [V] [TRT] Pow_2255 [Pow] inputs: [3130 -> (-1, -1, 1024)[FLOAT]], [3131 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3131 for ONNX node: 3131 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Pow_2255 for ONNX node: Pow_2255 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3132 for ONNX tensor: 3132 [06/20/2022-16:24:47] [V] [TRT] Pow_2255 [Pow] outputs: [3132 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: ReduceMean_2256 [ReduceMean] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3132 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2256 [ReduceMean] inputs: [3132 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: ReduceMean_2256 for ONNX node: ReduceMean_2256 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3133 for ONNX tensor: 3133 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2256 [ReduceMean] outputs: [3133 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2257 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2257 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2257 [Constant] outputs: [3134 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2258 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3133 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3134 [06/20/2022-16:24:47] [V] [TRT] Add_2258 [Add] inputs: [3133 -> (-1, -1, 1)[FLOAT]], [3134 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3134 for ONNX node: 3134 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2258 for ONNX node: Add_2258 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3135 for ONNX tensor: 3135 [06/20/2022-16:24:47] [V] [TRT] Add_2258 [Add] outputs: [3135 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Sqrt_2259 [Sqrt] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3135 [06/20/2022-16:24:47] [V] [TRT] Sqrt_2259 [Sqrt] inputs: [3135 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Sqrt_2259 for ONNX node: Sqrt_2259 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3136 for ONNX tensor: 3136 [06/20/2022-16:24:47] [V] [TRT] Sqrt_2259 [Sqrt] outputs: [3136 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Div_2260 [Div] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3130 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3136 [06/20/2022-16:24:47] [V] [TRT] Div_2260 [Div] inputs: [3130 -> (-1, -1, 1024)[FLOAT]], [3136 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Div_2260 for ONNX node: Div_2260 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3137 for ONNX tensor: 3137 [06/20/2022-16:24:47] [V] [TRT] Div_2260 [Div] outputs: [3137 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Mul_2261 [Mul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3137 [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.attention.output.LayerNorm.weight [06/20/2022-16:24:47] [V] [TRT] Mul_2261 [Mul] inputs: [3137 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.23.attention.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.attention.output.LayerNorm.weight for ONNX node: bert.encoder.layer.23.attention.output.LayerNorm.weight [06/20/2022-16:24:47] [V] [TRT] Registering layer: Mul_2261 for ONNX node: Mul_2261 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3138 for ONNX tensor: 3138 [06/20/2022-16:24:47] [V] [TRT] Mul_2261 [Mul] outputs: [3138 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2262 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3138 [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.attention.output.LayerNorm.bias [06/20/2022-16:24:47] [V] [TRT] Add_2262 [Add] inputs: [3138 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.23.attention.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.attention.output.LayerNorm.bias for ONNX node: bert.encoder.layer.23.attention.output.LayerNorm.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2262 for ONNX node: Add_2262 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3139 for ONNX tensor: 3139 [06/20/2022-16:24:47] [V] [TRT] Add_2262 [Add] outputs: [3139 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2263 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3139 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3485 [06/20/2022-16:24:47] [V] [TRT] MatMul_2263 [MatMul] inputs: [3139 -> (-1, -1, 1024)[FLOAT]], [3485 -> (1024, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3485 for ONNX node: 3485 [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2263 for ONNX node: MatMul_2263 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3141 for ONNX tensor: 3141 [06/20/2022-16:24:47] [V] [TRT] MatMul_2263 [MatMul] outputs: [3141 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2264 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.intermediate.dense.bias [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3141 [06/20/2022-16:24:47] [V] [TRT] Add_2264 [Add] inputs: [bert.encoder.layer.23.intermediate.dense.bias -> (4096)[FLOAT]], [3141 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.intermediate.dense.bias for ONNX node: bert.encoder.layer.23.intermediate.dense.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2264 for ONNX node: Add_2264 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3142 for ONNX tensor: 3142 [06/20/2022-16:24:47] [V] [TRT] Add_2264 [Add] outputs: [3142 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2265 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2265 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2265 [Constant] outputs: [3143 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Div_2266 [Div] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3142 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3143 [06/20/2022-16:24:47] [V] [TRT] Div_2266 [Div] inputs: [3142 -> (-1, -1, 4096)[FLOAT]], [3143 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3143 for ONNX node: 3143 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Div_2266 for ONNX node: Div_2266 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3144 for ONNX tensor: 3144 [06/20/2022-16:24:47] [V] [TRT] Div_2266 [Div] outputs: [3144 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Erf_2267 [Erf] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3144 [06/20/2022-16:24:47] [V] [TRT] Erf_2267 [Erf] inputs: [3144 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Erf_2267 for ONNX node: Erf_2267 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3145 for ONNX tensor: 3145 [06/20/2022-16:24:47] [V] [TRT] Erf_2267 [Erf] outputs: [3145 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2268 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2268 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2268 [Constant] outputs: [3146 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2269 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3145 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3146 [06/20/2022-16:24:47] [V] [TRT] Add_2269 [Add] inputs: [3145 -> (-1, -1, 4096)[FLOAT]], [3146 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3146 for ONNX node: 3146 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2269 for ONNX node: Add_2269 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3147 for ONNX tensor: 3147 [06/20/2022-16:24:47] [V] [TRT] Add_2269 [Add] outputs: [3147 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Mul_2270 [Mul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3142 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3147 [06/20/2022-16:24:47] [V] [TRT] Mul_2270 [Mul] inputs: [3142 -> (-1, -1, 4096)[FLOAT]], [3147 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Mul_2270 for ONNX node: Mul_2270 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3148 for ONNX tensor: 3148 [06/20/2022-16:24:47] [V] [TRT] Mul_2270 [Mul] outputs: [3148 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2271 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2271 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2271 [Constant] outputs: [3149 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Mul_2272 [Mul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3148 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3149 [06/20/2022-16:24:47] [V] [TRT] Mul_2272 [Mul] inputs: [3148 -> (-1, -1, 4096)[FLOAT]], [3149 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3149 for ONNX node: 3149 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Mul_2272 for ONNX node: Mul_2272 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3150 for ONNX tensor: 3150 [06/20/2022-16:24:47] [V] [TRT] Mul_2272 [Mul] outputs: [3150 -> (-1, -1, 4096)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2273 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3150 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3486 [06/20/2022-16:24:47] [V] [TRT] MatMul_2273 [MatMul] inputs: [3150 -> (-1, -1, 4096)[FLOAT]], [3486 -> (4096, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3486 for ONNX node: 3486 [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2273 for ONNX node: MatMul_2273 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3152 for ONNX tensor: 3152 [06/20/2022-16:24:47] [V] [TRT] MatMul_2273 [MatMul] outputs: [3152 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2274 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.output.dense.bias [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3152 [06/20/2022-16:24:47] [V] [TRT] Add_2274 [Add] inputs: [bert.encoder.layer.23.output.dense.bias -> (1024)[FLOAT]], [3152 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.output.dense.bias for ONNX node: bert.encoder.layer.23.output.dense.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2274 for ONNX node: Add_2274 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3153 for ONNX tensor: 3153 [06/20/2022-16:24:47] [V] [TRT] Add_2274 [Add] outputs: [3153 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2275 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3153 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3139 [06/20/2022-16:24:47] [V] [TRT] Add_2275 [Add] inputs: [3153 -> (-1, -1, 1024)[FLOAT]], [3139 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2275 for ONNX node: Add_2275 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3154 for ONNX tensor: 3154 [06/20/2022-16:24:47] [V] [TRT] Add_2275 [Add] outputs: [3154 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: ReduceMean_2276 [ReduceMean] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3154 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2276 [ReduceMean] inputs: [3154 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: ReduceMean_2276 for ONNX node: ReduceMean_2276 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3155 for ONNX tensor: 3155 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2276 [ReduceMean] outputs: [3155 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Sub_2277 [Sub] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3154 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3155 [06/20/2022-16:24:47] [V] [TRT] Sub_2277 [Sub] inputs: [3154 -> (-1, -1, 1024)[FLOAT]], [3155 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Sub_2277 for ONNX node: Sub_2277 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3156 for ONNX tensor: 3156 [06/20/2022-16:24:47] [V] [TRT] Sub_2277 [Sub] outputs: [3156 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2278 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2278 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2278 [Constant] outputs: [3157 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Pow_2279 [Pow] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3156 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3157 [06/20/2022-16:24:47] [V] [TRT] Pow_2279 [Pow] inputs: [3156 -> (-1, -1, 1024)[FLOAT]], [3157 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3157 for ONNX node: 3157 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Pow_2279 for ONNX node: Pow_2279 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3158 for ONNX tensor: 3158 [06/20/2022-16:24:47] [V] [TRT] Pow_2279 [Pow] outputs: [3158 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: ReduceMean_2280 [ReduceMean] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3158 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2280 [ReduceMean] inputs: [3158 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: ReduceMean_2280 for ONNX node: ReduceMean_2280 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3159 for ONNX tensor: 3159 [06/20/2022-16:24:47] [V] [TRT] ReduceMean_2280 [ReduceMean] outputs: [3159 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Constant_2281 [Constant] [06/20/2022-16:24:47] [V] [TRT] Constant_2281 [Constant] inputs: [06/20/2022-16:24:47] [V] [TRT] Constant_2281 [Constant] outputs: [3160 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2282 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3159 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3160 [06/20/2022-16:24:47] [V] [TRT] Add_2282 [Add] inputs: [3159 -> (-1, -1, 1)[FLOAT]], [3160 -> ()[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3160 for ONNX node: 3160 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2282 for ONNX node: Add_2282 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3161 for ONNX tensor: 3161 [06/20/2022-16:24:47] [V] [TRT] Add_2282 [Add] outputs: [3161 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Sqrt_2283 [Sqrt] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3161 [06/20/2022-16:24:47] [V] [TRT] Sqrt_2283 [Sqrt] inputs: [3161 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Sqrt_2283 for ONNX node: Sqrt_2283 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3162 for ONNX tensor: 3162 [06/20/2022-16:24:47] [V] [TRT] Sqrt_2283 [Sqrt] outputs: [3162 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Div_2284 [Div] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3156 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3162 [06/20/2022-16:24:47] [V] [TRT] Div_2284 [Div] inputs: [3156 -> (-1, -1, 1024)[FLOAT]], [3162 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Div_2284 for ONNX node: Div_2284 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3163 for ONNX tensor: 3163 [06/20/2022-16:24:47] [V] [TRT] Div_2284 [Div] outputs: [3163 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Mul_2285 [Mul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3163 [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.output.LayerNorm.weight [06/20/2022-16:24:47] [V] [TRT] Mul_2285 [Mul] inputs: [3163 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.23.output.LayerNorm.weight -> (1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.output.LayerNorm.weight for ONNX node: bert.encoder.layer.23.output.LayerNorm.weight [06/20/2022-16:24:47] [V] [TRT] Registering layer: Mul_2285 for ONNX node: Mul_2285 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3164 for ONNX tensor: 3164 [06/20/2022-16:24:47] [V] [TRT] Mul_2285 [Mul] outputs: [3164 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2286 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3164 [06/20/2022-16:24:47] [V] [TRT] Searching for input: bert.encoder.layer.23.output.LayerNorm.bias [06/20/2022-16:24:47] [V] [TRT] Add_2286 [Add] inputs: [3164 -> (-1, -1, 1024)[FLOAT]], [bert.encoder.layer.23.output.LayerNorm.bias -> (1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: bert.encoder.layer.23.output.LayerNorm.bias for ONNX node: bert.encoder.layer.23.output.LayerNorm.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2286 for ONNX node: Add_2286 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3165 for ONNX tensor: 3165 [06/20/2022-16:24:47] [V] [TRT] Add_2286 [Add] outputs: [3165 -> (-1, -1, 1024)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: MatMul_2287 [MatMul] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3165 [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3487 [06/20/2022-16:24:47] [V] [TRT] MatMul_2287 [MatMul] inputs: [3165 -> (-1, -1, 1024)[FLOAT]], [3487 -> (1024, 2)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: 3487 for ONNX node: 3487 [06/20/2022-16:24:47] [V] [TRT] Registering layer: MatMul_2287 for ONNX node: MatMul_2287 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3167 for ONNX tensor: 3167 [06/20/2022-16:24:47] [V] [TRT] MatMul_2287 [MatMul] outputs: [3167 -> (-1, -1, 2)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Add_2288 [Add] [06/20/2022-16:24:47] [V] [TRT] Searching for input: qa_outputs.bias [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3167 [06/20/2022-16:24:47] [V] [TRT] Add_2288 [Add] inputs: [qa_outputs.bias -> (2)[FLOAT]], [3167 -> (-1, -1, 2)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: qa_outputs.bias for ONNX node: qa_outputs.bias [06/20/2022-16:24:47] [V] [TRT] Registering layer: Add_2288 for ONNX node: Add_2288 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3168 for ONNX tensor: 3168 [06/20/2022-16:24:47] [V] [TRT] Add_2288 [Add] outputs: [3168 -> (-1, -1, 2)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Split_2289 [Split] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3168 [06/20/2022-16:24:47] [V] [TRT] Split_2289 [Split] inputs: [3168 -> (-1, -1, 2)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Registering layer: Split_2289 for ONNX node: Split_2289 [06/20/2022-16:24:47] [V] [TRT] Registering layer: Split_2289_474 for ONNX node: Split_2289 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3169 for ONNX tensor: 3169 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: 3170 for ONNX tensor: 3170 [06/20/2022-16:24:47] [V] [TRT] Split_2289 [Split] outputs: [3169 -> (-1, -1, 1)[FLOAT]], [3170 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Squeeze_2290 [Squeeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3169 [06/20/2022-16:24:47] [V] [TRT] Squeeze_2290 [Squeeze] inputs: [3169 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (_, _, 1), squeezing to: (_, _) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Squeeze_2290 for ONNX node: Squeeze_2290 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: start_476 for ONNX tensor: start [06/20/2022-16:24:47] [V] [TRT] Squeeze_2290 [Squeeze] outputs: [start -> (-1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Parsing node: Squeeze_2291 [Squeeze] [06/20/2022-16:24:47] [V] [TRT] Searching for input: 3170 [06/20/2022-16:24:47] [V] [TRT] Squeeze_2291 [Squeeze] inputs: [3170 -> (-1, -1, 1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Original shape: (_, _, 1), squeezing to: (_, _) [06/20/2022-16:24:47] [V] [TRT] Registering layer: Squeeze_2291 for ONNX node: Squeeze_2291 [06/20/2022-16:24:47] [V] [TRT] Registering tensor: end_478 for ONNX tensor: end [06/20/2022-16:24:47] [V] [TRT] Squeeze_2291 [Squeeze] outputs: [end -> (-1, -1)[FLOAT]], [06/20/2022-16:24:47] [V] [TRT] Marking start_476 as output: start [06/20/2022-16:24:47] [V] [TRT] Marking end_478 as output: end [06/20/2022-16:24:48] [I] Finish parsing network model [06/20/2022-16:24:48] [V] [TRT] Applying generic optimizations to the graph for inference. [06/20/2022-16:24:48] [V] [TRT] Original: 2446 layers [06/20/2022-16:24:48] [V] [TRT] After dead-layer removal: 2446 layers [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 398 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 398 with (Unnamed Layer* 31) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 400 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 400 with (Unnamed Layer* 34) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 421 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 421 with (Unnamed Layer* 70) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 424 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 424 with (Unnamed Layer* 74) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.embeddings.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.embeddings.LayerNorm.weight with (Unnamed Layer* 79) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.embeddings.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.embeddings.LayerNorm.bias with (Unnamed Layer* 82) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3175 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3175 with (Unnamed Layer* 85) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.attention.self.query.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.attention.self.query.bias with (Unnamed Layer* 88) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3176 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3176 with (Unnamed Layer* 91) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.attention.self.key.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.attention.self.key.bias with (Unnamed Layer* 94) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3179 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3179 with (Unnamed Layer* 109) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.attention.self.value.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.attention.self.value.bias with (Unnamed Layer* 112) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 485 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 485 with (Unnamed Layer* 143) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3185 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3185 with (Unnamed Layer* 175) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.attention.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.attention.output.dense.bias with (Unnamed Layer* 178) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 509 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 509 with (Unnamed Layer* 184) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 512 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 512 with (Unnamed Layer* 188) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.attention.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.attention.output.LayerNorm.weight with (Unnamed Layer* 193) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.attention.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.attention.output.LayerNorm.bias with (Unnamed Layer* 196) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3186 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3186 with (Unnamed Layer* 199) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.intermediate.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.intermediate.dense.bias with (Unnamed Layer* 202) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 521 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 521 with (Unnamed Layer* 205) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 524 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 524 with (Unnamed Layer* 209) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 527 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 527 with (Unnamed Layer* 213) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3187 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3187 with (Unnamed Layer* 216) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.output.dense.bias with (Unnamed Layer* 219) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 535 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 535 with (Unnamed Layer* 225) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 538 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 538 with (Unnamed Layer* 229) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.output.LayerNorm.weight with (Unnamed Layer* 234) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.0.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.0.output.LayerNorm.bias with (Unnamed Layer* 237) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3188 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3188 with (Unnamed Layer* 240) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.attention.self.query.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.attention.self.query.bias with (Unnamed Layer* 243) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3189 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3189 with (Unnamed Layer* 246) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.attention.self.key.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.attention.self.key.bias with (Unnamed Layer* 249) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3192 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3192 with (Unnamed Layer* 264) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.attention.self.value.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.attention.self.value.bias with (Unnamed Layer* 267) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 599 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 599 with (Unnamed Layer* 298) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3198 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3198 with (Unnamed Layer* 330) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.attention.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.attention.output.dense.bias with (Unnamed Layer* 333) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 623 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 623 with (Unnamed Layer* 339) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 626 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 626 with (Unnamed Layer* 343) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.attention.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.attention.output.LayerNorm.weight with (Unnamed Layer* 348) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.attention.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.attention.output.LayerNorm.bias with (Unnamed Layer* 351) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3199 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3199 with (Unnamed Layer* 354) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.intermediate.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.intermediate.dense.bias with (Unnamed Layer* 357) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 635 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 635 with (Unnamed Layer* 360) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 638 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 638 with (Unnamed Layer* 364) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 641 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 641 with (Unnamed Layer* 368) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3200 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3200 with (Unnamed Layer* 371) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.output.dense.bias with (Unnamed Layer* 374) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 649 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 649 with (Unnamed Layer* 380) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 652 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 652 with (Unnamed Layer* 384) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.output.LayerNorm.weight with (Unnamed Layer* 389) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.1.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.1.output.LayerNorm.bias with (Unnamed Layer* 392) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3201 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3201 with (Unnamed Layer* 395) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.attention.self.query.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.attention.self.query.bias with (Unnamed Layer* 398) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3202 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3202 with (Unnamed Layer* 401) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.attention.self.key.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.attention.self.key.bias with (Unnamed Layer* 404) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3205 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3205 with (Unnamed Layer* 419) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.attention.self.value.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.attention.self.value.bias with (Unnamed Layer* 422) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 713 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 713 with (Unnamed Layer* 453) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3211 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3211 with (Unnamed Layer* 485) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.attention.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.attention.output.dense.bias with (Unnamed Layer* 488) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 737 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 737 with (Unnamed Layer* 494) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 740 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 740 with (Unnamed Layer* 498) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.attention.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.attention.output.LayerNorm.weight with (Unnamed Layer* 503) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.attention.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.attention.output.LayerNorm.bias with (Unnamed Layer* 506) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3212 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3212 with (Unnamed Layer* 509) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.intermediate.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.intermediate.dense.bias with (Unnamed Layer* 512) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 749 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 749 with (Unnamed Layer* 515) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 752 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 752 with (Unnamed Layer* 519) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 755 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 755 with (Unnamed Layer* 523) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3213 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3213 with (Unnamed Layer* 526) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.output.dense.bias with (Unnamed Layer* 529) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 763 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 763 with (Unnamed Layer* 535) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 766 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 766 with (Unnamed Layer* 539) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.output.LayerNorm.weight with (Unnamed Layer* 544) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.2.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.2.output.LayerNorm.bias with (Unnamed Layer* 547) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3214 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3214 with (Unnamed Layer* 550) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.attention.self.query.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.attention.self.query.bias with (Unnamed Layer* 553) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3215 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3215 with (Unnamed Layer* 556) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.attention.self.key.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.attention.self.key.bias with (Unnamed Layer* 559) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3218 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3218 with (Unnamed Layer* 574) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.attention.self.value.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.attention.self.value.bias with (Unnamed Layer* 577) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 827 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 827 with (Unnamed Layer* 608) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3224 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3224 with (Unnamed Layer* 640) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.attention.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.attention.output.dense.bias with (Unnamed Layer* 643) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 851 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 851 with (Unnamed Layer* 649) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 854 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 854 with (Unnamed Layer* 653) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.attention.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.attention.output.LayerNorm.weight with (Unnamed Layer* 658) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.attention.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.attention.output.LayerNorm.bias with (Unnamed Layer* 661) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3225 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3225 with (Unnamed Layer* 664) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.intermediate.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.intermediate.dense.bias with (Unnamed Layer* 667) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 863 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 863 with (Unnamed Layer* 670) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 866 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 866 with (Unnamed Layer* 674) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 869 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 869 with (Unnamed Layer* 678) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3226 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3226 with (Unnamed Layer* 681) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.output.dense.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.output.dense.bias with (Unnamed Layer* 684) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 877 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 877 with (Unnamed Layer* 690) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 880 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 880 with (Unnamed Layer* 694) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.output.LayerNorm.weight [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.output.LayerNorm.weight with (Unnamed Layer* 699) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.3.output.LayerNorm.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.3.output.LayerNorm.bias with (Unnamed Layer* 702) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3227 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3227 with (Unnamed Layer* 705) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.attention.self.query.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.attention.self.query.bias with (Unnamed Layer* 708) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on 3228 [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing 3228 with (Unnamed Layer* 711) [Shuffle] [06/20/2022-16:24:48] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.attention.self.key.bias [06/20/2022-16:24:48] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.attention.self.key.bias with (Unnamed Layer* 714) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3231 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3231 with (Unnamed Layer* 729) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.attention.self.value.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.attention.self.value.bias with (Unnamed Layer* 732) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 941 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 941 with (Unnamed Layer* 763) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3237 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3237 with (Unnamed Layer* 795) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.attention.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.attention.output.dense.bias with (Unnamed Layer* 798) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 965 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 965 with (Unnamed Layer* 804) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 968 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 968 with (Unnamed Layer* 808) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.attention.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.attention.output.LayerNorm.weight with (Unnamed Layer* 813) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.attention.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.attention.output.LayerNorm.bias with (Unnamed Layer* 816) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3238 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3238 with (Unnamed Layer* 819) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.intermediate.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.intermediate.dense.bias with (Unnamed Layer* 822) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 977 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 977 with (Unnamed Layer* 825) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 980 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 980 with (Unnamed Layer* 829) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 983 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 983 with (Unnamed Layer* 833) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3239 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3239 with (Unnamed Layer* 836) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.output.dense.bias with (Unnamed Layer* 839) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 991 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 991 with (Unnamed Layer* 845) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 994 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 994 with (Unnamed Layer* 849) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.output.LayerNorm.weight with (Unnamed Layer* 854) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.4.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.4.output.LayerNorm.bias with (Unnamed Layer* 857) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3240 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3240 with (Unnamed Layer* 860) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.attention.self.query.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.attention.self.query.bias with (Unnamed Layer* 863) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3241 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3241 with (Unnamed Layer* 866) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.attention.self.key.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.attention.self.key.bias with (Unnamed Layer* 869) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3244 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3244 with (Unnamed Layer* 884) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.attention.self.value.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.attention.self.value.bias with (Unnamed Layer* 887) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1055 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1055 with (Unnamed Layer* 918) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3250 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3250 with (Unnamed Layer* 950) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.attention.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.attention.output.dense.bias with (Unnamed Layer* 953) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1079 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1079 with (Unnamed Layer* 959) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1082 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1082 with (Unnamed Layer* 963) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.attention.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.attention.output.LayerNorm.weight with (Unnamed Layer* 968) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.attention.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.attention.output.LayerNorm.bias with (Unnamed Layer* 971) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3251 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3251 with (Unnamed Layer* 974) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.intermediate.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.intermediate.dense.bias with (Unnamed Layer* 977) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1091 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1091 with (Unnamed Layer* 980) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1094 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1094 with (Unnamed Layer* 984) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1097 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1097 with (Unnamed Layer* 988) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3252 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3252 with (Unnamed Layer* 991) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.output.dense.bias with (Unnamed Layer* 994) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1105 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1105 with (Unnamed Layer* 1000) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1108 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1108 with (Unnamed Layer* 1004) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.output.LayerNorm.weight with (Unnamed Layer* 1009) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.5.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.5.output.LayerNorm.bias with (Unnamed Layer* 1012) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3253 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3253 with (Unnamed Layer* 1015) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.attention.self.query.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.attention.self.query.bias with (Unnamed Layer* 1018) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3254 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3254 with (Unnamed Layer* 1021) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.attention.self.key.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.attention.self.key.bias with (Unnamed Layer* 1024) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3257 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3257 with (Unnamed Layer* 1039) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.attention.self.value.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.attention.self.value.bias with (Unnamed Layer* 1042) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1169 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1169 with (Unnamed Layer* 1073) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3263 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3263 with (Unnamed Layer* 1105) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.attention.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.attention.output.dense.bias with (Unnamed Layer* 1108) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1193 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1193 with (Unnamed Layer* 1114) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1196 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1196 with (Unnamed Layer* 1118) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.attention.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.attention.output.LayerNorm.weight with (Unnamed Layer* 1123) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.attention.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.attention.output.LayerNorm.bias with (Unnamed Layer* 1126) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3264 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3264 with (Unnamed Layer* 1129) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.intermediate.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.intermediate.dense.bias with (Unnamed Layer* 1132) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1205 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1205 with (Unnamed Layer* 1135) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1208 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1208 with (Unnamed Layer* 1139) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1211 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1211 with (Unnamed Layer* 1143) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3265 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3265 with (Unnamed Layer* 1146) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.output.dense.bias with (Unnamed Layer* 1149) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1219 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1219 with (Unnamed Layer* 1155) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1222 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1222 with (Unnamed Layer* 1159) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.output.LayerNorm.weight with (Unnamed Layer* 1164) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.6.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.6.output.LayerNorm.bias with (Unnamed Layer* 1167) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3266 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3266 with (Unnamed Layer* 1170) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.attention.self.query.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.attention.self.query.bias with (Unnamed Layer* 1173) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3267 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3267 with (Unnamed Layer* 1176) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.attention.self.key.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.attention.self.key.bias with (Unnamed Layer* 1179) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3270 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3270 with (Unnamed Layer* 1194) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.attention.self.value.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.attention.self.value.bias with (Unnamed Layer* 1197) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1283 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1283 with (Unnamed Layer* 1228) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3276 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3276 with (Unnamed Layer* 1260) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.attention.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.attention.output.dense.bias with (Unnamed Layer* 1263) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1307 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1307 with (Unnamed Layer* 1269) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1310 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1310 with (Unnamed Layer* 1273) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.attention.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.attention.output.LayerNorm.weight with (Unnamed Layer* 1278) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.attention.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.attention.output.LayerNorm.bias with (Unnamed Layer* 1281) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3277 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3277 with (Unnamed Layer* 1284) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.intermediate.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.intermediate.dense.bias with (Unnamed Layer* 1287) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1319 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1319 with (Unnamed Layer* 1290) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1322 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1322 with (Unnamed Layer* 1294) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1325 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1325 with (Unnamed Layer* 1298) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3278 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3278 with (Unnamed Layer* 1301) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.output.dense.bias with (Unnamed Layer* 1304) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1333 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1333 with (Unnamed Layer* 1310) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1336 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1336 with (Unnamed Layer* 1314) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.output.LayerNorm.weight with (Unnamed Layer* 1319) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.7.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.7.output.LayerNorm.bias with (Unnamed Layer* 1322) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3279 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3279 with (Unnamed Layer* 1325) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.attention.self.query.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.attention.self.query.bias with (Unnamed Layer* 1328) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3280 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3280 with (Unnamed Layer* 1331) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.attention.self.key.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.attention.self.key.bias with (Unnamed Layer* 1334) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3283 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3283 with (Unnamed Layer* 1349) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.attention.self.value.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.attention.self.value.bias with (Unnamed Layer* 1352) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1397 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1397 with (Unnamed Layer* 1383) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3289 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3289 with (Unnamed Layer* 1415) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.attention.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.attention.output.dense.bias with (Unnamed Layer* 1418) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1421 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1421 with (Unnamed Layer* 1424) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1424 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1424 with (Unnamed Layer* 1428) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.attention.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.attention.output.LayerNorm.weight with (Unnamed Layer* 1433) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.attention.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.attention.output.LayerNorm.bias with (Unnamed Layer* 1436) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3290 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3290 with (Unnamed Layer* 1439) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.intermediate.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.intermediate.dense.bias with (Unnamed Layer* 1442) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1433 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1433 with (Unnamed Layer* 1445) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1436 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1436 with (Unnamed Layer* 1449) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1439 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1439 with (Unnamed Layer* 1453) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3291 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3291 with (Unnamed Layer* 1456) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.output.dense.bias with (Unnamed Layer* 1459) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1447 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1447 with (Unnamed Layer* 1465) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1450 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1450 with (Unnamed Layer* 1469) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.output.LayerNorm.weight with (Unnamed Layer* 1474) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.8.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.8.output.LayerNorm.bias with (Unnamed Layer* 1477) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3292 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3292 with (Unnamed Layer* 1480) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.attention.self.query.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.attention.self.query.bias with (Unnamed Layer* 1483) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3293 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3293 with (Unnamed Layer* 1486) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.attention.self.key.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.attention.self.key.bias with (Unnamed Layer* 1489) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3296 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3296 with (Unnamed Layer* 1504) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.attention.self.value.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.attention.self.value.bias with (Unnamed Layer* 1507) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1511 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1511 with (Unnamed Layer* 1538) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3302 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3302 with (Unnamed Layer* 1570) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.attention.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.attention.output.dense.bias with (Unnamed Layer* 1573) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1535 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1535 with (Unnamed Layer* 1579) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1538 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1538 with (Unnamed Layer* 1583) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.attention.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.attention.output.LayerNorm.weight with (Unnamed Layer* 1588) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.attention.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.attention.output.LayerNorm.bias with (Unnamed Layer* 1591) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3303 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3303 with (Unnamed Layer* 1594) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.intermediate.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.intermediate.dense.bias with (Unnamed Layer* 1597) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1547 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1547 with (Unnamed Layer* 1600) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1550 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1550 with (Unnamed Layer* 1604) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1553 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1553 with (Unnamed Layer* 1608) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3304 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3304 with (Unnamed Layer* 1611) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.output.dense.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.output.dense.bias with (Unnamed Layer* 1614) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1561 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1561 with (Unnamed Layer* 1620) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 1564 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 1564 with (Unnamed Layer* 1624) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.output.LayerNorm.weight [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.output.LayerNorm.weight with (Unnamed Layer* 1629) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.9.output.LayerNorm.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.9.output.LayerNorm.bias with (Unnamed Layer* 1632) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on 3305 [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing 3305 with (Unnamed Layer* 1635) [Shuffle] [06/20/2022-16:24:49] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.attention.self.query.bias [06/20/2022-16:24:49] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.attention.self.query.bias with (Unnamed Layer* 1638) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3306 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3306 with (Unnamed Layer* 1641) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.attention.self.key.bias with (Unnamed Layer* 1644) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3309 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3309 with (Unnamed Layer* 1659) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.attention.self.value.bias with (Unnamed Layer* 1662) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1625 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1625 with (Unnamed Layer* 1693) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3315 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3315 with (Unnamed Layer* 1725) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.attention.output.dense.bias with (Unnamed Layer* 1728) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1649 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1649 with (Unnamed Layer* 1734) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1652 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1652 with (Unnamed Layer* 1738) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.attention.output.LayerNorm.weight with (Unnamed Layer* 1743) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.attention.output.LayerNorm.bias with (Unnamed Layer* 1746) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3316 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3316 with (Unnamed Layer* 1749) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.intermediate.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.intermediate.dense.bias with (Unnamed Layer* 1752) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1661 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1661 with (Unnamed Layer* 1755) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1664 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1664 with (Unnamed Layer* 1759) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1667 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1667 with (Unnamed Layer* 1763) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3317 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3317 with (Unnamed Layer* 1766) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.output.dense.bias with (Unnamed Layer* 1769) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1675 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1675 with (Unnamed Layer* 1775) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1678 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1678 with (Unnamed Layer* 1779) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.output.LayerNorm.weight with (Unnamed Layer* 1784) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.10.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.10.output.LayerNorm.bias with (Unnamed Layer* 1787) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3318 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3318 with (Unnamed Layer* 1790) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.attention.self.query.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.attention.self.query.bias with (Unnamed Layer* 1793) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3319 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3319 with (Unnamed Layer* 1796) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.attention.self.key.bias with (Unnamed Layer* 1799) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3322 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3322 with (Unnamed Layer* 1814) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.attention.self.value.bias with (Unnamed Layer* 1817) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1739 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1739 with (Unnamed Layer* 1848) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3328 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3328 with (Unnamed Layer* 1880) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.attention.output.dense.bias with (Unnamed Layer* 1883) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1763 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1763 with (Unnamed Layer* 1889) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1766 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1766 with (Unnamed Layer* 1893) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.attention.output.LayerNorm.weight with (Unnamed Layer* 1898) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.attention.output.LayerNorm.bias with (Unnamed Layer* 1901) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3329 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3329 with (Unnamed Layer* 1904) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.intermediate.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.intermediate.dense.bias with (Unnamed Layer* 1907) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1775 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1775 with (Unnamed Layer* 1910) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1778 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1778 with (Unnamed Layer* 1914) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1781 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1781 with (Unnamed Layer* 1918) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3330 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3330 with (Unnamed Layer* 1921) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.output.dense.bias with (Unnamed Layer* 1924) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1789 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1789 with (Unnamed Layer* 1930) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1792 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1792 with (Unnamed Layer* 1934) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.output.LayerNorm.weight with (Unnamed Layer* 1939) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.11.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.11.output.LayerNorm.bias with (Unnamed Layer* 1942) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3331 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3331 with (Unnamed Layer* 1945) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.attention.self.query.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.attention.self.query.bias with (Unnamed Layer* 1948) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3332 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3332 with (Unnamed Layer* 1951) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.attention.self.key.bias with (Unnamed Layer* 1954) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3335 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3335 with (Unnamed Layer* 1969) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.attention.self.value.bias with (Unnamed Layer* 1972) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1853 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1853 with (Unnamed Layer* 2003) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3341 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3341 with (Unnamed Layer* 2035) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.attention.output.dense.bias with (Unnamed Layer* 2038) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1877 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1877 with (Unnamed Layer* 2044) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1880 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1880 with (Unnamed Layer* 2048) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.attention.output.LayerNorm.weight with (Unnamed Layer* 2053) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.attention.output.LayerNorm.bias with (Unnamed Layer* 2056) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3342 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3342 with (Unnamed Layer* 2059) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.intermediate.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.intermediate.dense.bias with (Unnamed Layer* 2062) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1889 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1889 with (Unnamed Layer* 2065) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1892 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1892 with (Unnamed Layer* 2069) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1895 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1895 with (Unnamed Layer* 2073) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3343 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3343 with (Unnamed Layer* 2076) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.output.dense.bias with (Unnamed Layer* 2079) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1903 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1903 with (Unnamed Layer* 2085) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1906 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1906 with (Unnamed Layer* 2089) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.output.LayerNorm.weight with (Unnamed Layer* 2094) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.12.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.12.output.LayerNorm.bias with (Unnamed Layer* 2097) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3344 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3344 with (Unnamed Layer* 2100) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.attention.self.query.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.attention.self.query.bias with (Unnamed Layer* 2103) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3345 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3345 with (Unnamed Layer* 2106) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.attention.self.key.bias with (Unnamed Layer* 2109) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3348 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3348 with (Unnamed Layer* 2124) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.attention.self.value.bias with (Unnamed Layer* 2127) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1967 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1967 with (Unnamed Layer* 2158) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3354 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3354 with (Unnamed Layer* 2190) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.attention.output.dense.bias with (Unnamed Layer* 2193) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1991 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1991 with (Unnamed Layer* 2199) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 1994 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 1994 with (Unnamed Layer* 2203) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.attention.output.LayerNorm.weight with (Unnamed Layer* 2208) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.attention.output.LayerNorm.bias with (Unnamed Layer* 2211) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3355 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3355 with (Unnamed Layer* 2214) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.intermediate.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.intermediate.dense.bias with (Unnamed Layer* 2217) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2003 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2003 with (Unnamed Layer* 2220) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2006 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2006 with (Unnamed Layer* 2224) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2009 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2009 with (Unnamed Layer* 2228) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3356 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3356 with (Unnamed Layer* 2231) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.output.dense.bias with (Unnamed Layer* 2234) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2017 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2017 with (Unnamed Layer* 2240) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2020 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2020 with (Unnamed Layer* 2244) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.output.LayerNorm.weight with (Unnamed Layer* 2249) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.13.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.13.output.LayerNorm.bias with (Unnamed Layer* 2252) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3357 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3357 with (Unnamed Layer* 2255) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.attention.self.query.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.attention.self.query.bias with (Unnamed Layer* 2258) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3358 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3358 with (Unnamed Layer* 2261) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.attention.self.key.bias with (Unnamed Layer* 2264) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3361 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3361 with (Unnamed Layer* 2279) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.attention.self.value.bias with (Unnamed Layer* 2282) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2081 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2081 with (Unnamed Layer* 2313) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3367 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3367 with (Unnamed Layer* 2345) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.attention.output.dense.bias with (Unnamed Layer* 2348) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2105 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2105 with (Unnamed Layer* 2354) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2108 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2108 with (Unnamed Layer* 2358) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.attention.output.LayerNorm.weight with (Unnamed Layer* 2363) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.attention.output.LayerNorm.bias with (Unnamed Layer* 2366) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3368 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3368 with (Unnamed Layer* 2369) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.intermediate.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.intermediate.dense.bias with (Unnamed Layer* 2372) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2117 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2117 with (Unnamed Layer* 2375) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2120 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2120 with (Unnamed Layer* 2379) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2123 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2123 with (Unnamed Layer* 2383) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3369 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3369 with (Unnamed Layer* 2386) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.output.dense.bias with (Unnamed Layer* 2389) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2131 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2131 with (Unnamed Layer* 2395) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2134 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2134 with (Unnamed Layer* 2399) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.output.LayerNorm.weight with (Unnamed Layer* 2404) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.14.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.14.output.LayerNorm.bias with (Unnamed Layer* 2407) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3370 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3370 with (Unnamed Layer* 2410) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.attention.self.query.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.attention.self.query.bias with (Unnamed Layer* 2413) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3371 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3371 with (Unnamed Layer* 2416) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.attention.self.key.bias with (Unnamed Layer* 2419) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3374 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3374 with (Unnamed Layer* 2434) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.attention.self.value.bias with (Unnamed Layer* 2437) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2195 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2195 with (Unnamed Layer* 2468) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3380 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3380 with (Unnamed Layer* 2500) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.attention.output.dense.bias with (Unnamed Layer* 2503) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2219 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2219 with (Unnamed Layer* 2509) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2222 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2222 with (Unnamed Layer* 2513) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.attention.output.LayerNorm.weight with (Unnamed Layer* 2518) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.attention.output.LayerNorm.bias with (Unnamed Layer* 2521) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3381 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3381 with (Unnamed Layer* 2524) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.intermediate.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.intermediate.dense.bias with (Unnamed Layer* 2527) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2231 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2231 with (Unnamed Layer* 2530) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2234 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2234 with (Unnamed Layer* 2534) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2237 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2237 with (Unnamed Layer* 2538) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3382 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3382 with (Unnamed Layer* 2541) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.output.dense.bias with (Unnamed Layer* 2544) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2245 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2245 with (Unnamed Layer* 2550) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2248 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2248 with (Unnamed Layer* 2554) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.output.LayerNorm.weight with (Unnamed Layer* 2559) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.15.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.15.output.LayerNorm.bias with (Unnamed Layer* 2562) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3383 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3383 with (Unnamed Layer* 2565) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.attention.self.query.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.attention.self.query.bias with (Unnamed Layer* 2568) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3384 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3384 with (Unnamed Layer* 2571) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.attention.self.key.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.attention.self.key.bias with (Unnamed Layer* 2574) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3387 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3387 with (Unnamed Layer* 2589) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.attention.self.value.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.attention.self.value.bias with (Unnamed Layer* 2592) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2309 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2309 with (Unnamed Layer* 2623) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3393 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3393 with (Unnamed Layer* 2655) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.attention.output.dense.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.attention.output.dense.bias with (Unnamed Layer* 2658) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2333 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2333 with (Unnamed Layer* 2664) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 2336 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 2336 with (Unnamed Layer* 2668) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.attention.output.LayerNorm.weight [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.attention.output.LayerNorm.weight with (Unnamed Layer* 2673) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.attention.output.LayerNorm.bias [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.attention.output.LayerNorm.bias with (Unnamed Layer* 2676) [Shuffle] [06/20/2022-16:24:50] [V] [TRT] Running: ConstShuffleFusion on 3394 [06/20/2022-16:24:50] [V] [TRT] ConstShuffleFusion: Fusing 3394 with (Unnamed Layer* 2679) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.intermediate.dense.bias with (Unnamed Layer* 2682) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2345 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2345 with (Unnamed Layer* 2685) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2348 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2348 with (Unnamed Layer* 2689) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2351 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2351 with (Unnamed Layer* 2693) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3395 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3395 with (Unnamed Layer* 2696) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.output.dense.bias with (Unnamed Layer* 2699) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2359 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2359 with (Unnamed Layer* 2705) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2362 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2362 with (Unnamed Layer* 2709) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.output.LayerNorm.weight with (Unnamed Layer* 2714) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.16.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.16.output.LayerNorm.bias with (Unnamed Layer* 2717) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3396 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3396 with (Unnamed Layer* 2720) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.attention.self.query.bias with (Unnamed Layer* 2723) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3397 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3397 with (Unnamed Layer* 2726) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.attention.self.key.bias with (Unnamed Layer* 2729) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3400 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3400 with (Unnamed Layer* 2744) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.attention.self.value.bias with (Unnamed Layer* 2747) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2423 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2423 with (Unnamed Layer* 2778) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3406 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3406 with (Unnamed Layer* 2810) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.attention.output.dense.bias with (Unnamed Layer* 2813) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2447 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2447 with (Unnamed Layer* 2819) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2450 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2450 with (Unnamed Layer* 2823) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.attention.output.LayerNorm.weight with (Unnamed Layer* 2828) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.attention.output.LayerNorm.bias with (Unnamed Layer* 2831) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3407 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3407 with (Unnamed Layer* 2834) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.intermediate.dense.bias with (Unnamed Layer* 2837) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2459 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2459 with (Unnamed Layer* 2840) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2462 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2462 with (Unnamed Layer* 2844) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2465 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2465 with (Unnamed Layer* 2848) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3408 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3408 with (Unnamed Layer* 2851) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.output.dense.bias with (Unnamed Layer* 2854) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2473 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2473 with (Unnamed Layer* 2860) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2476 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2476 with (Unnamed Layer* 2864) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.output.LayerNorm.weight with (Unnamed Layer* 2869) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.17.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.17.output.LayerNorm.bias with (Unnamed Layer* 2872) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3409 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3409 with (Unnamed Layer* 2875) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.attention.self.query.bias with (Unnamed Layer* 2878) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3410 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3410 with (Unnamed Layer* 2881) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.attention.self.key.bias with (Unnamed Layer* 2884) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3413 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3413 with (Unnamed Layer* 2899) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.attention.self.value.bias with (Unnamed Layer* 2902) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2537 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2537 with (Unnamed Layer* 2933) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3419 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3419 with (Unnamed Layer* 2965) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.attention.output.dense.bias with (Unnamed Layer* 2968) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2561 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2561 with (Unnamed Layer* 2974) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2564 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2564 with (Unnamed Layer* 2978) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.attention.output.LayerNorm.weight with (Unnamed Layer* 2983) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.attention.output.LayerNorm.bias with (Unnamed Layer* 2986) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3420 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3420 with (Unnamed Layer* 2989) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.intermediate.dense.bias with (Unnamed Layer* 2992) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2573 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2573 with (Unnamed Layer* 2995) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2576 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2576 with (Unnamed Layer* 2999) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2579 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2579 with (Unnamed Layer* 3003) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3421 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3421 with (Unnamed Layer* 3006) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.output.dense.bias with (Unnamed Layer* 3009) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2587 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2587 with (Unnamed Layer* 3015) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2590 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2590 with (Unnamed Layer* 3019) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.output.LayerNorm.weight with (Unnamed Layer* 3024) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.18.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.18.output.LayerNorm.bias with (Unnamed Layer* 3027) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3422 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3422 with (Unnamed Layer* 3030) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.attention.self.query.bias with (Unnamed Layer* 3033) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3423 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3423 with (Unnamed Layer* 3036) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.attention.self.key.bias with (Unnamed Layer* 3039) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3426 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3426 with (Unnamed Layer* 3054) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.attention.self.value.bias with (Unnamed Layer* 3057) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2651 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2651 with (Unnamed Layer* 3088) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3432 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3432 with (Unnamed Layer* 3120) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.attention.output.dense.bias with (Unnamed Layer* 3123) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2675 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2675 with (Unnamed Layer* 3129) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2678 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2678 with (Unnamed Layer* 3133) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.attention.output.LayerNorm.weight with (Unnamed Layer* 3138) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.attention.output.LayerNorm.bias with (Unnamed Layer* 3141) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3433 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3433 with (Unnamed Layer* 3144) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.intermediate.dense.bias with (Unnamed Layer* 3147) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2687 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2687 with (Unnamed Layer* 3150) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2690 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2690 with (Unnamed Layer* 3154) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2693 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2693 with (Unnamed Layer* 3158) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3434 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3434 with (Unnamed Layer* 3161) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.output.dense.bias with (Unnamed Layer* 3164) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2701 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2701 with (Unnamed Layer* 3170) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2704 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2704 with (Unnamed Layer* 3174) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.output.LayerNorm.weight with (Unnamed Layer* 3179) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.19.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.19.output.LayerNorm.bias with (Unnamed Layer* 3182) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3435 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3435 with (Unnamed Layer* 3185) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.attention.self.query.bias with (Unnamed Layer* 3188) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3436 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3436 with (Unnamed Layer* 3191) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.attention.self.key.bias with (Unnamed Layer* 3194) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3439 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3439 with (Unnamed Layer* 3209) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.attention.self.value.bias with (Unnamed Layer* 3212) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2765 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2765 with (Unnamed Layer* 3243) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3445 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3445 with (Unnamed Layer* 3275) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.attention.output.dense.bias with (Unnamed Layer* 3278) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2789 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2789 with (Unnamed Layer* 3284) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2792 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2792 with (Unnamed Layer* 3288) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.attention.output.LayerNorm.weight with (Unnamed Layer* 3293) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.attention.output.LayerNorm.bias with (Unnamed Layer* 3296) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3446 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3446 with (Unnamed Layer* 3299) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.intermediate.dense.bias with (Unnamed Layer* 3302) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2801 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2801 with (Unnamed Layer* 3305) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2804 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2804 with (Unnamed Layer* 3309) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2807 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2807 with (Unnamed Layer* 3313) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3447 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3447 with (Unnamed Layer* 3316) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.output.dense.bias with (Unnamed Layer* 3319) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2815 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2815 with (Unnamed Layer* 3325) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2818 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2818 with (Unnamed Layer* 3329) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.output.LayerNorm.weight with (Unnamed Layer* 3334) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.20.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.20.output.LayerNorm.bias with (Unnamed Layer* 3337) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3448 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3448 with (Unnamed Layer* 3340) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.attention.self.query.bias with (Unnamed Layer* 3343) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3449 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3449 with (Unnamed Layer* 3346) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.attention.self.key.bias with (Unnamed Layer* 3349) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3452 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3452 with (Unnamed Layer* 3364) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.attention.self.value.bias with (Unnamed Layer* 3367) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2879 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2879 with (Unnamed Layer* 3398) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3458 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3458 with (Unnamed Layer* 3430) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.attention.output.dense.bias with (Unnamed Layer* 3433) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2903 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2903 with (Unnamed Layer* 3439) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2906 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2906 with (Unnamed Layer* 3443) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.attention.output.LayerNorm.weight with (Unnamed Layer* 3448) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.attention.output.LayerNorm.bias with (Unnamed Layer* 3451) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3459 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3459 with (Unnamed Layer* 3454) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.intermediate.dense.bias with (Unnamed Layer* 3457) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2915 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2915 with (Unnamed Layer* 3460) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2918 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2918 with (Unnamed Layer* 3464) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2921 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2921 with (Unnamed Layer* 3468) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3460 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3460 with (Unnamed Layer* 3471) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.output.dense.bias with (Unnamed Layer* 3474) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2929 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2929 with (Unnamed Layer* 3480) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2932 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2932 with (Unnamed Layer* 3484) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.output.LayerNorm.weight with (Unnamed Layer* 3489) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.21.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.21.output.LayerNorm.bias with (Unnamed Layer* 3492) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3461 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3461 with (Unnamed Layer* 3495) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.attention.self.query.bias with (Unnamed Layer* 3498) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3462 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3462 with (Unnamed Layer* 3501) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.attention.self.key.bias with (Unnamed Layer* 3504) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3465 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3465 with (Unnamed Layer* 3519) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.attention.self.value.bias with (Unnamed Layer* 3522) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 2993 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 2993 with (Unnamed Layer* 3553) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3471 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3471 with (Unnamed Layer* 3585) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.attention.output.dense.bias with (Unnamed Layer* 3588) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3017 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3017 with (Unnamed Layer* 3594) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3020 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3020 with (Unnamed Layer* 3598) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.attention.output.LayerNorm.weight with (Unnamed Layer* 3603) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.attention.output.LayerNorm.bias with (Unnamed Layer* 3606) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3472 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3472 with (Unnamed Layer* 3609) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.intermediate.dense.bias with (Unnamed Layer* 3612) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3029 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3029 with (Unnamed Layer* 3615) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3032 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3032 with (Unnamed Layer* 3619) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3035 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3035 with (Unnamed Layer* 3623) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3473 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3473 with (Unnamed Layer* 3626) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.output.dense.bias with (Unnamed Layer* 3629) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3043 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3043 with (Unnamed Layer* 3635) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3046 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3046 with (Unnamed Layer* 3639) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.output.LayerNorm.weight with (Unnamed Layer* 3644) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.22.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.22.output.LayerNorm.bias with (Unnamed Layer* 3647) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3474 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3474 with (Unnamed Layer* 3650) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.attention.self.query.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.attention.self.query.bias with (Unnamed Layer* 3653) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3475 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3475 with (Unnamed Layer* 3656) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.attention.self.key.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.attention.self.key.bias with (Unnamed Layer* 3659) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3478 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3478 with (Unnamed Layer* 3674) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.attention.self.value.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.attention.self.value.bias with (Unnamed Layer* 3677) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3107 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3107 with (Unnamed Layer* 3708) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3484 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3484 with (Unnamed Layer* 3740) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.attention.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.attention.output.dense.bias with (Unnamed Layer* 3743) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3131 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3131 with (Unnamed Layer* 3749) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3134 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3134 with (Unnamed Layer* 3753) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.attention.output.LayerNorm.weight [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.attention.output.LayerNorm.weight with (Unnamed Layer* 3758) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.attention.output.LayerNorm.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.attention.output.LayerNorm.bias with (Unnamed Layer* 3761) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3485 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3485 with (Unnamed Layer* 3764) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.intermediate.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.intermediate.dense.bias with (Unnamed Layer* 3767) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3143 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3143 with (Unnamed Layer* 3770) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3146 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3146 with (Unnamed Layer* 3774) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3149 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3149 with (Unnamed Layer* 3778) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3486 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3486 with (Unnamed Layer* 3781) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.output.dense.bias [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.output.dense.bias with (Unnamed Layer* 3784) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3157 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3157 with (Unnamed Layer* 3790) [Shuffle] [06/20/2022-16:24:51] [V] [TRT] Running: ConstShuffleFusion on 3160 [06/20/2022-16:24:51] [V] [TRT] ConstShuffleFusion: Fusing 3160 with (Unnamed Layer* 3794) [Shuffle] [06/20/2022-16:24:52] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.output.LayerNorm.weight [06/20/2022-16:24:52] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.output.LayerNorm.weight with (Unnamed Layer* 3799) [Shuffle] [06/20/2022-16:24:52] [V] [TRT] Running: ConstShuffleFusion on bert.encoder.layer.23.output.LayerNorm.bias [06/20/2022-16:24:52] [V] [TRT] ConstShuffleFusion: Fusing bert.encoder.layer.23.output.LayerNorm.bias with (Unnamed Layer* 3802) [Shuffle] [06/20/2022-16:24:52] [V] [TRT] Running: ConstShuffleFusion on 3487 [06/20/2022-16:24:52] [V] [TRT] ConstShuffleFusion: Fusing 3487 with (Unnamed Layer* 3805) [Shuffle] [06/20/2022-16:24:52] [V] [TRT] Running: ConstShuffleFusion on qa_outputs.bias [06/20/2022-16:24:52] [V] [TRT] ConstShuffleFusion: Fusing qa_outputs.bias with (Unnamed Layer* 3808) [Shuffle] [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Unsqueeze_0 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Unsqueeze_0 with Unsqueeze_1 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_67 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_67 with Transpose_68 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_44 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_44 with Transpose_69 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_56 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_56 with Transpose_57 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_76 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_76 with Reshape_86 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_161 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_161 with Transpose_162 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_138 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_138 with Transpose_163 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_150 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_150 with Transpose_151 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_170 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_170 with Reshape_180 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_255 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_255 with Transpose_256 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_232 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_232 with Transpose_257 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_244 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_244 with Transpose_245 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_264 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_264 with Reshape_274 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_349 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_349 with Transpose_350 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_326 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_326 with Transpose_351 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_338 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_338 with Transpose_339 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_358 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_358 with Reshape_368 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_443 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_443 with Transpose_444 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_420 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_420 with Transpose_445 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_432 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_432 with Transpose_433 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_452 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_452 with Reshape_462 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_537 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_537 with Transpose_538 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_514 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_514 with Transpose_539 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_526 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_526 with Transpose_527 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_546 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_546 with Reshape_556 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_631 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_631 with Transpose_632 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_608 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_608 with Transpose_633 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_620 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_620 with Transpose_621 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_640 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_640 with Reshape_650 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_725 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_725 with Transpose_726 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_702 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_702 with Transpose_727 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_714 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_714 with Transpose_715 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_734 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_734 with Reshape_744 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_819 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_819 with Transpose_820 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_796 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_796 with Transpose_821 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_808 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_808 with Transpose_809 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_828 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_828 with Reshape_838 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_913 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_913 with Transpose_914 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_890 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_890 with Transpose_915 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_902 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_902 with Transpose_903 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_922 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_922 with Reshape_932 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1007 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1007 with Transpose_1008 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_984 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_984 with Transpose_1009 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_996 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_996 with Transpose_997 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1016 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1016 with Reshape_1026 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1101 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1101 with Transpose_1102 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1078 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1078 with Transpose_1103 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1090 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1090 with Transpose_1091 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1110 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1110 with Reshape_1120 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1195 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1195 with Transpose_1196 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1172 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1172 with Transpose_1197 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1184 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1184 with Transpose_1185 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1204 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1204 with Reshape_1214 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1289 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1289 with Transpose_1290 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1266 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1266 with Transpose_1291 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1278 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1278 with Transpose_1279 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1298 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1298 with Reshape_1308 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1383 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1383 with Transpose_1384 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1360 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1360 with Transpose_1385 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1372 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1372 with Transpose_1373 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1392 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1392 with Reshape_1402 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1477 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1477 with Transpose_1478 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1454 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1454 with Transpose_1479 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1466 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1466 with Transpose_1467 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1486 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1486 with Reshape_1496 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1571 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1571 with Transpose_1572 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1548 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1548 with Transpose_1573 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1560 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1560 with Transpose_1561 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1580 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1580 with Reshape_1590 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1665 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1665 with Transpose_1666 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1642 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1642 with Transpose_1667 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1654 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1654 with Transpose_1655 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1674 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1674 with Reshape_1684 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1759 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1759 with Transpose_1760 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1736 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1736 with Transpose_1761 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1748 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1748 with Transpose_1749 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1768 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1768 with Reshape_1778 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1853 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1853 with Transpose_1854 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1830 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1830 with Transpose_1855 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1842 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1842 with Transpose_1843 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1862 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1862 with Reshape_1872 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1947 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1947 with Transpose_1948 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1924 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1924 with Transpose_1949 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_1936 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1936 with Transpose_1937 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_1956 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_1956 with Reshape_1966 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2041 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2041 with Transpose_2042 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2018 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2018 with Transpose_2043 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2030 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2030 with Transpose_2031 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_2050 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_2050 with Reshape_2060 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2135 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2135 with Transpose_2136 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2112 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2112 with Transpose_2137 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2124 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2124 with Transpose_2125 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_2144 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_2144 with Reshape_2154 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2229 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2229 with Transpose_2230 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2206 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2206 with Transpose_2231 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Reshape_2218 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_2218 with Transpose_2219 [06/20/2022-16:24:52] [V] [TRT] Running: ShuffleShuffleFusion on Transpose_2238 [06/20/2022-16:24:52] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_2238 with Reshape_2248 [06/20/2022-16:24:53] [V] [TRT] After Myelin optimization: 1 layers [06/20/2022-16:24:53] [V] [TRT] Applying ScaleNodes fusions. [06/20/2022-16:24:53] [V] [TRT] After scale fusion: 1 layers [06/20/2022-16:24:53] [V] [TRT] After dupe layer removal: 1 layers [06/20/2022-16:24:53] [V] [TRT] After final dead-layer removal: 1 layers [06/20/2022-16:24:53] [V] [TRT] After tensor merging: 1 layers [06/20/2022-16:24:53] [V] [TRT] After vertical fusions: 1 layers [06/20/2022-16:24:53] [V] [TRT] After dupe layer removal: 1 layers [06/20/2022-16:24:53] [V] [TRT] After final dead-layer removal: 1 layers [06/20/2022-16:24:53] [V] [TRT] After tensor merging: 1 layers [06/20/2022-16:24:53] [V] [TRT] After slice removal: 1 layers [06/20/2022-16:24:53] [V] [TRT] After concat removal: 1 layers [06/20/2022-16:24:53] [V] [TRT] Trying to split Reshape and strided tensor [06/20/2022-16:24:53] [V] [TRT] Graph construction and optimization completed in 5.23841 seconds. [06/20/2022-16:24:54] [V] [TRT] Using cublasLt as a tactic source [06/20/2022-16:24:54] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +873, GPU +378, now: CPU 2944, GPU 11673 (MiB) [06/20/2022-16:24:54] [V] [TRT] Using cuDNN as a tactic source [06/20/2022-16:24:54] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +126, GPU +60, now: CPU 3070, GPU 11733 (MiB) [06/20/2022-16:24:54] [W] [TRT] TensorRT was linked against cuDNN 8.4.1 but loaded cuDNN 8.4.0 [06/20/2022-16:24:54] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [06/20/2022-16:24:54] [V] [TRT] Constructing optimization profile number 0 [1/1]. [06/20/2022-16:24:54] [V] [TRT] Reserving memory for host IO tensors. Host: 0 bytes [06/20/2022-16:24:54] [V] [TRT] =============== Computing reformatting costs [06/20/2022-16:24:54] [V] [TRT] =============== Computing reformatting costs [06/20/2022-16:24:54] [V] [TRT] =============== Computing reformatting costs [06/20/2022-16:24:54] [V] [TRT] =============== Computing reformatting costs [06/20/2022-16:24:54] [V] [TRT] *************** Autotuning Reformat: Half(128,1) -> Float(128,1) *************** [06/20/2022-16:24:54] [V] [TRT] --------------- Timing Runner: Optimizer Reformat( -> end) (Reformat) [06/20/2022-16:24:54] [V] [TRT] Tactic: 0x00000000000003e8 Time: 0.00447086 [06/20/2022-16:24:54] [V] [TRT] Tactic: 0x00000000000003ea Time: 0.0110614 [06/20/2022-16:24:54] [V] [TRT] Tactic: 0x0000000000000000 Time: 0.0044595 [06/20/2022-16:24:54] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 0.0044595 [06/20/2022-16:24:54] [V] [TRT] =============== Computing reformatting costs [06/20/2022-16:24:54] [V] [TRT] *************** Autotuning Reformat: Half(128,1) -> Float(128,1) *************** [06/20/2022-16:24:54] [V] [TRT] =============== Computing costs for [06/20/2022-16:24:54] [V] [TRT] *************** Autotuning format combination: Int32(128,1), Int32(128,1), Int32(128,1) -> Float(128,1), Float(128,1) *************** [06/20/2022-16:24:54] [V] [TRT] --------------- Timing Runner: {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} (Myelin) [06/20/2022-16:25:32] [V] [TRT] Tactic: 0x0000000000000000 Time: 271.184 [06/20/2022-16:25:32] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 271.184 [06/20/2022-16:25:32] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [06/20/2022-16:25:32] [V] [TRT] *************** Autotuning format combination: Int32(128,1), Int32(128,1), Int32(128,1) -> Half(128,1), Half(128,1) *************** [06/20/2022-16:25:32] [V] [TRT] --------------- Timing Runner: {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} (Myelin) [06/20/2022-16:25:32] [W] [TRT] Weights [name=bert.embeddings.position_embeddings.weight] had the following issues when converted to FP16: [06/20/2022-16:25:32] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:32] [W] [TRT] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [06/20/2022-16:25:32] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.embeddings.word_embeddings.weight] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] - Values less than smallest positive FP16 Subnormal value detected. Converting to FP16 minimum subnormalized value. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.embeddings.token_type_embeddings.weight] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.embeddings.LayerNorm.bias + (Unnamed Layer* 82) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.0.attention.self.key.bias + (Unnamed Layer* 94) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.0.attention.self.value.bias + (Unnamed Layer* 112) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.0.attention.output.dense.bias + (Unnamed Layer* 178) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.0.output.dense.bias + (Unnamed Layer* 219) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.0.output.LayerNorm.bias + (Unnamed Layer* 237) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.1.attention.self.key.bias + (Unnamed Layer* 249) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.1.attention.self.value.bias + (Unnamed Layer* 267) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.1.attention.output.dense.bias + (Unnamed Layer* 333) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.1.attention.output.LayerNorm.bias + (Unnamed Layer* 351) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.1.output.dense.bias + (Unnamed Layer* 374) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.2.attention.self.query.bias + (Unnamed Layer* 398) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.2.attention.self.key.bias + (Unnamed Layer* 404) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.2.attention.self.value.bias + (Unnamed Layer* 422) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.2.intermediate.dense.bias + (Unnamed Layer* 512) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.2.output.dense.bias + (Unnamed Layer* 529) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.3.attention.self.query.bias + (Unnamed Layer* 553) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.3.attention.self.key.bias + (Unnamed Layer* 559) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.3.attention.self.value.bias + (Unnamed Layer* 577) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.3.attention.output.dense.bias + (Unnamed Layer* 643) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.3.intermediate.dense.bias + (Unnamed Layer* 667) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.3.output.dense.bias + (Unnamed Layer* 684) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.4.attention.self.query.bias + (Unnamed Layer* 708) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.4.attention.self.key.bias + (Unnamed Layer* 714) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.4.attention.self.value.bias + (Unnamed Layer* 732) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.4.attention.output.dense.bias + (Unnamed Layer* 798) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.4.attention.output.LayerNorm.bias + (Unnamed Layer* 816) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:33] [W] [TRT] Weights [name=bert.encoder.layer.4.intermediate.dense.bias + (Unnamed Layer* 822) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:33] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:33] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.4.output.dense.bias + (Unnamed Layer* 839) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.4.output.LayerNorm.bias + (Unnamed Layer* 857) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.5.attention.self.query.bias + (Unnamed Layer* 863) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.5.attention.self.key.bias + (Unnamed Layer* 869) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.5.attention.self.value.bias + (Unnamed Layer* 887) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.5.attention.output.dense.bias + (Unnamed Layer* 953) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.5.output.dense.bias + (Unnamed Layer* 994) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.attention.self.query.bias + (Unnamed Layer* 1018) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.attention.self.key.bias + (Unnamed Layer* 1024) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.attention.self.value.bias + (Unnamed Layer* 1042) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.attention.output.dense.bias + (Unnamed Layer* 1108) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.attention.output.LayerNorm.bias + (Unnamed Layer* 1126) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.intermediate.dense.bias + (Unnamed Layer* 1132) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.6.output.dense.bias + (Unnamed Layer* 1149) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.7.attention.self.key.bias + (Unnamed Layer* 1179) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.7.attention.self.value.bias + (Unnamed Layer* 1197) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.7.attention.output.dense.bias + (Unnamed Layer* 1263) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.7.attention.output.LayerNorm.bias + (Unnamed Layer* 1281) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.7.intermediate.dense.bias + (Unnamed Layer* 1287) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.7.output.dense.bias + (Unnamed Layer* 1304) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.8.attention.self.query.bias + (Unnamed Layer* 1328) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.8.attention.self.key.bias + (Unnamed Layer* 1334) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.8.attention.self.value.bias + (Unnamed Layer* 1352) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.8.attention.output.dense.bias + (Unnamed Layer* 1418) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.8.output.LayerNorm.bias + (Unnamed Layer* 1477) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.9.attention.self.query.bias + (Unnamed Layer* 1483) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.9.attention.self.key.bias + (Unnamed Layer* 1489) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.9.attention.self.value.bias + (Unnamed Layer* 1507) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.9.attention.output.dense.bias + (Unnamed Layer* 1573) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.9.attention.output.LayerNorm.bias + (Unnamed Layer* 1591) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.9.output.dense.bias + (Unnamed Layer* 1614) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.10.attention.self.query.bias + (Unnamed Layer* 1638) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.10.attention.self.key.bias + (Unnamed Layer* 1644) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.10.attention.self.value.bias + (Unnamed Layer* 1662) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.10.attention.output.dense.bias + (Unnamed Layer* 1728) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:34] [W] [TRT] Weights [name=bert.encoder.layer.10.attention.output.LayerNorm.bias + (Unnamed Layer* 1746) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:34] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:34] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.10.intermediate.dense.bias + (Unnamed Layer* 1752) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.10.output.dense.bias + (Unnamed Layer* 1769) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.10.output.LayerNorm.bias + (Unnamed Layer* 1787) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.11.attention.self.query.bias + (Unnamed Layer* 1793) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.11.attention.self.key.bias + (Unnamed Layer* 1799) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.11.attention.self.value.bias + (Unnamed Layer* 1817) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.11.intermediate.dense.bias + (Unnamed Layer* 1907) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.11.output.dense.bias + (Unnamed Layer* 1924) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.attention.self.query.bias + (Unnamed Layer* 1948) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.attention.self.key.bias + (Unnamed Layer* 1954) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.attention.self.value.bias + (Unnamed Layer* 1972) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.attention.output.LayerNorm.bias + (Unnamed Layer* 2056) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.intermediate.dense.bias + (Unnamed Layer* 2062) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.output.dense.bias + (Unnamed Layer* 2079) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.12.output.LayerNorm.bias + (Unnamed Layer* 2097) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.13.attention.self.query.bias + (Unnamed Layer* 2103) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.13.attention.self.key.bias + (Unnamed Layer* 2109) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.13.attention.self.value.bias + (Unnamed Layer* 2127) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.13.attention.output.LayerNorm.bias + (Unnamed Layer* 2211) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.13.output.dense.bias + (Unnamed Layer* 2234) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.13.output.LayerNorm.bias + (Unnamed Layer* 2252) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=3361 + (Unnamed Layer* 2279) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.14.attention.self.query.bias + (Unnamed Layer* 2258) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.14.attention.self.key.bias + (Unnamed Layer* 2264) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.14.attention.self.value.bias + (Unnamed Layer* 2282) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.14.attention.output.LayerNorm.bias + (Unnamed Layer* 2366) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.14.output.dense.bias + (Unnamed Layer* 2389) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.15.attention.self.query.bias + (Unnamed Layer* 2413) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.15.attention.self.key.bias + (Unnamed Layer* 2419) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.15.attention.self.value.bias + (Unnamed Layer* 2437) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.15.attention.output.dense.bias + (Unnamed Layer* 2503) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.15.attention.output.LayerNorm.bias + (Unnamed Layer* 2521) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:35] [W] [TRT] Weights [name=bert.encoder.layer.15.intermediate.dense.bias + (Unnamed Layer* 2527) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:35] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:35] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.15.output.dense.bias + (Unnamed Layer* 2544) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.attention.self.query.bias + (Unnamed Layer* 2568) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.attention.self.key.bias + (Unnamed Layer* 2574) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.attention.self.value.bias + (Unnamed Layer* 2592) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.attention.output.dense.bias + (Unnamed Layer* 2658) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.attention.output.LayerNorm.bias + (Unnamed Layer* 2676) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.intermediate.dense.bias + (Unnamed Layer* 2682) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.16.output.dense.bias + (Unnamed Layer* 2699) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.17.attention.self.query.bias + (Unnamed Layer* 2723) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.17.attention.self.key.bias + (Unnamed Layer* 2729) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.17.attention.self.value.bias + (Unnamed Layer* 2747) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.17.attention.output.dense.bias + (Unnamed Layer* 2813) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.17.intermediate.dense.bias + (Unnamed Layer* 2837) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.17.output.dense.bias + (Unnamed Layer* 2854) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.18.attention.self.query.bias + (Unnamed Layer* 2878) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.18.attention.self.key.bias + (Unnamed Layer* 2884) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.18.attention.self.value.bias + (Unnamed Layer* 2902) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.18.attention.output.dense.bias + (Unnamed Layer* 2968) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.18.intermediate.dense.bias + (Unnamed Layer* 2992) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.18.output.LayerNorm.bias + (Unnamed Layer* 3027) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.19.attention.self.query.bias + (Unnamed Layer* 3033) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.19.attention.self.key.bias + (Unnamed Layer* 3039) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.19.intermediate.dense.bias + (Unnamed Layer* 3147) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.19.output.dense.bias + (Unnamed Layer* 3164) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.20.attention.self.query.bias + (Unnamed Layer* 3188) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.20.attention.self.key.bias + (Unnamed Layer* 3194) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.20.attention.self.value.bias + (Unnamed Layer* 3212) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.20.attention.output.dense.bias + (Unnamed Layer* 3278) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:36] [W] [TRT] Weights [name=bert.encoder.layer.20.attention.output.LayerNorm.bias + (Unnamed Layer* 3296) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:36] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:36] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.20.output.LayerNorm.bias + (Unnamed Layer* 3337) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.21.attention.self.query.bias + (Unnamed Layer* 3343) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.21.attention.self.key.bias + (Unnamed Layer* 3349) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.21.attention.self.value.bias + (Unnamed Layer* 3367) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.21.attention.output.dense.bias + (Unnamed Layer* 3433) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.21.intermediate.dense.bias + (Unnamed Layer* 3457) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.attention.self.query.bias + (Unnamed Layer* 3498) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.attention.self.key.bias + (Unnamed Layer* 3504) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.attention.self.value.bias + (Unnamed Layer* 3522) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.attention.output.dense.bias + (Unnamed Layer* 3588) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.intermediate.dense.bias + (Unnamed Layer* 3612) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.output.dense.bias + (Unnamed Layer* 3629) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.22.output.LayerNorm.bias + (Unnamed Layer* 3647) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.attention.self.query.bias + (Unnamed Layer* 3653) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.attention.self.key.bias + (Unnamed Layer* 3659) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.attention.self.value.bias + (Unnamed Layer* 3677) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.attention.output.dense.bias + (Unnamed Layer* 3743) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.attention.output.LayerNorm.bias + (Unnamed Layer* 3761) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.intermediate.dense.bias + (Unnamed Layer* 3767) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=bert.encoder.layer.23.output.dense.bias + (Unnamed Layer* 3784) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:25:37] [W] [TRT] Weights [name=3487 + (Unnamed Layer* 3805) [Shuffle]] had the following issues when converted to FP16: [06/20/2022-16:25:37] [W] [TRT] - Subnormal FP16 values detected. [06/20/2022-16:25:37] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to reduce the magnitude of the weights. [06/20/2022-16:28:46] [V] [TRT] Tactic: 0x0000000000000000 Time: 143.118 [06/20/2022-16:28:46] [V] [TRT] Fastest Tactic: 0x0000000000000000 Time: 143.118 [06/20/2022-16:28:46] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Myelin Tactic: 0x0000000000000000 [06/20/2022-16:28:46] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 0 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} (end) from Half(128,1) to Float(128,1) [06/20/2022-16:28:46] [V] [TRT] Adding reformat layer: Reformatted Output Tensor 1 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} (start) from Half(128,1) to Float(128,1) [06/20/2022-16:28:46] [V] [TRT] Formats and tactics selection completed in 231.71 seconds. [06/20/2022-16:28:46] [V] [TRT] After reformat layers: 3 layers [06/20/2022-16:28:46] [V] [TRT] Pre-optimized block assignment. [06/20/2022-16:28:46] [V] [TRT] Block size 65536 [06/20/2022-16:28:46] [V] [TRT] Block size 65536 [06/20/2022-16:28:46] [V] [TRT] Block size 10485760000 [06/20/2022-16:28:46] [V] [TRT] Total Activation Memory: 10485891072 [06/20/2022-16:28:46] [I] [TRT] Detected 3 inputs and 2 output network tensors. [06/20/2022-16:28:47] [V] [TRT] Layer: {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} Host Persistent: 24 Device Persistent: 0 Scratch Memory: 604045312 [06/20/2022-16:28:47] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 1 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [06/20/2022-16:28:47] [V] [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [06/20/2022-16:28:47] [I] [TRT] Total Host Persistent Memory: 32 [06/20/2022-16:28:47] [I] [TRT] Total Device Persistent Memory: 0 [06/20/2022-16:28:47] [I] [TRT] Total Scratch Memory: 604045312 [06/20/2022-16:28:47] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 637 MiB, GPU 2940 MiB [06/20/2022-16:28:47] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 0.055489ms to assign 3 blocks to 3 nodes requiring 604176384 bytes. [06/20/2022-16:28:47] [V] [TRT] Optimized block assignment. [06/20/2022-16:28:47] [V] [TRT] Block size 604045312 [06/20/2022-16:28:47] [V] [TRT] Block size 65536 [06/20/2022-16:28:47] [V] [TRT] Block size 65536 [06/20/2022-16:28:47] [I] [TRT] Total Activation Memory: 604176384 [06/20/2022-16:28:47] [I] [TRT] (Sparsity) Layers eligible for sparse math: [06/20/2022-16:28:47] [I] [TRT] (Sparsity) TRT inference plan picked sparse implementation for layers: [06/20/2022-16:28:47] [V] [TRT] Disabling unused tactic source: CUDNN [06/20/2022-16:28:47] [V] [TRT] Disabling unused tactic source: CUBLAS, CUBLAS_LT [06/20/2022-16:28:47] [V] [TRT] Disabling unused tactic source: EDGE_MASK_CONVOLUTIONS [06/20/2022-16:28:47] [V] [TRT] Engine generation completed in 234.364 seconds. [06/20/2022-16:28:47] [V] [TRT] Deleting timing cache: 1 entries, served 1 hits since creation. [06/20/2022-16:28:47] [V] [TRT] Engine Layer Information: Layer(Myelin): {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}, Tactic: 0x0000000000000000, input_mask[Int32(256,128)], segment_ids[Int32(256,128)], input_ids[Int32(256,128)] -> Reformatted Output Tensor 0 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}[Half(256,128)], Reformatted Output Tensor 1 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}[Half(256,128)] Layer(Reformat): Reformatting CopyNode for Output Tensor 1 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}, Tactic: 0x0000000000000000, Reformatted Output Tensor 1 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}[Half(256,128)] -> start[Float(256,128)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}, Tactic: 0x0000000000000000, Reformatted Output Tensor 0 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]}[Half(256,128)] -> end[Float(256,128)] [06/20/2022-16:28:47] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +0, GPU +1024, now: CPU 0, GPU 1024 (MiB) [06/20/2022-16:28:47] [W] [TRT] The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. [06/20/2022-16:28:48] [W] [TRT] The getMaxBatchSize() function should not be used with an engine built from a network created with NetworkDefinitionCreationFlag::kEXPLICIT_BATCH flag. This function will always return 1. [06/20/2022-16:28:50] [I] Engine built in 257.725 sec. [06/20/2022-16:28:50] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 2019, GPU 11593 (MiB) [06/20/2022-16:28:50] [I] [TRT] Loaded engine size: 640 MiB [06/20/2022-16:28:50] [V] [TRT] Deserialization required 430265 microseconds. [06/20/2022-16:28:50] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +637, now: CPU 0, GPU 637 (MiB) [06/20/2022-16:28:50] [I] Engine deserialized in 0.481016 sec. [06/20/2022-16:28:50] [V] [TRT] Total per-runner device persistent memory is 0 [06/20/2022-16:28:50] [V] [TRT] Total per-runner host persistent memory is 32 [06/20/2022-16:28:50] [V] [TRT] Allocated activation device memory of size 604176384 [06/20/2022-16:28:51] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +576, now: CPU 0, GPU 1213 (MiB) [06/20/2022-16:28:51] [I] Using random values for input input_ids [06/20/2022-16:28:51] [I] Created input binding for input_ids with dimensions 256x128 [06/20/2022-16:28:51] [I] Using random values for input input_mask [06/20/2022-16:28:51] [I] Created input binding for input_mask with dimensions 256x128 [06/20/2022-16:28:51] [I] Using random values for input segment_ids [06/20/2022-16:28:51] [I] Created input binding for segment_ids with dimensions 256x128 [06/20/2022-16:28:51] [I] Using random values for output start [06/20/2022-16:28:51] [I] Created output binding for start with dimensions 256x128 [06/20/2022-16:28:51] [I] Using random values for output end [06/20/2022-16:28:51] [I] Created output binding for end with dimensions 256x128 [06/20/2022-16:28:51] [I] Starting inference [06/20/2022-16:29:01] [I] Warmup completed 1 queries over 200 ms [06/20/2022-16:29:01] [I] Timing trace has 77 queries over 10.3215 s [06/20/2022-16:29:01] [I] [06/20/2022-16:29:01] [I] === Trace details === [06/20/2022-16:29:01] [I] Trace averages of 10 runs: [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 131.536 ms - Host latency: 131.593 ms (enqueue 0.0805985 ms) [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 131.752 ms - Host latency: 131.808 ms (enqueue 0.0782471 ms) [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 131.971 ms - Host latency: 132.031 ms (enqueue 0.0850586 ms) [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 132.185 ms - Host latency: 132.243 ms (enqueue 0.0772949 ms) [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 132.174 ms - Host latency: 132.232 ms (enqueue 0.0833984 ms) [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 132.387 ms - Host latency: 132.448 ms (enqueue 0.0780273 ms) [06/20/2022-16:29:01] [I] Average on 10 runs - GPU latency: 132.509 ms - Host latency: 132.567 ms (enqueue 0.0790039 ms) [06/20/2022-16:29:01] [I] [06/20/2022-16:29:01] [I] === Performance summary === [06/20/2022-16:29:01] [I] Throughput: 7.46018 qps [06/20/2022-16:29:01] [I] Latency: min = 130.806 ms, max = 133.262 ms, mean = 132.175 ms, median = 132.167 ms, percentile(99%) = 133.262 ms [06/20/2022-16:29:01] [I] Enqueue Time: min = 0.0412445 ms, max = 0.168762 ms, mean = 0.0800791 ms, median = 0.078125 ms, percentile(99%) = 0.168762 ms [06/20/2022-16:29:01] [I] H2D Latency: min = 0.0319824 ms, max = 0.0512695 ms, mean = 0.0381949 ms, median = 0.0375977 ms, percentile(99%) = 0.0512695 ms [06/20/2022-16:29:01] [I] GPU Compute Time: min = 130.75 ms, max = 133.207 ms, mean = 132.117 ms, median = 132.114 ms, percentile(99%) = 133.207 ms [06/20/2022-16:29:01] [I] D2H Latency: min = 0.0185547 ms, max = 0.0222168 ms, mean = 0.0202573 ms, median = 0.0205078 ms, percentile(99%) = 0.0222168 ms [06/20/2022-16:29:01] [I] Total Host Walltime: 10.3215 s [06/20/2022-16:29:01] [I] Total GPU Compute Time: 10.173 s [06/20/2022-16:29:01] [I] Explanations of the performance metrics are printed in the verbose logs. [06/20/2022-16:29:01] [V] [06/20/2022-16:29:01] [V] === Explanations of the performance metrics === [06/20/2022-16:29:01] [V] Total Host Walltime: the host walltime from when the first query (after warmups) is enqueued to when the last query is completed. [06/20/2022-16:29:01] [V] GPU Compute Time: the GPU latency to execute the kernels for a query. [06/20/2022-16:29:01] [V] Total GPU Compute Time: the summation of the GPU Compute Time of all the queries. If this is significantly shorter than Total Host Walltime, the GPU may be under-utilized because of host-side overheads or data transfers. [06/20/2022-16:29:01] [V] Throughput: the observed throughput computed by dividing the number of queries by the Total Host Walltime. If this is significantly lower than the reciprocal of GPU Compute Time, the GPU may be under-utilized because of host-side overheads or data transfers. [06/20/2022-16:29:01] [V] Enqueue Time: the host latency to enqueue a query. If this is longer than GPU Compute Time, the GPU may be under-utilized. [06/20/2022-16:29:01] [V] H2D Latency: the latency for host-to-device data transfers for input tensors of a single query. [06/20/2022-16:29:01] [V] D2H Latency: the latency for device-to-host data transfers for output tensors of a single query. [06/20/2022-16:29:01] [V] Latency: the summation of H2D Latency, GPU Compute Time, and D2H Latency. This is the latency to infer a single query. [06/20/2022-16:29:01] [I] [06/20/2022-16:29:01] [W] [TRT] Skip layer timing collection in CUDA graph capture mode. [06/20/2022-16:29:01] [W] Failed to collect layer timing info from previous enqueueV2() [06/20/2022-16:29:12] [I] [06/20/2022-16:29:12] [I] === Profile (79 iterations ) === [06/20/2022-16:29:12] [I] Layer Time (ms) Avg. Time (ms) Median Time (ms) Time % [06/20/2022-16:29:12] [I] {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} 10505.87 132.9857 133.0514 100.0 [06/20/2022-16:29:12] [I] Reformatting CopyNode for Output Tensor 1 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} 0.58 0.0073 0.0072 0.0 [06/20/2022-16:29:12] [I] Reformatting CopyNode for Output Tensor 0 to {ForeignNode[bert.embeddings.position_embeddings.weight...Squeeze_2290]} 0.57 0.0072 0.0072 0.0 [06/20/2022-16:29:12] [I] Total 10507.02 133.0002 133.0647 100.0 [06/20/2022-16:29:12] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8401] # /workspace/TensorRT/build/out/trtexec --onnx=sparse-bert-large-uncased-squad_opset11.onnx --saveEngine=bs_256_sparse-bert-large-uncased-squad_opset11.trt --duration=10 --workspace=10000 --fp16 --useCudaGraph --dumpProfile --separateProfileRun --sparsity=enable --optShapes=input_mask:256x128,segment_ids:256x128,input_ids:256x128 --verbose