&&&& RUNNING TensorRT.trtexec [TensorRT v8201] # trtexec --explicitBatch --onnx=Bart/temp5/Bart/bart-base/Bart-bart-base.onnx --minShapes=input_ids:16x1 --maxShapes=input_ids:16x32 --optShapes=input_ids:16x16 --buildOnly --saveEngine=gpt.trt --verbose [01/12/2022-09:32:11] [I] === Model Options === [01/12/2022-09:32:11] [I] Format: ONNX [01/12/2022-09:32:11] [I] Model: Bart/temp5/Bart/bart-base/Bart-bart-base.onnx [01/12/2022-09:32:11] [I] Output: [01/12/2022-09:32:11] [I] === Build Options === [01/12/2022-09:32:11] [I] Max batch: explicit batch [01/12/2022-09:32:11] [I] Workspace: 16 MiB [01/12/2022-09:32:11] [I] minTiming: 1 [01/12/2022-09:32:11] [I] avgTiming: 8 [01/12/2022-09:32:11] [I] Precision: FP32 [01/12/2022-09:32:11] [I] Calibration: [01/12/2022-09:32:11] [I] Refit: Disabled [01/12/2022-09:32:11] [I] Sparsity: Disabled [01/12/2022-09:32:11] [I] Safe mode: Disabled [01/12/2022-09:32:11] [I] DirectIO mode: Disabled [01/12/2022-09:32:11] [I] Restricted mode: Disabled [01/12/2022-09:32:11] [I] Save engine: gpt.trt [01/12/2022-09:32:11] [I] Load engine: [01/12/2022-09:32:11] [I] Profiling verbosity: 0 [01/12/2022-09:32:11] [I] Tactic sources: Using default tactic sources [01/12/2022-09:32:11] [I] timingCacheMode: local [01/12/2022-09:32:11] [I] timingCacheFile: [01/12/2022-09:32:11] [I] Input(s)s format: fp32:CHW [01/12/2022-09:32:11] [I] Output(s)s format: fp32:CHW [01/12/2022-09:32:11] [I] Input build shape: input_ids=16x1+16x16+16x32 [01/12/2022-09:32:11] [I] Input calibration shapes: model [01/12/2022-09:32:11] [I] === System Options === [01/12/2022-09:32:11] [I] Device: 0 [01/12/2022-09:32:11] [I] DLACore: [01/12/2022-09:32:11] [I] Plugins: [01/12/2022-09:32:11] [I] === Inference Options === [01/12/2022-09:32:11] [I] Batch: Explicit [01/12/2022-09:32:11] [I] Input inference shape: input_ids=16x16 [01/12/2022-09:32:11] [I] Iterations: 10 [01/12/2022-09:32:11] [I] Duration: 3s (+ 200ms warm up) [01/12/2022-09:32:11] [I] Sleep time: 0ms [01/12/2022-09:32:11] [I] Idle time: 0ms [01/12/2022-09:32:11] [I] Streams: 1 [01/12/2022-09:32:11] [I] ExposeDMA: Disabled [01/12/2022-09:32:11] [I] Data transfers: Enabled [01/12/2022-09:32:11] [I] Spin-wait: Disabled [01/12/2022-09:32:11] [I] Multithreading: Disabled [01/12/2022-09:32:11] [I] CUDA Graph: Disabled [01/12/2022-09:32:11] [I] Separate profiling: Disabled [01/12/2022-09:32:11] [I] Time Deserialize: Disabled [01/12/2022-09:32:11] [I] Time Refit: Disabled [01/12/2022-09:32:11] [I] Skip inference: Enabled [01/12/2022-09:32:11] [I] Inputs: [01/12/2022-09:32:11] [I] === Reporting Options === [01/12/2022-09:32:11] [I] Verbose: Enabled [01/12/2022-09:32:11] [I] Averages: 10 inferences [01/12/2022-09:32:11] [I] Percentile: 99 [01/12/2022-09:32:11] [I] Dump refittable layers:Disabled [01/12/2022-09:32:11] [I] Dump output: Disabled [01/12/2022-09:32:11] [I] Profile: Disabled [01/12/2022-09:32:11] [I] Export timing to JSON file: [01/12/2022-09:32:11] [I] Export output to JSON file: [01/12/2022-09:32:11] [I] Export profile to JSON file: [01/12/2022-09:32:11] [I] [01/12/2022-09:32:11] [I] === Device Information === [01/12/2022-09:32:11] [I] Selected Device: Tesla T4 [01/12/2022-09:32:11] [I] Compute Capability: 7.5 [01/12/2022-09:32:11] [I] SMs: 40 [01/12/2022-09:32:11] [I] Compute Clock Rate: 1.59 GHz [01/12/2022-09:32:11] [I] Device Global Memory: 15109 MiB [01/12/2022-09:32:11] [I] Shared Memory per SM: 64 KiB [01/12/2022-09:32:11] [I] Memory Bus Width: 256 bits (ECC enabled) [01/12/2022-09:32:11] [I] Memory Clock Rate: 5.001 GHz [01/12/2022-09:32:11] [I] [01/12/2022-09:32:11] [I] TensorRT version: 8.2.1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::EfficientNMS_TFTRT_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::Proposal version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [01/12/2022-09:32:11] [V] [TRT] Registered plugin creator - ::Split version 1 [01/12/2022-09:32:12] [I] [TRT] [MemUsageChange] Init CUDA: CPU +321, GPU +0, now: CPU 333, GPU 6844 (MiB) [01/12/2022-09:32:12] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 333 MiB, GPU 6992 MiB [01/12/2022-09:32:13] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 467 MiB, GPU 7026 MiB [01/12/2022-09:32:13] [I] Start parsing network model [01/12/2022-09:32:13] [I] [TRT] ---------------------------------------------------------------- [01/12/2022-09:32:13] [I] [TRT] Input filename: Bart/temp5/Bart/bart-base/Bart-bart-base.onnx [01/12/2022-09:32:13] [I] [TRT] ONNX IR version: 0.0.7 [01/12/2022-09:32:13] [I] [TRT] Opset version: 12 [01/12/2022-09:32:13] [I] [TRT] Producer name: pytorch [01/12/2022-09:32:13] [I] [TRT] Producer version: 1.10 [01/12/2022-09:32:13] [I] [TRT] Domain: [01/12/2022-09:32:13] [I] [TRT] Model version: 0 [01/12/2022-09:32:13] [I] [TRT] Doc string: [01/12/2022-09:32:13] [I] [TRT] ---------------------------------------------------------------- [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TFTRT_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [01/12/2022-09:32:13] [V] [TRT] Plugin creator already registered - ::Split version 1 [01/12/2022-09:32:13] [V] [TRT] Adding network input: input_ids with dtype: int32, dimensions: (-1, -1) [01/12/2022-09:32:13] [V] [TRT] Registering tensor: input_ids for ONNX tensor: input_ids [01/12/2022-09:32:13] [V] [TRT] Importing initializer: shared.weight [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/shared.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.embed_positions.weight [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.embed_positions.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.layers.0.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.0.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.layers.1.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.1.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.layers.2.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.2.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.layers.3.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.3.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.layers.4.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.4.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/encoder.layers.5.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layers.5.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layernorm_embedding.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: encoder.layernorm_embedding.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.embed_positions.weight [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.embed_positions.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.encoder_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.encoder_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.encoder_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.encoder_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.encoder_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.encoder_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.layers.0.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.0.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.encoder_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.encoder_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.encoder_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.encoder_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.encoder_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.encoder_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.layers.1.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.1.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.encoder_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.encoder_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.encoder_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.encoder_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.encoder_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.encoder_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.layers.2.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.2.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.encoder_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.encoder_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.encoder_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.encoder_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.encoder_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.encoder_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.layers.3.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.3.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.encoder_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.encoder_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.encoder_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.encoder_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.encoder_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.encoder_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.layers.4.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.4.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.self_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.self_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.self_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.self_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.self_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.self_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.encoder_attn.k_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.encoder_attn.v_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.encoder_attn.q_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.encoder_attn.out_proj.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.encoder_attn_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.encoder_attn_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/decoder.layers.5.fc1.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.fc2.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.final_layer_norm.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layers.5.final_layer_norm.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layernorm_embedding.weight [01/12/2022-09:32:13] [V] [TRT] Importing initializer: decoder.layernorm_embedding.bias [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2776 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2777 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2778 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2779 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2779 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2780 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2780 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2781 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2782 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2783 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2784 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2784 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2785 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2786 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2787 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2788 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2789 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2790 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2791 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2792 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2793 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2794 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2795 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2796 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2797 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2798 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2799 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2799 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2800 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2800 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2801 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2801 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2802 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2802 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2803 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2803 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2804 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2805 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2806 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2807 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2807 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2808 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2809 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2810 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2811 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2812 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2813 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2814 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2815 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2816 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2817 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2818 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2819 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2820 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2821 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2822 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2822 [01/12/2022-09:32:13] [V] [TRT] Importing initializer: 2823 [01/12/2022-09:32:13] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2823 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2824 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2824 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2825 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2825 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2826 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2826 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2827 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2828 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2829 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2830 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2830 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2831 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2832 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2833 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2834 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2835 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2836 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2837 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2838 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2839 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2840 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2841 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2842 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2843 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2844 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2845 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2845 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2846 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2846 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2847 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2847 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2848 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2848 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2849 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2849 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2850 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2851 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2852 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2853 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2853 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2854 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2855 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2856 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2857 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2858 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2859 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2860 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2861 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2862 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2863 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2864 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2865 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2866 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2867 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2868 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2868 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2869 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2869 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2870 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2870 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2871 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2871 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2872 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2872 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2873 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2874 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2875 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2876 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2876 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2877 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2878 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2879 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2880 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2881 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2882 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2883 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2884 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2885 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2886 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2887 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2888 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2889 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2890 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2891 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2891 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2892 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2892 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2893 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2893 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2894 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2894 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2895 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2895 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2896 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2897 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2898 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2899 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2899 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2900 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2901 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2902 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2903 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2904 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2905 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2906 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2907 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2908 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2909 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2910 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2911 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2912 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2913 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2914 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2914 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2915 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2915 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2916 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2916 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2917 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2918 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2919 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2920 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2921 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2922 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2922 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2923 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2923 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2924 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2925 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2926 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2927 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2927 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2928 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2929 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2930 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2931 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2932 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2933 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2934 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2935 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2936 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2937 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2938 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2939 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2940 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2941 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2942 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2943 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2943 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2944 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2944 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2945 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2945 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2946 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2947 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2948 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2949 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2949 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2950 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2951 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2952 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2953 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2954 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2955 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2956 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2957 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2958 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2959 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2960 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2961 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2962 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2963 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2964 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2964 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2965 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2965 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2966 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2966 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2967 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2967 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2968 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2968 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2969 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2970 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2971 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2972 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2972 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2973 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2974 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2975 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2976 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2977 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2978 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2979 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2980 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2981 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2982 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2983 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2984 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2985 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2986 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2987 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2988 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2988 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2989 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2989 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2990 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2990 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2991 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2992 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2993 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2994 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/2994 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2995 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2996 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2997 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2998 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 2999 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3000 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3001 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3002 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3003 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3004 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3005 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3006 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3007 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3008 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3009 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3009 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3010 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3010 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3011 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3011 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3012 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3012 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3013 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3013 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3014 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3015 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3016 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3017 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3017 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3018 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3019 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3020 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3021 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3022 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3023 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3024 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3025 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3026 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3027 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3028 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3029 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3030 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3031 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3032 [01/12/2022-09:32:14] [V] [TRT] Importing initializer: 3033 [01/12/2022-09:32:14] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3033 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3034 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3034 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3035 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3035 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3036 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3037 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3038 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3039 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3039 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3040 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3041 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3042 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3043 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3044 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3045 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3046 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3047 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3048 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3049 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3050 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3051 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3052 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3053 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3054 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3054 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3055 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3055 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3056 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3056 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3057 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3057 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3058 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3058 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3059 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3060 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3061 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3062 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3062 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3063 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3064 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3065 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3066 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3067 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3068 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3069 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3070 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3071 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3072 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3073 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3074 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3075 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3076 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3077 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3078 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3078 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3079 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3079 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3080 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3080 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3081 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3082 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3083 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3084 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3084 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3085 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3086 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3087 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3088 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3089 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3090 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3091 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3092 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3093 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3094 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3095 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3096 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3097 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3098 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3099 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3099 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3100 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3100 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3101 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3101 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3102 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3102 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3103 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3103 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3104 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3105 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3106 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3107 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3107 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3108 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3109 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3110 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3111 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3112 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3113 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3114 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3115 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3116 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3117 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3118 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3119 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3120 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3121 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3122 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3123 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3123 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3124 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3124 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3125 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3125 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3126 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3127 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3128 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3129 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3129 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3130 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3131 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3132 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3133 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3134 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3135 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3136 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3137 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3138 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3139 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3140 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3141 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3142 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3143 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3144 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3144 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3145 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3145 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3146 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3146 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3147 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3147 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3148 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3148 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3149 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3150 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3151 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3152 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3152 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3153 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3154 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3155 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3156 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3157 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3158 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3159 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3160 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3161 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3162 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3163 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3164 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3165 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3166 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3167 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3168 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3168 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3169 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3169 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3170 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3170 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3171 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3172 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3173 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3174 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3174 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3175 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3176 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3177 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3178 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3179 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3180 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3181 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3182 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3183 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3184 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3185 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3186 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3187 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3188 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3189 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3189 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3190 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3190 [01/12/2022-09:32:15] [V] [TRT] Importing initializer: 3191 [01/12/2022-09:32:15] [V] [TRT] Reading weights from external file: Bart/temp5/Bart/bart-base/3191 [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_0 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: input_ids [01/12/2022-09:32:15] [V] [TRT] Shape_0 [Shape] inputs: [input_ids -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_0 for ONNX node: Shape_0 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 260 for ONNX tensor: 260 [01/12/2022-09:32:15] [V] [TRT] Shape_0 [Shape] outputs: [260 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_1 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_1 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_1 [Constant] outputs: [261 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_2 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 260 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 261 [01/12/2022-09:32:15] [V] [TRT] Gather_2 [Gather] inputs: [260 -> (2)[INT32]], [261 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 261 for ONNX node: 261 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_2 for ONNX node: Gather_2 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 262 for ONNX tensor: 262 [01/12/2022-09:32:15] [V] [TRT] Gather_2 [Gather] outputs: [262 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_3 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: input_ids [01/12/2022-09:32:15] [V] [TRT] Shape_3 [Shape] inputs: [input_ids -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_3 for ONNX node: Shape_3 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 263 for ONNX tensor: 263 [01/12/2022-09:32:15] [V] [TRT] Shape_3 [Shape] outputs: [263 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_4 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_4 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_4 [Constant] outputs: [264 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_5 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 263 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 264 [01/12/2022-09:32:15] [V] [TRT] Gather_5 [Gather] inputs: [263 -> (2)[INT32]], [264 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 264 for ONNX node: 264 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_5 for ONNX node: Gather_5 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 265 for ONNX tensor: 265 [01/12/2022-09:32:15] [V] [TRT] Gather_5 [Gather] outputs: [265 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_6 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 262 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_6 [Unsqueeze] inputs: [262 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_6 for ONNX node: Unsqueeze_6 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 266 for ONNX tensor: 266 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_6 [Unsqueeze] outputs: [266 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_7 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 265 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_7 [Unsqueeze] inputs: [265 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_7 for ONNX node: Unsqueeze_7 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 267 for ONNX tensor: 267 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_7 [Unsqueeze] outputs: [267 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Concat_8 [Concat] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 266 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 267 [01/12/2022-09:32:15] [V] [TRT] Concat_8 [Concat] inputs: [266 -> (1)[INT32]], [267 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Concat_8 for ONNX node: Concat_8 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 268 for ONNX tensor: 268 [01/12/2022-09:32:15] [V] [TRT] Concat_8 [Concat] outputs: [268 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ConstantOfShape_9 [ConstantOfShape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 268 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_9 [ConstantOfShape] inputs: [268 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ConstantOfShape_9 for ONNX node: ConstantOfShape_9 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 269 for ONNX tensor: 269 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_9 [ConstantOfShape] outputs: [269 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_10 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_10 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_10 [Constant] outputs: [270 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_11 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_11 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_11 [Constant] outputs: [271 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_12 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_12 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_12 [Constant] outputs: [272 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_13 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_13 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_13 [Constant] outputs: [273 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Slice_14 [Slice] [01/12/2022-09:32:15] [V] [TRT] Searching for input: input_ids [01/12/2022-09:32:15] [V] [TRT] Searching for input: 271 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 272 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 270 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 273 [01/12/2022-09:32:15] [V] [TRT] Slice_14 [Slice] inputs: [input_ids -> (-1, -1)[INT32]], [271 -> (1)[INT32]], [272 -> (1)[INT32]], [270 -> (1)[INT32]], [273 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Slice_14 for ONNX node: Slice_14 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 274 for ONNX tensor: 274 [01/12/2022-09:32:15] [V] [TRT] Slice_14 [Slice] outputs: [274 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_15 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_15 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_15 [Constant] outputs: [275 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_16 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_16 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_16 [Constant] outputs: [276 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_17 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_17 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [01/12/2022-09:32:15] [V] [TRT] Constant_17 [Constant] outputs: [277 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_18 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_18 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_18 [Constant] outputs: [278 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Slice_19 [Slice] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 269 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 276 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 277 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 275 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 278 [01/12/2022-09:32:15] [V] [TRT] Slice_19 [Slice] inputs: [269 -> (-1, -1)[INT32]], [276 -> (1)[INT32]], [277 -> (1)[INT32]], [275 -> (1)[INT32]], [278 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Slice_19 for ONNX node: Slice_19 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 279 for ONNX tensor: 279 [01/12/2022-09:32:15] [V] [TRT] Slice_19 [Slice] outputs: [279 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_20 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 279 [01/12/2022-09:32:15] [V] [TRT] Shape_20 [Shape] inputs: [279 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_20 for ONNX node: Shape_20 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 280 for ONNX tensor: 280 [01/12/2022-09:32:15] [V] [TRT] Shape_20 [Shape] outputs: [280 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Expand_21 [Expand] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 274 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 280 [01/12/2022-09:32:15] [V] [TRT] Expand_21 [Expand] inputs: [274 -> (-1, -1)[INT32]], [280 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Expand_21 for ONNX node: Expand_21 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 281 for ONNX tensor: 281 [01/12/2022-09:32:15] [V] [TRT] Expand_21 [Expand] outputs: [281 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_22 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 269 [01/12/2022-09:32:15] [V] [TRT] Shape_22 [Shape] inputs: [269 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_22 for ONNX node: Shape_22 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 282 for ONNX tensor: 282 [01/12/2022-09:32:15] [V] [TRT] Shape_22 [Shape] outputs: [282 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_23 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_23 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_23 [Constant] outputs: [283 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_24 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 282 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 283 [01/12/2022-09:32:15] [V] [TRT] Gather_24 [Gather] inputs: [282 -> (2)[INT32]], [283 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 283 for ONNX node: 283 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_24 for ONNX node: Gather_24 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 284 for ONNX tensor: 284 [01/12/2022-09:32:15] [V] [TRT] Gather_24 [Gather] outputs: [284 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Cast_25 [Cast] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 284 [01/12/2022-09:32:15] [V] [TRT] Cast_25 [Cast] inputs: [284 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Casting to type: int32 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Cast_25 for ONNX node: Cast_25 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 285 for ONNX tensor: 285 [01/12/2022-09:32:15] [V] [TRT] Cast_25 [Cast] outputs: [285 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_26 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_26 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_26 [Constant] outputs: [286 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_27 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_27 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_27 [Constant] outputs: [287 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Range_28 [Range] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 286 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 285 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 287 [01/12/2022-09:32:15] [V] [TRT] Range_28 [Range] inputs: [286 -> ()[INT32]], [285 -> ()[INT32]], [287 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Range_28 for ONNX node: Range_28 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 288 for ONNX tensor: 288 [01/12/2022-09:32:15] [V] [TRT] Range_28 [Range] outputs: [288 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_29 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 269 [01/12/2022-09:32:15] [V] [TRT] Shape_29 [Shape] inputs: [269 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_29 for ONNX node: Shape_29 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 289 for ONNX tensor: 289 [01/12/2022-09:32:15] [V] [TRT] Shape_29 [Shape] outputs: [289 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_30 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_30 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_30 [Constant] outputs: [290 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_31 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 289 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 290 [01/12/2022-09:32:15] [V] [TRT] Gather_31 [Gather] inputs: [289 -> (2)[INT32]], [290 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 290 for ONNX node: 290 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_31 for ONNX node: Gather_31 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 291 for ONNX tensor: 291 [01/12/2022-09:32:15] [V] [TRT] Gather_31 [Gather] outputs: [291 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Cast_32 [Cast] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 291 [01/12/2022-09:32:15] [V] [TRT] Cast_32 [Cast] inputs: [291 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Casting to type: int32 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Cast_32 for ONNX node: Cast_32 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 292 for ONNX tensor: 292 [01/12/2022-09:32:15] [V] [TRT] Cast_32 [Cast] outputs: [292 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_33 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_33 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_33 [Constant] outputs: [293 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_34 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_34 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_34 [Constant] outputs: [294 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Range_35 [Range] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 293 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 292 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 294 [01/12/2022-09:32:15] [V] [TRT] Range_35 [Range] inputs: [293 -> ()[INT32]], [292 -> ()[INT32]], [294 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Range_35 for ONNX node: Range_35 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 295 for ONNX tensor: 295 [01/12/2022-09:32:15] [V] [TRT] Range_35 [Range] outputs: [295 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_36 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_36 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_36 [Constant] outputs: [296 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_37 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_37 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_37 [Constant] outputs: [297 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_38 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_38 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [01/12/2022-09:32:15] [V] [TRT] Constant_38 [Constant] outputs: [298 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_39 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_39 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_39 [Constant] outputs: [299 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Slice_40 [Slice] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 295 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 297 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 298 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 296 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 299 [01/12/2022-09:32:15] [V] [TRT] Slice_40 [Slice] inputs: [295 -> (-1)[INT32]], [297 -> (1)[INT32]], [298 -> (1)[INT32]], [296 -> (1)[INT32]], [299 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Slice_40 for ONNX node: Slice_40 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 300 for ONNX tensor: 300 [01/12/2022-09:32:15] [V] [TRT] Slice_40 [Slice] outputs: [300 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_41 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_41 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_41 [Constant] outputs: [301 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Reshape_42 [Reshape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 288 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 301 [01/12/2022-09:32:15] [V] [TRT] Reshape_42 [Reshape] inputs: [288 -> (-1)[INT32]], [301 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Reshape_42 for ONNX node: Reshape_42 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 302 for ONNX tensor: 302 [01/12/2022-09:32:15] [V] [TRT] Reshape_42 [Reshape] outputs: [302 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_43 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 302 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 300 [01/12/2022-09:32:15] [V] [TRT] Add_43 [Add] inputs: [302 -> (-1, 1)[INT32]], [300 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_43 for ONNX node: Add_43 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 303 for ONNX tensor: 303 [01/12/2022-09:32:15] [V] [TRT] Add_43 [Add] outputs: [303 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_44 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 303 [01/12/2022-09:32:15] [V] [TRT] Shape_44 [Shape] inputs: [303 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_44 for ONNX node: Shape_44 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 304 for ONNX tensor: 304 [01/12/2022-09:32:15] [V] [TRT] Shape_44 [Shape] outputs: [304 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_45 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Shape_45 [Shape] inputs: [304 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_45 for ONNX node: Shape_45 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 305 for ONNX tensor: 305 [01/12/2022-09:32:15] [V] [TRT] Shape_45 [Shape] outputs: [305 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ConstantOfShape_46 [ConstantOfShape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 305 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_46 [ConstantOfShape] inputs: [305 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ConstantOfShape_46 for ONNX node: ConstantOfShape_46 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 306 for ONNX tensor: 306 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_46 [ConstantOfShape] outputs: [306 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_47 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_47 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_47 [Constant] outputs: [307 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_48 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 306 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 307 [01/12/2022-09:32:15] [V] [TRT] Mul_48 [Mul] inputs: [306 -> (2)[INT32]], [307 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 307 for ONNX node: 307 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_48 for ONNX node: Mul_48 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 308 for ONNX tensor: 308 [01/12/2022-09:32:15] [V] [TRT] Mul_48 [Mul] outputs: [308 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Equal_49 [Equal] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 308 [01/12/2022-09:32:15] [V] [TRT] Equal_49 [Equal] inputs: [304 -> (2)[INT32]], [308 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Equal_49 for ONNX node: Equal_49 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 309 for ONNX tensor: 309 [01/12/2022-09:32:15] [V] [TRT] Equal_49 [Equal] outputs: [309 -> (2)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Where_50 [Where] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 309 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 306 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Where_50 [Where] inputs: [309 -> (2)[BOOL]], [306 -> (2)[INT32]], [304 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Where_50 for ONNX node: Where_50 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 310 for ONNX tensor: 310 [01/12/2022-09:32:15] [V] [TRT] Where_50 [Where] outputs: [310 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Expand_51 [Expand] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 302 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 310 [01/12/2022-09:32:15] [V] [TRT] Expand_51 [Expand] inputs: [302 -> (-1, 1)[INT32]], [310 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Expand_51 for ONNX node: Expand_51 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 311 for ONNX tensor: 311 [01/12/2022-09:32:15] [V] [TRT] Expand_51 [Expand] outputs: [311 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_52 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 311 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_52 [Unsqueeze] inputs: [311 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_52 for ONNX node: Unsqueeze_52 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 312 for ONNX tensor: 312 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_52 [Unsqueeze] outputs: [312 -> (-1, -1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_53 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Shape_53 [Shape] inputs: [304 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_53 for ONNX node: Shape_53 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 313 for ONNX tensor: 313 [01/12/2022-09:32:15] [V] [TRT] Shape_53 [Shape] outputs: [313 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ConstantOfShape_54 [ConstantOfShape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 313 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_54 [ConstantOfShape] inputs: [313 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ConstantOfShape_54 for ONNX node: ConstantOfShape_54 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 314 for ONNX tensor: 314 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_54 [ConstantOfShape] outputs: [314 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_55 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_55 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_55 [Constant] outputs: [315 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_56 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 314 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 315 [01/12/2022-09:32:15] [V] [TRT] Mul_56 [Mul] inputs: [314 -> (2)[INT32]], [315 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 315 for ONNX node: 315 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_56 for ONNX node: Mul_56 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 316 for ONNX tensor: 316 [01/12/2022-09:32:15] [V] [TRT] Mul_56 [Mul] outputs: [316 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Equal_57 [Equal] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 316 [01/12/2022-09:32:15] [V] [TRT] Equal_57 [Equal] inputs: [304 -> (2)[INT32]], [316 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Equal_57 for ONNX node: Equal_57 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 317 for ONNX tensor: 317 [01/12/2022-09:32:15] [V] [TRT] Equal_57 [Equal] outputs: [317 -> (2)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Where_58 [Where] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 317 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 314 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Where_58 [Where] inputs: [317 -> (2)[BOOL]], [314 -> (2)[INT32]], [304 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Where_58 for ONNX node: Where_58 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 318 for ONNX tensor: 318 [01/12/2022-09:32:15] [V] [TRT] Where_58 [Where] outputs: [318 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Expand_59 [Expand] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 300 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 318 [01/12/2022-09:32:15] [V] [TRT] Expand_59 [Expand] inputs: [300 -> (-1)[INT32]], [318 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Expand_59 for ONNX node: Expand_59 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 319 for ONNX tensor: 319 [01/12/2022-09:32:15] [V] [TRT] Expand_59 [Expand] outputs: [319 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_60 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 319 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_60 [Unsqueeze] inputs: [319 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_60 for ONNX node: Unsqueeze_60 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 320 for ONNX tensor: 320 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_60 [Unsqueeze] outputs: [320 -> (-1, -1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Concat_61 [Concat] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 312 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 320 [01/12/2022-09:32:15] [V] [TRT] Concat_61 [Concat] inputs: [312 -> (-1, -1, 1)[INT32]], [320 -> (-1, -1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Concat_61 for ONNX node: Concat_61 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 321 for ONNX tensor: 321 [01/12/2022-09:32:15] [V] [TRT] Concat_61 [Concat] outputs: [321 -> (-1, -1, 2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_62 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 269 [01/12/2022-09:32:15] [V] [TRT] Shape_62 [Shape] inputs: [269 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_62 for ONNX node: Shape_62 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 322 for ONNX tensor: 322 [01/12/2022-09:32:15] [V] [TRT] Shape_62 [Shape] outputs: [322 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_63 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_63 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_63 [Constant] outputs: [323 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_64 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_64 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_64 [Constant] outputs: [324 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_65 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_65 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [01/12/2022-09:32:15] [V] [TRT] Constant_65 [Constant] outputs: [325 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Slice_66 [Slice] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 322 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 324 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 325 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 323 [01/12/2022-09:32:15] [V] [TRT] Slice_66 [Slice] inputs: [322 -> (2)[INT32]], [324 -> (1)[INT32]], [325 -> (1)[INT32]], [323 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Slice_66 for ONNX node: Slice_66 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 326 for ONNX tensor: 326 [01/12/2022-09:32:15] [V] [TRT] Slice_66 [Slice] outputs: [326 -> (0)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Concat_67 [Concat] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 304 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 326 [01/12/2022-09:32:15] [V] [TRT] Concat_67 [Concat] inputs: [304 -> (2)[INT32]], [326 -> (0)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Concat_67 for ONNX node: Concat_67 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 327 for ONNX tensor: 327 [01/12/2022-09:32:15] [V] [TRT] Concat_67 [Concat] outputs: [327 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Reshape_68 [Reshape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 281 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 327 [01/12/2022-09:32:15] [V] [TRT] Reshape_68 [Reshape] inputs: [281 -> (-1, -1)[INT32]], [327 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Reshape_68 for ONNX node: Reshape_68 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 328 for ONNX tensor: 328 [01/12/2022-09:32:15] [V] [TRT] Reshape_68 [Reshape] outputs: [328 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ScatterND_69 [ScatterND] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 269 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 321 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 328 [01/12/2022-09:32:15] [V] [TRT] ScatterND_69 [ScatterND] inputs: [269 -> (-1, -1)[INT32]], [321 -> (-1, -1, 2)[INT32]], [328 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ScatterND_69 for ONNX node: ScatterND_69 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 329 for ONNX tensor: 329 [01/12/2022-09:32:15] [V] [TRT] ScatterND_69 [ScatterND] outputs: [329 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_70 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_70 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_70 [Constant] outputs: [330 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_71 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 329 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 330 [01/12/2022-09:32:15] [V] [TRT] Gather_71 [Gather] inputs: [329 -> (-1, -1)[INT32]], [330 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 330 for ONNX node: 330 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 1 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_71 for ONNX node: Gather_71 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 331 for ONNX tensor: 331 [01/12/2022-09:32:15] [V] [TRT] Gather_71 [Gather] outputs: [331 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_72 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 331 [01/12/2022-09:32:15] [V] [TRT] Shape_72 [Shape] inputs: [331 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_72 for ONNX node: Shape_72 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 332 for ONNX tensor: 332 [01/12/2022-09:32:15] [V] [TRT] Shape_72 [Shape] outputs: [332 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ConstantOfShape_73 [ConstantOfShape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 332 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_73 [ConstantOfShape] inputs: [332 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ConstantOfShape_73 for ONNX node: ConstantOfShape_73 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 333 for ONNX tensor: 333 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_73 [ConstantOfShape] outputs: [333 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_74 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 331 [01/12/2022-09:32:15] [V] [TRT] Shape_74 [Shape] inputs: [331 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_74 for ONNX node: Shape_74 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 334 for ONNX tensor: 334 [01/12/2022-09:32:15] [V] [TRT] Shape_74 [Shape] outputs: [334 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Expand_75 [Expand] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 333 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 334 [01/12/2022-09:32:15] [V] [TRT] Expand_75 [Expand] inputs: [333 -> (-1)[INT32]], [334 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Expand_75 for ONNX node: Expand_75 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 335 for ONNX tensor: 335 [01/12/2022-09:32:15] [V] [TRT] Expand_75 [Expand] outputs: [335 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_76 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 329 [01/12/2022-09:32:15] [V] [TRT] Shape_76 [Shape] inputs: [329 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_76 for ONNX node: Shape_76 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 336 for ONNX tensor: 336 [01/12/2022-09:32:15] [V] [TRT] Shape_76 [Shape] outputs: [336 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_77 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_77 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_77 [Constant] outputs: [337 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_78 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 336 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 337 [01/12/2022-09:32:15] [V] [TRT] Gather_78 [Gather] inputs: [336 -> (2)[INT32]], [337 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 337 for ONNX node: 337 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_78 for ONNX node: Gather_78 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 338 for ONNX tensor: 338 [01/12/2022-09:32:15] [V] [TRT] Gather_78 [Gather] outputs: [338 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Cast_79 [Cast] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 338 [01/12/2022-09:32:15] [V] [TRT] Cast_79 [Cast] inputs: [338 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Casting to type: int32 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Cast_79 for ONNX node: Cast_79 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 339 for ONNX tensor: 339 [01/12/2022-09:32:15] [V] [TRT] Cast_79 [Cast] outputs: [339 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_80 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_80 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_80 [Constant] outputs: [340 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_81 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_81 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_81 [Constant] outputs: [341 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Range_82 [Range] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 340 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 339 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 341 [01/12/2022-09:32:15] [V] [TRT] Range_82 [Range] inputs: [340 -> ()[INT32]], [339 -> ()[INT32]], [341 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Range_82 for ONNX node: Range_82 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 342 for ONNX tensor: 342 [01/12/2022-09:32:15] [V] [TRT] Range_82 [Range] outputs: [342 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_83 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_83 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_83 [Constant] outputs: [343 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_84 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_84 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_84 [Constant] outputs: [344 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Reshape_85 [Reshape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 342 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 344 [01/12/2022-09:32:15] [V] [TRT] Reshape_85 [Reshape] inputs: [342 -> (-1)[INT32]], [344 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Reshape_85 for ONNX node: Reshape_85 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 345 for ONNX tensor: 345 [01/12/2022-09:32:15] [V] [TRT] Reshape_85 [Reshape] outputs: [345 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_86 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_86 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_86 [Constant] outputs: [346 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_87 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 345 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 346 [01/12/2022-09:32:15] [V] [TRT] Add_87 [Add] inputs: [345 -> (-1, 1)[INT32]], [346 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 346 for ONNX node: 346 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_87 for ONNX node: Add_87 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 347 for ONNX tensor: 347 [01/12/2022-09:32:15] [V] [TRT] Add_87 [Add] outputs: [347 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_88 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 347 [01/12/2022-09:32:15] [V] [TRT] Shape_88 [Shape] inputs: [347 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_88 for ONNX node: Shape_88 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 348 for ONNX tensor: 348 [01/12/2022-09:32:15] [V] [TRT] Shape_88 [Shape] outputs: [348 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_89 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Shape_89 [Shape] inputs: [348 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_89 for ONNX node: Shape_89 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 349 for ONNX tensor: 349 [01/12/2022-09:32:15] [V] [TRT] Shape_89 [Shape] outputs: [349 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ConstantOfShape_90 [ConstantOfShape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 349 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_90 [ConstantOfShape] inputs: [349 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ConstantOfShape_90 for ONNX node: ConstantOfShape_90 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 350 for ONNX tensor: 350 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_90 [ConstantOfShape] outputs: [350 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_91 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_91 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_91 [Constant] outputs: [351 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_92 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 350 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 351 [01/12/2022-09:32:15] [V] [TRT] Mul_92 [Mul] inputs: [350 -> (2)[INT32]], [351 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 351 for ONNX node: 351 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_92 for ONNX node: Mul_92 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 352 for ONNX tensor: 352 [01/12/2022-09:32:15] [V] [TRT] Mul_92 [Mul] outputs: [352 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Equal_93 [Equal] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 352 [01/12/2022-09:32:15] [V] [TRT] Equal_93 [Equal] inputs: [348 -> (2)[INT32]], [352 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Equal_93 for ONNX node: Equal_93 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 353 for ONNX tensor: 353 [01/12/2022-09:32:15] [V] [TRT] Equal_93 [Equal] outputs: [353 -> (2)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Where_94 [Where] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 353 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 350 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Where_94 [Where] inputs: [353 -> (2)[BOOL]], [350 -> (2)[INT32]], [348 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Where_94 for ONNX node: Where_94 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 354 for ONNX tensor: 354 [01/12/2022-09:32:15] [V] [TRT] Where_94 [Where] outputs: [354 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Expand_95 [Expand] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 345 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 354 [01/12/2022-09:32:15] [V] [TRT] Expand_95 [Expand] inputs: [345 -> (-1, 1)[INT32]], [354 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Expand_95 for ONNX node: Expand_95 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 355 for ONNX tensor: 355 [01/12/2022-09:32:15] [V] [TRT] Expand_95 [Expand] outputs: [355 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_96 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 355 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_96 [Unsqueeze] inputs: [355 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (_, 1), unsqueezing to: (_, _, _) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_96 for ONNX node: Unsqueeze_96 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 356 for ONNX tensor: 356 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_96 [Unsqueeze] outputs: [356 -> (-1, 1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_97 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Shape_97 [Shape] inputs: [348 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_97 for ONNX node: Shape_97 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 357 for ONNX tensor: 357 [01/12/2022-09:32:15] [V] [TRT] Shape_97 [Shape] outputs: [357 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ConstantOfShape_98 [ConstantOfShape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 357 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_98 [ConstantOfShape] inputs: [357 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ConstantOfShape_98 for ONNX node: ConstantOfShape_98 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 358 for ONNX tensor: 358 [01/12/2022-09:32:15] [V] [TRT] ConstantOfShape_98 [ConstantOfShape] outputs: [358 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_99 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_99 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_99 [Constant] outputs: [359 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_100 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 358 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 359 [01/12/2022-09:32:15] [V] [TRT] Mul_100 [Mul] inputs: [358 -> (2)[INT32]], [359 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 359 for ONNX node: 359 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_100 for ONNX node: Mul_100 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 360 for ONNX tensor: 360 [01/12/2022-09:32:15] [V] [TRT] Mul_100 [Mul] outputs: [360 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Equal_101 [Equal] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 360 [01/12/2022-09:32:15] [V] [TRT] Equal_101 [Equal] inputs: [348 -> (2)[INT32]], [360 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Equal_101 for ONNX node: Equal_101 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 361 for ONNX tensor: 361 [01/12/2022-09:32:15] [V] [TRT] Equal_101 [Equal] outputs: [361 -> (2)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Where_102 [Where] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 361 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 358 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Where_102 [Where] inputs: [361 -> (2)[BOOL]], [358 -> (2)[INT32]], [348 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Where_102 for ONNX node: Where_102 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 362 for ONNX tensor: 362 [01/12/2022-09:32:15] [V] [TRT] Where_102 [Where] outputs: [362 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Expand_103 [Expand] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 343 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 362 [01/12/2022-09:32:15] [V] [TRT] Expand_103 [Expand] inputs: [343 -> (1)[INT32]], [362 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 343 for ONNX node: 343 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Expand_103 for ONNX node: Expand_103 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 363 for ONNX tensor: 363 [01/12/2022-09:32:15] [V] [TRT] Expand_103 [Expand] outputs: [363 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_104 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 363 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_104 [Unsqueeze] inputs: [363 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (_, 1), unsqueezing to: (_, _, _) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_104 for ONNX node: Unsqueeze_104 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 364 for ONNX tensor: 364 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_104 [Unsqueeze] outputs: [364 -> (-1, 1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Concat_105 [Concat] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 356 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 364 [01/12/2022-09:32:15] [V] [TRT] Concat_105 [Concat] inputs: [356 -> (-1, 1, 1)[INT32]], [364 -> (-1, 1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Concat_105 for ONNX node: Concat_105 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 365 for ONNX tensor: 365 [01/12/2022-09:32:15] [V] [TRT] Concat_105 [Concat] outputs: [365 -> (-1, 1, 2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_106 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 329 [01/12/2022-09:32:15] [V] [TRT] Shape_106 [Shape] inputs: [329 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_106 for ONNX node: Shape_106 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 366 for ONNX tensor: 366 [01/12/2022-09:32:15] [V] [TRT] Shape_106 [Shape] outputs: [366 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_107 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_107 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_107 [Constant] outputs: [367 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_108 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_108 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_108 [Constant] outputs: [368 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_109 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_109 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [01/12/2022-09:32:15] [V] [TRT] Constant_109 [Constant] outputs: [369 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Slice_110 [Slice] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 366 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 368 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 369 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 367 [01/12/2022-09:32:15] [V] [TRT] Slice_110 [Slice] inputs: [366 -> (2)[INT32]], [368 -> (1)[INT32]], [369 -> (1)[INT32]], [367 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Slice_110 for ONNX node: Slice_110 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 370 for ONNX tensor: 370 [01/12/2022-09:32:15] [V] [TRT] Slice_110 [Slice] outputs: [370 -> (0)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Concat_111 [Concat] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 348 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 370 [01/12/2022-09:32:15] [V] [TRT] Concat_111 [Concat] inputs: [348 -> (2)[INT32]], [370 -> (0)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Concat_111 for ONNX node: Concat_111 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 371 for ONNX tensor: 371 [01/12/2022-09:32:15] [V] [TRT] Concat_111 [Concat] outputs: [371 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Reshape_112 [Reshape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 335 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 371 [01/12/2022-09:32:15] [V] [TRT] Reshape_112 [Reshape] inputs: [335 -> (-1)[INT32]], [371 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Reshape_112 for ONNX node: Reshape_112 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 372 for ONNX tensor: 372 [01/12/2022-09:32:15] [V] [TRT] Reshape_112 [Reshape] outputs: [372 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ScatterND_113 [ScatterND] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 329 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 365 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 372 [01/12/2022-09:32:15] [V] [TRT] ScatterND_113 [ScatterND] inputs: [329 -> (-1, -1)[INT32]], [365 -> (-1, 1, 2)[INT32]], [372 -> (-1, 1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ScatterND_113 for ONNX node: ScatterND_113 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 373 for ONNX tensor: 373 [01/12/2022-09:32:15] [V] [TRT] ScatterND_113 [ScatterND] outputs: [373 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_114 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_114 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_114 [Constant] outputs: [374 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Equal_115 [Equal] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 373 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 374 [01/12/2022-09:32:15] [V] [TRT] Equal_115 [Equal] inputs: [373 -> (-1, -1)[INT32]], [374 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 374 for ONNX node: 374 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Equal_115 for ONNX node: Equal_115 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 375 for ONNX tensor: 375 [01/12/2022-09:32:15] [V] [TRT] Equal_115 [Equal] outputs: [375 -> (-1, -1)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Cast_116 [Cast] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 375 [01/12/2022-09:32:15] [V] [TRT] Cast_116 [Cast] inputs: [375 -> (-1, -1)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Casting to type: bool [01/12/2022-09:32:15] [V] [TRT] Registering layer: Cast_116 for ONNX node: Cast_116 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 376 for ONNX tensor: 376 [01/12/2022-09:32:15] [V] [TRT] Cast_116 [Cast] outputs: [376 -> (-1, -1)[BOOL]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_117 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_117 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_117 [Constant] outputs: [377 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Where_118 [Where] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 376 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 377 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 373 [01/12/2022-09:32:15] [V] [TRT] Where_118 [Where] inputs: [376 -> (-1, -1)[BOOL]], [377 -> ()[INT32]], [373 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 377 for ONNX node: 377 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Where_118 for ONNX node: Where_118 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 378 for ONNX tensor: 378 [01/12/2022-09:32:15] [V] [TRT] Where_118 [Where] outputs: [378 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_119 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: input_ids [01/12/2022-09:32:15] [V] [TRT] Shape_119 [Shape] inputs: [input_ids -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_119 for ONNX node: Shape_119 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 379 for ONNX tensor: 379 [01/12/2022-09:32:15] [V] [TRT] Shape_119 [Shape] outputs: [379 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_120 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_120 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_120 [Constant] outputs: [380 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_121 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 379 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 380 [01/12/2022-09:32:15] [V] [TRT] Gather_121 [Gather] inputs: [379 -> (2)[INT32]], [380 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 380 for ONNX node: 380 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_121 for ONNX node: Gather_121 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 381 for ONNX tensor: 381 [01/12/2022-09:32:15] [V] [TRT] Gather_121 [Gather] outputs: [381 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_122 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 381 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_122 [Unsqueeze] inputs: [381 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_122 for ONNX node: Unsqueeze_122 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 384 for ONNX tensor: 384 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_122 [Unsqueeze] outputs: [384 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Concat_123 [Concat] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 2776 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 384 [01/12/2022-09:32:15] [V] [TRT] Concat_123 [Concat] inputs: [2776 -> (1)[INT32]], [384 -> (1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 2776 for ONNX node: 2776 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Concat_123 for ONNX node: Concat_123 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 385 for ONNX tensor: 385 [01/12/2022-09:32:15] [V] [TRT] Concat_123 [Concat] outputs: [385 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Reshape_124 [Reshape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: input_ids [01/12/2022-09:32:15] [V] [TRT] Searching for input: 385 [01/12/2022-09:32:15] [V] [TRT] Reshape_124 [Reshape] inputs: [input_ids -> (-1, -1)[INT32]], [385 -> (2)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Reshape_124 for ONNX node: Reshape_124 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 386 for ONNX tensor: 386 [01/12/2022-09:32:15] [V] [TRT] Reshape_124 [Reshape] outputs: [386 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_125 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: shared.weight [01/12/2022-09:32:15] [V] [TRT] Searching for input: 386 [01/12/2022-09:32:15] [V] [TRT] Gather_125 [Gather] inputs: [shared.weight -> (50265, 768)[FLOAT]], [386 -> (-1, -1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: shared.weight for ONNX node: shared.weight [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_125 for ONNX node: Gather_125 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 387 for ONNX tensor: 387 [01/12/2022-09:32:15] [V] [TRT] Gather_125 [Gather] outputs: [387 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_126 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_126 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_126 [Constant] outputs: [388 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_127 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 387 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 388 [01/12/2022-09:32:15] [V] [TRT] Mul_127 [Mul] inputs: [387 -> (-1, -1, 768)[FLOAT]], [388 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 388 for ONNX node: 388 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_127 for ONNX node: Mul_127 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 389 for ONNX tensor: 389 [01/12/2022-09:32:15] [V] [TRT] Mul_127 [Mul] outputs: [389 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_128 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_128 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_128 [Constant] outputs: [390 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_129 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 381 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 390 [01/12/2022-09:32:15] [V] [TRT] Add_129 [Add] inputs: [381 -> ()[INT32]], [390 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 390 for ONNX node: 390 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_129 for ONNX node: Add_129 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 391 for ONNX tensor: 391 [01/12/2022-09:32:15] [V] [TRT] Add_129 [Add] outputs: [391 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Cast_130 [Cast] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 391 [01/12/2022-09:32:15] [V] [TRT] Cast_130 [Cast] inputs: [391 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Casting to type: int32 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Cast_130 for ONNX node: Cast_130 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 395 for ONNX tensor: 395 [01/12/2022-09:32:15] [V] [TRT] Cast_130 [Cast] outputs: [395 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Range_131 [Range] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 2777 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 395 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 2778 [01/12/2022-09:32:15] [V] [TRT] Range_131 [Range] inputs: [2777 -> ()[INT32]], [395 -> ()[INT32]], [2778 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Range_131 for ONNX node: Range_131 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 397 for ONNX tensor: 397 [01/12/2022-09:32:15] [V] [TRT] Range_131 [Range] outputs: [397 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_132 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_132 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_132 [Constant] outputs: [398 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_133 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 397 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 398 [01/12/2022-09:32:15] [V] [TRT] Add_133 [Add] inputs: [397 -> (-1)[INT32]], [398 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 398 for ONNX node: 398 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_133 for ONNX node: Add_133 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 399 for ONNX tensor: 399 [01/12/2022-09:32:15] [V] [TRT] Add_133 [Add] outputs: [399 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_134 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: encoder.embed_positions.weight [01/12/2022-09:32:15] [V] [TRT] Searching for input: 399 [01/12/2022-09:32:15] [V] [TRT] Gather_134 [Gather] inputs: [encoder.embed_positions.weight -> (1026, 768)[FLOAT]], [399 -> (-1)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: encoder.embed_positions.weight for ONNX node: encoder.embed_positions.weight [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_134 for ONNX node: Gather_134 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 400 for ONNX tensor: 400 [01/12/2022-09:32:15] [V] [TRT] Gather_134 [Gather] outputs: [400 -> (-1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_135 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 389 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 400 [01/12/2022-09:32:15] [V] [TRT] Add_135 [Add] inputs: [389 -> (-1, -1, 768)[FLOAT]], [400 -> (-1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_135 for ONNX node: Add_135 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 401 for ONNX tensor: 401 [01/12/2022-09:32:15] [V] [TRT] Add_135 [Add] outputs: [401 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ReduceMean_136 [ReduceMean] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 401 [01/12/2022-09:32:15] [V] [TRT] ReduceMean_136 [ReduceMean] inputs: [401 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ReduceMean_136 for ONNX node: ReduceMean_136 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 402 for ONNX tensor: 402 [01/12/2022-09:32:15] [V] [TRT] ReduceMean_136 [ReduceMean] outputs: [402 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Sub_137 [Sub] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 401 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 402 [01/12/2022-09:32:15] [V] [TRT] Sub_137 [Sub] inputs: [401 -> (-1, -1, 768)[FLOAT]], [402 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Sub_137 for ONNX node: Sub_137 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 403 for ONNX tensor: 403 [01/12/2022-09:32:15] [V] [TRT] Sub_137 [Sub] outputs: [403 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_138 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_138 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_138 [Constant] outputs: [404 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Pow_139 [Pow] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 403 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 404 [01/12/2022-09:32:15] [V] [TRT] Pow_139 [Pow] inputs: [403 -> (-1, -1, 768)[FLOAT]], [404 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 404 for ONNX node: 404 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Pow_139 for ONNX node: Pow_139 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 405 for ONNX tensor: 405 [01/12/2022-09:32:15] [V] [TRT] Pow_139 [Pow] outputs: [405 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: ReduceMean_140 [ReduceMean] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 405 [01/12/2022-09:32:15] [V] [TRT] ReduceMean_140 [ReduceMean] inputs: [405 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: ReduceMean_140 for ONNX node: ReduceMean_140 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 406 for ONNX tensor: 406 [01/12/2022-09:32:15] [V] [TRT] ReduceMean_140 [ReduceMean] outputs: [406 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_141 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_141 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_141 [Constant] outputs: [407 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_142 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 406 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 407 [01/12/2022-09:32:15] [V] [TRT] Add_142 [Add] inputs: [406 -> (-1, -1, 1)[FLOAT]], [407 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 407 for ONNX node: 407 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_142 for ONNX node: Add_142 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 408 for ONNX tensor: 408 [01/12/2022-09:32:15] [V] [TRT] Add_142 [Add] outputs: [408 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Sqrt_143 [Sqrt] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 408 [01/12/2022-09:32:15] [V] [TRT] Sqrt_143 [Sqrt] inputs: [408 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Sqrt_143 for ONNX node: Sqrt_143 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 409 for ONNX tensor: 409 [01/12/2022-09:32:15] [V] [TRT] Sqrt_143 [Sqrt] outputs: [409 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Div_144 [Div] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 403 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 409 [01/12/2022-09:32:15] [V] [TRT] Div_144 [Div] inputs: [403 -> (-1, -1, 768)[FLOAT]], [409 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Div_144 for ONNX node: Div_144 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 410 for ONNX tensor: 410 [01/12/2022-09:32:15] [V] [TRT] Div_144 [Div] outputs: [410 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_145 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 410 [01/12/2022-09:32:15] [V] [TRT] Searching for input: encoder.layernorm_embedding.weight [01/12/2022-09:32:15] [V] [TRT] Mul_145 [Mul] inputs: [410 -> (-1, -1, 768)[FLOAT]], [encoder.layernorm_embedding.weight -> (768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: encoder.layernorm_embedding.weight for ONNX node: encoder.layernorm_embedding.weight [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_145 for ONNX node: Mul_145 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 411 for ONNX tensor: 411 [01/12/2022-09:32:15] [V] [TRT] Mul_145 [Mul] outputs: [411 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_146 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 411 [01/12/2022-09:32:15] [V] [TRT] Searching for input: encoder.layernorm_embedding.bias [01/12/2022-09:32:15] [V] [TRT] Add_146 [Add] inputs: [411 -> (-1, -1, 768)[FLOAT]], [encoder.layernorm_embedding.bias -> (768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: encoder.layernorm_embedding.bias for ONNX node: encoder.layernorm_embedding.bias [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_146 for ONNX node: Add_146 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 412 for ONNX tensor: 412 [01/12/2022-09:32:15] [V] [TRT] Add_146 [Add] outputs: [412 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_147 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 412 [01/12/2022-09:32:15] [V] [TRT] Shape_147 [Shape] inputs: [412 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_147 for ONNX node: Shape_147 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 413 for ONNX tensor: 413 [01/12/2022-09:32:15] [V] [TRT] Shape_147 [Shape] outputs: [413 -> (3)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_148 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_148 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_148 [Constant] outputs: [414 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_149 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 413 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 414 [01/12/2022-09:32:15] [V] [TRT] Gather_149 [Gather] inputs: [413 -> (3)[INT32]], [414 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 414 for ONNX node: 414 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_149 for ONNX node: Gather_149 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 415 for ONNX tensor: 415 [01/12/2022-09:32:15] [V] [TRT] Gather_149 [Gather] outputs: [415 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Shape_150 [Shape] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 412 [01/12/2022-09:32:15] [V] [TRT] Shape_150 [Shape] inputs: [412 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: Shape_150 for ONNX node: Shape_150 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 416 for ONNX tensor: 416 [01/12/2022-09:32:15] [V] [TRT] Shape_150 [Shape] outputs: [416 -> (3)[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_151 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_151 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_151 [Constant] outputs: [417 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Gather_152 [Gather] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 416 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 417 [01/12/2022-09:32:15] [V] [TRT] Gather_152 [Gather] inputs: [416 -> (3)[INT32]], [417 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 417 for ONNX node: 417 [01/12/2022-09:32:15] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Gather_152 for ONNX node: Gather_152 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 418 for ONNX tensor: 418 [01/12/2022-09:32:15] [V] [TRT] Gather_152 [Gather] outputs: [418 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: MatMul_153 [MatMul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 412 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 2779 [01/12/2022-09:32:15] [V] [TRT] MatMul_153 [MatMul] inputs: [412 -> (-1, -1, 768)[FLOAT]], [2779 -> (768, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 2779 for ONNX node: 2779 [01/12/2022-09:32:15] [V] [TRT] Registering layer: MatMul_153 for ONNX node: MatMul_153 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 420 for ONNX tensor: 420 [01/12/2022-09:32:15] [V] [TRT] MatMul_153 [MatMul] outputs: [420 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_154 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: encoder.layers.0.self_attn.q_proj.bias [01/12/2022-09:32:15] [V] [TRT] Searching for input: 420 [01/12/2022-09:32:15] [V] [TRT] Add_154 [Add] inputs: [encoder.layers.0.self_attn.q_proj.bias -> (768)[FLOAT]], [420 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: encoder.layers.0.self_attn.q_proj.bias for ONNX node: encoder.layers.0.self_attn.q_proj.bias [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_154 for ONNX node: Add_154 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 421 for ONNX tensor: 421 [01/12/2022-09:32:15] [V] [TRT] Add_154 [Add] outputs: [421 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Constant_155 [Constant] [01/12/2022-09:32:15] [V] [TRT] Constant_155 [Constant] inputs: [01/12/2022-09:32:15] [V] [TRT] Constant_155 [Constant] outputs: [422 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Mul_156 [Mul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 421 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 422 [01/12/2022-09:32:15] [V] [TRT] Mul_156 [Mul] inputs: [421 -> (-1, -1, 768)[FLOAT]], [422 -> ()[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 422 for ONNX node: 422 [01/12/2022-09:32:15] [V] [TRT] Registering layer: Mul_156 for ONNX node: Mul_156 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 423 for ONNX tensor: 423 [01/12/2022-09:32:15] [V] [TRT] Mul_156 [Mul] outputs: [423 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: MatMul_157 [MatMul] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 412 [01/12/2022-09:32:15] [V] [TRT] Searching for input: 2780 [01/12/2022-09:32:15] [V] [TRT] MatMul_157 [MatMul] inputs: [412 -> (-1, -1, 768)[FLOAT]], [2780 -> (768, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: 2780 for ONNX node: 2780 [01/12/2022-09:32:15] [V] [TRT] Registering layer: MatMul_157 for ONNX node: MatMul_157 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 425 for ONNX tensor: 425 [01/12/2022-09:32:15] [V] [TRT] MatMul_157 [MatMul] outputs: [425 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Add_158 [Add] [01/12/2022-09:32:15] [V] [TRT] Searching for input: encoder.layers.0.self_attn.k_proj.bias [01/12/2022-09:32:15] [V] [TRT] Searching for input: 425 [01/12/2022-09:32:15] [V] [TRT] Add_158 [Add] inputs: [encoder.layers.0.self_attn.k_proj.bias -> (768)[FLOAT]], [425 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Registering layer: encoder.layers.0.self_attn.k_proj.bias for ONNX node: encoder.layers.0.self_attn.k_proj.bias [01/12/2022-09:32:15] [V] [TRT] Registering layer: Add_158 for ONNX node: Add_158 [01/12/2022-09:32:15] [V] [TRT] Registering tensor: 426 for ONNX tensor: 426 [01/12/2022-09:32:15] [V] [TRT] Add_158 [Add] outputs: [426 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:15] [V] [TRT] Parsing node: Unsqueeze_159 [Unsqueeze] [01/12/2022-09:32:15] [V] [TRT] Searching for input: 415 [01/12/2022-09:32:15] [V] [TRT] Unsqueeze_159 [Unsqueeze] inputs: [415 -> ()[INT32]], [01/12/2022-09:32:15] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:15] [V] [TRT] Registering layer: Unsqueeze_159 for ONNX node: Unsqueeze_159 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 430 for ONNX tensor: 430 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_159 [Unsqueeze] outputs: [430 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_160 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 430 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2781 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2782 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2783 [01/12/2022-09:32:16] [V] [TRT] Concat_160 [Concat] inputs: [430 -> (1)[INT32]], [2781 -> (1)[INT32]], [2782 -> (1)[INT32]], [2783 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2781 for ONNX node: 2781 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2782 for ONNX node: 2782 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2783 for ONNX node: 2783 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_160 for ONNX node: Concat_160 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 434 for ONNX tensor: 434 [01/12/2022-09:32:16] [V] [TRT] Concat_160 [Concat] outputs: [434 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_161 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 426 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 434 [01/12/2022-09:32:16] [V] [TRT] Reshape_161 [Reshape] inputs: [426 -> (-1, -1, 768)[FLOAT]], [434 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_161 for ONNX node: Reshape_161 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 435 for ONNX tensor: 435 [01/12/2022-09:32:16] [V] [TRT] Reshape_161 [Reshape] outputs: [435 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_162 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 435 [01/12/2022-09:32:16] [V] [TRT] Transpose_162 [Transpose] inputs: [435 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_162 for ONNX node: Transpose_162 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 436 for ONNX tensor: 436 [01/12/2022-09:32:16] [V] [TRT] Transpose_162 [Transpose] outputs: [436 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_163 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 412 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2784 [01/12/2022-09:32:16] [V] [TRT] MatMul_163 [MatMul] inputs: [412 -> (-1, -1, 768)[FLOAT]], [2784 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2784 for ONNX node: 2784 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_163 for ONNX node: MatMul_163 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 438 for ONNX tensor: 438 [01/12/2022-09:32:16] [V] [TRT] MatMul_163 [MatMul] outputs: [438 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_164 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 438 [01/12/2022-09:32:16] [V] [TRT] Add_164 [Add] inputs: [encoder.layers.0.self_attn.v_proj.bias -> (768)[FLOAT]], [438 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.self_attn.v_proj.bias for ONNX node: encoder.layers.0.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_164 for ONNX node: Add_164 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 439 for ONNX tensor: 439 [01/12/2022-09:32:16] [V] [TRT] Add_164 [Add] outputs: [439 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_165 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 415 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_165 [Unsqueeze] inputs: [415 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_165 for ONNX node: Unsqueeze_165 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 443 for ONNX tensor: 443 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_165 [Unsqueeze] outputs: [443 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_166 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 443 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2785 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2786 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2787 [01/12/2022-09:32:16] [V] [TRT] Concat_166 [Concat] inputs: [443 -> (1)[INT32]], [2785 -> (1)[INT32]], [2786 -> (1)[INT32]], [2787 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2785 for ONNX node: 2785 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2786 for ONNX node: 2786 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2787 for ONNX node: 2787 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_166 for ONNX node: Concat_166 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 447 for ONNX tensor: 447 [01/12/2022-09:32:16] [V] [TRT] Concat_166 [Concat] outputs: [447 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_167 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 439 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 447 [01/12/2022-09:32:16] [V] [TRT] Reshape_167 [Reshape] inputs: [439 -> (-1, -1, 768)[FLOAT]], [447 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_167 for ONNX node: Reshape_167 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 448 for ONNX tensor: 448 [01/12/2022-09:32:16] [V] [TRT] Reshape_167 [Reshape] outputs: [448 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_168 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 448 [01/12/2022-09:32:16] [V] [TRT] Transpose_168 [Transpose] inputs: [448 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_168 for ONNX node: Transpose_168 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 449 for ONNX tensor: 449 [01/12/2022-09:32:16] [V] [TRT] Transpose_168 [Transpose] outputs: [449 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_169 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_169 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_169 [Constant] outputs: [450 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_170 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 415 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 450 [01/12/2022-09:32:16] [V] [TRT] Mul_170 [Mul] inputs: [415 -> ()[INT32]], [450 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 450 for ONNX node: 450 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_170 for ONNX node: Mul_170 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 451 for ONNX tensor: 451 [01/12/2022-09:32:16] [V] [TRT] Mul_170 [Mul] outputs: [451 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_171 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 415 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_171 [Unsqueeze] inputs: [415 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_171 for ONNX node: Unsqueeze_171 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 454 for ONNX tensor: 454 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_171 [Unsqueeze] outputs: [454 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_172 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 418 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_172 [Unsqueeze] inputs: [418 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_172 for ONNX node: Unsqueeze_172 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_172 [Unsqueeze] outputs: [455 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_173 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 454 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 455 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2788 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2789 [01/12/2022-09:32:16] [V] [TRT] Concat_173 [Concat] inputs: [454 -> (1)[INT32]], [455 -> (1)[INT32]], [2788 -> (1)[INT32]], [2789 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2788 for ONNX node: 2788 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2789 for ONNX node: 2789 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_173 for ONNX node: Concat_173 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 458 for ONNX tensor: 458 [01/12/2022-09:32:16] [V] [TRT] Concat_173 [Concat] outputs: [458 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_174 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 423 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 458 [01/12/2022-09:32:16] [V] [TRT] Reshape_174 [Reshape] inputs: [423 -> (-1, -1, 768)[FLOAT]], [458 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_174 for ONNX node: Reshape_174 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 459 for ONNX tensor: 459 [01/12/2022-09:32:16] [V] [TRT] Reshape_174 [Reshape] outputs: [459 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_175 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 459 [01/12/2022-09:32:16] [V] [TRT] Transpose_175 [Transpose] inputs: [459 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_175 for ONNX node: Transpose_175 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 460 for ONNX tensor: 460 [01/12/2022-09:32:16] [V] [TRT] Transpose_175 [Transpose] outputs: [460 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_176 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 451 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_176 [Unsqueeze] inputs: [451 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_176 for ONNX node: Unsqueeze_176 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 463 for ONNX tensor: 463 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_176 [Unsqueeze] outputs: [463 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_177 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 463 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2790 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2791 [01/12/2022-09:32:16] [V] [TRT] Concat_177 [Concat] inputs: [463 -> (1)[INT32]], [2790 -> (1)[INT32]], [2791 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2790 for ONNX node: 2790 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2791 for ONNX node: 2791 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_177 for ONNX node: Concat_177 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 466 for ONNX tensor: 466 [01/12/2022-09:32:16] [V] [TRT] Concat_177 [Concat] outputs: [466 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_178 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 460 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 466 [01/12/2022-09:32:16] [V] [TRT] Reshape_178 [Reshape] inputs: [460 -> (-1, 12, -1, 64)[FLOAT]], [466 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_178 for ONNX node: Reshape_178 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 467 for ONNX tensor: 467 [01/12/2022-09:32:16] [V] [TRT] Reshape_178 [Reshape] outputs: [467 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_179 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 451 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_179 [Unsqueeze] inputs: [451 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_179 for ONNX node: Unsqueeze_179 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 470 for ONNX tensor: 470 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_179 [Unsqueeze] outputs: [470 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_180 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 470 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2792 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2793 [01/12/2022-09:32:16] [V] [TRT] Concat_180 [Concat] inputs: [470 -> (1)[INT32]], [2792 -> (1)[INT32]], [2793 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2792 for ONNX node: 2792 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2793 for ONNX node: 2793 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_180 for ONNX node: Concat_180 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 473 for ONNX tensor: 473 [01/12/2022-09:32:16] [V] [TRT] Concat_180 [Concat] outputs: [473 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_181 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 436 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 473 [01/12/2022-09:32:16] [V] [TRT] Reshape_181 [Reshape] inputs: [436 -> (-1, 12, -1, 64)[FLOAT]], [473 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_181 for ONNX node: Reshape_181 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 474 for ONNX tensor: 474 [01/12/2022-09:32:16] [V] [TRT] Reshape_181 [Reshape] outputs: [474 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_182 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 451 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_182 [Unsqueeze] inputs: [451 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_182 for ONNX node: Unsqueeze_182 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 477 for ONNX tensor: 477 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_182 [Unsqueeze] outputs: [477 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_183 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 477 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2794 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2795 [01/12/2022-09:32:16] [V] [TRT] Concat_183 [Concat] inputs: [477 -> (1)[INT32]], [2794 -> (1)[INT32]], [2795 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2794 for ONNX node: 2794 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2795 for ONNX node: 2795 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_183 for ONNX node: Concat_183 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 480 for ONNX tensor: 480 [01/12/2022-09:32:16] [V] [TRT] Concat_183 [Concat] outputs: [480 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_184 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 449 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 480 [01/12/2022-09:32:16] [V] [TRT] Reshape_184 [Reshape] inputs: [449 -> (-1, 12, -1, 64)[FLOAT]], [480 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_184 for ONNX node: Reshape_184 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 481 for ONNX tensor: 481 [01/12/2022-09:32:16] [V] [TRT] Reshape_184 [Reshape] outputs: [481 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_185 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 474 [01/12/2022-09:32:16] [V] [TRT] Transpose_185 [Transpose] inputs: [474 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_185 for ONNX node: Transpose_185 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 482 for ONNX tensor: 482 [01/12/2022-09:32:16] [V] [TRT] Transpose_185 [Transpose] outputs: [482 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_186 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 467 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 482 [01/12/2022-09:32:16] [V] [TRT] MatMul_186 [MatMul] inputs: [467 -> (-1, -1, 64)[FLOAT]], [482 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_186 for ONNX node: MatMul_186 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 483 for ONNX tensor: 483 [01/12/2022-09:32:16] [V] [TRT] MatMul_186 [MatMul] outputs: [483 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Softmax_187 [Softmax] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 483 [01/12/2022-09:32:16] [V] [TRT] Softmax_187 [Softmax] inputs: [483 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Softmax_187 for ONNX node: Softmax_187 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 484 for ONNX tensor: 484 [01/12/2022-09:32:16] [V] [TRT] Softmax_187 [Softmax] outputs: [484 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_188 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 484 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 481 [01/12/2022-09:32:16] [V] [TRT] MatMul_188 [MatMul] inputs: [484 -> (-1, -1, -1)[FLOAT]], [481 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_188 for ONNX node: MatMul_188 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 485 for ONNX tensor: 485 [01/12/2022-09:32:16] [V] [TRT] MatMul_188 [MatMul] outputs: [485 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_189 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 415 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_189 [Unsqueeze] inputs: [415 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_189 for ONNX node: Unsqueeze_189 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 488 for ONNX tensor: 488 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_189 [Unsqueeze] outputs: [488 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_190 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 418 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_190 [Unsqueeze] inputs: [418 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_190 for ONNX node: Unsqueeze_190 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 490 for ONNX tensor: 490 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_190 [Unsqueeze] outputs: [490 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_191 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 488 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2796 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 490 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2797 [01/12/2022-09:32:16] [V] [TRT] Concat_191 [Concat] inputs: [488 -> (1)[INT32]], [2796 -> (1)[INT32]], [490 -> (1)[INT32]], [2797 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2796 for ONNX node: 2796 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2797 for ONNX node: 2797 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_191 for ONNX node: Concat_191 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 492 for ONNX tensor: 492 [01/12/2022-09:32:16] [V] [TRT] Concat_191 [Concat] outputs: [492 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_192 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 485 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 492 [01/12/2022-09:32:16] [V] [TRT] Reshape_192 [Reshape] inputs: [485 -> (-1, -1, 64)[FLOAT]], [492 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_192 for ONNX node: Reshape_192 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 493 for ONNX tensor: 493 [01/12/2022-09:32:16] [V] [TRT] Reshape_192 [Reshape] outputs: [493 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_193 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 493 [01/12/2022-09:32:16] [V] [TRT] Transpose_193 [Transpose] inputs: [493 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_193 for ONNX node: Transpose_193 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 494 for ONNX tensor: 494 [01/12/2022-09:32:16] [V] [TRT] Transpose_193 [Transpose] outputs: [494 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_194 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 415 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_194 [Unsqueeze] inputs: [415 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_194 for ONNX node: Unsqueeze_194 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 496 for ONNX tensor: 496 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_194 [Unsqueeze] outputs: [496 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_195 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 418 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_195 [Unsqueeze] inputs: [418 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_195 for ONNX node: Unsqueeze_195 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 497 for ONNX tensor: 497 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_195 [Unsqueeze] outputs: [497 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_196 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 496 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 497 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2798 [01/12/2022-09:32:16] [V] [TRT] Concat_196 [Concat] inputs: [496 -> (1)[INT32]], [497 -> (1)[INT32]], [2798 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2798 for ONNX node: 2798 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_196 for ONNX node: Concat_196 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 499 for ONNX tensor: 499 [01/12/2022-09:32:16] [V] [TRT] Concat_196 [Concat] outputs: [499 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_197 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 494 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 499 [01/12/2022-09:32:16] [V] [TRT] Reshape_197 [Reshape] inputs: [494 -> (-1, -1, 12, 64)[FLOAT]], [499 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_197 for ONNX node: Reshape_197 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 500 for ONNX tensor: 500 [01/12/2022-09:32:16] [V] [TRT] Reshape_197 [Reshape] outputs: [500 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_198 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 500 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2799 [01/12/2022-09:32:16] [V] [TRT] MatMul_198 [MatMul] inputs: [500 -> (-1, -1, 768)[FLOAT]], [2799 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2799 for ONNX node: 2799 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_198 for ONNX node: MatMul_198 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 502 for ONNX tensor: 502 [01/12/2022-09:32:16] [V] [TRT] MatMul_198 [MatMul] outputs: [502 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_199 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 502 [01/12/2022-09:32:16] [V] [TRT] Add_199 [Add] inputs: [encoder.layers.0.self_attn.out_proj.bias -> (768)[FLOAT]], [502 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.self_attn.out_proj.bias for ONNX node: encoder.layers.0.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_199 for ONNX node: Add_199 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 503 for ONNX tensor: 503 [01/12/2022-09:32:16] [V] [TRT] Add_199 [Add] outputs: [503 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_200 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 412 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 503 [01/12/2022-09:32:16] [V] [TRT] Add_200 [Add] inputs: [412 -> (-1, -1, 768)[FLOAT]], [503 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_200 for ONNX node: Add_200 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 504 for ONNX tensor: 504 [01/12/2022-09:32:16] [V] [TRT] Add_200 [Add] outputs: [504 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_201 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 504 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_201 [ReduceMean] inputs: [504 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_201 for ONNX node: ReduceMean_201 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 505 for ONNX tensor: 505 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_201 [ReduceMean] outputs: [505 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_202 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 504 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 505 [01/12/2022-09:32:16] [V] [TRT] Sub_202 [Sub] inputs: [504 -> (-1, -1, 768)[FLOAT]], [505 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_202 for ONNX node: Sub_202 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 506 for ONNX tensor: 506 [01/12/2022-09:32:16] [V] [TRT] Sub_202 [Sub] outputs: [506 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_203 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_203 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_203 [Constant] outputs: [507 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_204 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 506 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 507 [01/12/2022-09:32:16] [V] [TRT] Pow_204 [Pow] inputs: [506 -> (-1, -1, 768)[FLOAT]], [507 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 507 for ONNX node: 507 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_204 for ONNX node: Pow_204 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 508 for ONNX tensor: 508 [01/12/2022-09:32:16] [V] [TRT] Pow_204 [Pow] outputs: [508 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_205 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 508 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_205 [ReduceMean] inputs: [508 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_205 for ONNX node: ReduceMean_205 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 509 for ONNX tensor: 509 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_205 [ReduceMean] outputs: [509 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_206 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_206 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_206 [Constant] outputs: [510 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_207 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 509 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 510 [01/12/2022-09:32:16] [V] [TRT] Add_207 [Add] inputs: [509 -> (-1, -1, 1)[FLOAT]], [510 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 510 for ONNX node: 510 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_207 for ONNX node: Add_207 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511 [01/12/2022-09:32:16] [V] [TRT] Add_207 [Add] outputs: [511 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_208 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 511 [01/12/2022-09:32:16] [V] [TRT] Sqrt_208 [Sqrt] inputs: [511 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_208 for ONNX node: Sqrt_208 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 512 for ONNX tensor: 512 [01/12/2022-09:32:16] [V] [TRT] Sqrt_208 [Sqrt] outputs: [512 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_209 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 506 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 512 [01/12/2022-09:32:16] [V] [TRT] Div_209 [Div] inputs: [506 -> (-1, -1, 768)[FLOAT]], [512 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_209 for ONNX node: Div_209 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 513 for ONNX tensor: 513 [01/12/2022-09:32:16] [V] [TRT] Div_209 [Div] outputs: [513 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_210 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 513 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_210 [Mul] inputs: [513 -> (-1, -1, 768)[FLOAT]], [encoder.layers.0.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.self_attn_layer_norm.weight for ONNX node: encoder.layers.0.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_210 for ONNX node: Mul_210 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 514 for ONNX tensor: 514 [01/12/2022-09:32:16] [V] [TRT] Mul_210 [Mul] outputs: [514 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_211 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 514 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_211 [Add] inputs: [514 -> (-1, -1, 768)[FLOAT]], [encoder.layers.0.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.self_attn_layer_norm.bias for ONNX node: encoder.layers.0.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_211 for ONNX node: Add_211 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 515 for ONNX tensor: 515 [01/12/2022-09:32:16] [V] [TRT] Add_211 [Add] outputs: [515 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_212 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 515 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2800 [01/12/2022-09:32:16] [V] [TRT] MatMul_212 [MatMul] inputs: [515 -> (-1, -1, 768)[FLOAT]], [2800 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2800 for ONNX node: 2800 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_212 for ONNX node: MatMul_212 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 517 for ONNX tensor: 517 [01/12/2022-09:32:16] [V] [TRT] MatMul_212 [MatMul] outputs: [517 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_213 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 517 [01/12/2022-09:32:16] [V] [TRT] Add_213 [Add] inputs: [encoder.layers.0.fc1.bias -> (3072)[FLOAT]], [517 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.fc1.bias for ONNX node: encoder.layers.0.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_213 for ONNX node: Add_213 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518 [01/12/2022-09:32:16] [V] [TRT] Add_213 [Add] outputs: [518 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_214 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_214 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_214 [Constant] outputs: [519 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_215 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 518 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 519 [01/12/2022-09:32:16] [V] [TRT] Div_215 [Div] inputs: [518 -> (-1, -1, 3072)[FLOAT]], [519 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 519 for ONNX node: 519 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_215 for ONNX node: Div_215 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520 [01/12/2022-09:32:16] [V] [TRT] Div_215 [Div] outputs: [520 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Erf_216 [Erf] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 520 [01/12/2022-09:32:16] [V] [TRT] Erf_216 [Erf] inputs: [520 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Erf_216 for ONNX node: Erf_216 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 521 for ONNX tensor: 521 [01/12/2022-09:32:16] [V] [TRT] Erf_216 [Erf] outputs: [521 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_217 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_217 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_217 [Constant] outputs: [522 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_218 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 521 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 522 [01/12/2022-09:32:16] [V] [TRT] Add_218 [Add] inputs: [521 -> (-1, -1, 3072)[FLOAT]], [522 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 522 for ONNX node: 522 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_218 for ONNX node: Add_218 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 523 for ONNX tensor: 523 [01/12/2022-09:32:16] [V] [TRT] Add_218 [Add] outputs: [523 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_219 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 518 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 523 [01/12/2022-09:32:16] [V] [TRT] Mul_219 [Mul] inputs: [518 -> (-1, -1, 3072)[FLOAT]], [523 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_219 for ONNX node: Mul_219 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 524 for ONNX tensor: 524 [01/12/2022-09:32:16] [V] [TRT] Mul_219 [Mul] outputs: [524 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_220 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_220 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_220 [Constant] outputs: [525 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_221 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 524 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 525 [01/12/2022-09:32:16] [V] [TRT] Mul_221 [Mul] inputs: [524 -> (-1, -1, 3072)[FLOAT]], [525 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 525 for ONNX node: 525 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_221 for ONNX node: Mul_221 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 526 for ONNX tensor: 526 [01/12/2022-09:32:16] [V] [TRT] Mul_221 [Mul] outputs: [526 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_222 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 526 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2801 [01/12/2022-09:32:16] [V] [TRT] MatMul_222 [MatMul] inputs: [526 -> (-1, -1, 3072)[FLOAT]], [2801 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2801 for ONNX node: 2801 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_222 for ONNX node: MatMul_222 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 528 for ONNX tensor: 528 [01/12/2022-09:32:16] [V] [TRT] MatMul_222 [MatMul] outputs: [528 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_223 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 528 [01/12/2022-09:32:16] [V] [TRT] Add_223 [Add] inputs: [encoder.layers.0.fc2.bias -> (768)[FLOAT]], [528 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.fc2.bias for ONNX node: encoder.layers.0.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_223 for ONNX node: Add_223 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 529 for ONNX tensor: 529 [01/12/2022-09:32:16] [V] [TRT] Add_223 [Add] outputs: [529 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_224 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 515 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 529 [01/12/2022-09:32:16] [V] [TRT] Add_224 [Add] inputs: [515 -> (-1, -1, 768)[FLOAT]], [529 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_224 for ONNX node: Add_224 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 530 for ONNX tensor: 530 [01/12/2022-09:32:16] [V] [TRT] Add_224 [Add] outputs: [530 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_225 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 530 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_225 [ReduceMean] inputs: [530 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_225 for ONNX node: ReduceMean_225 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_225 [ReduceMean] outputs: [531 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_226 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 530 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 531 [01/12/2022-09:32:16] [V] [TRT] Sub_226 [Sub] inputs: [530 -> (-1, -1, 768)[FLOAT]], [531 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_226 for ONNX node: Sub_226 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532 [01/12/2022-09:32:16] [V] [TRT] Sub_226 [Sub] outputs: [532 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_227 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_227 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_227 [Constant] outputs: [533 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_228 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 532 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 533 [01/12/2022-09:32:16] [V] [TRT] Pow_228 [Pow] inputs: [532 -> (-1, -1, 768)[FLOAT]], [533 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 533 for ONNX node: 533 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_228 for ONNX node: Pow_228 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 534 for ONNX tensor: 534 [01/12/2022-09:32:16] [V] [TRT] Pow_228 [Pow] outputs: [534 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_229 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 534 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_229 [ReduceMean] inputs: [534 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_229 for ONNX node: ReduceMean_229 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_229 [ReduceMean] outputs: [535 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_230 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_230 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_230 [Constant] outputs: [536 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_231 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 535 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 536 [01/12/2022-09:32:16] [V] [TRT] Add_231 [Add] inputs: [535 -> (-1, -1, 1)[FLOAT]], [536 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 536 for ONNX node: 536 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_231 for ONNX node: Add_231 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537 [01/12/2022-09:32:16] [V] [TRT] Add_231 [Add] outputs: [537 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_232 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 537 [01/12/2022-09:32:16] [V] [TRT] Sqrt_232 [Sqrt] inputs: [537 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_232 for ONNX node: Sqrt_232 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 538 for ONNX tensor: 538 [01/12/2022-09:32:16] [V] [TRT] Sqrt_232 [Sqrt] outputs: [538 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_233 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 532 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 538 [01/12/2022-09:32:16] [V] [TRT] Div_233 [Div] inputs: [532 -> (-1, -1, 768)[FLOAT]], [538 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_233 for ONNX node: Div_233 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 539 for ONNX tensor: 539 [01/12/2022-09:32:16] [V] [TRT] Div_233 [Div] outputs: [539 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_234 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 539 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.final_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_234 [Mul] inputs: [539 -> (-1, -1, 768)[FLOAT]], [encoder.layers.0.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.final_layer_norm.weight for ONNX node: encoder.layers.0.final_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_234 for ONNX node: Mul_234 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540 [01/12/2022-09:32:16] [V] [TRT] Mul_234 [Mul] outputs: [540 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_235 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 540 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.0.final_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_235 [Add] inputs: [540 -> (-1, -1, 768)[FLOAT]], [encoder.layers.0.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.0.final_layer_norm.bias for ONNX node: encoder.layers.0.final_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_235 for ONNX node: Add_235 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 541 for ONNX tensor: 541 [01/12/2022-09:32:16] [V] [TRT] Add_235 [Add] outputs: [541 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Shape_236 [Shape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 541 [01/12/2022-09:32:16] [V] [TRT] Shape_236 [Shape] inputs: [541 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Shape_236 for ONNX node: Shape_236 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 542 for ONNX tensor: 542 [01/12/2022-09:32:16] [V] [TRT] Shape_236 [Shape] outputs: [542 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_237 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_237 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_237 [Constant] outputs: [543 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Gather_238 [Gather] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 542 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 543 [01/12/2022-09:32:16] [V] [TRT] Gather_238 [Gather] inputs: [542 -> (3)[INT32]], [543 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 543 for ONNX node: 543 [01/12/2022-09:32:16] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Gather_238 for ONNX node: Gather_238 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 544 for ONNX tensor: 544 [01/12/2022-09:32:16] [V] [TRT] Gather_238 [Gather] outputs: [544 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Shape_239 [Shape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 541 [01/12/2022-09:32:16] [V] [TRT] Shape_239 [Shape] inputs: [541 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Shape_239 for ONNX node: Shape_239 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 545 for ONNX tensor: 545 [01/12/2022-09:32:16] [V] [TRT] Shape_239 [Shape] outputs: [545 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_240 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_240 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_240 [Constant] outputs: [546 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Gather_241 [Gather] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 545 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 546 [01/12/2022-09:32:16] [V] [TRT] Gather_241 [Gather] inputs: [545 -> (3)[INT32]], [546 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 546 for ONNX node: 546 [01/12/2022-09:32:16] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Gather_241 for ONNX node: Gather_241 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 547 for ONNX tensor: 547 [01/12/2022-09:32:16] [V] [TRT] Gather_241 [Gather] outputs: [547 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_242 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 541 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2802 [01/12/2022-09:32:16] [V] [TRT] MatMul_242 [MatMul] inputs: [541 -> (-1, -1, 768)[FLOAT]], [2802 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2802 for ONNX node: 2802 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_242 for ONNX node: MatMul_242 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549 [01/12/2022-09:32:16] [V] [TRT] MatMul_242 [MatMul] outputs: [549 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_243 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.self_attn.q_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 549 [01/12/2022-09:32:16] [V] [TRT] Add_243 [Add] inputs: [encoder.layers.1.self_attn.q_proj.bias -> (768)[FLOAT]], [549 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.self_attn.q_proj.bias for ONNX node: encoder.layers.1.self_attn.q_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_243 for ONNX node: Add_243 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 550 for ONNX tensor: 550 [01/12/2022-09:32:16] [V] [TRT] Add_243 [Add] outputs: [550 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_244 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_244 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_244 [Constant] outputs: [551 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_245 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 550 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 551 [01/12/2022-09:32:16] [V] [TRT] Mul_245 [Mul] inputs: [550 -> (-1, -1, 768)[FLOAT]], [551 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 551 for ONNX node: 551 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_245 for ONNX node: Mul_245 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552 [01/12/2022-09:32:16] [V] [TRT] Mul_245 [Mul] outputs: [552 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_246 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 541 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2803 [01/12/2022-09:32:16] [V] [TRT] MatMul_246 [MatMul] inputs: [541 -> (-1, -1, 768)[FLOAT]], [2803 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2803 for ONNX node: 2803 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_246 for ONNX node: MatMul_246 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 554 for ONNX tensor: 554 [01/12/2022-09:32:16] [V] [TRT] MatMul_246 [MatMul] outputs: [554 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_247 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.self_attn.k_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 554 [01/12/2022-09:32:16] [V] [TRT] Add_247 [Add] inputs: [encoder.layers.1.self_attn.k_proj.bias -> (768)[FLOAT]], [554 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.self_attn.k_proj.bias for ONNX node: encoder.layers.1.self_attn.k_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_247 for ONNX node: Add_247 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 555 for ONNX tensor: 555 [01/12/2022-09:32:16] [V] [TRT] Add_247 [Add] outputs: [555 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_248 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 544 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_248 [Unsqueeze] inputs: [544 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_248 for ONNX node: Unsqueeze_248 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_248 [Unsqueeze] outputs: [559 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_249 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 559 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2804 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2805 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2806 [01/12/2022-09:32:16] [V] [TRT] Concat_249 [Concat] inputs: [559 -> (1)[INT32]], [2804 -> (1)[INT32]], [2805 -> (1)[INT32]], [2806 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2804 for ONNX node: 2804 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2805 for ONNX node: 2805 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2806 for ONNX node: 2806 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_249 for ONNX node: Concat_249 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 563 for ONNX tensor: 563 [01/12/2022-09:32:16] [V] [TRT] Concat_249 [Concat] outputs: [563 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_250 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 555 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 563 [01/12/2022-09:32:16] [V] [TRT] Reshape_250 [Reshape] inputs: [555 -> (-1, -1, 768)[FLOAT]], [563 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_250 for ONNX node: Reshape_250 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 564 for ONNX tensor: 564 [01/12/2022-09:32:16] [V] [TRT] Reshape_250 [Reshape] outputs: [564 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_251 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 564 [01/12/2022-09:32:16] [V] [TRT] Transpose_251 [Transpose] inputs: [564 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_251 for ONNX node: Transpose_251 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 565 for ONNX tensor: 565 [01/12/2022-09:32:16] [V] [TRT] Transpose_251 [Transpose] outputs: [565 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_252 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 541 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2807 [01/12/2022-09:32:16] [V] [TRT] MatMul_252 [MatMul] inputs: [541 -> (-1, -1, 768)[FLOAT]], [2807 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2807 for ONNX node: 2807 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_252 for ONNX node: MatMul_252 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 567 for ONNX tensor: 567 [01/12/2022-09:32:16] [V] [TRT] MatMul_252 [MatMul] outputs: [567 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_253 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 567 [01/12/2022-09:32:16] [V] [TRT] Add_253 [Add] inputs: [encoder.layers.1.self_attn.v_proj.bias -> (768)[FLOAT]], [567 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.self_attn.v_proj.bias for ONNX node: encoder.layers.1.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_253 for ONNX node: Add_253 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 568 for ONNX tensor: 568 [01/12/2022-09:32:16] [V] [TRT] Add_253 [Add] outputs: [568 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_254 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 544 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_254 [Unsqueeze] inputs: [544 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_254 for ONNX node: Unsqueeze_254 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 572 for ONNX tensor: 572 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_254 [Unsqueeze] outputs: [572 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_255 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 572 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2808 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2809 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2810 [01/12/2022-09:32:16] [V] [TRT] Concat_255 [Concat] inputs: [572 -> (1)[INT32]], [2808 -> (1)[INT32]], [2809 -> (1)[INT32]], [2810 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2808 for ONNX node: 2808 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2809 for ONNX node: 2809 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2810 for ONNX node: 2810 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_255 for ONNX node: Concat_255 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576 [01/12/2022-09:32:16] [V] [TRT] Concat_255 [Concat] outputs: [576 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_256 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 568 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 576 [01/12/2022-09:32:16] [V] [TRT] Reshape_256 [Reshape] inputs: [568 -> (-1, -1, 768)[FLOAT]], [576 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_256 for ONNX node: Reshape_256 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 577 for ONNX tensor: 577 [01/12/2022-09:32:16] [V] [TRT] Reshape_256 [Reshape] outputs: [577 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_257 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 577 [01/12/2022-09:32:16] [V] [TRT] Transpose_257 [Transpose] inputs: [577 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_257 for ONNX node: Transpose_257 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 578 for ONNX tensor: 578 [01/12/2022-09:32:16] [V] [TRT] Transpose_257 [Transpose] outputs: [578 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_258 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_258 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_258 [Constant] outputs: [579 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_259 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 544 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 579 [01/12/2022-09:32:16] [V] [TRT] Mul_259 [Mul] inputs: [544 -> ()[INT32]], [579 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 579 for ONNX node: 579 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_259 for ONNX node: Mul_259 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580 [01/12/2022-09:32:16] [V] [TRT] Mul_259 [Mul] outputs: [580 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_260 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 544 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_260 [Unsqueeze] inputs: [544 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_260 for ONNX node: Unsqueeze_260 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 583 for ONNX tensor: 583 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_260 [Unsqueeze] outputs: [583 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_261 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 547 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_261 [Unsqueeze] inputs: [547 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_261 for ONNX node: Unsqueeze_261 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_261 [Unsqueeze] outputs: [584 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_262 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 583 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 584 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2811 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2812 [01/12/2022-09:32:16] [V] [TRT] Concat_262 [Concat] inputs: [583 -> (1)[INT32]], [584 -> (1)[INT32]], [2811 -> (1)[INT32]], [2812 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2811 for ONNX node: 2811 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2812 for ONNX node: 2812 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_262 for ONNX node: Concat_262 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587 [01/12/2022-09:32:16] [V] [TRT] Concat_262 [Concat] outputs: [587 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_263 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 552 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 587 [01/12/2022-09:32:16] [V] [TRT] Reshape_263 [Reshape] inputs: [552 -> (-1, -1, 768)[FLOAT]], [587 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_263 for ONNX node: Reshape_263 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 588 for ONNX tensor: 588 [01/12/2022-09:32:16] [V] [TRT] Reshape_263 [Reshape] outputs: [588 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_264 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 588 [01/12/2022-09:32:16] [V] [TRT] Transpose_264 [Transpose] inputs: [588 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_264 for ONNX node: Transpose_264 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 589 for ONNX tensor: 589 [01/12/2022-09:32:16] [V] [TRT] Transpose_264 [Transpose] outputs: [589 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_265 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 580 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_265 [Unsqueeze] inputs: [580 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_265 for ONNX node: Unsqueeze_265 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 592 for ONNX tensor: 592 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_265 [Unsqueeze] outputs: [592 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_266 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 592 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2813 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2814 [01/12/2022-09:32:16] [V] [TRT] Concat_266 [Concat] inputs: [592 -> (1)[INT32]], [2813 -> (1)[INT32]], [2814 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2813 for ONNX node: 2813 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2814 for ONNX node: 2814 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_266 for ONNX node: Concat_266 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 595 for ONNX tensor: 595 [01/12/2022-09:32:16] [V] [TRT] Concat_266 [Concat] outputs: [595 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_267 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 589 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 595 [01/12/2022-09:32:16] [V] [TRT] Reshape_267 [Reshape] inputs: [589 -> (-1, 12, -1, 64)[FLOAT]], [595 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_267 for ONNX node: Reshape_267 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 596 for ONNX tensor: 596 [01/12/2022-09:32:16] [V] [TRT] Reshape_267 [Reshape] outputs: [596 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_268 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 580 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_268 [Unsqueeze] inputs: [580 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_268 for ONNX node: Unsqueeze_268 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 599 for ONNX tensor: 599 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_268 [Unsqueeze] outputs: [599 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_269 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 599 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2815 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2816 [01/12/2022-09:32:16] [V] [TRT] Concat_269 [Concat] inputs: [599 -> (1)[INT32]], [2815 -> (1)[INT32]], [2816 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2815 for ONNX node: 2815 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2816 for ONNX node: 2816 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_269 for ONNX node: Concat_269 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 602 for ONNX tensor: 602 [01/12/2022-09:32:16] [V] [TRT] Concat_269 [Concat] outputs: [602 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_270 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 565 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 602 [01/12/2022-09:32:16] [V] [TRT] Reshape_270 [Reshape] inputs: [565 -> (-1, 12, -1, 64)[FLOAT]], [602 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_270 for ONNX node: Reshape_270 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 603 for ONNX tensor: 603 [01/12/2022-09:32:16] [V] [TRT] Reshape_270 [Reshape] outputs: [603 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_271 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 580 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_271 [Unsqueeze] inputs: [580 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_271 for ONNX node: Unsqueeze_271 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 606 for ONNX tensor: 606 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_271 [Unsqueeze] outputs: [606 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_272 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 606 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2817 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2818 [01/12/2022-09:32:16] [V] [TRT] Concat_272 [Concat] inputs: [606 -> (1)[INT32]], [2817 -> (1)[INT32]], [2818 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2817 for ONNX node: 2817 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2818 for ONNX node: 2818 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_272 for ONNX node: Concat_272 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609 [01/12/2022-09:32:16] [V] [TRT] Concat_272 [Concat] outputs: [609 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_273 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 578 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 609 [01/12/2022-09:32:16] [V] [TRT] Reshape_273 [Reshape] inputs: [578 -> (-1, 12, -1, 64)[FLOAT]], [609 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_273 for ONNX node: Reshape_273 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 610 for ONNX tensor: 610 [01/12/2022-09:32:16] [V] [TRT] Reshape_273 [Reshape] outputs: [610 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_274 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 603 [01/12/2022-09:32:16] [V] [TRT] Transpose_274 [Transpose] inputs: [603 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_274 for ONNX node: Transpose_274 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 611 for ONNX tensor: 611 [01/12/2022-09:32:16] [V] [TRT] Transpose_274 [Transpose] outputs: [611 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_275 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 596 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 611 [01/12/2022-09:32:16] [V] [TRT] MatMul_275 [MatMul] inputs: [596 -> (-1, -1, 64)[FLOAT]], [611 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_275 for ONNX node: MatMul_275 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 612 for ONNX tensor: 612 [01/12/2022-09:32:16] [V] [TRT] MatMul_275 [MatMul] outputs: [612 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Softmax_276 [Softmax] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 612 [01/12/2022-09:32:16] [V] [TRT] Softmax_276 [Softmax] inputs: [612 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Softmax_276 for ONNX node: Softmax_276 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613 [01/12/2022-09:32:16] [V] [TRT] Softmax_276 [Softmax] outputs: [613 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_277 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 613 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 610 [01/12/2022-09:32:16] [V] [TRT] MatMul_277 [MatMul] inputs: [613 -> (-1, -1, -1)[FLOAT]], [610 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_277 for ONNX node: MatMul_277 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 614 for ONNX tensor: 614 [01/12/2022-09:32:16] [V] [TRT] MatMul_277 [MatMul] outputs: [614 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_278 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 544 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_278 [Unsqueeze] inputs: [544 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_278 for ONNX node: Unsqueeze_278 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 617 for ONNX tensor: 617 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_278 [Unsqueeze] outputs: [617 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_279 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 547 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_279 [Unsqueeze] inputs: [547 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_279 for ONNX node: Unsqueeze_279 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 619 for ONNX tensor: 619 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_279 [Unsqueeze] outputs: [619 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_280 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 617 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2819 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 619 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2820 [01/12/2022-09:32:16] [V] [TRT] Concat_280 [Concat] inputs: [617 -> (1)[INT32]], [2819 -> (1)[INT32]], [619 -> (1)[INT32]], [2820 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2819 for ONNX node: 2819 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2820 for ONNX node: 2820 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_280 for ONNX node: Concat_280 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621 [01/12/2022-09:32:16] [V] [TRT] Concat_280 [Concat] outputs: [621 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_281 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 614 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 621 [01/12/2022-09:32:16] [V] [TRT] Reshape_281 [Reshape] inputs: [614 -> (-1, -1, 64)[FLOAT]], [621 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_281 for ONNX node: Reshape_281 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 622 for ONNX tensor: 622 [01/12/2022-09:32:16] [V] [TRT] Reshape_281 [Reshape] outputs: [622 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_282 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 622 [01/12/2022-09:32:16] [V] [TRT] Transpose_282 [Transpose] inputs: [622 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_282 for ONNX node: Transpose_282 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 623 for ONNX tensor: 623 [01/12/2022-09:32:16] [V] [TRT] Transpose_282 [Transpose] outputs: [623 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_283 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 544 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_283 [Unsqueeze] inputs: [544 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_283 for ONNX node: Unsqueeze_283 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 625 for ONNX tensor: 625 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_283 [Unsqueeze] outputs: [625 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_284 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 547 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_284 [Unsqueeze] inputs: [547 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_284 for ONNX node: Unsqueeze_284 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 626 for ONNX tensor: 626 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_284 [Unsqueeze] outputs: [626 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_285 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 625 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 626 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2821 [01/12/2022-09:32:16] [V] [TRT] Concat_285 [Concat] inputs: [625 -> (1)[INT32]], [626 -> (1)[INT32]], [2821 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2821 for ONNX node: 2821 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_285 for ONNX node: Concat_285 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628 [01/12/2022-09:32:16] [V] [TRT] Concat_285 [Concat] outputs: [628 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_286 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 623 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 628 [01/12/2022-09:32:16] [V] [TRT] Reshape_286 [Reshape] inputs: [623 -> (-1, -1, 12, 64)[FLOAT]], [628 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_286 for ONNX node: Reshape_286 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629 [01/12/2022-09:32:16] [V] [TRT] Reshape_286 [Reshape] outputs: [629 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_287 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 629 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2822 [01/12/2022-09:32:16] [V] [TRT] MatMul_287 [MatMul] inputs: [629 -> (-1, -1, 768)[FLOAT]], [2822 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2822 for ONNX node: 2822 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_287 for ONNX node: MatMul_287 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 631 for ONNX tensor: 631 [01/12/2022-09:32:16] [V] [TRT] MatMul_287 [MatMul] outputs: [631 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_288 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 631 [01/12/2022-09:32:16] [V] [TRT] Add_288 [Add] inputs: [encoder.layers.1.self_attn.out_proj.bias -> (768)[FLOAT]], [631 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.self_attn.out_proj.bias for ONNX node: encoder.layers.1.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_288 for ONNX node: Add_288 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 632 for ONNX tensor: 632 [01/12/2022-09:32:16] [V] [TRT] Add_288 [Add] outputs: [632 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_289 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 541 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 632 [01/12/2022-09:32:16] [V] [TRT] Add_289 [Add] inputs: [541 -> (-1, -1, 768)[FLOAT]], [632 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_289 for ONNX node: Add_289 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 633 for ONNX tensor: 633 [01/12/2022-09:32:16] [V] [TRT] Add_289 [Add] outputs: [633 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_290 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 633 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_290 [ReduceMean] inputs: [633 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_290 for ONNX node: ReduceMean_290 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 634 for ONNX tensor: 634 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_290 [ReduceMean] outputs: [634 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_291 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 633 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 634 [01/12/2022-09:32:16] [V] [TRT] Sub_291 [Sub] inputs: [633 -> (-1, -1, 768)[FLOAT]], [634 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_291 for ONNX node: Sub_291 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 635 for ONNX tensor: 635 [01/12/2022-09:32:16] [V] [TRT] Sub_291 [Sub] outputs: [635 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_292 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_292 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_292 [Constant] outputs: [636 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_293 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 635 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 636 [01/12/2022-09:32:16] [V] [TRT] Pow_293 [Pow] inputs: [635 -> (-1, -1, 768)[FLOAT]], [636 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 636 for ONNX node: 636 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_293 for ONNX node: Pow_293 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637 [01/12/2022-09:32:16] [V] [TRT] Pow_293 [Pow] outputs: [637 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_294 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 637 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_294 [ReduceMean] inputs: [637 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_294 for ONNX node: ReduceMean_294 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 638 for ONNX tensor: 638 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_294 [ReduceMean] outputs: [638 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_295 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_295 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_295 [Constant] outputs: [639 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_296 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 638 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 639 [01/12/2022-09:32:16] [V] [TRT] Add_296 [Add] inputs: [638 -> (-1, -1, 1)[FLOAT]], [639 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 639 for ONNX node: 639 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_296 for ONNX node: Add_296 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640 [01/12/2022-09:32:16] [V] [TRT] Add_296 [Add] outputs: [640 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_297 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 640 [01/12/2022-09:32:16] [V] [TRT] Sqrt_297 [Sqrt] inputs: [640 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_297 for ONNX node: Sqrt_297 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 641 for ONNX tensor: 641 [01/12/2022-09:32:16] [V] [TRT] Sqrt_297 [Sqrt] outputs: [641 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_298 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 635 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 641 [01/12/2022-09:32:16] [V] [TRT] Div_298 [Div] inputs: [635 -> (-1, -1, 768)[FLOAT]], [641 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_298 for ONNX node: Div_298 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642 [01/12/2022-09:32:16] [V] [TRT] Div_298 [Div] outputs: [642 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_299 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 642 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_299 [Mul] inputs: [642 -> (-1, -1, 768)[FLOAT]], [encoder.layers.1.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.self_attn_layer_norm.weight for ONNX node: encoder.layers.1.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_299 for ONNX node: Mul_299 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643 [01/12/2022-09:32:16] [V] [TRT] Mul_299 [Mul] outputs: [643 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_300 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 643 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_300 [Add] inputs: [643 -> (-1, -1, 768)[FLOAT]], [encoder.layers.1.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.self_attn_layer_norm.bias for ONNX node: encoder.layers.1.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_300 for ONNX node: Add_300 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 644 for ONNX tensor: 644 [01/12/2022-09:32:16] [V] [TRT] Add_300 [Add] outputs: [644 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_301 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 644 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2823 [01/12/2022-09:32:16] [V] [TRT] MatMul_301 [MatMul] inputs: [644 -> (-1, -1, 768)[FLOAT]], [2823 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2823 for ONNX node: 2823 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_301 for ONNX node: MatMul_301 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646 [01/12/2022-09:32:16] [V] [TRT] MatMul_301 [MatMul] outputs: [646 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_302 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 646 [01/12/2022-09:32:16] [V] [TRT] Add_302 [Add] inputs: [encoder.layers.1.fc1.bias -> (3072)[FLOAT]], [646 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.fc1.bias for ONNX node: encoder.layers.1.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_302 for ONNX node: Add_302 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647 [01/12/2022-09:32:16] [V] [TRT] Add_302 [Add] outputs: [647 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_303 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_303 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_303 [Constant] outputs: [648 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_304 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 647 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 648 [01/12/2022-09:32:16] [V] [TRT] Div_304 [Div] inputs: [647 -> (-1, -1, 3072)[FLOAT]], [648 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 648 for ONNX node: 648 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_304 for ONNX node: Div_304 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 649 for ONNX tensor: 649 [01/12/2022-09:32:16] [V] [TRT] Div_304 [Div] outputs: [649 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Erf_305 [Erf] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 649 [01/12/2022-09:32:16] [V] [TRT] Erf_305 [Erf] inputs: [649 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Erf_305 for ONNX node: Erf_305 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 650 for ONNX tensor: 650 [01/12/2022-09:32:16] [V] [TRT] Erf_305 [Erf] outputs: [650 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_306 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_306 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_306 [Constant] outputs: [651 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_307 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 650 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 651 [01/12/2022-09:32:16] [V] [TRT] Add_307 [Add] inputs: [650 -> (-1, -1, 3072)[FLOAT]], [651 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 651 for ONNX node: 651 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_307 for ONNX node: Add_307 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 652 for ONNX tensor: 652 [01/12/2022-09:32:16] [V] [TRT] Add_307 [Add] outputs: [652 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_308 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 647 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 652 [01/12/2022-09:32:16] [V] [TRT] Mul_308 [Mul] inputs: [647 -> (-1, -1, 3072)[FLOAT]], [652 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_308 for ONNX node: Mul_308 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 653 for ONNX tensor: 653 [01/12/2022-09:32:16] [V] [TRT] Mul_308 [Mul] outputs: [653 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_309 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_309 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_309 [Constant] outputs: [654 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_310 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 653 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 654 [01/12/2022-09:32:16] [V] [TRT] Mul_310 [Mul] inputs: [653 -> (-1, -1, 3072)[FLOAT]], [654 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 654 for ONNX node: 654 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_310 for ONNX node: Mul_310 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 655 for ONNX tensor: 655 [01/12/2022-09:32:16] [V] [TRT] Mul_310 [Mul] outputs: [655 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_311 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 655 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2824 [01/12/2022-09:32:16] [V] [TRT] MatMul_311 [MatMul] inputs: [655 -> (-1, -1, 3072)[FLOAT]], [2824 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2824 for ONNX node: 2824 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_311 for ONNX node: MatMul_311 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657 [01/12/2022-09:32:16] [V] [TRT] MatMul_311 [MatMul] outputs: [657 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_312 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 657 [01/12/2022-09:32:16] [V] [TRT] Add_312 [Add] inputs: [encoder.layers.1.fc2.bias -> (768)[FLOAT]], [657 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.fc2.bias for ONNX node: encoder.layers.1.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_312 for ONNX node: Add_312 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 658 for ONNX tensor: 658 [01/12/2022-09:32:16] [V] [TRT] Add_312 [Add] outputs: [658 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_313 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 644 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 658 [01/12/2022-09:32:16] [V] [TRT] Add_313 [Add] inputs: [644 -> (-1, -1, 768)[FLOAT]], [658 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_313 for ONNX node: Add_313 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 659 for ONNX tensor: 659 [01/12/2022-09:32:16] [V] [TRT] Add_313 [Add] outputs: [659 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_314 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 659 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_314 [ReduceMean] inputs: [659 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_314 for ONNX node: ReduceMean_314 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 660 for ONNX tensor: 660 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_314 [ReduceMean] outputs: [660 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_315 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 659 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 660 [01/12/2022-09:32:16] [V] [TRT] Sub_315 [Sub] inputs: [659 -> (-1, -1, 768)[FLOAT]], [660 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_315 for ONNX node: Sub_315 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 661 for ONNX tensor: 661 [01/12/2022-09:32:16] [V] [TRT] Sub_315 [Sub] outputs: [661 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_316 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_316 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_316 [Constant] outputs: [662 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_317 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 661 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 662 [01/12/2022-09:32:16] [V] [TRT] Pow_317 [Pow] inputs: [661 -> (-1, -1, 768)[FLOAT]], [662 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 662 for ONNX node: 662 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_317 for ONNX node: Pow_317 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 663 for ONNX tensor: 663 [01/12/2022-09:32:16] [V] [TRT] Pow_317 [Pow] outputs: [663 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_318 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 663 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_318 [ReduceMean] inputs: [663 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_318 for ONNX node: ReduceMean_318 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 664 for ONNX tensor: 664 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_318 [ReduceMean] outputs: [664 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_319 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_319 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_319 [Constant] outputs: [665 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_320 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 664 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 665 [01/12/2022-09:32:16] [V] [TRT] Add_320 [Add] inputs: [664 -> (-1, -1, 1)[FLOAT]], [665 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 665 for ONNX node: 665 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_320 for ONNX node: Add_320 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 666 for ONNX tensor: 666 [01/12/2022-09:32:16] [V] [TRT] Add_320 [Add] outputs: [666 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_321 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 666 [01/12/2022-09:32:16] [V] [TRT] Sqrt_321 [Sqrt] inputs: [666 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_321 for ONNX node: Sqrt_321 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 667 for ONNX tensor: 667 [01/12/2022-09:32:16] [V] [TRT] Sqrt_321 [Sqrt] outputs: [667 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_322 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 661 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 667 [01/12/2022-09:32:16] [V] [TRT] Div_322 [Div] inputs: [661 -> (-1, -1, 768)[FLOAT]], [667 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_322 for ONNX node: Div_322 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 668 for ONNX tensor: 668 [01/12/2022-09:32:16] [V] [TRT] Div_322 [Div] outputs: [668 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_323 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 668 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.final_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_323 [Mul] inputs: [668 -> (-1, -1, 768)[FLOAT]], [encoder.layers.1.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.final_layer_norm.weight for ONNX node: encoder.layers.1.final_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_323 for ONNX node: Mul_323 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 669 for ONNX tensor: 669 [01/12/2022-09:32:16] [V] [TRT] Mul_323 [Mul] outputs: [669 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_324 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 669 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.1.final_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_324 [Add] inputs: [669 -> (-1, -1, 768)[FLOAT]], [encoder.layers.1.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.1.final_layer_norm.bias for ONNX node: encoder.layers.1.final_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_324 for ONNX node: Add_324 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 670 for ONNX tensor: 670 [01/12/2022-09:32:16] [V] [TRT] Add_324 [Add] outputs: [670 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Shape_325 [Shape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 670 [01/12/2022-09:32:16] [V] [TRT] Shape_325 [Shape] inputs: [670 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Shape_325 for ONNX node: Shape_325 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 671 for ONNX tensor: 671 [01/12/2022-09:32:16] [V] [TRT] Shape_325 [Shape] outputs: [671 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_326 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_326 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_326 [Constant] outputs: [672 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Gather_327 [Gather] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 671 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 672 [01/12/2022-09:32:16] [V] [TRT] Gather_327 [Gather] inputs: [671 -> (3)[INT32]], [672 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 672 for ONNX node: 672 [01/12/2022-09:32:16] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Gather_327 for ONNX node: Gather_327 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673 [01/12/2022-09:32:16] [V] [TRT] Gather_327 [Gather] outputs: [673 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Shape_328 [Shape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 670 [01/12/2022-09:32:16] [V] [TRT] Shape_328 [Shape] inputs: [670 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Shape_328 for ONNX node: Shape_328 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 674 for ONNX tensor: 674 [01/12/2022-09:32:16] [V] [TRT] Shape_328 [Shape] outputs: [674 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_329 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_329 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_329 [Constant] outputs: [675 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Gather_330 [Gather] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 674 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 675 [01/12/2022-09:32:16] [V] [TRT] Gather_330 [Gather] inputs: [674 -> (3)[INT32]], [675 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 675 for ONNX node: 675 [01/12/2022-09:32:16] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Gather_330 for ONNX node: Gather_330 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 676 for ONNX tensor: 676 [01/12/2022-09:32:16] [V] [TRT] Gather_330 [Gather] outputs: [676 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_331 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 670 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2825 [01/12/2022-09:32:16] [V] [TRT] MatMul_331 [MatMul] inputs: [670 -> (-1, -1, 768)[FLOAT]], [2825 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2825 for ONNX node: 2825 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_331 for ONNX node: MatMul_331 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 678 for ONNX tensor: 678 [01/12/2022-09:32:16] [V] [TRT] MatMul_331 [MatMul] outputs: [678 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_332 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.self_attn.q_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 678 [01/12/2022-09:32:16] [V] [TRT] Add_332 [Add] inputs: [encoder.layers.2.self_attn.q_proj.bias -> (768)[FLOAT]], [678 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.self_attn.q_proj.bias for ONNX node: encoder.layers.2.self_attn.q_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_332 for ONNX node: Add_332 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 679 for ONNX tensor: 679 [01/12/2022-09:32:16] [V] [TRT] Add_332 [Add] outputs: [679 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_333 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_333 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_333 [Constant] outputs: [680 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_334 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 679 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 680 [01/12/2022-09:32:16] [V] [TRT] Mul_334 [Mul] inputs: [679 -> (-1, -1, 768)[FLOAT]], [680 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 680 for ONNX node: 680 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_334 for ONNX node: Mul_334 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 681 for ONNX tensor: 681 [01/12/2022-09:32:16] [V] [TRT] Mul_334 [Mul] outputs: [681 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_335 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 670 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2826 [01/12/2022-09:32:16] [V] [TRT] MatMul_335 [MatMul] inputs: [670 -> (-1, -1, 768)[FLOAT]], [2826 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2826 for ONNX node: 2826 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_335 for ONNX node: MatMul_335 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 683 for ONNX tensor: 683 [01/12/2022-09:32:16] [V] [TRT] MatMul_335 [MatMul] outputs: [683 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_336 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.self_attn.k_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 683 [01/12/2022-09:32:16] [V] [TRT] Add_336 [Add] inputs: [encoder.layers.2.self_attn.k_proj.bias -> (768)[FLOAT]], [683 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.self_attn.k_proj.bias for ONNX node: encoder.layers.2.self_attn.k_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_336 for ONNX node: Add_336 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 684 for ONNX tensor: 684 [01/12/2022-09:32:16] [V] [TRT] Add_336 [Add] outputs: [684 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_337 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 673 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_337 [Unsqueeze] inputs: [673 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_337 for ONNX node: Unsqueeze_337 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 688 for ONNX tensor: 688 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_337 [Unsqueeze] outputs: [688 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_338 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 688 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2827 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2828 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2829 [01/12/2022-09:32:16] [V] [TRT] Concat_338 [Concat] inputs: [688 -> (1)[INT32]], [2827 -> (1)[INT32]], [2828 -> (1)[INT32]], [2829 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2827 for ONNX node: 2827 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2828 for ONNX node: 2828 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2829 for ONNX node: 2829 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_338 for ONNX node: Concat_338 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 692 for ONNX tensor: 692 [01/12/2022-09:32:16] [V] [TRT] Concat_338 [Concat] outputs: [692 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_339 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 684 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 692 [01/12/2022-09:32:16] [V] [TRT] Reshape_339 [Reshape] inputs: [684 -> (-1, -1, 768)[FLOAT]], [692 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_339 for ONNX node: Reshape_339 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 693 for ONNX tensor: 693 [01/12/2022-09:32:16] [V] [TRT] Reshape_339 [Reshape] outputs: [693 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_340 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 693 [01/12/2022-09:32:16] [V] [TRT] Transpose_340 [Transpose] inputs: [693 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_340 for ONNX node: Transpose_340 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 694 for ONNX tensor: 694 [01/12/2022-09:32:16] [V] [TRT] Transpose_340 [Transpose] outputs: [694 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_341 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 670 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2830 [01/12/2022-09:32:16] [V] [TRT] MatMul_341 [MatMul] inputs: [670 -> (-1, -1, 768)[FLOAT]], [2830 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2830 for ONNX node: 2830 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_341 for ONNX node: MatMul_341 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 696 for ONNX tensor: 696 [01/12/2022-09:32:16] [V] [TRT] MatMul_341 [MatMul] outputs: [696 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_342 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 696 [01/12/2022-09:32:16] [V] [TRT] Add_342 [Add] inputs: [encoder.layers.2.self_attn.v_proj.bias -> (768)[FLOAT]], [696 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.self_attn.v_proj.bias for ONNX node: encoder.layers.2.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_342 for ONNX node: Add_342 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 697 for ONNX tensor: 697 [01/12/2022-09:32:16] [V] [TRT] Add_342 [Add] outputs: [697 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_343 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 673 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_343 [Unsqueeze] inputs: [673 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_343 for ONNX node: Unsqueeze_343 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 701 for ONNX tensor: 701 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_343 [Unsqueeze] outputs: [701 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_344 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 701 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2831 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2832 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2833 [01/12/2022-09:32:16] [V] [TRT] Concat_344 [Concat] inputs: [701 -> (1)[INT32]], [2831 -> (1)[INT32]], [2832 -> (1)[INT32]], [2833 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2831 for ONNX node: 2831 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2832 for ONNX node: 2832 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2833 for ONNX node: 2833 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_344 for ONNX node: Concat_344 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 705 for ONNX tensor: 705 [01/12/2022-09:32:16] [V] [TRT] Concat_344 [Concat] outputs: [705 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_345 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 697 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 705 [01/12/2022-09:32:16] [V] [TRT] Reshape_345 [Reshape] inputs: [697 -> (-1, -1, 768)[FLOAT]], [705 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_345 for ONNX node: Reshape_345 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 706 for ONNX tensor: 706 [01/12/2022-09:32:16] [V] [TRT] Reshape_345 [Reshape] outputs: [706 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_346 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 706 [01/12/2022-09:32:16] [V] [TRT] Transpose_346 [Transpose] inputs: [706 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_346 for ONNX node: Transpose_346 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 707 for ONNX tensor: 707 [01/12/2022-09:32:16] [V] [TRT] Transpose_346 [Transpose] outputs: [707 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_347 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_347 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_347 [Constant] outputs: [708 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_348 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 673 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 708 [01/12/2022-09:32:16] [V] [TRT] Mul_348 [Mul] inputs: [673 -> ()[INT32]], [708 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 708 for ONNX node: 708 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_348 for ONNX node: Mul_348 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 709 for ONNX tensor: 709 [01/12/2022-09:32:16] [V] [TRT] Mul_348 [Mul] outputs: [709 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_349 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 673 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_349 [Unsqueeze] inputs: [673 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_349 for ONNX node: Unsqueeze_349 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 712 for ONNX tensor: 712 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_349 [Unsqueeze] outputs: [712 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_350 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 676 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_350 [Unsqueeze] inputs: [676 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_350 for ONNX node: Unsqueeze_350 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 713 for ONNX tensor: 713 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_350 [Unsqueeze] outputs: [713 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_351 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 712 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 713 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2834 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2835 [01/12/2022-09:32:16] [V] [TRT] Concat_351 [Concat] inputs: [712 -> (1)[INT32]], [713 -> (1)[INT32]], [2834 -> (1)[INT32]], [2835 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2834 for ONNX node: 2834 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2835 for ONNX node: 2835 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_351 for ONNX node: Concat_351 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 716 for ONNX tensor: 716 [01/12/2022-09:32:16] [V] [TRT] Concat_351 [Concat] outputs: [716 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_352 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 681 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 716 [01/12/2022-09:32:16] [V] [TRT] Reshape_352 [Reshape] inputs: [681 -> (-1, -1, 768)[FLOAT]], [716 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_352 for ONNX node: Reshape_352 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 717 for ONNX tensor: 717 [01/12/2022-09:32:16] [V] [TRT] Reshape_352 [Reshape] outputs: [717 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_353 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 717 [01/12/2022-09:32:16] [V] [TRT] Transpose_353 [Transpose] inputs: [717 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_353 for ONNX node: Transpose_353 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 718 for ONNX tensor: 718 [01/12/2022-09:32:16] [V] [TRT] Transpose_353 [Transpose] outputs: [718 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_354 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 709 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_354 [Unsqueeze] inputs: [709 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_354 for ONNX node: Unsqueeze_354 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 721 for ONNX tensor: 721 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_354 [Unsqueeze] outputs: [721 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_355 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 721 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2836 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2837 [01/12/2022-09:32:16] [V] [TRT] Concat_355 [Concat] inputs: [721 -> (1)[INT32]], [2836 -> (1)[INT32]], [2837 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2836 for ONNX node: 2836 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2837 for ONNX node: 2837 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_355 for ONNX node: Concat_355 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724 [01/12/2022-09:32:16] [V] [TRT] Concat_355 [Concat] outputs: [724 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_356 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 718 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 724 [01/12/2022-09:32:16] [V] [TRT] Reshape_356 [Reshape] inputs: [718 -> (-1, 12, -1, 64)[FLOAT]], [724 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_356 for ONNX node: Reshape_356 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 725 for ONNX tensor: 725 [01/12/2022-09:32:16] [V] [TRT] Reshape_356 [Reshape] outputs: [725 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_357 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 709 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_357 [Unsqueeze] inputs: [709 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_357 for ONNX node: Unsqueeze_357 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 728 for ONNX tensor: 728 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_357 [Unsqueeze] outputs: [728 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_358 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 728 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2838 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2839 [01/12/2022-09:32:16] [V] [TRT] Concat_358 [Concat] inputs: [728 -> (1)[INT32]], [2838 -> (1)[INT32]], [2839 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2838 for ONNX node: 2838 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2839 for ONNX node: 2839 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_358 for ONNX node: Concat_358 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 731 for ONNX tensor: 731 [01/12/2022-09:32:16] [V] [TRT] Concat_358 [Concat] outputs: [731 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_359 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 694 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 731 [01/12/2022-09:32:16] [V] [TRT] Reshape_359 [Reshape] inputs: [694 -> (-1, 12, -1, 64)[FLOAT]], [731 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_359 for ONNX node: Reshape_359 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 732 for ONNX tensor: 732 [01/12/2022-09:32:16] [V] [TRT] Reshape_359 [Reshape] outputs: [732 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_360 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 709 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_360 [Unsqueeze] inputs: [709 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_360 for ONNX node: Unsqueeze_360 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 735 for ONNX tensor: 735 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_360 [Unsqueeze] outputs: [735 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_361 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 735 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2840 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2841 [01/12/2022-09:32:16] [V] [TRT] Concat_361 [Concat] inputs: [735 -> (1)[INT32]], [2840 -> (1)[INT32]], [2841 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2840 for ONNX node: 2840 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2841 for ONNX node: 2841 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_361 for ONNX node: Concat_361 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738 [01/12/2022-09:32:16] [V] [TRT] Concat_361 [Concat] outputs: [738 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_362 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 707 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 738 [01/12/2022-09:32:16] [V] [TRT] Reshape_362 [Reshape] inputs: [707 -> (-1, 12, -1, 64)[FLOAT]], [738 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_362 for ONNX node: Reshape_362 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739 [01/12/2022-09:32:16] [V] [TRT] Reshape_362 [Reshape] outputs: [739 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_363 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 732 [01/12/2022-09:32:16] [V] [TRT] Transpose_363 [Transpose] inputs: [732 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_363 for ONNX node: Transpose_363 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 740 for ONNX tensor: 740 [01/12/2022-09:32:16] [V] [TRT] Transpose_363 [Transpose] outputs: [740 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_364 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 725 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 740 [01/12/2022-09:32:16] [V] [TRT] MatMul_364 [MatMul] inputs: [725 -> (-1, -1, 64)[FLOAT]], [740 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_364 for ONNX node: MatMul_364 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741 [01/12/2022-09:32:16] [V] [TRT] MatMul_364 [MatMul] outputs: [741 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Softmax_365 [Softmax] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 741 [01/12/2022-09:32:16] [V] [TRT] Softmax_365 [Softmax] inputs: [741 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Softmax_365 for ONNX node: Softmax_365 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742 [01/12/2022-09:32:16] [V] [TRT] Softmax_365 [Softmax] outputs: [742 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_366 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 742 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 739 [01/12/2022-09:32:16] [V] [TRT] MatMul_366 [MatMul] inputs: [742 -> (-1, -1, -1)[FLOAT]], [739 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_366 for ONNX node: MatMul_366 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743 [01/12/2022-09:32:16] [V] [TRT] MatMul_366 [MatMul] outputs: [743 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_367 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 673 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_367 [Unsqueeze] inputs: [673 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_367 for ONNX node: Unsqueeze_367 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 746 for ONNX tensor: 746 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_367 [Unsqueeze] outputs: [746 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_368 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 676 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_368 [Unsqueeze] inputs: [676 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_368 for ONNX node: Unsqueeze_368 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 748 for ONNX tensor: 748 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_368 [Unsqueeze] outputs: [748 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_369 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 746 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2842 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 748 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2843 [01/12/2022-09:32:16] [V] [TRT] Concat_369 [Concat] inputs: [746 -> (1)[INT32]], [2842 -> (1)[INT32]], [748 -> (1)[INT32]], [2843 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2842 for ONNX node: 2842 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2843 for ONNX node: 2843 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_369 for ONNX node: Concat_369 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 750 for ONNX tensor: 750 [01/12/2022-09:32:16] [V] [TRT] Concat_369 [Concat] outputs: [750 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_370 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 743 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 750 [01/12/2022-09:32:16] [V] [TRT] Reshape_370 [Reshape] inputs: [743 -> (-1, -1, 64)[FLOAT]], [750 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_370 for ONNX node: Reshape_370 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 751 for ONNX tensor: 751 [01/12/2022-09:32:16] [V] [TRT] Reshape_370 [Reshape] outputs: [751 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_371 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 751 [01/12/2022-09:32:16] [V] [TRT] Transpose_371 [Transpose] inputs: [751 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_371 for ONNX node: Transpose_371 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 752 for ONNX tensor: 752 [01/12/2022-09:32:16] [V] [TRT] Transpose_371 [Transpose] outputs: [752 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_372 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 673 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_372 [Unsqueeze] inputs: [673 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_372 for ONNX node: Unsqueeze_372 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 754 for ONNX tensor: 754 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_372 [Unsqueeze] outputs: [754 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_373 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 676 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_373 [Unsqueeze] inputs: [676 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_373 for ONNX node: Unsqueeze_373 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 755 for ONNX tensor: 755 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_373 [Unsqueeze] outputs: [755 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_374 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 754 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 755 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2844 [01/12/2022-09:32:16] [V] [TRT] Concat_374 [Concat] inputs: [754 -> (1)[INT32]], [755 -> (1)[INT32]], [2844 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2844 for ONNX node: 2844 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_374 for ONNX node: Concat_374 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 757 for ONNX tensor: 757 [01/12/2022-09:32:16] [V] [TRT] Concat_374 [Concat] outputs: [757 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_375 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 752 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 757 [01/12/2022-09:32:16] [V] [TRT] Reshape_375 [Reshape] inputs: [752 -> (-1, -1, 12, 64)[FLOAT]], [757 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_375 for ONNX node: Reshape_375 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 758 for ONNX tensor: 758 [01/12/2022-09:32:16] [V] [TRT] Reshape_375 [Reshape] outputs: [758 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_376 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 758 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2845 [01/12/2022-09:32:16] [V] [TRT] MatMul_376 [MatMul] inputs: [758 -> (-1, -1, 768)[FLOAT]], [2845 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2845 for ONNX node: 2845 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_376 for ONNX node: MatMul_376 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760 [01/12/2022-09:32:16] [V] [TRT] MatMul_376 [MatMul] outputs: [760 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_377 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 760 [01/12/2022-09:32:16] [V] [TRT] Add_377 [Add] inputs: [encoder.layers.2.self_attn.out_proj.bias -> (768)[FLOAT]], [760 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.self_attn.out_proj.bias for ONNX node: encoder.layers.2.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_377 for ONNX node: Add_377 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 761 for ONNX tensor: 761 [01/12/2022-09:32:16] [V] [TRT] Add_377 [Add] outputs: [761 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_378 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 670 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 761 [01/12/2022-09:32:16] [V] [TRT] Add_378 [Add] inputs: [670 -> (-1, -1, 768)[FLOAT]], [761 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_378 for ONNX node: Add_378 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762 [01/12/2022-09:32:16] [V] [TRT] Add_378 [Add] outputs: [762 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_379 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 762 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_379 [ReduceMean] inputs: [762 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_379 for ONNX node: ReduceMean_379 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_379 [ReduceMean] outputs: [763 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_380 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 762 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 763 [01/12/2022-09:32:16] [V] [TRT] Sub_380 [Sub] inputs: [762 -> (-1, -1, 768)[FLOAT]], [763 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_380 for ONNX node: Sub_380 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764 [01/12/2022-09:32:16] [V] [TRT] Sub_380 [Sub] outputs: [764 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_381 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_381 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_381 [Constant] outputs: [765 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_382 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 764 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 765 [01/12/2022-09:32:16] [V] [TRT] Pow_382 [Pow] inputs: [764 -> (-1, -1, 768)[FLOAT]], [765 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 765 for ONNX node: 765 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_382 for ONNX node: Pow_382 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766 [01/12/2022-09:32:16] [V] [TRT] Pow_382 [Pow] outputs: [766 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_383 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 766 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_383 [ReduceMean] inputs: [766 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_383 for ONNX node: ReduceMean_383 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 767 for ONNX tensor: 767 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_383 [ReduceMean] outputs: [767 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_384 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_384 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_384 [Constant] outputs: [768 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_385 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 767 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 768 [01/12/2022-09:32:16] [V] [TRT] Add_385 [Add] inputs: [767 -> (-1, -1, 1)[FLOAT]], [768 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 768 for ONNX node: 768 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_385 for ONNX node: Add_385 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769 [01/12/2022-09:32:16] [V] [TRT] Add_385 [Add] outputs: [769 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_386 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 769 [01/12/2022-09:32:16] [V] [TRT] Sqrt_386 [Sqrt] inputs: [769 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_386 for ONNX node: Sqrt_386 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770 [01/12/2022-09:32:16] [V] [TRT] Sqrt_386 [Sqrt] outputs: [770 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_387 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 764 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 770 [01/12/2022-09:32:16] [V] [TRT] Div_387 [Div] inputs: [764 -> (-1, -1, 768)[FLOAT]], [770 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_387 for ONNX node: Div_387 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771 [01/12/2022-09:32:16] [V] [TRT] Div_387 [Div] outputs: [771 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_388 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 771 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_388 [Mul] inputs: [771 -> (-1, -1, 768)[FLOAT]], [encoder.layers.2.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.self_attn_layer_norm.weight for ONNX node: encoder.layers.2.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_388 for ONNX node: Mul_388 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 772 for ONNX tensor: 772 [01/12/2022-09:32:16] [V] [TRT] Mul_388 [Mul] outputs: [772 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_389 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 772 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_389 [Add] inputs: [772 -> (-1, -1, 768)[FLOAT]], [encoder.layers.2.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.self_attn_layer_norm.bias for ONNX node: encoder.layers.2.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_389 for ONNX node: Add_389 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773 [01/12/2022-09:32:16] [V] [TRT] Add_389 [Add] outputs: [773 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_390 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 773 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2846 [01/12/2022-09:32:16] [V] [TRT] MatMul_390 [MatMul] inputs: [773 -> (-1, -1, 768)[FLOAT]], [2846 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2846 for ONNX node: 2846 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_390 for ONNX node: MatMul_390 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 775 for ONNX tensor: 775 [01/12/2022-09:32:16] [V] [TRT] MatMul_390 [MatMul] outputs: [775 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_391 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 775 [01/12/2022-09:32:16] [V] [TRT] Add_391 [Add] inputs: [encoder.layers.2.fc1.bias -> (3072)[FLOAT]], [775 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.fc1.bias for ONNX node: encoder.layers.2.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_391 for ONNX node: Add_391 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 776 for ONNX tensor: 776 [01/12/2022-09:32:16] [V] [TRT] Add_391 [Add] outputs: [776 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_392 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_392 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_392 [Constant] outputs: [777 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_393 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 776 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 777 [01/12/2022-09:32:16] [V] [TRT] Div_393 [Div] inputs: [776 -> (-1, -1, 3072)[FLOAT]], [777 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 777 for ONNX node: 777 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_393 for ONNX node: Div_393 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 778 for ONNX tensor: 778 [01/12/2022-09:32:16] [V] [TRT] Div_393 [Div] outputs: [778 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Erf_394 [Erf] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 778 [01/12/2022-09:32:16] [V] [TRT] Erf_394 [Erf] inputs: [778 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Erf_394 for ONNX node: Erf_394 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 779 for ONNX tensor: 779 [01/12/2022-09:32:16] [V] [TRT] Erf_394 [Erf] outputs: [779 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_395 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_395 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_395 [Constant] outputs: [780 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_396 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 779 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 780 [01/12/2022-09:32:16] [V] [TRT] Add_396 [Add] inputs: [779 -> (-1, -1, 3072)[FLOAT]], [780 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 780 for ONNX node: 780 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_396 for ONNX node: Add_396 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 781 for ONNX tensor: 781 [01/12/2022-09:32:16] [V] [TRT] Add_396 [Add] outputs: [781 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_397 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 776 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 781 [01/12/2022-09:32:16] [V] [TRT] Mul_397 [Mul] inputs: [776 -> (-1, -1, 3072)[FLOAT]], [781 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_397 for ONNX node: Mul_397 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 782 for ONNX tensor: 782 [01/12/2022-09:32:16] [V] [TRT] Mul_397 [Mul] outputs: [782 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_398 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_398 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_398 [Constant] outputs: [783 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_399 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 782 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 783 [01/12/2022-09:32:16] [V] [TRT] Mul_399 [Mul] inputs: [782 -> (-1, -1, 3072)[FLOAT]], [783 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 783 for ONNX node: 783 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_399 for ONNX node: Mul_399 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 784 for ONNX tensor: 784 [01/12/2022-09:32:16] [V] [TRT] Mul_399 [Mul] outputs: [784 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_400 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 784 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2847 [01/12/2022-09:32:16] [V] [TRT] MatMul_400 [MatMul] inputs: [784 -> (-1, -1, 3072)[FLOAT]], [2847 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2847 for ONNX node: 2847 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_400 for ONNX node: MatMul_400 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786 [01/12/2022-09:32:16] [V] [TRT] MatMul_400 [MatMul] outputs: [786 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_401 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 786 [01/12/2022-09:32:16] [V] [TRT] Add_401 [Add] inputs: [encoder.layers.2.fc2.bias -> (768)[FLOAT]], [786 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.fc2.bias for ONNX node: encoder.layers.2.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_401 for ONNX node: Add_401 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 787 for ONNX tensor: 787 [01/12/2022-09:32:16] [V] [TRT] Add_401 [Add] outputs: [787 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_402 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 773 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 787 [01/12/2022-09:32:16] [V] [TRT] Add_402 [Add] inputs: [773 -> (-1, -1, 768)[FLOAT]], [787 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_402 for ONNX node: Add_402 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 788 for ONNX tensor: 788 [01/12/2022-09:32:16] [V] [TRT] Add_402 [Add] outputs: [788 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_403 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 788 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_403 [ReduceMean] inputs: [788 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_403 for ONNX node: ReduceMean_403 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 789 for ONNX tensor: 789 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_403 [ReduceMean] outputs: [789 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_404 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 788 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 789 [01/12/2022-09:32:16] [V] [TRT] Sub_404 [Sub] inputs: [788 -> (-1, -1, 768)[FLOAT]], [789 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_404 for ONNX node: Sub_404 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 790 for ONNX tensor: 790 [01/12/2022-09:32:16] [V] [TRT] Sub_404 [Sub] outputs: [790 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_405 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_405 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_405 [Constant] outputs: [791 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_406 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 790 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 791 [01/12/2022-09:32:16] [V] [TRT] Pow_406 [Pow] inputs: [790 -> (-1, -1, 768)[FLOAT]], [791 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 791 for ONNX node: 791 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_406 for ONNX node: Pow_406 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 792 for ONNX tensor: 792 [01/12/2022-09:32:16] [V] [TRT] Pow_406 [Pow] outputs: [792 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_407 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 792 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_407 [ReduceMean] inputs: [792 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_407 for ONNX node: ReduceMean_407 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 793 for ONNX tensor: 793 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_407 [ReduceMean] outputs: [793 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_408 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_408 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_408 [Constant] outputs: [794 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_409 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 793 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 794 [01/12/2022-09:32:16] [V] [TRT] Add_409 [Add] inputs: [793 -> (-1, -1, 1)[FLOAT]], [794 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 794 for ONNX node: 794 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_409 for ONNX node: Add_409 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795 [01/12/2022-09:32:16] [V] [TRT] Add_409 [Add] outputs: [795 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_410 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 795 [01/12/2022-09:32:16] [V] [TRT] Sqrt_410 [Sqrt] inputs: [795 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_410 for ONNX node: Sqrt_410 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 796 for ONNX tensor: 796 [01/12/2022-09:32:16] [V] [TRT] Sqrt_410 [Sqrt] outputs: [796 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_411 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 790 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 796 [01/12/2022-09:32:16] [V] [TRT] Div_411 [Div] inputs: [790 -> (-1, -1, 768)[FLOAT]], [796 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_411 for ONNX node: Div_411 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 797 for ONNX tensor: 797 [01/12/2022-09:32:16] [V] [TRT] Div_411 [Div] outputs: [797 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_412 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 797 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.final_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_412 [Mul] inputs: [797 -> (-1, -1, 768)[FLOAT]], [encoder.layers.2.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.final_layer_norm.weight for ONNX node: encoder.layers.2.final_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_412 for ONNX node: Mul_412 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 798 for ONNX tensor: 798 [01/12/2022-09:32:16] [V] [TRT] Mul_412 [Mul] outputs: [798 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_413 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 798 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.2.final_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_413 [Add] inputs: [798 -> (-1, -1, 768)[FLOAT]], [encoder.layers.2.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.2.final_layer_norm.bias for ONNX node: encoder.layers.2.final_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_413 for ONNX node: Add_413 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 799 for ONNX tensor: 799 [01/12/2022-09:32:16] [V] [TRT] Add_413 [Add] outputs: [799 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Shape_414 [Shape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 799 [01/12/2022-09:32:16] [V] [TRT] Shape_414 [Shape] inputs: [799 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Shape_414 for ONNX node: Shape_414 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 800 for ONNX tensor: 800 [01/12/2022-09:32:16] [V] [TRT] Shape_414 [Shape] outputs: [800 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_415 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_415 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_415 [Constant] outputs: [801 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Gather_416 [Gather] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 800 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 801 [01/12/2022-09:32:16] [V] [TRT] Gather_416 [Gather] inputs: [800 -> (3)[INT32]], [801 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 801 for ONNX node: 801 [01/12/2022-09:32:16] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Gather_416 for ONNX node: Gather_416 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 802 for ONNX tensor: 802 [01/12/2022-09:32:16] [V] [TRT] Gather_416 [Gather] outputs: [802 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Shape_417 [Shape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 799 [01/12/2022-09:32:16] [V] [TRT] Shape_417 [Shape] inputs: [799 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Shape_417 for ONNX node: Shape_417 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 803 for ONNX tensor: 803 [01/12/2022-09:32:16] [V] [TRT] Shape_417 [Shape] outputs: [803 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_418 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_418 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_418 [Constant] outputs: [804 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Gather_419 [Gather] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 803 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 804 [01/12/2022-09:32:16] [V] [TRT] Gather_419 [Gather] inputs: [803 -> (3)[INT32]], [804 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 804 for ONNX node: 804 [01/12/2022-09:32:16] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Gather_419 for ONNX node: Gather_419 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 805 for ONNX tensor: 805 [01/12/2022-09:32:16] [V] [TRT] Gather_419 [Gather] outputs: [805 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_420 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 799 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2848 [01/12/2022-09:32:16] [V] [TRT] MatMul_420 [MatMul] inputs: [799 -> (-1, -1, 768)[FLOAT]], [2848 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2848 for ONNX node: 2848 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_420 for ONNX node: MatMul_420 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 807 for ONNX tensor: 807 [01/12/2022-09:32:16] [V] [TRT] MatMul_420 [MatMul] outputs: [807 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_421 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.self_attn.q_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 807 [01/12/2022-09:32:16] [V] [TRT] Add_421 [Add] inputs: [encoder.layers.3.self_attn.q_proj.bias -> (768)[FLOAT]], [807 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.self_attn.q_proj.bias for ONNX node: encoder.layers.3.self_attn.q_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_421 for ONNX node: Add_421 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 808 for ONNX tensor: 808 [01/12/2022-09:32:16] [V] [TRT] Add_421 [Add] outputs: [808 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_422 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_422 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_422 [Constant] outputs: [809 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_423 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 808 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 809 [01/12/2022-09:32:16] [V] [TRT] Mul_423 [Mul] inputs: [808 -> (-1, -1, 768)[FLOAT]], [809 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 809 for ONNX node: 809 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_423 for ONNX node: Mul_423 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 810 for ONNX tensor: 810 [01/12/2022-09:32:16] [V] [TRT] Mul_423 [Mul] outputs: [810 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_424 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 799 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2849 [01/12/2022-09:32:16] [V] [TRT] MatMul_424 [MatMul] inputs: [799 -> (-1, -1, 768)[FLOAT]], [2849 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2849 for ONNX node: 2849 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_424 for ONNX node: MatMul_424 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 812 for ONNX tensor: 812 [01/12/2022-09:32:16] [V] [TRT] MatMul_424 [MatMul] outputs: [812 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_425 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.self_attn.k_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 812 [01/12/2022-09:32:16] [V] [TRT] Add_425 [Add] inputs: [encoder.layers.3.self_attn.k_proj.bias -> (768)[FLOAT]], [812 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.self_attn.k_proj.bias for ONNX node: encoder.layers.3.self_attn.k_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_425 for ONNX node: Add_425 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 813 for ONNX tensor: 813 [01/12/2022-09:32:16] [V] [TRT] Add_425 [Add] outputs: [813 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_426 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 802 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_426 [Unsqueeze] inputs: [802 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_426 for ONNX node: Unsqueeze_426 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 817 for ONNX tensor: 817 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_426 [Unsqueeze] outputs: [817 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_427 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 817 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2850 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2851 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2852 [01/12/2022-09:32:16] [V] [TRT] Concat_427 [Concat] inputs: [817 -> (1)[INT32]], [2850 -> (1)[INT32]], [2851 -> (1)[INT32]], [2852 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2850 for ONNX node: 2850 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2851 for ONNX node: 2851 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2852 for ONNX node: 2852 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_427 for ONNX node: Concat_427 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 821 for ONNX tensor: 821 [01/12/2022-09:32:16] [V] [TRT] Concat_427 [Concat] outputs: [821 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_428 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 813 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 821 [01/12/2022-09:32:16] [V] [TRT] Reshape_428 [Reshape] inputs: [813 -> (-1, -1, 768)[FLOAT]], [821 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_428 for ONNX node: Reshape_428 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 822 for ONNX tensor: 822 [01/12/2022-09:32:16] [V] [TRT] Reshape_428 [Reshape] outputs: [822 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_429 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 822 [01/12/2022-09:32:16] [V] [TRT] Transpose_429 [Transpose] inputs: [822 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_429 for ONNX node: Transpose_429 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823 [01/12/2022-09:32:16] [V] [TRT] Transpose_429 [Transpose] outputs: [823 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_430 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 799 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2853 [01/12/2022-09:32:16] [V] [TRT] MatMul_430 [MatMul] inputs: [799 -> (-1, -1, 768)[FLOAT]], [2853 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2853 for ONNX node: 2853 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_430 for ONNX node: MatMul_430 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 825 for ONNX tensor: 825 [01/12/2022-09:32:16] [V] [TRT] MatMul_430 [MatMul] outputs: [825 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_431 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 825 [01/12/2022-09:32:16] [V] [TRT] Add_431 [Add] inputs: [encoder.layers.3.self_attn.v_proj.bias -> (768)[FLOAT]], [825 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.self_attn.v_proj.bias for ONNX node: encoder.layers.3.self_attn.v_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_431 for ONNX node: Add_431 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 826 for ONNX tensor: 826 [01/12/2022-09:32:16] [V] [TRT] Add_431 [Add] outputs: [826 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_432 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 802 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_432 [Unsqueeze] inputs: [802 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_432 for ONNX node: Unsqueeze_432 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 830 for ONNX tensor: 830 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_432 [Unsqueeze] outputs: [830 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_433 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 830 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2854 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2855 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2856 [01/12/2022-09:32:16] [V] [TRT] Concat_433 [Concat] inputs: [830 -> (1)[INT32]], [2854 -> (1)[INT32]], [2855 -> (1)[INT32]], [2856 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2854 for ONNX node: 2854 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2855 for ONNX node: 2855 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2856 for ONNX node: 2856 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_433 for ONNX node: Concat_433 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 834 for ONNX tensor: 834 [01/12/2022-09:32:16] [V] [TRT] Concat_433 [Concat] outputs: [834 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_434 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 826 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 834 [01/12/2022-09:32:16] [V] [TRT] Reshape_434 [Reshape] inputs: [826 -> (-1, -1, 768)[FLOAT]], [834 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_434 for ONNX node: Reshape_434 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 835 for ONNX tensor: 835 [01/12/2022-09:32:16] [V] [TRT] Reshape_434 [Reshape] outputs: [835 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_435 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 835 [01/12/2022-09:32:16] [V] [TRT] Transpose_435 [Transpose] inputs: [835 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_435 for ONNX node: Transpose_435 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 836 for ONNX tensor: 836 [01/12/2022-09:32:16] [V] [TRT] Transpose_435 [Transpose] outputs: [836 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_436 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_436 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_436 [Constant] outputs: [837 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_437 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 802 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 837 [01/12/2022-09:32:16] [V] [TRT] Mul_437 [Mul] inputs: [802 -> ()[INT32]], [837 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 837 for ONNX node: 837 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_437 for ONNX node: Mul_437 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 838 for ONNX tensor: 838 [01/12/2022-09:32:16] [V] [TRT] Mul_437 [Mul] outputs: [838 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_438 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 802 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_438 [Unsqueeze] inputs: [802 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_438 for ONNX node: Unsqueeze_438 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 841 for ONNX tensor: 841 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_438 [Unsqueeze] outputs: [841 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_439 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 805 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_439 [Unsqueeze] inputs: [805 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_439 for ONNX node: Unsqueeze_439 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 842 for ONNX tensor: 842 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_439 [Unsqueeze] outputs: [842 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_440 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 841 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 842 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2857 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2858 [01/12/2022-09:32:16] [V] [TRT] Concat_440 [Concat] inputs: [841 -> (1)[INT32]], [842 -> (1)[INT32]], [2857 -> (1)[INT32]], [2858 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2857 for ONNX node: 2857 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2858 for ONNX node: 2858 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_440 for ONNX node: Concat_440 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 845 for ONNX tensor: 845 [01/12/2022-09:32:16] [V] [TRT] Concat_440 [Concat] outputs: [845 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_441 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 810 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 845 [01/12/2022-09:32:16] [V] [TRT] Reshape_441 [Reshape] inputs: [810 -> (-1, -1, 768)[FLOAT]], [845 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_441 for ONNX node: Reshape_441 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 846 for ONNX tensor: 846 [01/12/2022-09:32:16] [V] [TRT] Reshape_441 [Reshape] outputs: [846 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_442 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 846 [01/12/2022-09:32:16] [V] [TRT] Transpose_442 [Transpose] inputs: [846 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_442 for ONNX node: Transpose_442 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 847 for ONNX tensor: 847 [01/12/2022-09:32:16] [V] [TRT] Transpose_442 [Transpose] outputs: [847 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_443 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 838 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_443 [Unsqueeze] inputs: [838 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_443 for ONNX node: Unsqueeze_443 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 850 for ONNX tensor: 850 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_443 [Unsqueeze] outputs: [850 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_444 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 850 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2859 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2860 [01/12/2022-09:32:16] [V] [TRT] Concat_444 [Concat] inputs: [850 -> (1)[INT32]], [2859 -> (1)[INT32]], [2860 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2859 for ONNX node: 2859 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2860 for ONNX node: 2860 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_444 for ONNX node: Concat_444 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 853 for ONNX tensor: 853 [01/12/2022-09:32:16] [V] [TRT] Concat_444 [Concat] outputs: [853 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_445 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 847 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 853 [01/12/2022-09:32:16] [V] [TRT] Reshape_445 [Reshape] inputs: [847 -> (-1, 12, -1, 64)[FLOAT]], [853 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_445 for ONNX node: Reshape_445 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 854 for ONNX tensor: 854 [01/12/2022-09:32:16] [V] [TRT] Reshape_445 [Reshape] outputs: [854 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_446 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 838 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_446 [Unsqueeze] inputs: [838 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_446 for ONNX node: Unsqueeze_446 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 857 for ONNX tensor: 857 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_446 [Unsqueeze] outputs: [857 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_447 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 857 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2861 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2862 [01/12/2022-09:32:16] [V] [TRT] Concat_447 [Concat] inputs: [857 -> (1)[INT32]], [2861 -> (1)[INT32]], [2862 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2861 for ONNX node: 2861 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2862 for ONNX node: 2862 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_447 for ONNX node: Concat_447 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 860 for ONNX tensor: 860 [01/12/2022-09:32:16] [V] [TRT] Concat_447 [Concat] outputs: [860 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_448 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 823 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 860 [01/12/2022-09:32:16] [V] [TRT] Reshape_448 [Reshape] inputs: [823 -> (-1, 12, -1, 64)[FLOAT]], [860 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_448 for ONNX node: Reshape_448 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 861 for ONNX tensor: 861 [01/12/2022-09:32:16] [V] [TRT] Reshape_448 [Reshape] outputs: [861 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_449 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 838 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_449 [Unsqueeze] inputs: [838 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_449 for ONNX node: Unsqueeze_449 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 864 for ONNX tensor: 864 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_449 [Unsqueeze] outputs: [864 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_450 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 864 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2863 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2864 [01/12/2022-09:32:16] [V] [TRT] Concat_450 [Concat] inputs: [864 -> (1)[INT32]], [2863 -> (1)[INT32]], [2864 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2863 for ONNX node: 2863 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2864 for ONNX node: 2864 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_450 for ONNX node: Concat_450 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 867 for ONNX tensor: 867 [01/12/2022-09:32:16] [V] [TRT] Concat_450 [Concat] outputs: [867 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_451 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 836 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 867 [01/12/2022-09:32:16] [V] [TRT] Reshape_451 [Reshape] inputs: [836 -> (-1, 12, -1, 64)[FLOAT]], [867 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_451 for ONNX node: Reshape_451 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 868 for ONNX tensor: 868 [01/12/2022-09:32:16] [V] [TRT] Reshape_451 [Reshape] outputs: [868 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_452 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 861 [01/12/2022-09:32:16] [V] [TRT] Transpose_452 [Transpose] inputs: [861 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_452 for ONNX node: Transpose_452 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 869 for ONNX tensor: 869 [01/12/2022-09:32:16] [V] [TRT] Transpose_452 [Transpose] outputs: [869 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_453 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 854 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 869 [01/12/2022-09:32:16] [V] [TRT] MatMul_453 [MatMul] inputs: [854 -> (-1, -1, 64)[FLOAT]], [869 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_453 for ONNX node: MatMul_453 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 870 for ONNX tensor: 870 [01/12/2022-09:32:16] [V] [TRT] MatMul_453 [MatMul] outputs: [870 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Softmax_454 [Softmax] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 870 [01/12/2022-09:32:16] [V] [TRT] Softmax_454 [Softmax] inputs: [870 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Softmax_454 for ONNX node: Softmax_454 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 871 for ONNX tensor: 871 [01/12/2022-09:32:16] [V] [TRT] Softmax_454 [Softmax] outputs: [871 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_455 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 871 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 868 [01/12/2022-09:32:16] [V] [TRT] MatMul_455 [MatMul] inputs: [871 -> (-1, -1, -1)[FLOAT]], [868 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_455 for ONNX node: MatMul_455 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 872 for ONNX tensor: 872 [01/12/2022-09:32:16] [V] [TRT] MatMul_455 [MatMul] outputs: [872 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_456 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 802 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_456 [Unsqueeze] inputs: [802 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_456 for ONNX node: Unsqueeze_456 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 875 for ONNX tensor: 875 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_456 [Unsqueeze] outputs: [875 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_457 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 805 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_457 [Unsqueeze] inputs: [805 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_457 for ONNX node: Unsqueeze_457 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 877 for ONNX tensor: 877 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_457 [Unsqueeze] outputs: [877 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_458 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 875 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2865 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 877 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2866 [01/12/2022-09:32:16] [V] [TRT] Concat_458 [Concat] inputs: [875 -> (1)[INT32]], [2865 -> (1)[INT32]], [877 -> (1)[INT32]], [2866 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2865 for ONNX node: 2865 [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2866 for ONNX node: 2866 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_458 for ONNX node: Concat_458 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 879 for ONNX tensor: 879 [01/12/2022-09:32:16] [V] [TRT] Concat_458 [Concat] outputs: [879 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_459 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 872 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 879 [01/12/2022-09:32:16] [V] [TRT] Reshape_459 [Reshape] inputs: [872 -> (-1, -1, 64)[FLOAT]], [879 -> (4)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_459 for ONNX node: Reshape_459 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 880 for ONNX tensor: 880 [01/12/2022-09:32:16] [V] [TRT] Reshape_459 [Reshape] outputs: [880 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Transpose_460 [Transpose] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 880 [01/12/2022-09:32:16] [V] [TRT] Transpose_460 [Transpose] inputs: [880 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Transpose_460 for ONNX node: Transpose_460 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 881 for ONNX tensor: 881 [01/12/2022-09:32:16] [V] [TRT] Transpose_460 [Transpose] outputs: [881 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_461 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 802 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_461 [Unsqueeze] inputs: [802 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_461 for ONNX node: Unsqueeze_461 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_461 [Unsqueeze] outputs: [883 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Unsqueeze_462 [Unsqueeze] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 805 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_462 [Unsqueeze] inputs: [805 -> ()[INT32]], [01/12/2022-09:32:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:16] [V] [TRT] Registering layer: Unsqueeze_462 for ONNX node: Unsqueeze_462 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 884 for ONNX tensor: 884 [01/12/2022-09:32:16] [V] [TRT] Unsqueeze_462 [Unsqueeze] outputs: [884 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Concat_463 [Concat] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 883 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 884 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2867 [01/12/2022-09:32:16] [V] [TRT] Concat_463 [Concat] inputs: [883 -> (1)[INT32]], [884 -> (1)[INT32]], [2867 -> (1)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2867 for ONNX node: 2867 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Concat_463 for ONNX node: Concat_463 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 886 for ONNX tensor: 886 [01/12/2022-09:32:16] [V] [TRT] Concat_463 [Concat] outputs: [886 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Reshape_464 [Reshape] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 881 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 886 [01/12/2022-09:32:16] [V] [TRT] Reshape_464 [Reshape] inputs: [881 -> (-1, -1, 12, 64)[FLOAT]], [886 -> (3)[INT32]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Reshape_464 for ONNX node: Reshape_464 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 887 for ONNX tensor: 887 [01/12/2022-09:32:16] [V] [TRT] Reshape_464 [Reshape] outputs: [887 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_465 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 887 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2868 [01/12/2022-09:32:16] [V] [TRT] MatMul_465 [MatMul] inputs: [887 -> (-1, -1, 768)[FLOAT]], [2868 -> (768, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2868 for ONNX node: 2868 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_465 for ONNX node: MatMul_465 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 889 for ONNX tensor: 889 [01/12/2022-09:32:16] [V] [TRT] MatMul_465 [MatMul] outputs: [889 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_466 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 889 [01/12/2022-09:32:16] [V] [TRT] Add_466 [Add] inputs: [encoder.layers.3.self_attn.out_proj.bias -> (768)[FLOAT]], [889 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.self_attn.out_proj.bias for ONNX node: encoder.layers.3.self_attn.out_proj.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_466 for ONNX node: Add_466 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 890 for ONNX tensor: 890 [01/12/2022-09:32:16] [V] [TRT] Add_466 [Add] outputs: [890 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_467 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 799 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 890 [01/12/2022-09:32:16] [V] [TRT] Add_467 [Add] inputs: [799 -> (-1, -1, 768)[FLOAT]], [890 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_467 for ONNX node: Add_467 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 891 for ONNX tensor: 891 [01/12/2022-09:32:16] [V] [TRT] Add_467 [Add] outputs: [891 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_468 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 891 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_468 [ReduceMean] inputs: [891 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_468 for ONNX node: ReduceMean_468 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 892 for ONNX tensor: 892 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_468 [ReduceMean] outputs: [892 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_469 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 891 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 892 [01/12/2022-09:32:16] [V] [TRT] Sub_469 [Sub] inputs: [891 -> (-1, -1, 768)[FLOAT]], [892 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_469 for ONNX node: Sub_469 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 893 for ONNX tensor: 893 [01/12/2022-09:32:16] [V] [TRT] Sub_469 [Sub] outputs: [893 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_470 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_470 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_470 [Constant] outputs: [894 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Pow_471 [Pow] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 893 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 894 [01/12/2022-09:32:16] [V] [TRT] Pow_471 [Pow] inputs: [893 -> (-1, -1, 768)[FLOAT]], [894 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 894 for ONNX node: 894 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Pow_471 for ONNX node: Pow_471 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 895 for ONNX tensor: 895 [01/12/2022-09:32:16] [V] [TRT] Pow_471 [Pow] outputs: [895 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_472 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 895 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_472 [ReduceMean] inputs: [895 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_472 for ONNX node: ReduceMean_472 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 896 for ONNX tensor: 896 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_472 [ReduceMean] outputs: [896 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_473 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_473 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_473 [Constant] outputs: [897 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_474 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 896 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 897 [01/12/2022-09:32:16] [V] [TRT] Add_474 [Add] inputs: [896 -> (-1, -1, 1)[FLOAT]], [897 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 897 for ONNX node: 897 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_474 for ONNX node: Add_474 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 898 for ONNX tensor: 898 [01/12/2022-09:32:16] [V] [TRT] Add_474 [Add] outputs: [898 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sqrt_475 [Sqrt] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 898 [01/12/2022-09:32:16] [V] [TRT] Sqrt_475 [Sqrt] inputs: [898 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sqrt_475 for ONNX node: Sqrt_475 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 899 for ONNX tensor: 899 [01/12/2022-09:32:16] [V] [TRT] Sqrt_475 [Sqrt] outputs: [899 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_476 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 893 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 899 [01/12/2022-09:32:16] [V] [TRT] Div_476 [Div] inputs: [893 -> (-1, -1, 768)[FLOAT]], [899 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_476 for ONNX node: Div_476 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 900 for ONNX tensor: 900 [01/12/2022-09:32:16] [V] [TRT] Div_476 [Div] outputs: [900 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_477 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 900 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Mul_477 [Mul] inputs: [900 -> (-1, -1, 768)[FLOAT]], [encoder.layers.3.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.self_attn_layer_norm.weight for ONNX node: encoder.layers.3.self_attn_layer_norm.weight [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_477 for ONNX node: Mul_477 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 901 for ONNX tensor: 901 [01/12/2022-09:32:16] [V] [TRT] Mul_477 [Mul] outputs: [901 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_478 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 901 [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Add_478 [Add] inputs: [901 -> (-1, -1, 768)[FLOAT]], [encoder.layers.3.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.self_attn_layer_norm.bias for ONNX node: encoder.layers.3.self_attn_layer_norm.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_478 for ONNX node: Add_478 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 902 for ONNX tensor: 902 [01/12/2022-09:32:16] [V] [TRT] Add_478 [Add] outputs: [902 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_479 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 902 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2869 [01/12/2022-09:32:16] [V] [TRT] MatMul_479 [MatMul] inputs: [902 -> (-1, -1, 768)[FLOAT]], [2869 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2869 for ONNX node: 2869 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_479 for ONNX node: MatMul_479 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 904 for ONNX tensor: 904 [01/12/2022-09:32:16] [V] [TRT] MatMul_479 [MatMul] outputs: [904 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_480 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 904 [01/12/2022-09:32:16] [V] [TRT] Add_480 [Add] inputs: [encoder.layers.3.fc1.bias -> (3072)[FLOAT]], [904 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.fc1.bias for ONNX node: encoder.layers.3.fc1.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_480 for ONNX node: Add_480 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 905 for ONNX tensor: 905 [01/12/2022-09:32:16] [V] [TRT] Add_480 [Add] outputs: [905 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_481 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_481 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_481 [Constant] outputs: [906 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Div_482 [Div] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 905 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 906 [01/12/2022-09:32:16] [V] [TRT] Div_482 [Div] inputs: [905 -> (-1, -1, 3072)[FLOAT]], [906 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 906 for ONNX node: 906 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Div_482 for ONNX node: Div_482 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907 [01/12/2022-09:32:16] [V] [TRT] Div_482 [Div] outputs: [907 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Erf_483 [Erf] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 907 [01/12/2022-09:32:16] [V] [TRT] Erf_483 [Erf] inputs: [907 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Erf_483 for ONNX node: Erf_483 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 908 for ONNX tensor: 908 [01/12/2022-09:32:16] [V] [TRT] Erf_483 [Erf] outputs: [908 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_484 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_484 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_484 [Constant] outputs: [909 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_485 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 908 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 909 [01/12/2022-09:32:16] [V] [TRT] Add_485 [Add] inputs: [908 -> (-1, -1, 3072)[FLOAT]], [909 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 909 for ONNX node: 909 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_485 for ONNX node: Add_485 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 910 for ONNX tensor: 910 [01/12/2022-09:32:16] [V] [TRT] Add_485 [Add] outputs: [910 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_486 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 905 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 910 [01/12/2022-09:32:16] [V] [TRT] Mul_486 [Mul] inputs: [905 -> (-1, -1, 3072)[FLOAT]], [910 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_486 for ONNX node: Mul_486 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 911 for ONNX tensor: 911 [01/12/2022-09:32:16] [V] [TRT] Mul_486 [Mul] outputs: [911 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Constant_487 [Constant] [01/12/2022-09:32:16] [V] [TRT] Constant_487 [Constant] inputs: [01/12/2022-09:32:16] [V] [TRT] Constant_487 [Constant] outputs: [912 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Mul_488 [Mul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 911 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 912 [01/12/2022-09:32:16] [V] [TRT] Mul_488 [Mul] inputs: [911 -> (-1, -1, 3072)[FLOAT]], [912 -> ()[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 912 for ONNX node: 912 [01/12/2022-09:32:16] [V] [TRT] Registering layer: Mul_488 for ONNX node: Mul_488 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 913 for ONNX tensor: 913 [01/12/2022-09:32:16] [V] [TRT] Mul_488 [Mul] outputs: [913 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: MatMul_489 [MatMul] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 913 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 2870 [01/12/2022-09:32:16] [V] [TRT] MatMul_489 [MatMul] inputs: [913 -> (-1, -1, 3072)[FLOAT]], [2870 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: 2870 for ONNX node: 2870 [01/12/2022-09:32:16] [V] [TRT] Registering layer: MatMul_489 for ONNX node: MatMul_489 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 915 for ONNX tensor: 915 [01/12/2022-09:32:16] [V] [TRT] MatMul_489 [MatMul] outputs: [915 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_490 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: encoder.layers.3.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Searching for input: 915 [01/12/2022-09:32:16] [V] [TRT] Add_490 [Add] inputs: [encoder.layers.3.fc2.bias -> (768)[FLOAT]], [915 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: encoder.layers.3.fc2.bias for ONNX node: encoder.layers.3.fc2.bias [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_490 for ONNX node: Add_490 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 916 for ONNX tensor: 916 [01/12/2022-09:32:16] [V] [TRT] Add_490 [Add] outputs: [916 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Add_491 [Add] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 902 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 916 [01/12/2022-09:32:16] [V] [TRT] Add_491 [Add] inputs: [902 -> (-1, -1, 768)[FLOAT]], [916 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Add_491 for ONNX node: Add_491 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 917 for ONNX tensor: 917 [01/12/2022-09:32:16] [V] [TRT] Add_491 [Add] outputs: [917 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: ReduceMean_492 [ReduceMean] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 917 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_492 [ReduceMean] inputs: [917 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: ReduceMean_492 for ONNX node: ReduceMean_492 [01/12/2022-09:32:16] [V] [TRT] Registering tensor: 918 for ONNX tensor: 918 [01/12/2022-09:32:16] [V] [TRT] ReduceMean_492 [ReduceMean] outputs: [918 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Parsing node: Sub_493 [Sub] [01/12/2022-09:32:16] [V] [TRT] Searching for input: 917 [01/12/2022-09:32:16] [V] [TRT] Searching for input: 918 [01/12/2022-09:32:16] [V] [TRT] Sub_493 [Sub] inputs: [917 -> (-1, -1, 768)[FLOAT]], [918 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:16] [V] [TRT] Registering layer: Sub_493 for ONNX node: Sub_493 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 919 for ONNX tensor: 919 [01/12/2022-09:32:17] [V] [TRT] Sub_493 [Sub] outputs: [919 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_494 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_494 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_494 [Constant] outputs: [920 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Pow_495 [Pow] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 919 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 920 [01/12/2022-09:32:17] [V] [TRT] Pow_495 [Pow] inputs: [919 -> (-1, -1, 768)[FLOAT]], [920 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 920 for ONNX node: 920 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Pow_495 for ONNX node: Pow_495 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 921 for ONNX tensor: 921 [01/12/2022-09:32:17] [V] [TRT] Pow_495 [Pow] outputs: [921 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: ReduceMean_496 [ReduceMean] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 921 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_496 [ReduceMean] inputs: [921 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: ReduceMean_496 for ONNX node: ReduceMean_496 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 922 for ONNX tensor: 922 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_496 [ReduceMean] outputs: [922 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_497 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_497 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_497 [Constant] outputs: [923 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_498 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 922 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 923 [01/12/2022-09:32:17] [V] [TRT] Add_498 [Add] inputs: [922 -> (-1, -1, 1)[FLOAT]], [923 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 923 for ONNX node: 923 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_498 for ONNX node: Add_498 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 924 for ONNX tensor: 924 [01/12/2022-09:32:17] [V] [TRT] Add_498 [Add] outputs: [924 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Sqrt_499 [Sqrt] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 924 [01/12/2022-09:32:17] [V] [TRT] Sqrt_499 [Sqrt] inputs: [924 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Sqrt_499 for ONNX node: Sqrt_499 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 925 for ONNX tensor: 925 [01/12/2022-09:32:17] [V] [TRT] Sqrt_499 [Sqrt] outputs: [925 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Div_500 [Div] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 919 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 925 [01/12/2022-09:32:17] [V] [TRT] Div_500 [Div] inputs: [919 -> (-1, -1, 768)[FLOAT]], [925 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Div_500 for ONNX node: Div_500 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 926 for ONNX tensor: 926 [01/12/2022-09:32:17] [V] [TRT] Div_500 [Div] outputs: [926 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_501 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 926 [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.3.final_layer_norm.weight [01/12/2022-09:32:17] [V] [TRT] Mul_501 [Mul] inputs: [926 -> (-1, -1, 768)[FLOAT]], [encoder.layers.3.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.3.final_layer_norm.weight for ONNX node: encoder.layers.3.final_layer_norm.weight [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_501 for ONNX node: Mul_501 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927 [01/12/2022-09:32:17] [V] [TRT] Mul_501 [Mul] outputs: [927 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_502 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 927 [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.3.final_layer_norm.bias [01/12/2022-09:32:17] [V] [TRT] Add_502 [Add] inputs: [927 -> (-1, -1, 768)[FLOAT]], [encoder.layers.3.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.3.final_layer_norm.bias for ONNX node: encoder.layers.3.final_layer_norm.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_502 for ONNX node: Add_502 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 928 for ONNX tensor: 928 [01/12/2022-09:32:17] [V] [TRT] Add_502 [Add] outputs: [928 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Shape_503 [Shape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 928 [01/12/2022-09:32:17] [V] [TRT] Shape_503 [Shape] inputs: [928 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Shape_503 for ONNX node: Shape_503 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 929 for ONNX tensor: 929 [01/12/2022-09:32:17] [V] [TRT] Shape_503 [Shape] outputs: [929 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_504 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_504 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_504 [Constant] outputs: [930 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Gather_505 [Gather] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 929 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 930 [01/12/2022-09:32:17] [V] [TRT] Gather_505 [Gather] inputs: [929 -> (3)[INT32]], [930 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 930 for ONNX node: 930 [01/12/2022-09:32:17] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Gather_505 for ONNX node: Gather_505 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 931 for ONNX tensor: 931 [01/12/2022-09:32:17] [V] [TRT] Gather_505 [Gather] outputs: [931 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Shape_506 [Shape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 928 [01/12/2022-09:32:17] [V] [TRT] Shape_506 [Shape] inputs: [928 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Shape_506 for ONNX node: Shape_506 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 932 for ONNX tensor: 932 [01/12/2022-09:32:17] [V] [TRT] Shape_506 [Shape] outputs: [932 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_507 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_507 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_507 [Constant] outputs: [933 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Gather_508 [Gather] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 932 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 933 [01/12/2022-09:32:17] [V] [TRT] Gather_508 [Gather] inputs: [932 -> (3)[INT32]], [933 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 933 for ONNX node: 933 [01/12/2022-09:32:17] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Gather_508 for ONNX node: Gather_508 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 934 for ONNX tensor: 934 [01/12/2022-09:32:17] [V] [TRT] Gather_508 [Gather] outputs: [934 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_509 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 928 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2871 [01/12/2022-09:32:17] [V] [TRT] MatMul_509 [MatMul] inputs: [928 -> (-1, -1, 768)[FLOAT]], [2871 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2871 for ONNX node: 2871 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_509 for ONNX node: MatMul_509 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 936 for ONNX tensor: 936 [01/12/2022-09:32:17] [V] [TRT] MatMul_509 [MatMul] outputs: [936 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_510 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.self_attn.q_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 936 [01/12/2022-09:32:17] [V] [TRT] Add_510 [Add] inputs: [encoder.layers.4.self_attn.q_proj.bias -> (768)[FLOAT]], [936 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.self_attn.q_proj.bias for ONNX node: encoder.layers.4.self_attn.q_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_510 for ONNX node: Add_510 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 937 for ONNX tensor: 937 [01/12/2022-09:32:17] [V] [TRT] Add_510 [Add] outputs: [937 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_511 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_511 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_511 [Constant] outputs: [938 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_512 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 937 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 938 [01/12/2022-09:32:17] [V] [TRT] Mul_512 [Mul] inputs: [937 -> (-1, -1, 768)[FLOAT]], [938 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 938 for ONNX node: 938 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_512 for ONNX node: Mul_512 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 939 for ONNX tensor: 939 [01/12/2022-09:32:17] [V] [TRT] Mul_512 [Mul] outputs: [939 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_513 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 928 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2872 [01/12/2022-09:32:17] [V] [TRT] MatMul_513 [MatMul] inputs: [928 -> (-1, -1, 768)[FLOAT]], [2872 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2872 for ONNX node: 2872 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_513 for ONNX node: MatMul_513 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 941 for ONNX tensor: 941 [01/12/2022-09:32:17] [V] [TRT] MatMul_513 [MatMul] outputs: [941 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_514 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.self_attn.k_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 941 [01/12/2022-09:32:17] [V] [TRT] Add_514 [Add] inputs: [encoder.layers.4.self_attn.k_proj.bias -> (768)[FLOAT]], [941 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.self_attn.k_proj.bias for ONNX node: encoder.layers.4.self_attn.k_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_514 for ONNX node: Add_514 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 942 for ONNX tensor: 942 [01/12/2022-09:32:17] [V] [TRT] Add_514 [Add] outputs: [942 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_515 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 931 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_515 [Unsqueeze] inputs: [931 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_515 for ONNX node: Unsqueeze_515 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 946 for ONNX tensor: 946 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_515 [Unsqueeze] outputs: [946 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_516 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 946 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2873 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2874 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2875 [01/12/2022-09:32:17] [V] [TRT] Concat_516 [Concat] inputs: [946 -> (1)[INT32]], [2873 -> (1)[INT32]], [2874 -> (1)[INT32]], [2875 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2873 for ONNX node: 2873 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2874 for ONNX node: 2874 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2875 for ONNX node: 2875 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_516 for ONNX node: Concat_516 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 950 for ONNX tensor: 950 [01/12/2022-09:32:17] [V] [TRT] Concat_516 [Concat] outputs: [950 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_517 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 942 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 950 [01/12/2022-09:32:17] [V] [TRT] Reshape_517 [Reshape] inputs: [942 -> (-1, -1, 768)[FLOAT]], [950 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_517 for ONNX node: Reshape_517 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 951 for ONNX tensor: 951 [01/12/2022-09:32:17] [V] [TRT] Reshape_517 [Reshape] outputs: [951 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_518 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 951 [01/12/2022-09:32:17] [V] [TRT] Transpose_518 [Transpose] inputs: [951 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_518 for ONNX node: Transpose_518 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 952 for ONNX tensor: 952 [01/12/2022-09:32:17] [V] [TRT] Transpose_518 [Transpose] outputs: [952 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_519 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 928 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2876 [01/12/2022-09:32:17] [V] [TRT] MatMul_519 [MatMul] inputs: [928 -> (-1, -1, 768)[FLOAT]], [2876 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2876 for ONNX node: 2876 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_519 for ONNX node: MatMul_519 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 954 for ONNX tensor: 954 [01/12/2022-09:32:17] [V] [TRT] MatMul_519 [MatMul] outputs: [954 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_520 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.self_attn.v_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 954 [01/12/2022-09:32:17] [V] [TRT] Add_520 [Add] inputs: [encoder.layers.4.self_attn.v_proj.bias -> (768)[FLOAT]], [954 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.self_attn.v_proj.bias for ONNX node: encoder.layers.4.self_attn.v_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_520 for ONNX node: Add_520 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 955 for ONNX tensor: 955 [01/12/2022-09:32:17] [V] [TRT] Add_520 [Add] outputs: [955 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_521 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 931 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_521 [Unsqueeze] inputs: [931 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_521 for ONNX node: Unsqueeze_521 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 959 for ONNX tensor: 959 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_521 [Unsqueeze] outputs: [959 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_522 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 959 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2877 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2878 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2879 [01/12/2022-09:32:17] [V] [TRT] Concat_522 [Concat] inputs: [959 -> (1)[INT32]], [2877 -> (1)[INT32]], [2878 -> (1)[INT32]], [2879 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2877 for ONNX node: 2877 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2878 for ONNX node: 2878 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2879 for ONNX node: 2879 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_522 for ONNX node: Concat_522 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 963 for ONNX tensor: 963 [01/12/2022-09:32:17] [V] [TRT] Concat_522 [Concat] outputs: [963 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_523 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 955 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 963 [01/12/2022-09:32:17] [V] [TRT] Reshape_523 [Reshape] inputs: [955 -> (-1, -1, 768)[FLOAT]], [963 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_523 for ONNX node: Reshape_523 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 964 for ONNX tensor: 964 [01/12/2022-09:32:17] [V] [TRT] Reshape_523 [Reshape] outputs: [964 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_524 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 964 [01/12/2022-09:32:17] [V] [TRT] Transpose_524 [Transpose] inputs: [964 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_524 for ONNX node: Transpose_524 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 965 for ONNX tensor: 965 [01/12/2022-09:32:17] [V] [TRT] Transpose_524 [Transpose] outputs: [965 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_525 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_525 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_525 [Constant] outputs: [966 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_526 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 931 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 966 [01/12/2022-09:32:17] [V] [TRT] Mul_526 [Mul] inputs: [931 -> ()[INT32]], [966 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 966 for ONNX node: 966 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_526 for ONNX node: Mul_526 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 967 for ONNX tensor: 967 [01/12/2022-09:32:17] [V] [TRT] Mul_526 [Mul] outputs: [967 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_527 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 931 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_527 [Unsqueeze] inputs: [931 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_527 for ONNX node: Unsqueeze_527 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 970 for ONNX tensor: 970 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_527 [Unsqueeze] outputs: [970 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_528 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 934 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_528 [Unsqueeze] inputs: [934 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_528 for ONNX node: Unsqueeze_528 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 971 for ONNX tensor: 971 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_528 [Unsqueeze] outputs: [971 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_529 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 970 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 971 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2880 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2881 [01/12/2022-09:32:17] [V] [TRT] Concat_529 [Concat] inputs: [970 -> (1)[INT32]], [971 -> (1)[INT32]], [2880 -> (1)[INT32]], [2881 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2880 for ONNX node: 2880 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2881 for ONNX node: 2881 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_529 for ONNX node: Concat_529 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 974 for ONNX tensor: 974 [01/12/2022-09:32:17] [V] [TRT] Concat_529 [Concat] outputs: [974 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_530 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 939 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 974 [01/12/2022-09:32:17] [V] [TRT] Reshape_530 [Reshape] inputs: [939 -> (-1, -1, 768)[FLOAT]], [974 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_530 for ONNX node: Reshape_530 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 975 for ONNX tensor: 975 [01/12/2022-09:32:17] [V] [TRT] Reshape_530 [Reshape] outputs: [975 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_531 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 975 [01/12/2022-09:32:17] [V] [TRT] Transpose_531 [Transpose] inputs: [975 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_531 for ONNX node: Transpose_531 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 976 for ONNX tensor: 976 [01/12/2022-09:32:17] [V] [TRT] Transpose_531 [Transpose] outputs: [976 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_532 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 967 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_532 [Unsqueeze] inputs: [967 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_532 for ONNX node: Unsqueeze_532 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 979 for ONNX tensor: 979 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_532 [Unsqueeze] outputs: [979 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_533 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 979 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2882 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2883 [01/12/2022-09:32:17] [V] [TRT] Concat_533 [Concat] inputs: [979 -> (1)[INT32]], [2882 -> (1)[INT32]], [2883 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2882 for ONNX node: 2882 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2883 for ONNX node: 2883 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_533 for ONNX node: Concat_533 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 982 for ONNX tensor: 982 [01/12/2022-09:32:17] [V] [TRT] Concat_533 [Concat] outputs: [982 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_534 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 976 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 982 [01/12/2022-09:32:17] [V] [TRT] Reshape_534 [Reshape] inputs: [976 -> (-1, 12, -1, 64)[FLOAT]], [982 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_534 for ONNX node: Reshape_534 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 983 for ONNX tensor: 983 [01/12/2022-09:32:17] [V] [TRT] Reshape_534 [Reshape] outputs: [983 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_535 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 967 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_535 [Unsqueeze] inputs: [967 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_535 for ONNX node: Unsqueeze_535 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 986 for ONNX tensor: 986 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_535 [Unsqueeze] outputs: [986 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_536 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 986 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2884 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2885 [01/12/2022-09:32:17] [V] [TRT] Concat_536 [Concat] inputs: [986 -> (1)[INT32]], [2884 -> (1)[INT32]], [2885 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2884 for ONNX node: 2884 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2885 for ONNX node: 2885 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_536 for ONNX node: Concat_536 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 989 for ONNX tensor: 989 [01/12/2022-09:32:17] [V] [TRT] Concat_536 [Concat] outputs: [989 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_537 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 952 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 989 [01/12/2022-09:32:17] [V] [TRT] Reshape_537 [Reshape] inputs: [952 -> (-1, 12, -1, 64)[FLOAT]], [989 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_537 for ONNX node: Reshape_537 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 990 for ONNX tensor: 990 [01/12/2022-09:32:17] [V] [TRT] Reshape_537 [Reshape] outputs: [990 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_538 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 967 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_538 [Unsqueeze] inputs: [967 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_538 for ONNX node: Unsqueeze_538 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 993 for ONNX tensor: 993 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_538 [Unsqueeze] outputs: [993 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_539 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 993 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2886 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2887 [01/12/2022-09:32:17] [V] [TRT] Concat_539 [Concat] inputs: [993 -> (1)[INT32]], [2886 -> (1)[INT32]], [2887 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2886 for ONNX node: 2886 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2887 for ONNX node: 2887 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_539 for ONNX node: Concat_539 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 996 for ONNX tensor: 996 [01/12/2022-09:32:17] [V] [TRT] Concat_539 [Concat] outputs: [996 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_540 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 965 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 996 [01/12/2022-09:32:17] [V] [TRT] Reshape_540 [Reshape] inputs: [965 -> (-1, 12, -1, 64)[FLOAT]], [996 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_540 for ONNX node: Reshape_540 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 997 for ONNX tensor: 997 [01/12/2022-09:32:17] [V] [TRT] Reshape_540 [Reshape] outputs: [997 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_541 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 990 [01/12/2022-09:32:17] [V] [TRT] Transpose_541 [Transpose] inputs: [990 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_541 for ONNX node: Transpose_541 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 998 for ONNX tensor: 998 [01/12/2022-09:32:17] [V] [TRT] Transpose_541 [Transpose] outputs: [998 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_542 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 983 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 998 [01/12/2022-09:32:17] [V] [TRT] MatMul_542 [MatMul] inputs: [983 -> (-1, -1, 64)[FLOAT]], [998 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_542 for ONNX node: MatMul_542 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 999 for ONNX tensor: 999 [01/12/2022-09:32:17] [V] [TRT] MatMul_542 [MatMul] outputs: [999 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Softmax_543 [Softmax] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 999 [01/12/2022-09:32:17] [V] [TRT] Softmax_543 [Softmax] inputs: [999 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Softmax_543 for ONNX node: Softmax_543 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1000 for ONNX tensor: 1000 [01/12/2022-09:32:17] [V] [TRT] Softmax_543 [Softmax] outputs: [1000 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_544 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1000 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 997 [01/12/2022-09:32:17] [V] [TRT] MatMul_544 [MatMul] inputs: [1000 -> (-1, -1, -1)[FLOAT]], [997 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_544 for ONNX node: MatMul_544 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1001 for ONNX tensor: 1001 [01/12/2022-09:32:17] [V] [TRT] MatMul_544 [MatMul] outputs: [1001 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_545 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 931 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_545 [Unsqueeze] inputs: [931 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_545 for ONNX node: Unsqueeze_545 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1004 for ONNX tensor: 1004 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_545 [Unsqueeze] outputs: [1004 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_546 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 934 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_546 [Unsqueeze] inputs: [934 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_546 for ONNX node: Unsqueeze_546 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1006 for ONNX tensor: 1006 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_546 [Unsqueeze] outputs: [1006 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_547 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1004 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2888 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1006 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2889 [01/12/2022-09:32:17] [V] [TRT] Concat_547 [Concat] inputs: [1004 -> (1)[INT32]], [2888 -> (1)[INT32]], [1006 -> (1)[INT32]], [2889 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2888 for ONNX node: 2888 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2889 for ONNX node: 2889 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_547 for ONNX node: Concat_547 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1008 for ONNX tensor: 1008 [01/12/2022-09:32:17] [V] [TRT] Concat_547 [Concat] outputs: [1008 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_548 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1001 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1008 [01/12/2022-09:32:17] [V] [TRT] Reshape_548 [Reshape] inputs: [1001 -> (-1, -1, 64)[FLOAT]], [1008 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_548 for ONNX node: Reshape_548 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1009 for ONNX tensor: 1009 [01/12/2022-09:32:17] [V] [TRT] Reshape_548 [Reshape] outputs: [1009 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_549 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1009 [01/12/2022-09:32:17] [V] [TRT] Transpose_549 [Transpose] inputs: [1009 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_549 for ONNX node: Transpose_549 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1010 for ONNX tensor: 1010 [01/12/2022-09:32:17] [V] [TRT] Transpose_549 [Transpose] outputs: [1010 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_550 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 931 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_550 [Unsqueeze] inputs: [931 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_550 for ONNX node: Unsqueeze_550 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1012 for ONNX tensor: 1012 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_550 [Unsqueeze] outputs: [1012 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_551 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 934 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_551 [Unsqueeze] inputs: [934 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_551 for ONNX node: Unsqueeze_551 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1013 for ONNX tensor: 1013 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_551 [Unsqueeze] outputs: [1013 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_552 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1012 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1013 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2890 [01/12/2022-09:32:17] [V] [TRT] Concat_552 [Concat] inputs: [1012 -> (1)[INT32]], [1013 -> (1)[INT32]], [2890 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2890 for ONNX node: 2890 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_552 for ONNX node: Concat_552 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1015 for ONNX tensor: 1015 [01/12/2022-09:32:17] [V] [TRT] Concat_552 [Concat] outputs: [1015 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_553 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1010 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1015 [01/12/2022-09:32:17] [V] [TRT] Reshape_553 [Reshape] inputs: [1010 -> (-1, -1, 12, 64)[FLOAT]], [1015 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_553 for ONNX node: Reshape_553 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1016 for ONNX tensor: 1016 [01/12/2022-09:32:17] [V] [TRT] Reshape_553 [Reshape] outputs: [1016 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_554 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1016 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2891 [01/12/2022-09:32:17] [V] [TRT] MatMul_554 [MatMul] inputs: [1016 -> (-1, -1, 768)[FLOAT]], [2891 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2891 for ONNX node: 2891 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_554 for ONNX node: MatMul_554 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1018 for ONNX tensor: 1018 [01/12/2022-09:32:17] [V] [TRT] MatMul_554 [MatMul] outputs: [1018 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_555 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.self_attn.out_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1018 [01/12/2022-09:32:17] [V] [TRT] Add_555 [Add] inputs: [encoder.layers.4.self_attn.out_proj.bias -> (768)[FLOAT]], [1018 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.self_attn.out_proj.bias for ONNX node: encoder.layers.4.self_attn.out_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_555 for ONNX node: Add_555 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1019 for ONNX tensor: 1019 [01/12/2022-09:32:17] [V] [TRT] Add_555 [Add] outputs: [1019 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_556 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 928 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1019 [01/12/2022-09:32:17] [V] [TRT] Add_556 [Add] inputs: [928 -> (-1, -1, 768)[FLOAT]], [1019 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_556 for ONNX node: Add_556 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1020 for ONNX tensor: 1020 [01/12/2022-09:32:17] [V] [TRT] Add_556 [Add] outputs: [1020 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: ReduceMean_557 [ReduceMean] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1020 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_557 [ReduceMean] inputs: [1020 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: ReduceMean_557 for ONNX node: ReduceMean_557 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1021 for ONNX tensor: 1021 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_557 [ReduceMean] outputs: [1021 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Sub_558 [Sub] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1020 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1021 [01/12/2022-09:32:17] [V] [TRT] Sub_558 [Sub] inputs: [1020 -> (-1, -1, 768)[FLOAT]], [1021 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Sub_558 for ONNX node: Sub_558 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1022 for ONNX tensor: 1022 [01/12/2022-09:32:17] [V] [TRT] Sub_558 [Sub] outputs: [1022 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_559 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_559 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_559 [Constant] outputs: [1023 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Pow_560 [Pow] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1022 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1023 [01/12/2022-09:32:17] [V] [TRT] Pow_560 [Pow] inputs: [1022 -> (-1, -1, 768)[FLOAT]], [1023 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1023 for ONNX node: 1023 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Pow_560 for ONNX node: Pow_560 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1024 for ONNX tensor: 1024 [01/12/2022-09:32:17] [V] [TRT] Pow_560 [Pow] outputs: [1024 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: ReduceMean_561 [ReduceMean] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1024 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_561 [ReduceMean] inputs: [1024 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: ReduceMean_561 for ONNX node: ReduceMean_561 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1025 for ONNX tensor: 1025 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_561 [ReduceMean] outputs: [1025 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_562 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_562 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_562 [Constant] outputs: [1026 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_563 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1025 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1026 [01/12/2022-09:32:17] [V] [TRT] Add_563 [Add] inputs: [1025 -> (-1, -1, 1)[FLOAT]], [1026 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1026 for ONNX node: 1026 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_563 for ONNX node: Add_563 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1027 for ONNX tensor: 1027 [01/12/2022-09:32:17] [V] [TRT] Add_563 [Add] outputs: [1027 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Sqrt_564 [Sqrt] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1027 [01/12/2022-09:32:17] [V] [TRT] Sqrt_564 [Sqrt] inputs: [1027 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Sqrt_564 for ONNX node: Sqrt_564 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1028 for ONNX tensor: 1028 [01/12/2022-09:32:17] [V] [TRT] Sqrt_564 [Sqrt] outputs: [1028 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Div_565 [Div] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1022 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1028 [01/12/2022-09:32:17] [V] [TRT] Div_565 [Div] inputs: [1022 -> (-1, -1, 768)[FLOAT]], [1028 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Div_565 for ONNX node: Div_565 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1029 for ONNX tensor: 1029 [01/12/2022-09:32:17] [V] [TRT] Div_565 [Div] outputs: [1029 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_566 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1029 [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.self_attn_layer_norm.weight [01/12/2022-09:32:17] [V] [TRT] Mul_566 [Mul] inputs: [1029 -> (-1, -1, 768)[FLOAT]], [encoder.layers.4.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.self_attn_layer_norm.weight for ONNX node: encoder.layers.4.self_attn_layer_norm.weight [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_566 for ONNX node: Mul_566 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1030 for ONNX tensor: 1030 [01/12/2022-09:32:17] [V] [TRT] Mul_566 [Mul] outputs: [1030 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_567 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1030 [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.self_attn_layer_norm.bias [01/12/2022-09:32:17] [V] [TRT] Add_567 [Add] inputs: [1030 -> (-1, -1, 768)[FLOAT]], [encoder.layers.4.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.self_attn_layer_norm.bias for ONNX node: encoder.layers.4.self_attn_layer_norm.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_567 for ONNX node: Add_567 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1031 for ONNX tensor: 1031 [01/12/2022-09:32:17] [V] [TRT] Add_567 [Add] outputs: [1031 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_568 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1031 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2892 [01/12/2022-09:32:17] [V] [TRT] MatMul_568 [MatMul] inputs: [1031 -> (-1, -1, 768)[FLOAT]], [2892 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2892 for ONNX node: 2892 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_568 for ONNX node: MatMul_568 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1033 for ONNX tensor: 1033 [01/12/2022-09:32:17] [V] [TRT] MatMul_568 [MatMul] outputs: [1033 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_569 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.fc1.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1033 [01/12/2022-09:32:17] [V] [TRT] Add_569 [Add] inputs: [encoder.layers.4.fc1.bias -> (3072)[FLOAT]], [1033 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.fc1.bias for ONNX node: encoder.layers.4.fc1.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_569 for ONNX node: Add_569 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1034 for ONNX tensor: 1034 [01/12/2022-09:32:17] [V] [TRT] Add_569 [Add] outputs: [1034 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_570 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_570 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_570 [Constant] outputs: [1035 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Div_571 [Div] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1034 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1035 [01/12/2022-09:32:17] [V] [TRT] Div_571 [Div] inputs: [1034 -> (-1, -1, 3072)[FLOAT]], [1035 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1035 for ONNX node: 1035 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Div_571 for ONNX node: Div_571 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1036 for ONNX tensor: 1036 [01/12/2022-09:32:17] [V] [TRT] Div_571 [Div] outputs: [1036 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Erf_572 [Erf] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1036 [01/12/2022-09:32:17] [V] [TRT] Erf_572 [Erf] inputs: [1036 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Erf_572 for ONNX node: Erf_572 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1037 for ONNX tensor: 1037 [01/12/2022-09:32:17] [V] [TRT] Erf_572 [Erf] outputs: [1037 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_573 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_573 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_573 [Constant] outputs: [1038 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_574 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1037 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1038 [01/12/2022-09:32:17] [V] [TRT] Add_574 [Add] inputs: [1037 -> (-1, -1, 3072)[FLOAT]], [1038 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1038 for ONNX node: 1038 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_574 for ONNX node: Add_574 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1039 for ONNX tensor: 1039 [01/12/2022-09:32:17] [V] [TRT] Add_574 [Add] outputs: [1039 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_575 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1034 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1039 [01/12/2022-09:32:17] [V] [TRT] Mul_575 [Mul] inputs: [1034 -> (-1, -1, 3072)[FLOAT]], [1039 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_575 for ONNX node: Mul_575 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1040 for ONNX tensor: 1040 [01/12/2022-09:32:17] [V] [TRT] Mul_575 [Mul] outputs: [1040 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_576 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_576 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_576 [Constant] outputs: [1041 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_577 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1040 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1041 [01/12/2022-09:32:17] [V] [TRT] Mul_577 [Mul] inputs: [1040 -> (-1, -1, 3072)[FLOAT]], [1041 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1041 for ONNX node: 1041 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_577 for ONNX node: Mul_577 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1042 for ONNX tensor: 1042 [01/12/2022-09:32:17] [V] [TRT] Mul_577 [Mul] outputs: [1042 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_578 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1042 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2893 [01/12/2022-09:32:17] [V] [TRT] MatMul_578 [MatMul] inputs: [1042 -> (-1, -1, 3072)[FLOAT]], [2893 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2893 for ONNX node: 2893 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_578 for ONNX node: MatMul_578 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1044 for ONNX tensor: 1044 [01/12/2022-09:32:17] [V] [TRT] MatMul_578 [MatMul] outputs: [1044 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_579 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.fc2.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1044 [01/12/2022-09:32:17] [V] [TRT] Add_579 [Add] inputs: [encoder.layers.4.fc2.bias -> (768)[FLOAT]], [1044 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.fc2.bias for ONNX node: encoder.layers.4.fc2.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_579 for ONNX node: Add_579 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1045 for ONNX tensor: 1045 [01/12/2022-09:32:17] [V] [TRT] Add_579 [Add] outputs: [1045 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_580 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1031 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1045 [01/12/2022-09:32:17] [V] [TRT] Add_580 [Add] inputs: [1031 -> (-1, -1, 768)[FLOAT]], [1045 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_580 for ONNX node: Add_580 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1046 for ONNX tensor: 1046 [01/12/2022-09:32:17] [V] [TRT] Add_580 [Add] outputs: [1046 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: ReduceMean_581 [ReduceMean] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1046 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_581 [ReduceMean] inputs: [1046 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: ReduceMean_581 for ONNX node: ReduceMean_581 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1047 for ONNX tensor: 1047 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_581 [ReduceMean] outputs: [1047 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Sub_582 [Sub] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1046 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1047 [01/12/2022-09:32:17] [V] [TRT] Sub_582 [Sub] inputs: [1046 -> (-1, -1, 768)[FLOAT]], [1047 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Sub_582 for ONNX node: Sub_582 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1048 for ONNX tensor: 1048 [01/12/2022-09:32:17] [V] [TRT] Sub_582 [Sub] outputs: [1048 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_583 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_583 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_583 [Constant] outputs: [1049 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Pow_584 [Pow] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1048 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1049 [01/12/2022-09:32:17] [V] [TRT] Pow_584 [Pow] inputs: [1048 -> (-1, -1, 768)[FLOAT]], [1049 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1049 for ONNX node: 1049 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Pow_584 for ONNX node: Pow_584 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1050 for ONNX tensor: 1050 [01/12/2022-09:32:17] [V] [TRT] Pow_584 [Pow] outputs: [1050 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: ReduceMean_585 [ReduceMean] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1050 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_585 [ReduceMean] inputs: [1050 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: ReduceMean_585 for ONNX node: ReduceMean_585 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1051 for ONNX tensor: 1051 [01/12/2022-09:32:17] [V] [TRT] ReduceMean_585 [ReduceMean] outputs: [1051 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_586 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_586 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_586 [Constant] outputs: [1052 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_587 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1051 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1052 [01/12/2022-09:32:17] [V] [TRT] Add_587 [Add] inputs: [1051 -> (-1, -1, 1)[FLOAT]], [1052 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1052 for ONNX node: 1052 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_587 for ONNX node: Add_587 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1053 for ONNX tensor: 1053 [01/12/2022-09:32:17] [V] [TRT] Add_587 [Add] outputs: [1053 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Sqrt_588 [Sqrt] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1053 [01/12/2022-09:32:17] [V] [TRT] Sqrt_588 [Sqrt] inputs: [1053 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Sqrt_588 for ONNX node: Sqrt_588 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1054 for ONNX tensor: 1054 [01/12/2022-09:32:17] [V] [TRT] Sqrt_588 [Sqrt] outputs: [1054 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Div_589 [Div] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1048 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1054 [01/12/2022-09:32:17] [V] [TRT] Div_589 [Div] inputs: [1048 -> (-1, -1, 768)[FLOAT]], [1054 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Div_589 for ONNX node: Div_589 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1055 for ONNX tensor: 1055 [01/12/2022-09:32:17] [V] [TRT] Div_589 [Div] outputs: [1055 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_590 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1055 [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.final_layer_norm.weight [01/12/2022-09:32:17] [V] [TRT] Mul_590 [Mul] inputs: [1055 -> (-1, -1, 768)[FLOAT]], [encoder.layers.4.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.final_layer_norm.weight for ONNX node: encoder.layers.4.final_layer_norm.weight [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_590 for ONNX node: Mul_590 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1056 for ONNX tensor: 1056 [01/12/2022-09:32:17] [V] [TRT] Mul_590 [Mul] outputs: [1056 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_591 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1056 [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.4.final_layer_norm.bias [01/12/2022-09:32:17] [V] [TRT] Add_591 [Add] inputs: [1056 -> (-1, -1, 768)[FLOAT]], [encoder.layers.4.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.4.final_layer_norm.bias for ONNX node: encoder.layers.4.final_layer_norm.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_591 for ONNX node: Add_591 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1057 for ONNX tensor: 1057 [01/12/2022-09:32:17] [V] [TRT] Add_591 [Add] outputs: [1057 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Shape_592 [Shape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1057 [01/12/2022-09:32:17] [V] [TRT] Shape_592 [Shape] inputs: [1057 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Shape_592 for ONNX node: Shape_592 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1058 for ONNX tensor: 1058 [01/12/2022-09:32:17] [V] [TRT] Shape_592 [Shape] outputs: [1058 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_593 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_593 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_593 [Constant] outputs: [1059 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Gather_594 [Gather] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1058 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1059 [01/12/2022-09:32:17] [V] [TRT] Gather_594 [Gather] inputs: [1058 -> (3)[INT32]], [1059 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1059 for ONNX node: 1059 [01/12/2022-09:32:17] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Gather_594 for ONNX node: Gather_594 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1060 for ONNX tensor: 1060 [01/12/2022-09:32:17] [V] [TRT] Gather_594 [Gather] outputs: [1060 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Shape_595 [Shape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1057 [01/12/2022-09:32:17] [V] [TRT] Shape_595 [Shape] inputs: [1057 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Shape_595 for ONNX node: Shape_595 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1061 for ONNX tensor: 1061 [01/12/2022-09:32:17] [V] [TRT] Shape_595 [Shape] outputs: [1061 -> (3)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_596 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_596 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_596 [Constant] outputs: [1062 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Gather_597 [Gather] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1061 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1062 [01/12/2022-09:32:17] [V] [TRT] Gather_597 [Gather] inputs: [1061 -> (3)[INT32]], [1062 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1062 for ONNX node: 1062 [01/12/2022-09:32:17] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Gather_597 for ONNX node: Gather_597 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1063 for ONNX tensor: 1063 [01/12/2022-09:32:17] [V] [TRT] Gather_597 [Gather] outputs: [1063 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_598 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1057 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2894 [01/12/2022-09:32:17] [V] [TRT] MatMul_598 [MatMul] inputs: [1057 -> (-1, -1, 768)[FLOAT]], [2894 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2894 for ONNX node: 2894 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_598 for ONNX node: MatMul_598 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1065 for ONNX tensor: 1065 [01/12/2022-09:32:17] [V] [TRT] MatMul_598 [MatMul] outputs: [1065 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_599 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.5.self_attn.q_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1065 [01/12/2022-09:32:17] [V] [TRT] Add_599 [Add] inputs: [encoder.layers.5.self_attn.q_proj.bias -> (768)[FLOAT]], [1065 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.5.self_attn.q_proj.bias for ONNX node: encoder.layers.5.self_attn.q_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_599 for ONNX node: Add_599 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1066 for ONNX tensor: 1066 [01/12/2022-09:32:17] [V] [TRT] Add_599 [Add] outputs: [1066 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_600 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_600 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_600 [Constant] outputs: [1067 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_601 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1066 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1067 [01/12/2022-09:32:17] [V] [TRT] Mul_601 [Mul] inputs: [1066 -> (-1, -1, 768)[FLOAT]], [1067 -> ()[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1067 for ONNX node: 1067 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_601 for ONNX node: Mul_601 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1068 for ONNX tensor: 1068 [01/12/2022-09:32:17] [V] [TRT] Mul_601 [Mul] outputs: [1068 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_602 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1057 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2895 [01/12/2022-09:32:17] [V] [TRT] MatMul_602 [MatMul] inputs: [1057 -> (-1, -1, 768)[FLOAT]], [2895 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2895 for ONNX node: 2895 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_602 for ONNX node: MatMul_602 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1070 for ONNX tensor: 1070 [01/12/2022-09:32:17] [V] [TRT] MatMul_602 [MatMul] outputs: [1070 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_603 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.5.self_attn.k_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1070 [01/12/2022-09:32:17] [V] [TRT] Add_603 [Add] inputs: [encoder.layers.5.self_attn.k_proj.bias -> (768)[FLOAT]], [1070 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.5.self_attn.k_proj.bias for ONNX node: encoder.layers.5.self_attn.k_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_603 for ONNX node: Add_603 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1071 for ONNX tensor: 1071 [01/12/2022-09:32:17] [V] [TRT] Add_603 [Add] outputs: [1071 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_604 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1060 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_604 [Unsqueeze] inputs: [1060 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_604 for ONNX node: Unsqueeze_604 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1075 for ONNX tensor: 1075 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_604 [Unsqueeze] outputs: [1075 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_605 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1075 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2896 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2897 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2898 [01/12/2022-09:32:17] [V] [TRT] Concat_605 [Concat] inputs: [1075 -> (1)[INT32]], [2896 -> (1)[INT32]], [2897 -> (1)[INT32]], [2898 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2896 for ONNX node: 2896 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2897 for ONNX node: 2897 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2898 for ONNX node: 2898 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_605 for ONNX node: Concat_605 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1079 for ONNX tensor: 1079 [01/12/2022-09:32:17] [V] [TRT] Concat_605 [Concat] outputs: [1079 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_606 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1071 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1079 [01/12/2022-09:32:17] [V] [TRT] Reshape_606 [Reshape] inputs: [1071 -> (-1, -1, 768)[FLOAT]], [1079 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_606 for ONNX node: Reshape_606 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1080 for ONNX tensor: 1080 [01/12/2022-09:32:17] [V] [TRT] Reshape_606 [Reshape] outputs: [1080 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_607 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1080 [01/12/2022-09:32:17] [V] [TRT] Transpose_607 [Transpose] inputs: [1080 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_607 for ONNX node: Transpose_607 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1081 for ONNX tensor: 1081 [01/12/2022-09:32:17] [V] [TRT] Transpose_607 [Transpose] outputs: [1081 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: MatMul_608 [MatMul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1057 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2899 [01/12/2022-09:32:17] [V] [TRT] MatMul_608 [MatMul] inputs: [1057 -> (-1, -1, 768)[FLOAT]], [2899 -> (768, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2899 for ONNX node: 2899 [01/12/2022-09:32:17] [V] [TRT] Registering layer: MatMul_608 for ONNX node: MatMul_608 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1083 for ONNX tensor: 1083 [01/12/2022-09:32:17] [V] [TRT] MatMul_608 [MatMul] outputs: [1083 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Add_609 [Add] [01/12/2022-09:32:17] [V] [TRT] Searching for input: encoder.layers.5.self_attn.v_proj.bias [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1083 [01/12/2022-09:32:17] [V] [TRT] Add_609 [Add] inputs: [encoder.layers.5.self_attn.v_proj.bias -> (768)[FLOAT]], [1083 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: encoder.layers.5.self_attn.v_proj.bias for ONNX node: encoder.layers.5.self_attn.v_proj.bias [01/12/2022-09:32:17] [V] [TRT] Registering layer: Add_609 for ONNX node: Add_609 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1084 for ONNX tensor: 1084 [01/12/2022-09:32:17] [V] [TRT] Add_609 [Add] outputs: [1084 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_610 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1060 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_610 [Unsqueeze] inputs: [1060 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_610 for ONNX node: Unsqueeze_610 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1088 for ONNX tensor: 1088 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_610 [Unsqueeze] outputs: [1088 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_611 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1088 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2900 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2901 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2902 [01/12/2022-09:32:17] [V] [TRT] Concat_611 [Concat] inputs: [1088 -> (1)[INT32]], [2900 -> (1)[INT32]], [2901 -> (1)[INT32]], [2902 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2900 for ONNX node: 2900 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2901 for ONNX node: 2901 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2902 for ONNX node: 2902 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_611 for ONNX node: Concat_611 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1092 for ONNX tensor: 1092 [01/12/2022-09:32:17] [V] [TRT] Concat_611 [Concat] outputs: [1092 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Reshape_612 [Reshape] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1084 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1092 [01/12/2022-09:32:17] [V] [TRT] Reshape_612 [Reshape] inputs: [1084 -> (-1, -1, 768)[FLOAT]], [1092 -> (4)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Reshape_612 for ONNX node: Reshape_612 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1093 for ONNX tensor: 1093 [01/12/2022-09:32:17] [V] [TRT] Reshape_612 [Reshape] outputs: [1093 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Transpose_613 [Transpose] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1093 [01/12/2022-09:32:17] [V] [TRT] Transpose_613 [Transpose] inputs: [1093 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: Transpose_613 for ONNX node: Transpose_613 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1094 for ONNX tensor: 1094 [01/12/2022-09:32:17] [V] [TRT] Transpose_613 [Transpose] outputs: [1094 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Constant_614 [Constant] [01/12/2022-09:32:17] [V] [TRT] Constant_614 [Constant] inputs: [01/12/2022-09:32:17] [V] [TRT] Constant_614 [Constant] outputs: [1095 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Mul_615 [Mul] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1060 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1095 [01/12/2022-09:32:17] [V] [TRT] Mul_615 [Mul] inputs: [1060 -> ()[INT32]], [1095 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 1095 for ONNX node: 1095 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Mul_615 for ONNX node: Mul_615 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1096 for ONNX tensor: 1096 [01/12/2022-09:32:17] [V] [TRT] Mul_615 [Mul] outputs: [1096 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_616 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1060 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_616 [Unsqueeze] inputs: [1060 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_616 for ONNX node: Unsqueeze_616 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1099 for ONNX tensor: 1099 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_616 [Unsqueeze] outputs: [1099 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Unsqueeze_617 [Unsqueeze] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1063 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_617 [Unsqueeze] inputs: [1063 -> ()[INT32]], [01/12/2022-09:32:17] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:17] [V] [TRT] Registering layer: Unsqueeze_617 for ONNX node: Unsqueeze_617 [01/12/2022-09:32:17] [V] [TRT] Registering tensor: 1100 for ONNX tensor: 1100 [01/12/2022-09:32:17] [V] [TRT] Unsqueeze_617 [Unsqueeze] outputs: [1100 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Parsing node: Concat_618 [Concat] [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1099 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 1100 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2903 [01/12/2022-09:32:17] [V] [TRT] Searching for input: 2904 [01/12/2022-09:32:17] [V] [TRT] Concat_618 [Concat] inputs: [1099 -> (1)[INT32]], [1100 -> (1)[INT32]], [2903 -> (1)[INT32]], [2904 -> (1)[INT32]], [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2903 for ONNX node: 2903 [01/12/2022-09:32:17] [V] [TRT] Registering layer: 2904 for ONNX node: 2904 [01/12/2022-09:32:17] [V] [TRT] Registering layer: Concat_618 for ONNX node: Concat_618 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1103 for ONNX tensor: 1103 [01/12/2022-09:32:18] [V] [TRT] Concat_618 [Concat] outputs: [1103 -> (4)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_619 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1068 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1103 [01/12/2022-09:32:18] [V] [TRT] Reshape_619 [Reshape] inputs: [1068 -> (-1, -1, 768)[FLOAT]], [1103 -> (4)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_619 for ONNX node: Reshape_619 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1104 for ONNX tensor: 1104 [01/12/2022-09:32:18] [V] [TRT] Reshape_619 [Reshape] outputs: [1104 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Transpose_620 [Transpose] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1104 [01/12/2022-09:32:18] [V] [TRT] Transpose_620 [Transpose] inputs: [1104 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Transpose_620 for ONNX node: Transpose_620 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1105 for ONNX tensor: 1105 [01/12/2022-09:32:18] [V] [TRT] Transpose_620 [Transpose] outputs: [1105 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_621 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1096 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_621 [Unsqueeze] inputs: [1096 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_621 for ONNX node: Unsqueeze_621 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1108 for ONNX tensor: 1108 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_621 [Unsqueeze] outputs: [1108 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_622 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1108 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2905 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2906 [01/12/2022-09:32:18] [V] [TRT] Concat_622 [Concat] inputs: [1108 -> (1)[INT32]], [2905 -> (1)[INT32]], [2906 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2905 for ONNX node: 2905 [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2906 for ONNX node: 2906 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_622 for ONNX node: Concat_622 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1111 for ONNX tensor: 1111 [01/12/2022-09:32:18] [V] [TRT] Concat_622 [Concat] outputs: [1111 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_623 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1105 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1111 [01/12/2022-09:32:18] [V] [TRT] Reshape_623 [Reshape] inputs: [1105 -> (-1, 12, -1, 64)[FLOAT]], [1111 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_623 for ONNX node: Reshape_623 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1112 for ONNX tensor: 1112 [01/12/2022-09:32:18] [V] [TRT] Reshape_623 [Reshape] outputs: [1112 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_624 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1096 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_624 [Unsqueeze] inputs: [1096 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_624 for ONNX node: Unsqueeze_624 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1115 for ONNX tensor: 1115 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_624 [Unsqueeze] outputs: [1115 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_625 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1115 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2907 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2908 [01/12/2022-09:32:18] [V] [TRT] Concat_625 [Concat] inputs: [1115 -> (1)[INT32]], [2907 -> (1)[INT32]], [2908 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2907 for ONNX node: 2907 [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2908 for ONNX node: 2908 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_625 for ONNX node: Concat_625 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1118 for ONNX tensor: 1118 [01/12/2022-09:32:18] [V] [TRT] Concat_625 [Concat] outputs: [1118 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_626 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1081 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1118 [01/12/2022-09:32:18] [V] [TRT] Reshape_626 [Reshape] inputs: [1081 -> (-1, 12, -1, 64)[FLOAT]], [1118 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_626 for ONNX node: Reshape_626 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1119 for ONNX tensor: 1119 [01/12/2022-09:32:18] [V] [TRT] Reshape_626 [Reshape] outputs: [1119 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_627 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1096 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_627 [Unsqueeze] inputs: [1096 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_627 for ONNX node: Unsqueeze_627 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1122 for ONNX tensor: 1122 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_627 [Unsqueeze] outputs: [1122 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_628 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1122 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2909 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2910 [01/12/2022-09:32:18] [V] [TRT] Concat_628 [Concat] inputs: [1122 -> (1)[INT32]], [2909 -> (1)[INT32]], [2910 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2909 for ONNX node: 2909 [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2910 for ONNX node: 2910 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_628 for ONNX node: Concat_628 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1125 for ONNX tensor: 1125 [01/12/2022-09:32:18] [V] [TRT] Concat_628 [Concat] outputs: [1125 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_629 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1094 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1125 [01/12/2022-09:32:18] [V] [TRT] Reshape_629 [Reshape] inputs: [1094 -> (-1, 12, -1, 64)[FLOAT]], [1125 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_629 for ONNX node: Reshape_629 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1126 for ONNX tensor: 1126 [01/12/2022-09:32:18] [V] [TRT] Reshape_629 [Reshape] outputs: [1126 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Transpose_630 [Transpose] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1119 [01/12/2022-09:32:18] [V] [TRT] Transpose_630 [Transpose] inputs: [1119 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Transpose_630 for ONNX node: Transpose_630 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1127 for ONNX tensor: 1127 [01/12/2022-09:32:18] [V] [TRT] Transpose_630 [Transpose] outputs: [1127 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: MatMul_631 [MatMul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1112 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1127 [01/12/2022-09:32:18] [V] [TRT] MatMul_631 [MatMul] inputs: [1112 -> (-1, -1, 64)[FLOAT]], [1127 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: MatMul_631 for ONNX node: MatMul_631 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1128 for ONNX tensor: 1128 [01/12/2022-09:32:18] [V] [TRT] MatMul_631 [MatMul] outputs: [1128 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Softmax_632 [Softmax] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1128 [01/12/2022-09:32:18] [V] [TRT] Softmax_632 [Softmax] inputs: [1128 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Softmax_632 for ONNX node: Softmax_632 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1129 for ONNX tensor: 1129 [01/12/2022-09:32:18] [V] [TRT] Softmax_632 [Softmax] outputs: [1129 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: MatMul_633 [MatMul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1129 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1126 [01/12/2022-09:32:18] [V] [TRT] MatMul_633 [MatMul] inputs: [1129 -> (-1, -1, -1)[FLOAT]], [1126 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: MatMul_633 for ONNX node: MatMul_633 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1130 for ONNX tensor: 1130 [01/12/2022-09:32:18] [V] [TRT] MatMul_633 [MatMul] outputs: [1130 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_634 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1060 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_634 [Unsqueeze] inputs: [1060 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_634 for ONNX node: Unsqueeze_634 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1133 for ONNX tensor: 1133 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_634 [Unsqueeze] outputs: [1133 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_635 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1063 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_635 [Unsqueeze] inputs: [1063 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_635 for ONNX node: Unsqueeze_635 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1135 for ONNX tensor: 1135 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_635 [Unsqueeze] outputs: [1135 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_636 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1133 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2911 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1135 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2912 [01/12/2022-09:32:18] [V] [TRT] Concat_636 [Concat] inputs: [1133 -> (1)[INT32]], [2911 -> (1)[INT32]], [1135 -> (1)[INT32]], [2912 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2911 for ONNX node: 2911 [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2912 for ONNX node: 2912 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_636 for ONNX node: Concat_636 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1137 for ONNX tensor: 1137 [01/12/2022-09:32:18] [V] [TRT] Concat_636 [Concat] outputs: [1137 -> (4)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_637 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1130 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1137 [01/12/2022-09:32:18] [V] [TRT] Reshape_637 [Reshape] inputs: [1130 -> (-1, -1, 64)[FLOAT]], [1137 -> (4)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_637 for ONNX node: Reshape_637 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1138 for ONNX tensor: 1138 [01/12/2022-09:32:18] [V] [TRT] Reshape_637 [Reshape] outputs: [1138 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Transpose_638 [Transpose] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1138 [01/12/2022-09:32:18] [V] [TRT] Transpose_638 [Transpose] inputs: [1138 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Transpose_638 for ONNX node: Transpose_638 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1139 for ONNX tensor: 1139 [01/12/2022-09:32:18] [V] [TRT] Transpose_638 [Transpose] outputs: [1139 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_639 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1060 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_639 [Unsqueeze] inputs: [1060 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_639 for ONNX node: Unsqueeze_639 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1141 for ONNX tensor: 1141 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_639 [Unsqueeze] outputs: [1141 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_640 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1063 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_640 [Unsqueeze] inputs: [1063 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_640 for ONNX node: Unsqueeze_640 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1142 for ONNX tensor: 1142 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_640 [Unsqueeze] outputs: [1142 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_641 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1141 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1142 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2913 [01/12/2022-09:32:18] [V] [TRT] Concat_641 [Concat] inputs: [1141 -> (1)[INT32]], [1142 -> (1)[INT32]], [2913 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2913 for ONNX node: 2913 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_641 for ONNX node: Concat_641 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1144 for ONNX tensor: 1144 [01/12/2022-09:32:18] [V] [TRT] Concat_641 [Concat] outputs: [1144 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_642 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1139 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1144 [01/12/2022-09:32:18] [V] [TRT] Reshape_642 [Reshape] inputs: [1139 -> (-1, -1, 12, 64)[FLOAT]], [1144 -> (3)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_642 for ONNX node: Reshape_642 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1145 for ONNX tensor: 1145 [01/12/2022-09:32:18] [V] [TRT] Reshape_642 [Reshape] outputs: [1145 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: MatMul_643 [MatMul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1145 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2914 [01/12/2022-09:32:18] [V] [TRT] MatMul_643 [MatMul] inputs: [1145 -> (-1, -1, 768)[FLOAT]], [2914 -> (768, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2914 for ONNX node: 2914 [01/12/2022-09:32:18] [V] [TRT] Registering layer: MatMul_643 for ONNX node: MatMul_643 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1147 for ONNX tensor: 1147 [01/12/2022-09:32:18] [V] [TRT] MatMul_643 [MatMul] outputs: [1147 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_644 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.self_attn.out_proj.bias [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1147 [01/12/2022-09:32:18] [V] [TRT] Add_644 [Add] inputs: [encoder.layers.5.self_attn.out_proj.bias -> (768)[FLOAT]], [1147 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.self_attn.out_proj.bias for ONNX node: encoder.layers.5.self_attn.out_proj.bias [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_644 for ONNX node: Add_644 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1148 for ONNX tensor: 1148 [01/12/2022-09:32:18] [V] [TRT] Add_644 [Add] outputs: [1148 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_645 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1057 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1148 [01/12/2022-09:32:18] [V] [TRT] Add_645 [Add] inputs: [1057 -> (-1, -1, 768)[FLOAT]], [1148 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_645 for ONNX node: Add_645 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1149 for ONNX tensor: 1149 [01/12/2022-09:32:18] [V] [TRT] Add_645 [Add] outputs: [1149 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: ReduceMean_646 [ReduceMean] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1149 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_646 [ReduceMean] inputs: [1149 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: ReduceMean_646 for ONNX node: ReduceMean_646 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1150 for ONNX tensor: 1150 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_646 [ReduceMean] outputs: [1150 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Sub_647 [Sub] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1149 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1150 [01/12/2022-09:32:18] [V] [TRT] Sub_647 [Sub] inputs: [1149 -> (-1, -1, 768)[FLOAT]], [1150 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Sub_647 for ONNX node: Sub_647 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1151 for ONNX tensor: 1151 [01/12/2022-09:32:18] [V] [TRT] Sub_647 [Sub] outputs: [1151 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_648 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_648 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_648 [Constant] outputs: [1152 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Pow_649 [Pow] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1151 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1152 [01/12/2022-09:32:18] [V] [TRT] Pow_649 [Pow] inputs: [1151 -> (-1, -1, 768)[FLOAT]], [1152 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1152 for ONNX node: 1152 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Pow_649 for ONNX node: Pow_649 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1153 for ONNX tensor: 1153 [01/12/2022-09:32:18] [V] [TRT] Pow_649 [Pow] outputs: [1153 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: ReduceMean_650 [ReduceMean] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1153 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_650 [ReduceMean] inputs: [1153 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: ReduceMean_650 for ONNX node: ReduceMean_650 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1154 for ONNX tensor: 1154 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_650 [ReduceMean] outputs: [1154 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_651 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_651 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_651 [Constant] outputs: [1155 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_652 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1154 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1155 [01/12/2022-09:32:18] [V] [TRT] Add_652 [Add] inputs: [1154 -> (-1, -1, 1)[FLOAT]], [1155 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1155 for ONNX node: 1155 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_652 for ONNX node: Add_652 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1156 for ONNX tensor: 1156 [01/12/2022-09:32:18] [V] [TRT] Add_652 [Add] outputs: [1156 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Sqrt_653 [Sqrt] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1156 [01/12/2022-09:32:18] [V] [TRT] Sqrt_653 [Sqrt] inputs: [1156 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Sqrt_653 for ONNX node: Sqrt_653 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1157 for ONNX tensor: 1157 [01/12/2022-09:32:18] [V] [TRT] Sqrt_653 [Sqrt] outputs: [1157 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Div_654 [Div] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1151 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1157 [01/12/2022-09:32:18] [V] [TRT] Div_654 [Div] inputs: [1151 -> (-1, -1, 768)[FLOAT]], [1157 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Div_654 for ONNX node: Div_654 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1158 for ONNX tensor: 1158 [01/12/2022-09:32:18] [V] [TRT] Div_654 [Div] outputs: [1158 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Mul_655 [Mul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1158 [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.self_attn_layer_norm.weight [01/12/2022-09:32:18] [V] [TRT] Mul_655 [Mul] inputs: [1158 -> (-1, -1, 768)[FLOAT]], [encoder.layers.5.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.self_attn_layer_norm.weight for ONNX node: encoder.layers.5.self_attn_layer_norm.weight [01/12/2022-09:32:18] [V] [TRT] Registering layer: Mul_655 for ONNX node: Mul_655 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1159 for ONNX tensor: 1159 [01/12/2022-09:32:18] [V] [TRT] Mul_655 [Mul] outputs: [1159 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_656 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1159 [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.self_attn_layer_norm.bias [01/12/2022-09:32:18] [V] [TRT] Add_656 [Add] inputs: [1159 -> (-1, -1, 768)[FLOAT]], [encoder.layers.5.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.self_attn_layer_norm.bias for ONNX node: encoder.layers.5.self_attn_layer_norm.bias [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_656 for ONNX node: Add_656 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1160 for ONNX tensor: 1160 [01/12/2022-09:32:18] [V] [TRT] Add_656 [Add] outputs: [1160 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: MatMul_657 [MatMul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1160 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2915 [01/12/2022-09:32:18] [V] [TRT] MatMul_657 [MatMul] inputs: [1160 -> (-1, -1, 768)[FLOAT]], [2915 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2915 for ONNX node: 2915 [01/12/2022-09:32:18] [V] [TRT] Registering layer: MatMul_657 for ONNX node: MatMul_657 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1162 for ONNX tensor: 1162 [01/12/2022-09:32:18] [V] [TRT] MatMul_657 [MatMul] outputs: [1162 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_658 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.fc1.bias [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1162 [01/12/2022-09:32:18] [V] [TRT] Add_658 [Add] inputs: [encoder.layers.5.fc1.bias -> (3072)[FLOAT]], [1162 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.fc1.bias for ONNX node: encoder.layers.5.fc1.bias [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_658 for ONNX node: Add_658 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1163 for ONNX tensor: 1163 [01/12/2022-09:32:18] [V] [TRT] Add_658 [Add] outputs: [1163 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_659 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_659 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_659 [Constant] outputs: [1164 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Div_660 [Div] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1163 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1164 [01/12/2022-09:32:18] [V] [TRT] Div_660 [Div] inputs: [1163 -> (-1, -1, 3072)[FLOAT]], [1164 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1164 for ONNX node: 1164 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Div_660 for ONNX node: Div_660 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1165 for ONNX tensor: 1165 [01/12/2022-09:32:18] [V] [TRT] Div_660 [Div] outputs: [1165 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Erf_661 [Erf] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1165 [01/12/2022-09:32:18] [V] [TRT] Erf_661 [Erf] inputs: [1165 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Erf_661 for ONNX node: Erf_661 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1166 for ONNX tensor: 1166 [01/12/2022-09:32:18] [V] [TRT] Erf_661 [Erf] outputs: [1166 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_662 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_662 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_662 [Constant] outputs: [1167 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_663 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1166 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1167 [01/12/2022-09:32:18] [V] [TRT] Add_663 [Add] inputs: [1166 -> (-1, -1, 3072)[FLOAT]], [1167 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1167 for ONNX node: 1167 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_663 for ONNX node: Add_663 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1168 for ONNX tensor: 1168 [01/12/2022-09:32:18] [V] [TRT] Add_663 [Add] outputs: [1168 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Mul_664 [Mul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1163 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1168 [01/12/2022-09:32:18] [V] [TRT] Mul_664 [Mul] inputs: [1163 -> (-1, -1, 3072)[FLOAT]], [1168 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Mul_664 for ONNX node: Mul_664 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1169 for ONNX tensor: 1169 [01/12/2022-09:32:18] [V] [TRT] Mul_664 [Mul] outputs: [1169 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_665 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_665 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_665 [Constant] outputs: [1170 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Mul_666 [Mul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1169 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1170 [01/12/2022-09:32:18] [V] [TRT] Mul_666 [Mul] inputs: [1169 -> (-1, -1, 3072)[FLOAT]], [1170 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1170 for ONNX node: 1170 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Mul_666 for ONNX node: Mul_666 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1171 for ONNX tensor: 1171 [01/12/2022-09:32:18] [V] [TRT] Mul_666 [Mul] outputs: [1171 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: MatMul_667 [MatMul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1171 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2916 [01/12/2022-09:32:18] [V] [TRT] MatMul_667 [MatMul] inputs: [1171 -> (-1, -1, 3072)[FLOAT]], [2916 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2916 for ONNX node: 2916 [01/12/2022-09:32:18] [V] [TRT] Registering layer: MatMul_667 for ONNX node: MatMul_667 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1173 for ONNX tensor: 1173 [01/12/2022-09:32:18] [V] [TRT] MatMul_667 [MatMul] outputs: [1173 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_668 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.fc2.bias [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1173 [01/12/2022-09:32:18] [V] [TRT] Add_668 [Add] inputs: [encoder.layers.5.fc2.bias -> (768)[FLOAT]], [1173 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.fc2.bias for ONNX node: encoder.layers.5.fc2.bias [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_668 for ONNX node: Add_668 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1174 for ONNX tensor: 1174 [01/12/2022-09:32:18] [V] [TRT] Add_668 [Add] outputs: [1174 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_669 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1160 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1174 [01/12/2022-09:32:18] [V] [TRT] Add_669 [Add] inputs: [1160 -> (-1, -1, 768)[FLOAT]], [1174 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_669 for ONNX node: Add_669 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1175 for ONNX tensor: 1175 [01/12/2022-09:32:18] [V] [TRT] Add_669 [Add] outputs: [1175 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: ReduceMean_670 [ReduceMean] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1175 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_670 [ReduceMean] inputs: [1175 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: ReduceMean_670 for ONNX node: ReduceMean_670 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1176 for ONNX tensor: 1176 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_670 [ReduceMean] outputs: [1176 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Sub_671 [Sub] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1175 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1176 [01/12/2022-09:32:18] [V] [TRT] Sub_671 [Sub] inputs: [1175 -> (-1, -1, 768)[FLOAT]], [1176 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Sub_671 for ONNX node: Sub_671 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1177 for ONNX tensor: 1177 [01/12/2022-09:32:18] [V] [TRT] Sub_671 [Sub] outputs: [1177 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_672 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_672 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_672 [Constant] outputs: [1178 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Pow_673 [Pow] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1177 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1178 [01/12/2022-09:32:18] [V] [TRT] Pow_673 [Pow] inputs: [1177 -> (-1, -1, 768)[FLOAT]], [1178 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1178 for ONNX node: 1178 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Pow_673 for ONNX node: Pow_673 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1179 for ONNX tensor: 1179 [01/12/2022-09:32:18] [V] [TRT] Pow_673 [Pow] outputs: [1179 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: ReduceMean_674 [ReduceMean] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1179 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_674 [ReduceMean] inputs: [1179 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: ReduceMean_674 for ONNX node: ReduceMean_674 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1180 for ONNX tensor: 1180 [01/12/2022-09:32:18] [V] [TRT] ReduceMean_674 [ReduceMean] outputs: [1180 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_675 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_675 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_675 [Constant] outputs: [1181 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_676 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1180 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1181 [01/12/2022-09:32:18] [V] [TRT] Add_676 [Add] inputs: [1180 -> (-1, -1, 1)[FLOAT]], [1181 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1181 for ONNX node: 1181 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_676 for ONNX node: Add_676 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1182 for ONNX tensor: 1182 [01/12/2022-09:32:18] [V] [TRT] Add_676 [Add] outputs: [1182 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Sqrt_677 [Sqrt] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1182 [01/12/2022-09:32:18] [V] [TRT] Sqrt_677 [Sqrt] inputs: [1182 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Sqrt_677 for ONNX node: Sqrt_677 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1183 for ONNX tensor: 1183 [01/12/2022-09:32:18] [V] [TRT] Sqrt_677 [Sqrt] outputs: [1183 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Div_678 [Div] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1177 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1183 [01/12/2022-09:32:18] [V] [TRT] Div_678 [Div] inputs: [1177 -> (-1, -1, 768)[FLOAT]], [1183 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Div_678 for ONNX node: Div_678 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1184 for ONNX tensor: 1184 [01/12/2022-09:32:18] [V] [TRT] Div_678 [Div] outputs: [1184 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Mul_679 [Mul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1184 [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.final_layer_norm.weight [01/12/2022-09:32:18] [V] [TRT] Mul_679 [Mul] inputs: [1184 -> (-1, -1, 768)[FLOAT]], [encoder.layers.5.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.final_layer_norm.weight for ONNX node: encoder.layers.5.final_layer_norm.weight [01/12/2022-09:32:18] [V] [TRT] Registering layer: Mul_679 for ONNX node: Mul_679 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1185 for ONNX tensor: 1185 [01/12/2022-09:32:18] [V] [TRT] Mul_679 [Mul] outputs: [1185 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_680 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1185 [01/12/2022-09:32:18] [V] [TRT] Searching for input: encoder.layers.5.final_layer_norm.bias [01/12/2022-09:32:18] [V] [TRT] Add_680 [Add] inputs: [1185 -> (-1, -1, 768)[FLOAT]], [encoder.layers.5.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: encoder.layers.5.final_layer_norm.bias for ONNX node: encoder.layers.5.final_layer_norm.bias [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_680 for ONNX node: Add_680 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1186_0 for ONNX tensor: 1186 [01/12/2022-09:32:18] [V] [TRT] Add_680 [Add] outputs: [1186 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Shape_681 [Shape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 378 [01/12/2022-09:32:18] [V] [TRT] Shape_681 [Shape] inputs: [378 -> (-1, -1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Shape_681 for ONNX node: Shape_681 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1187 for ONNX tensor: 1187 [01/12/2022-09:32:18] [V] [TRT] Shape_681 [Shape] outputs: [1187 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_682 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_682 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_682 [Constant] outputs: [1188 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Gather_683 [Gather] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1187 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1188 [01/12/2022-09:32:18] [V] [TRT] Gather_683 [Gather] inputs: [1187 -> (2)[INT32]], [1188 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1188 for ONNX node: 1188 [01/12/2022-09:32:18] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Gather_683 for ONNX node: Gather_683 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1189 for ONNX tensor: 1189 [01/12/2022-09:32:18] [V] [TRT] Gather_683 [Gather] outputs: [1189 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Shape_684 [Shape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 378 [01/12/2022-09:32:18] [V] [TRT] Shape_684 [Shape] inputs: [378 -> (-1, -1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Shape_684 for ONNX node: Shape_684 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1190 for ONNX tensor: 1190 [01/12/2022-09:32:18] [V] [TRT] Shape_684 [Shape] outputs: [1190 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_685 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_685 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_685 [Constant] outputs: [1191 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Gather_686 [Gather] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1190 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1191 [01/12/2022-09:32:18] [V] [TRT] Gather_686 [Gather] inputs: [1190 -> (2)[INT32]], [1191 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1191 for ONNX node: 1191 [01/12/2022-09:32:18] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Gather_686 for ONNX node: Gather_686 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1192 for ONNX tensor: 1192 [01/12/2022-09:32:18] [V] [TRT] Gather_686 [Gather] outputs: [1192 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_687 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1192 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_687 [Unsqueeze] inputs: [1192 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_687 for ONNX node: Unsqueeze_687 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1195 for ONNX tensor: 1195 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_687 [Unsqueeze] outputs: [1195 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_688 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2917 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1195 [01/12/2022-09:32:18] [V] [TRT] Concat_688 [Concat] inputs: [2917 -> (1)[INT32]], [1195 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2917 for ONNX node: 2917 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_688 for ONNX node: Concat_688 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1196 for ONNX tensor: 1196 [01/12/2022-09:32:18] [V] [TRT] Concat_688 [Concat] outputs: [1196 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_689 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 378 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1196 [01/12/2022-09:32:18] [V] [TRT] Reshape_689 [Reshape] inputs: [378 -> (-1, -1)[INT32]], [1196 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_689 for ONNX node: Reshape_689 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1197 for ONNX tensor: 1197 [01/12/2022-09:32:18] [V] [TRT] Reshape_689 [Reshape] outputs: [1197 -> (-1, -1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Gather_690 [Gather] [01/12/2022-09:32:18] [V] [TRT] Searching for input: shared.weight [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1197 [01/12/2022-09:32:18] [V] [TRT] Gather_690 [Gather] inputs: [shared.weight -> (50265, 768)[FLOAT]], [1197 -> (-1, -1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: shared.weight_1 for ONNX node: shared.weight [01/12/2022-09:32:18] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Gather_690 for ONNX node: Gather_690 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1198 for ONNX tensor: 1198 [01/12/2022-09:32:18] [V] [TRT] Gather_690 [Gather] outputs: [1198 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_691 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_691 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_691 [Constant] outputs: [1199 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Mul_692 [Mul] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1198 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1199 [01/12/2022-09:32:18] [V] [TRT] Mul_692 [Mul] inputs: [1198 -> (-1, -1, 768)[FLOAT]], [1199 -> ()[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1199 for ONNX node: 1199 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Mul_692 for ONNX node: Mul_692 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1200 for ONNX tensor: 1200 [01/12/2022-09:32:18] [V] [TRT] Mul_692 [Mul] outputs: [1200 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_693 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1192 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_693 [Unsqueeze] inputs: [1192 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_693 for ONNX node: Unsqueeze_693 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1201 for ONNX tensor: 1201 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_693 [Unsqueeze] outputs: [1201 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_694 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1192 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_694 [Unsqueeze] inputs: [1192 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_694 for ONNX node: Unsqueeze_694 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1202 for ONNX tensor: 1202 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_694 [Unsqueeze] outputs: [1202 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_695 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1201 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1202 [01/12/2022-09:32:18] [V] [TRT] Concat_695 [Concat] inputs: [1201 -> (1)[INT32]], [1202 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_695 for ONNX node: Concat_695 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1203 for ONNX tensor: 1203 [01/12/2022-09:32:18] [V] [TRT] Concat_695 [Concat] outputs: [1203 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: ConstantOfShape_696 [ConstantOfShape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1203 [01/12/2022-09:32:18] [V] [TRT] ConstantOfShape_696 [ConstantOfShape] inputs: [1203 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: ConstantOfShape_696 for ONNX node: ConstantOfShape_696 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1204 for ONNX tensor: 1204 [01/12/2022-09:32:18] [V] [TRT] ConstantOfShape_696 [ConstantOfShape] outputs: [1204 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Shape_697 [Shape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1204 [01/12/2022-09:32:18] [V] [TRT] Shape_697 [Shape] inputs: [1204 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Shape_697 for ONNX node: Shape_697 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1205 for ONNX tensor: 1205 [01/12/2022-09:32:18] [V] [TRT] Shape_697 [Shape] outputs: [1205 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_698 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_698 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_698 [Constant] outputs: [1206 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_699 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_699 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_699 [Constant] outputs: [1207 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_700 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_700 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [01/12/2022-09:32:18] [V] [TRT] Constant_700 [Constant] outputs: [1208 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Slice_701 [Slice] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1205 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1207 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1208 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1206 [01/12/2022-09:32:18] [V] [TRT] Slice_701 [Slice] inputs: [1205 -> (2)[INT32]], [1207 -> (1)[INT32]], [1208 -> (1)[INT32]], [1206 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Slice_701 for ONNX node: Slice_701 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1209 for ONNX tensor: 1209 [01/12/2022-09:32:18] [V] [TRT] Slice_701 [Slice] outputs: [1209 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Squeeze_702 [Squeeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1209 [01/12/2022-09:32:18] [V] [TRT] Squeeze_702 [Squeeze] inputs: [1209 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (1,), squeezing to: () [01/12/2022-09:32:18] [V] [TRT] Registering layer: Squeeze_702 for ONNX node: Squeeze_702 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1210 for ONNX tensor: 1210 [01/12/2022-09:32:18] [V] [TRT] Squeeze_702 [Squeeze] outputs: [1210 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Cast_703 [Cast] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1210 [01/12/2022-09:32:18] [V] [TRT] Cast_703 [Cast] inputs: [1210 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Casting to type: int32 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Cast_703 for ONNX node: Cast_703 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1211 for ONNX tensor: 1211 [01/12/2022-09:32:18] [V] [TRT] Cast_703 [Cast] outputs: [1211 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_704 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_704 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_704 [Constant] outputs: [1212 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_705 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_705 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_705 [Constant] outputs: [1213 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Range_706 [Range] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1212 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1211 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1213 [01/12/2022-09:32:18] [V] [TRT] Range_706 [Range] inputs: [1212 -> ()[INT32]], [1211 -> ()[INT32]], [1213 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Range_706 for ONNX node: Range_706 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1214 for ONNX tensor: 1214 [01/12/2022-09:32:18] [V] [TRT] Range_706 [Range] outputs: [1214 -> (-1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_707 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_707 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_707 [Constant] outputs: [1215 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Add_708 [Add] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1214 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1215 [01/12/2022-09:32:18] [V] [TRT] Add_708 [Add] inputs: [1214 -> (-1)[INT32]], [1215 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 1215 for ONNX node: 1215 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Add_708 for ONNX node: Add_708 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1216 for ONNX tensor: 1216 [01/12/2022-09:32:18] [V] [TRT] Add_708 [Add] outputs: [1216 -> (-1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Shape_709 [Shape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1204 [01/12/2022-09:32:18] [V] [TRT] Shape_709 [Shape] inputs: [1204 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Shape_709 for ONNX node: Shape_709 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1217 for ONNX tensor: 1217 [01/12/2022-09:32:18] [V] [TRT] Shape_709 [Shape] outputs: [1217 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_710 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_710 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_710 [Constant] outputs: [1218 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_711 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_711 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Constant_711 [Constant] outputs: [1219 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Constant_712 [Constant] [01/12/2022-09:32:18] [V] [TRT] Constant_712 [Constant] inputs: [01/12/2022-09:32:18] [V] [TRT] Weight at index 0: 9223372036854775807 is out of range. Clamping to: 2147483647 [01/12/2022-09:32:18] [V] [TRT] Constant_712 [Constant] outputs: [1220 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Slice_713 [Slice] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1217 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1219 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1220 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1218 [01/12/2022-09:32:18] [V] [TRT] Slice_713 [Slice] inputs: [1217 -> (2)[INT32]], [1219 -> (1)[INT32]], [1220 -> (1)[INT32]], [1218 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Slice_713 for ONNX node: Slice_713 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1221 for ONNX tensor: 1221 [01/12/2022-09:32:18] [V] [TRT] Slice_713 [Slice] outputs: [1221 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Squeeze_714 [Squeeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1221 [01/12/2022-09:32:18] [V] [TRT] Squeeze_714 [Squeeze] inputs: [1221 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (1,), squeezing to: () [01/12/2022-09:32:18] [V] [TRT] Registering layer: Squeeze_714 for ONNX node: Squeeze_714 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1222 for ONNX tensor: 1222 [01/12/2022-09:32:18] [V] [TRT] Squeeze_714 [Squeeze] outputs: [1222 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Unsqueeze_715 [Unsqueeze] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1222 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_715 [Unsqueeze] inputs: [1222 -> ()[INT32]], [01/12/2022-09:32:18] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:18] [V] [TRT] Registering layer: Unsqueeze_715 for ONNX node: Unsqueeze_715 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1224 for ONNX tensor: 1224 [01/12/2022-09:32:18] [V] [TRT] Unsqueeze_715 [Unsqueeze] outputs: [1224 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Concat_716 [Concat] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1224 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 2918 [01/12/2022-09:32:18] [V] [TRT] Concat_716 [Concat] inputs: [1224 -> (1)[INT32]], [2918 -> (1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: 2918 for ONNX node: 2918 [01/12/2022-09:32:18] [V] [TRT] Registering layer: Concat_716 for ONNX node: Concat_716 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1226 for ONNX tensor: 1226 [01/12/2022-09:32:18] [V] [TRT] Concat_716 [Concat] outputs: [1226 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Reshape_717 [Reshape] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1216 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1226 [01/12/2022-09:32:18] [V] [TRT] Reshape_717 [Reshape] inputs: [1216 -> (-1)[INT32]], [1226 -> (2)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Registering layer: Reshape_717 for ONNX node: Reshape_717 [01/12/2022-09:32:18] [V] [TRT] Registering tensor: 1227 for ONNX tensor: 1227 [01/12/2022-09:32:18] [V] [TRT] Reshape_717 [Reshape] outputs: [1227 -> (-1, 1)[INT32]], [01/12/2022-09:32:18] [V] [TRT] Parsing node: Less_718 [Less] [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1214 [01/12/2022-09:32:18] [V] [TRT] Searching for input: 1227 [01/12/2022-09:32:18] [V] [TRT] Less_718 [Less] inputs: [1214 -> (-1)[INT32]], [1227 -> (-1, 1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Less_718 for ONNX node: Less_718 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1228 for ONNX tensor: 1228 [01/12/2022-09:32:19] [V] [TRT] Less_718 [Less] outputs: [1228 -> (-1, -1)[BOOL]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Cast_719 [Cast] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1228 [01/12/2022-09:32:19] [V] [TRT] Cast_719 [Cast] inputs: [1228 -> (-1, -1)[BOOL]], [01/12/2022-09:32:19] [V] [TRT] Casting to type: bool [01/12/2022-09:32:19] [V] [TRT] Registering layer: Cast_719 for ONNX node: Cast_719 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1229 for ONNX tensor: 1229 [01/12/2022-09:32:19] [V] [TRT] Cast_719 [Cast] outputs: [1229 -> (-1, -1)[BOOL]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_720 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_720 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_720 [Constant] outputs: [1230 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Where_721 [Where] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1229 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1230 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1204 [01/12/2022-09:32:19] [V] [TRT] Where_721 [Where] inputs: [1229 -> (-1, -1)[BOOL]], [1230 -> ()[FLOAT]], [1204 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1230 for ONNX node: 1230 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Where_721 for ONNX node: Where_721 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1231 for ONNX tensor: 1231 [01/12/2022-09:32:19] [V] [TRT] Where_721 [Where] outputs: [1231 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Cast_722 [Cast] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1231 [01/12/2022-09:32:19] [V] [TRT] Cast_722 [Cast] inputs: [1231 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Casting to type: float32 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Cast_722 for ONNX node: Cast_722 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1232 for ONNX tensor: 1232 [01/12/2022-09:32:19] [V] [TRT] Cast_722 [Cast] outputs: [1232 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_723 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1232 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_723 [Unsqueeze] inputs: [1232 -> (-1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_723 for ONNX node: Unsqueeze_723 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1233 for ONNX tensor: 1233 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_723 [Unsqueeze] outputs: [1233 -> (1, -1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_724 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1233 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_724 [Unsqueeze] inputs: [1233 -> (1, -1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (1, _, _), unsqueezing to: (_, _, _, _) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_724 for ONNX node: Unsqueeze_724 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1234 for ONNX tensor: 1234 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_724 [Unsqueeze] outputs: [1234 -> (1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_725 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_725 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_725 [Constant] outputs: [1235 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_726 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1192 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1235 [01/12/2022-09:32:19] [V] [TRT] Add_726 [Add] inputs: [1192 -> ()[INT32]], [1235 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1235 for ONNX node: 1235 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_726 for ONNX node: Add_726 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1236 for ONNX tensor: 1236 [01/12/2022-09:32:19] [V] [TRT] Add_726 [Add] outputs: [1236 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_727 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1189 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_727 [Unsqueeze] inputs: [1189 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_727 for ONNX node: Unsqueeze_727 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1238 for ONNX tensor: 1238 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_727 [Unsqueeze] outputs: [1238 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_728 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1192 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_728 [Unsqueeze] inputs: [1192 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_728 for ONNX node: Unsqueeze_728 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1240 for ONNX tensor: 1240 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_728 [Unsqueeze] outputs: [1240 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_729 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1236 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_729 [Unsqueeze] inputs: [1236 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_729 for ONNX node: Unsqueeze_729 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1241 for ONNX tensor: 1241 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_729 [Unsqueeze] outputs: [1241 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_730 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1238 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2919 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1240 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1241 [01/12/2022-09:32:19] [V] [TRT] Concat_730 [Concat] inputs: [1238 -> (1)[INT32]], [2919 -> (1)[INT32]], [1240 -> (1)[INT32]], [1241 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2919 for ONNX node: 2919 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Concat_730 for ONNX node: Concat_730 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1242 for ONNX tensor: 1242 [01/12/2022-09:32:19] [V] [TRT] Concat_730 [Concat] outputs: [1242 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_731 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_731 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_731 [Constant] outputs: [1243 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Reshape_732 [Reshape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1242 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1243 [01/12/2022-09:32:19] [V] [TRT] Reshape_732 [Reshape] inputs: [1242 -> (4)[INT32]], [1243 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Reshape_732 for ONNX node: Reshape_732 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1244 for ONNX tensor: 1244 [01/12/2022-09:32:19] [V] [TRT] Reshape_732 [Reshape] outputs: [1244 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Shape_733 [Shape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1244 [01/12/2022-09:32:19] [V] [TRT] Shape_733 [Shape] inputs: [1244 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Shape_733 for ONNX node: Shape_733 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1245 for ONNX tensor: 1245 [01/12/2022-09:32:19] [V] [TRT] Shape_733 [Shape] outputs: [1245 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: ConstantOfShape_734 [ConstantOfShape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1245 [01/12/2022-09:32:19] [V] [TRT] ConstantOfShape_734 [ConstantOfShape] inputs: [1245 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: ConstantOfShape_734 for ONNX node: ConstantOfShape_734 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1246 for ONNX tensor: 1246 [01/12/2022-09:32:19] [V] [TRT] ConstantOfShape_734 [ConstantOfShape] outputs: [1246 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_735 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_735 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_735 [Constant] outputs: [1247 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Mul_736 [Mul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1246 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1247 [01/12/2022-09:32:19] [V] [TRT] Mul_736 [Mul] inputs: [1246 -> (4)[INT32]], [1247 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1247 for ONNX node: 1247 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Mul_736 for ONNX node: Mul_736 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1248 for ONNX tensor: 1248 [01/12/2022-09:32:19] [V] [TRT] Mul_736 [Mul] outputs: [1248 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Equal_737 [Equal] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1244 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1248 [01/12/2022-09:32:19] [V] [TRT] Equal_737 [Equal] inputs: [1244 -> (4)[INT32]], [1248 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Equal_737 for ONNX node: Equal_737 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1249 for ONNX tensor: 1249 [01/12/2022-09:32:19] [V] [TRT] Equal_737 [Equal] outputs: [1249 -> (4)[BOOL]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Where_738 [Where] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1249 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1246 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1244 [01/12/2022-09:32:19] [V] [TRT] Where_738 [Where] inputs: [1249 -> (4)[BOOL]], [1246 -> (4)[INT32]], [1244 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Where_738 for ONNX node: Where_738 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1250 for ONNX tensor: 1250 [01/12/2022-09:32:19] [V] [TRT] Where_738 [Where] outputs: [1250 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Expand_739 [Expand] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1234 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1250 [01/12/2022-09:32:19] [V] [TRT] Expand_739 [Expand] inputs: [1234 -> (1, 1, -1, -1)[FLOAT]], [1250 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Expand_739 for ONNX node: Expand_739 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1251 for ONNX tensor: 1251 [01/12/2022-09:32:19] [V] [TRT] Expand_739 [Expand] outputs: [1251 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Cast_740 [Cast] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1251 [01/12/2022-09:32:19] [V] [TRT] Cast_740 [Cast] inputs: [1251 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Casting to type: float32 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Cast_740 for ONNX node: Cast_740 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1252 for ONNX tensor: 1252 [01/12/2022-09:32:19] [V] [TRT] Cast_740 [Cast] outputs: [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_741 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_741 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_741 [Constant] outputs: [1253 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_742 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1192 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1253 [01/12/2022-09:32:19] [V] [TRT] Add_742 [Add] inputs: [1192 -> ()[INT32]], [1253 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1253 for ONNX node: 1253 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_742 for ONNX node: Add_742 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1254 for ONNX tensor: 1254 [01/12/2022-09:32:19] [V] [TRT] Add_742 [Add] outputs: [1254 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Cast_743 [Cast] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1254 [01/12/2022-09:32:19] [V] [TRT] Cast_743 [Cast] inputs: [1254 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Casting to type: int32 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Cast_743 for ONNX node: Cast_743 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1258 for ONNX tensor: 1258 [01/12/2022-09:32:19] [V] [TRT] Cast_743 [Cast] outputs: [1258 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Range_744 [Range] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2920 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1258 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2921 [01/12/2022-09:32:19] [V] [TRT] Range_744 [Range] inputs: [2920 -> ()[INT32]], [1258 -> ()[INT32]], [2921 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Range_744 for ONNX node: Range_744 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1260 for ONNX tensor: 1260 [01/12/2022-09:32:19] [V] [TRT] Range_744 [Range] outputs: [1260 -> (-1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_745 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_745 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_745 [Constant] outputs: [1261 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_746 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1260 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1261 [01/12/2022-09:32:19] [V] [TRT] Add_746 [Add] inputs: [1260 -> (-1)[INT32]], [1261 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1261 for ONNX node: 1261 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_746 for ONNX node: Add_746 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1262 for ONNX tensor: 1262 [01/12/2022-09:32:19] [V] [TRT] Add_746 [Add] outputs: [1262 -> (-1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Gather_747 [Gather] [01/12/2022-09:32:19] [V] [TRT] Searching for input: decoder.embed_positions.weight [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1262 [01/12/2022-09:32:19] [V] [TRT] Gather_747 [Gather] inputs: [decoder.embed_positions.weight -> (1026, 768)[FLOAT]], [1262 -> (-1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: decoder.embed_positions.weight for ONNX node: decoder.embed_positions.weight [01/12/2022-09:32:19] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Gather_747 for ONNX node: Gather_747 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1263 for ONNX tensor: 1263 [01/12/2022-09:32:19] [V] [TRT] Gather_747 [Gather] outputs: [1263 -> (-1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_748 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1200 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1263 [01/12/2022-09:32:19] [V] [TRT] Add_748 [Add] inputs: [1200 -> (-1, -1, 768)[FLOAT]], [1263 -> (-1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_748 for ONNX node: Add_748 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1264 for ONNX tensor: 1264 [01/12/2022-09:32:19] [V] [TRT] Add_748 [Add] outputs: [1264 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: ReduceMean_749 [ReduceMean] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1264 [01/12/2022-09:32:19] [V] [TRT] ReduceMean_749 [ReduceMean] inputs: [1264 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: ReduceMean_749 for ONNX node: ReduceMean_749 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1265 for ONNX tensor: 1265 [01/12/2022-09:32:19] [V] [TRT] ReduceMean_749 [ReduceMean] outputs: [1265 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Sub_750 [Sub] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1264 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1265 [01/12/2022-09:32:19] [V] [TRT] Sub_750 [Sub] inputs: [1264 -> (-1, -1, 768)[FLOAT]], [1265 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Sub_750 for ONNX node: Sub_750 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1266 for ONNX tensor: 1266 [01/12/2022-09:32:19] [V] [TRT] Sub_750 [Sub] outputs: [1266 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_751 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_751 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_751 [Constant] outputs: [1267 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Pow_752 [Pow] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1266 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1267 [01/12/2022-09:32:19] [V] [TRT] Pow_752 [Pow] inputs: [1266 -> (-1, -1, 768)[FLOAT]], [1267 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1267 for ONNX node: 1267 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Pow_752 for ONNX node: Pow_752 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1268 for ONNX tensor: 1268 [01/12/2022-09:32:19] [V] [TRT] Pow_752 [Pow] outputs: [1268 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: ReduceMean_753 [ReduceMean] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1268 [01/12/2022-09:32:19] [V] [TRT] ReduceMean_753 [ReduceMean] inputs: [1268 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: ReduceMean_753 for ONNX node: ReduceMean_753 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1269 for ONNX tensor: 1269 [01/12/2022-09:32:19] [V] [TRT] ReduceMean_753 [ReduceMean] outputs: [1269 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_754 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_754 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_754 [Constant] outputs: [1270 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_755 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1269 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1270 [01/12/2022-09:32:19] [V] [TRT] Add_755 [Add] inputs: [1269 -> (-1, -1, 1)[FLOAT]], [1270 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1270 for ONNX node: 1270 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_755 for ONNX node: Add_755 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1271 for ONNX tensor: 1271 [01/12/2022-09:32:19] [V] [TRT] Add_755 [Add] outputs: [1271 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Sqrt_756 [Sqrt] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1271 [01/12/2022-09:32:19] [V] [TRT] Sqrt_756 [Sqrt] inputs: [1271 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Sqrt_756 for ONNX node: Sqrt_756 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1272 for ONNX tensor: 1272 [01/12/2022-09:32:19] [V] [TRT] Sqrt_756 [Sqrt] outputs: [1272 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Div_757 [Div] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1266 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1272 [01/12/2022-09:32:19] [V] [TRT] Div_757 [Div] inputs: [1266 -> (-1, -1, 768)[FLOAT]], [1272 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Div_757 for ONNX node: Div_757 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1273 for ONNX tensor: 1273 [01/12/2022-09:32:19] [V] [TRT] Div_757 [Div] outputs: [1273 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Mul_758 [Mul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1273 [01/12/2022-09:32:19] [V] [TRT] Searching for input: decoder.layernorm_embedding.weight [01/12/2022-09:32:19] [V] [TRT] Mul_758 [Mul] inputs: [1273 -> (-1, -1, 768)[FLOAT]], [decoder.layernorm_embedding.weight -> (768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: decoder.layernorm_embedding.weight for ONNX node: decoder.layernorm_embedding.weight [01/12/2022-09:32:19] [V] [TRT] Registering layer: Mul_758 for ONNX node: Mul_758 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1274 for ONNX tensor: 1274 [01/12/2022-09:32:19] [V] [TRT] Mul_758 [Mul] outputs: [1274 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_759 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1274 [01/12/2022-09:32:19] [V] [TRT] Searching for input: decoder.layernorm_embedding.bias [01/12/2022-09:32:19] [V] [TRT] Add_759 [Add] inputs: [1274 -> (-1, -1, 768)[FLOAT]], [decoder.layernorm_embedding.bias -> (768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: decoder.layernorm_embedding.bias for ONNX node: decoder.layernorm_embedding.bias [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_759 for ONNX node: Add_759 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1275 for ONNX tensor: 1275 [01/12/2022-09:32:19] [V] [TRT] Add_759 [Add] outputs: [1275 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Shape_760 [Shape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1275 [01/12/2022-09:32:19] [V] [TRT] Shape_760 [Shape] inputs: [1275 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Shape_760 for ONNX node: Shape_760 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1276 for ONNX tensor: 1276 [01/12/2022-09:32:19] [V] [TRT] Shape_760 [Shape] outputs: [1276 -> (3)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_761 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_761 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_761 [Constant] outputs: [1277 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Gather_762 [Gather] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1276 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1277 [01/12/2022-09:32:19] [V] [TRT] Gather_762 [Gather] inputs: [1276 -> (3)[INT32]], [1277 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1277 for ONNX node: 1277 [01/12/2022-09:32:19] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Gather_762 for ONNX node: Gather_762 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1278 for ONNX tensor: 1278 [01/12/2022-09:32:19] [V] [TRT] Gather_762 [Gather] outputs: [1278 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Shape_763 [Shape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1275 [01/12/2022-09:32:19] [V] [TRT] Shape_763 [Shape] inputs: [1275 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Shape_763 for ONNX node: Shape_763 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1279 for ONNX tensor: 1279 [01/12/2022-09:32:19] [V] [TRT] Shape_763 [Shape] outputs: [1279 -> (3)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_764 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_764 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_764 [Constant] outputs: [1280 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Gather_765 [Gather] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1279 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1280 [01/12/2022-09:32:19] [V] [TRT] Gather_765 [Gather] inputs: [1279 -> (3)[INT32]], [1280 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1280 for ONNX node: 1280 [01/12/2022-09:32:19] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Gather_765 for ONNX node: Gather_765 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1281 for ONNX tensor: 1281 [01/12/2022-09:32:19] [V] [TRT] Gather_765 [Gather] outputs: [1281 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: MatMul_766 [MatMul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1275 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2922 [01/12/2022-09:32:19] [V] [TRT] MatMul_766 [MatMul] inputs: [1275 -> (-1, -1, 768)[FLOAT]], [2922 -> (768, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2922 for ONNX node: 2922 [01/12/2022-09:32:19] [V] [TRT] Registering layer: MatMul_766 for ONNX node: MatMul_766 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1283 for ONNX tensor: 1283 [01/12/2022-09:32:19] [V] [TRT] MatMul_766 [MatMul] outputs: [1283 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_767 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: decoder.layers.0.self_attn.q_proj.bias [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1283 [01/12/2022-09:32:19] [V] [TRT] Add_767 [Add] inputs: [decoder.layers.0.self_attn.q_proj.bias -> (768)[FLOAT]], [1283 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: decoder.layers.0.self_attn.q_proj.bias for ONNX node: decoder.layers.0.self_attn.q_proj.bias [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_767 for ONNX node: Add_767 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1284 for ONNX tensor: 1284 [01/12/2022-09:32:19] [V] [TRT] Add_767 [Add] outputs: [1284 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_768 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_768 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_768 [Constant] outputs: [1285 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Mul_769 [Mul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1284 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1285 [01/12/2022-09:32:19] [V] [TRT] Mul_769 [Mul] inputs: [1284 -> (-1, -1, 768)[FLOAT]], [1285 -> ()[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1285 for ONNX node: 1285 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Mul_769 for ONNX node: Mul_769 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1286 for ONNX tensor: 1286 [01/12/2022-09:32:19] [V] [TRT] Mul_769 [Mul] outputs: [1286 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: MatMul_770 [MatMul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1275 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2923 [01/12/2022-09:32:19] [V] [TRT] MatMul_770 [MatMul] inputs: [1275 -> (-1, -1, 768)[FLOAT]], [2923 -> (768, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2923 for ONNX node: 2923 [01/12/2022-09:32:19] [V] [TRT] Registering layer: MatMul_770 for ONNX node: MatMul_770 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1288 for ONNX tensor: 1288 [01/12/2022-09:32:19] [V] [TRT] MatMul_770 [MatMul] outputs: [1288 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_771 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: decoder.layers.0.self_attn.k_proj.bias [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1288 [01/12/2022-09:32:19] [V] [TRT] Add_771 [Add] inputs: [decoder.layers.0.self_attn.k_proj.bias -> (768)[FLOAT]], [1288 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: decoder.layers.0.self_attn.k_proj.bias for ONNX node: decoder.layers.0.self_attn.k_proj.bias [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_771 for ONNX node: Add_771 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1289 for ONNX tensor: 1289 [01/12/2022-09:32:19] [V] [TRT] Add_771 [Add] outputs: [1289 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_772 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_772 [Unsqueeze] inputs: [1278 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_772 for ONNX node: Unsqueeze_772 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1293 for ONNX tensor: 1293 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_772 [Unsqueeze] outputs: [1293 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_773 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1293 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2924 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2925 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2926 [01/12/2022-09:32:19] [V] [TRT] Concat_773 [Concat] inputs: [1293 -> (1)[INT32]], [2924 -> (1)[INT32]], [2925 -> (1)[INT32]], [2926 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2924 for ONNX node: 2924 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2925 for ONNX node: 2925 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2926 for ONNX node: 2926 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Concat_773 for ONNX node: Concat_773 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1297 for ONNX tensor: 1297 [01/12/2022-09:32:19] [V] [TRT] Concat_773 [Concat] outputs: [1297 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Reshape_774 [Reshape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1289 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1297 [01/12/2022-09:32:19] [V] [TRT] Reshape_774 [Reshape] inputs: [1289 -> (-1, -1, 768)[FLOAT]], [1297 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Reshape_774 for ONNX node: Reshape_774 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1298 for ONNX tensor: 1298 [01/12/2022-09:32:19] [V] [TRT] Reshape_774 [Reshape] outputs: [1298 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Transpose_775 [Transpose] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1298 [01/12/2022-09:32:19] [V] [TRT] Transpose_775 [Transpose] inputs: [1298 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Transpose_775 for ONNX node: Transpose_775 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1299_2 for ONNX tensor: 1299 [01/12/2022-09:32:19] [V] [TRT] Transpose_775 [Transpose] outputs: [1299 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: MatMul_776 [MatMul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1275 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2927 [01/12/2022-09:32:19] [V] [TRT] MatMul_776 [MatMul] inputs: [1275 -> (-1, -1, 768)[FLOAT]], [2927 -> (768, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2927 for ONNX node: 2927 [01/12/2022-09:32:19] [V] [TRT] Registering layer: MatMul_776 for ONNX node: MatMul_776 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1301 for ONNX tensor: 1301 [01/12/2022-09:32:19] [V] [TRT] MatMul_776 [MatMul] outputs: [1301 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Add_777 [Add] [01/12/2022-09:32:19] [V] [TRT] Searching for input: decoder.layers.0.self_attn.v_proj.bias [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1301 [01/12/2022-09:32:19] [V] [TRT] Add_777 [Add] inputs: [decoder.layers.0.self_attn.v_proj.bias -> (768)[FLOAT]], [1301 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: decoder.layers.0.self_attn.v_proj.bias for ONNX node: decoder.layers.0.self_attn.v_proj.bias [01/12/2022-09:32:19] [V] [TRT] Registering layer: Add_777 for ONNX node: Add_777 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1302 for ONNX tensor: 1302 [01/12/2022-09:32:19] [V] [TRT] Add_777 [Add] outputs: [1302 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_778 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_778 [Unsqueeze] inputs: [1278 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_778 for ONNX node: Unsqueeze_778 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1306 for ONNX tensor: 1306 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_778 [Unsqueeze] outputs: [1306 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_779 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1306 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2928 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2929 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2930 [01/12/2022-09:32:19] [V] [TRT] Concat_779 [Concat] inputs: [1306 -> (1)[INT32]], [2928 -> (1)[INT32]], [2929 -> (1)[INT32]], [2930 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2928 for ONNX node: 2928 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2929 for ONNX node: 2929 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2930 for ONNX node: 2930 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Concat_779 for ONNX node: Concat_779 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1310 for ONNX tensor: 1310 [01/12/2022-09:32:19] [V] [TRT] Concat_779 [Concat] outputs: [1310 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Reshape_780 [Reshape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1302 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1310 [01/12/2022-09:32:19] [V] [TRT] Reshape_780 [Reshape] inputs: [1302 -> (-1, -1, 768)[FLOAT]], [1310 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Reshape_780 for ONNX node: Reshape_780 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1311 for ONNX tensor: 1311 [01/12/2022-09:32:19] [V] [TRT] Reshape_780 [Reshape] outputs: [1311 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Transpose_781 [Transpose] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1311 [01/12/2022-09:32:19] [V] [TRT] Transpose_781 [Transpose] inputs: [1311 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Transpose_781 for ONNX node: Transpose_781 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1312_3 for ONNX tensor: 1312 [01/12/2022-09:32:19] [V] [TRT] Transpose_781 [Transpose] outputs: [1312 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Constant_782 [Constant] [01/12/2022-09:32:19] [V] [TRT] Constant_782 [Constant] inputs: [01/12/2022-09:32:19] [V] [TRT] Constant_782 [Constant] outputs: [1313 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Mul_783 [Mul] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1313 [01/12/2022-09:32:19] [V] [TRT] Mul_783 [Mul] inputs: [1278 -> ()[INT32]], [1313 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 1313 for ONNX node: 1313 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Mul_783 for ONNX node: Mul_783 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1314 for ONNX tensor: 1314 [01/12/2022-09:32:19] [V] [TRT] Mul_783 [Mul] outputs: [1314 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_784 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_784 [Unsqueeze] inputs: [1278 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_784 for ONNX node: Unsqueeze_784 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1317 for ONNX tensor: 1317 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_784 [Unsqueeze] outputs: [1317 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_785 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1281 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_785 [Unsqueeze] inputs: [1281 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_785 for ONNX node: Unsqueeze_785 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1318 for ONNX tensor: 1318 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_785 [Unsqueeze] outputs: [1318 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_786 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1317 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1318 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2931 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2932 [01/12/2022-09:32:19] [V] [TRT] Concat_786 [Concat] inputs: [1317 -> (1)[INT32]], [1318 -> (1)[INT32]], [2931 -> (1)[INT32]], [2932 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2931 for ONNX node: 2931 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2932 for ONNX node: 2932 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Concat_786 for ONNX node: Concat_786 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1321 for ONNX tensor: 1321 [01/12/2022-09:32:19] [V] [TRT] Concat_786 [Concat] outputs: [1321 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Reshape_787 [Reshape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1286 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1321 [01/12/2022-09:32:19] [V] [TRT] Reshape_787 [Reshape] inputs: [1286 -> (-1, -1, 768)[FLOAT]], [1321 -> (4)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Reshape_787 for ONNX node: Reshape_787 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1322 for ONNX tensor: 1322 [01/12/2022-09:32:19] [V] [TRT] Reshape_787 [Reshape] outputs: [1322 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Transpose_788 [Transpose] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1322 [01/12/2022-09:32:19] [V] [TRT] Transpose_788 [Transpose] inputs: [1322 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Transpose_788 for ONNX node: Transpose_788 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1323 for ONNX tensor: 1323 [01/12/2022-09:32:19] [V] [TRT] Transpose_788 [Transpose] outputs: [1323 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_789 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1314 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_789 [Unsqueeze] inputs: [1314 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_789 for ONNX node: Unsqueeze_789 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1326 for ONNX tensor: 1326 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_789 [Unsqueeze] outputs: [1326 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_790 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1326 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2933 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2934 [01/12/2022-09:32:19] [V] [TRT] Concat_790 [Concat] inputs: [1326 -> (1)[INT32]], [2933 -> (1)[INT32]], [2934 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2933 for ONNX node: 2933 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2934 for ONNX node: 2934 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Concat_790 for ONNX node: Concat_790 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1329 for ONNX tensor: 1329 [01/12/2022-09:32:19] [V] [TRT] Concat_790 [Concat] outputs: [1329 -> (3)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Reshape_791 [Reshape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1323 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1329 [01/12/2022-09:32:19] [V] [TRT] Reshape_791 [Reshape] inputs: [1323 -> (-1, 12, -1, 64)[FLOAT]], [1329 -> (3)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Reshape_791 for ONNX node: Reshape_791 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1330 for ONNX tensor: 1330 [01/12/2022-09:32:19] [V] [TRT] Reshape_791 [Reshape] outputs: [1330 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_792 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1314 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_792 [Unsqueeze] inputs: [1314 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_792 for ONNX node: Unsqueeze_792 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1333 for ONNX tensor: 1333 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_792 [Unsqueeze] outputs: [1333 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_793 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1333 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2935 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2936 [01/12/2022-09:32:19] [V] [TRT] Concat_793 [Concat] inputs: [1333 -> (1)[INT32]], [2935 -> (1)[INT32]], [2936 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2935 for ONNX node: 2935 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2936 for ONNX node: 2936 [01/12/2022-09:32:19] [V] [TRT] Registering layer: Concat_793 for ONNX node: Concat_793 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1336 for ONNX tensor: 1336 [01/12/2022-09:32:19] [V] [TRT] Concat_793 [Concat] outputs: [1336 -> (3)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Reshape_794 [Reshape] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1299 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1336 [01/12/2022-09:32:19] [V] [TRT] Reshape_794 [Reshape] inputs: [1299 -> (-1, 12, -1, 64)[FLOAT]], [1336 -> (3)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: Reshape_794 for ONNX node: Reshape_794 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1337 for ONNX tensor: 1337 [01/12/2022-09:32:19] [V] [TRT] Reshape_794 [Reshape] outputs: [1337 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Unsqueeze_795 [Unsqueeze] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1314 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_795 [Unsqueeze] inputs: [1314 -> ()[INT32]], [01/12/2022-09:32:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:19] [V] [TRT] Registering layer: Unsqueeze_795 for ONNX node: Unsqueeze_795 [01/12/2022-09:32:19] [V] [TRT] Registering tensor: 1340 for ONNX tensor: 1340 [01/12/2022-09:32:19] [V] [TRT] Unsqueeze_795 [Unsqueeze] outputs: [1340 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Parsing node: Concat_796 [Concat] [01/12/2022-09:32:19] [V] [TRT] Searching for input: 1340 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2937 [01/12/2022-09:32:19] [V] [TRT] Searching for input: 2938 [01/12/2022-09:32:19] [V] [TRT] Concat_796 [Concat] inputs: [1340 -> (1)[INT32]], [2937 -> (1)[INT32]], [2938 -> (1)[INT32]], [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2937 for ONNX node: 2937 [01/12/2022-09:32:19] [V] [TRT] Registering layer: 2938 for ONNX node: 2938 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_796 for ONNX node: Concat_796 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1343 for ONNX tensor: 1343 [01/12/2022-09:32:20] [V] [TRT] Concat_796 [Concat] outputs: [1343 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_797 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1312 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1343 [01/12/2022-09:32:20] [V] [TRT] Reshape_797 [Reshape] inputs: [1312 -> (-1, 12, -1, 64)[FLOAT]], [1343 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_797 for ONNX node: Reshape_797 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1344 for ONNX tensor: 1344 [01/12/2022-09:32:20] [V] [TRT] Reshape_797 [Reshape] outputs: [1344 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Shape_798 [Shape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1337 [01/12/2022-09:32:20] [V] [TRT] Shape_798 [Shape] inputs: [1337 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Shape_798 for ONNX node: Shape_798 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1345 for ONNX tensor: 1345 [01/12/2022-09:32:20] [V] [TRT] Shape_798 [Shape] outputs: [1345 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_799 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_799 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_799 [Constant] outputs: [1346 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Gather_800 [Gather] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1345 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1346 [01/12/2022-09:32:20] [V] [TRT] Gather_800 [Gather] inputs: [1345 -> (3)[INT32]], [1346 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1346 for ONNX node: 1346 [01/12/2022-09:32:20] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Gather_800 for ONNX node: Gather_800 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1347 for ONNX tensor: 1347 [01/12/2022-09:32:20] [V] [TRT] Gather_800 [Gather] outputs: [1347 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Transpose_801 [Transpose] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1337 [01/12/2022-09:32:20] [V] [TRT] Transpose_801 [Transpose] inputs: [1337 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Transpose_801 for ONNX node: Transpose_801 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1348 for ONNX tensor: 1348 [01/12/2022-09:32:20] [V] [TRT] Transpose_801 [Transpose] outputs: [1348 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: MatMul_802 [MatMul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1330 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1348 [01/12/2022-09:32:20] [V] [TRT] MatMul_802 [MatMul] inputs: [1330 -> (-1, -1, 64)[FLOAT]], [1348 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: MatMul_802 for ONNX node: MatMul_802 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1349 for ONNX tensor: 1349 [01/12/2022-09:32:20] [V] [TRT] MatMul_802 [MatMul] outputs: [1349 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_803 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_803 [Unsqueeze] inputs: [1278 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_803 for ONNX node: Unsqueeze_803 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1351 for ONNX tensor: 1351 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_803 [Unsqueeze] outputs: [1351 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_804 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1281 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_804 [Unsqueeze] inputs: [1281 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_804 for ONNX node: Unsqueeze_804 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1353 for ONNX tensor: 1353 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_804 [Unsqueeze] outputs: [1353 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_805 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1347 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_805 [Unsqueeze] inputs: [1347 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_805 for ONNX node: Unsqueeze_805 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1354 for ONNX tensor: 1354 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_805 [Unsqueeze] outputs: [1354 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_806 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1351 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2939 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1353 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1354 [01/12/2022-09:32:20] [V] [TRT] Concat_806 [Concat] inputs: [1351 -> (1)[INT32]], [2939 -> (1)[INT32]], [1353 -> (1)[INT32]], [1354 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2939 for ONNX node: 2939 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_806 for ONNX node: Concat_806 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1355 for ONNX tensor: 1355 [01/12/2022-09:32:20] [V] [TRT] Concat_806 [Concat] outputs: [1355 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_807 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1349 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1355 [01/12/2022-09:32:20] [V] [TRT] Reshape_807 [Reshape] inputs: [1349 -> (-1, -1, -1)[FLOAT]], [1355 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_807 for ONNX node: Reshape_807 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1356 for ONNX tensor: 1356 [01/12/2022-09:32:20] [V] [TRT] Reshape_807 [Reshape] outputs: [1356 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_808 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1356 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1252 [01/12/2022-09:32:20] [V] [TRT] Add_808 [Add] inputs: [1356 -> (-1, 12, -1, -1)[FLOAT]], [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_808 for ONNX node: Add_808 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1357 for ONNX tensor: 1357 [01/12/2022-09:32:20] [V] [TRT] Add_808 [Add] outputs: [1357 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_809 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_809 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_809 [Constant] outputs: [1358 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Mul_810 [Mul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1358 [01/12/2022-09:32:20] [V] [TRT] Mul_810 [Mul] inputs: [1278 -> ()[INT32]], [1358 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1358 for ONNX node: 1358 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Mul_810 for ONNX node: Mul_810 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1359 for ONNX tensor: 1359 [01/12/2022-09:32:20] [V] [TRT] Mul_810 [Mul] outputs: [1359 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_811 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1359 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_811 [Unsqueeze] inputs: [1359 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_811 for ONNX node: Unsqueeze_811 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1360 for ONNX tensor: 1360 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_811 [Unsqueeze] outputs: [1360 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_812 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1281 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_812 [Unsqueeze] inputs: [1281 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_812 for ONNX node: Unsqueeze_812 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1361 for ONNX tensor: 1361 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_812 [Unsqueeze] outputs: [1361 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_813 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1347 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_813 [Unsqueeze] inputs: [1347 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_813 for ONNX node: Unsqueeze_813 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1362 for ONNX tensor: 1362 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_813 [Unsqueeze] outputs: [1362 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_814 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1360 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1361 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1362 [01/12/2022-09:32:20] [V] [TRT] Concat_814 [Concat] inputs: [1360 -> (1)[INT32]], [1361 -> (1)[INT32]], [1362 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_814 for ONNX node: Concat_814 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1363 for ONNX tensor: 1363 [01/12/2022-09:32:20] [V] [TRT] Concat_814 [Concat] outputs: [1363 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_815 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1357 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1363 [01/12/2022-09:32:20] [V] [TRT] Reshape_815 [Reshape] inputs: [1357 -> (-1, 12, -1, -1)[FLOAT]], [1363 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_815 for ONNX node: Reshape_815 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1364 for ONNX tensor: 1364 [01/12/2022-09:32:20] [V] [TRT] Reshape_815 [Reshape] outputs: [1364 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Softmax_816 [Softmax] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1364 [01/12/2022-09:32:20] [V] [TRT] Softmax_816 [Softmax] inputs: [1364 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Softmax_816 for ONNX node: Softmax_816 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1365 for ONNX tensor: 1365 [01/12/2022-09:32:20] [V] [TRT] Softmax_816 [Softmax] outputs: [1365 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: MatMul_817 [MatMul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1365 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1344 [01/12/2022-09:32:20] [V] [TRT] MatMul_817 [MatMul] inputs: [1365 -> (-1, -1, -1)[FLOAT]], [1344 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: MatMul_817 for ONNX node: MatMul_817 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1366 for ONNX tensor: 1366 [01/12/2022-09:32:20] [V] [TRT] MatMul_817 [MatMul] outputs: [1366 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_818 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_818 [Unsqueeze] inputs: [1278 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_818 for ONNX node: Unsqueeze_818 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1369 for ONNX tensor: 1369 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_818 [Unsqueeze] outputs: [1369 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_819 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1281 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_819 [Unsqueeze] inputs: [1281 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_819 for ONNX node: Unsqueeze_819 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1371 for ONNX tensor: 1371 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_819 [Unsqueeze] outputs: [1371 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_820 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1369 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2940 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1371 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2941 [01/12/2022-09:32:20] [V] [TRT] Concat_820 [Concat] inputs: [1369 -> (1)[INT32]], [2940 -> (1)[INT32]], [1371 -> (1)[INT32]], [2941 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2940 for ONNX node: 2940 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2941 for ONNX node: 2941 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_820 for ONNX node: Concat_820 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1373 for ONNX tensor: 1373 [01/12/2022-09:32:20] [V] [TRT] Concat_820 [Concat] outputs: [1373 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_821 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1366 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1373 [01/12/2022-09:32:20] [V] [TRT] Reshape_821 [Reshape] inputs: [1366 -> (-1, -1, 64)[FLOAT]], [1373 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_821 for ONNX node: Reshape_821 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1374 for ONNX tensor: 1374 [01/12/2022-09:32:20] [V] [TRT] Reshape_821 [Reshape] outputs: [1374 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Transpose_822 [Transpose] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1374 [01/12/2022-09:32:20] [V] [TRT] Transpose_822 [Transpose] inputs: [1374 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Transpose_822 for ONNX node: Transpose_822 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1375 for ONNX tensor: 1375 [01/12/2022-09:32:20] [V] [TRT] Transpose_822 [Transpose] outputs: [1375 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_823 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1278 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_823 [Unsqueeze] inputs: [1278 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_823 for ONNX node: Unsqueeze_823 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1377 for ONNX tensor: 1377 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_823 [Unsqueeze] outputs: [1377 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_824 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1281 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_824 [Unsqueeze] inputs: [1281 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_824 for ONNX node: Unsqueeze_824 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1378 for ONNX tensor: 1378 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_824 [Unsqueeze] outputs: [1378 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_825 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1377 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1378 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2942 [01/12/2022-09:32:20] [V] [TRT] Concat_825 [Concat] inputs: [1377 -> (1)[INT32]], [1378 -> (1)[INT32]], [2942 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2942 for ONNX node: 2942 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_825 for ONNX node: Concat_825 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1380 for ONNX tensor: 1380 [01/12/2022-09:32:20] [V] [TRT] Concat_825 [Concat] outputs: [1380 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_826 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1375 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1380 [01/12/2022-09:32:20] [V] [TRT] Reshape_826 [Reshape] inputs: [1375 -> (-1, -1, 12, 64)[FLOAT]], [1380 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_826 for ONNX node: Reshape_826 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1381 for ONNX tensor: 1381 [01/12/2022-09:32:20] [V] [TRT] Reshape_826 [Reshape] outputs: [1381 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: MatMul_827 [MatMul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1381 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2943 [01/12/2022-09:32:20] [V] [TRT] MatMul_827 [MatMul] inputs: [1381 -> (-1, -1, 768)[FLOAT]], [2943 -> (768, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2943 for ONNX node: 2943 [01/12/2022-09:32:20] [V] [TRT] Registering layer: MatMul_827 for ONNX node: MatMul_827 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1383 for ONNX tensor: 1383 [01/12/2022-09:32:20] [V] [TRT] MatMul_827 [MatMul] outputs: [1383 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_828 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: decoder.layers.0.self_attn.out_proj.bias [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1383 [01/12/2022-09:32:20] [V] [TRT] Add_828 [Add] inputs: [decoder.layers.0.self_attn.out_proj.bias -> (768)[FLOAT]], [1383 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: decoder.layers.0.self_attn.out_proj.bias for ONNX node: decoder.layers.0.self_attn.out_proj.bias [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_828 for ONNX node: Add_828 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1384 for ONNX tensor: 1384 [01/12/2022-09:32:20] [V] [TRT] Add_828 [Add] outputs: [1384 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_829 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1275 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1384 [01/12/2022-09:32:20] [V] [TRT] Add_829 [Add] inputs: [1275 -> (-1, -1, 768)[FLOAT]], [1384 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_829 for ONNX node: Add_829 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1385 for ONNX tensor: 1385 [01/12/2022-09:32:20] [V] [TRT] Add_829 [Add] outputs: [1385 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: ReduceMean_830 [ReduceMean] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1385 [01/12/2022-09:32:20] [V] [TRT] ReduceMean_830 [ReduceMean] inputs: [1385 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: ReduceMean_830 for ONNX node: ReduceMean_830 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1386 for ONNX tensor: 1386 [01/12/2022-09:32:20] [V] [TRT] ReduceMean_830 [ReduceMean] outputs: [1386 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Sub_831 [Sub] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1385 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1386 [01/12/2022-09:32:20] [V] [TRT] Sub_831 [Sub] inputs: [1385 -> (-1, -1, 768)[FLOAT]], [1386 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Sub_831 for ONNX node: Sub_831 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1387 for ONNX tensor: 1387 [01/12/2022-09:32:20] [V] [TRT] Sub_831 [Sub] outputs: [1387 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_832 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_832 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_832 [Constant] outputs: [1388 -> ()[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Pow_833 [Pow] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1387 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1388 [01/12/2022-09:32:20] [V] [TRT] Pow_833 [Pow] inputs: [1387 -> (-1, -1, 768)[FLOAT]], [1388 -> ()[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1388 for ONNX node: 1388 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Pow_833 for ONNX node: Pow_833 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1389 for ONNX tensor: 1389 [01/12/2022-09:32:20] [V] [TRT] Pow_833 [Pow] outputs: [1389 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: ReduceMean_834 [ReduceMean] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1389 [01/12/2022-09:32:20] [V] [TRT] ReduceMean_834 [ReduceMean] inputs: [1389 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: ReduceMean_834 for ONNX node: ReduceMean_834 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1390 for ONNX tensor: 1390 [01/12/2022-09:32:20] [V] [TRT] ReduceMean_834 [ReduceMean] outputs: [1390 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_835 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_835 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_835 [Constant] outputs: [1391 -> ()[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_836 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1390 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1391 [01/12/2022-09:32:20] [V] [TRT] Add_836 [Add] inputs: [1390 -> (-1, -1, 1)[FLOAT]], [1391 -> ()[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1391 for ONNX node: 1391 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_836 for ONNX node: Add_836 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1392 for ONNX tensor: 1392 [01/12/2022-09:32:20] [V] [TRT] Add_836 [Add] outputs: [1392 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Sqrt_837 [Sqrt] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1392 [01/12/2022-09:32:20] [V] [TRT] Sqrt_837 [Sqrt] inputs: [1392 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Sqrt_837 for ONNX node: Sqrt_837 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1393 for ONNX tensor: 1393 [01/12/2022-09:32:20] [V] [TRT] Sqrt_837 [Sqrt] outputs: [1393 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Div_838 [Div] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1387 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1393 [01/12/2022-09:32:20] [V] [TRT] Div_838 [Div] inputs: [1387 -> (-1, -1, 768)[FLOAT]], [1393 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Div_838 for ONNX node: Div_838 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1394 for ONNX tensor: 1394 [01/12/2022-09:32:20] [V] [TRT] Div_838 [Div] outputs: [1394 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Mul_839 [Mul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1394 [01/12/2022-09:32:20] [V] [TRT] Searching for input: decoder.layers.0.self_attn_layer_norm.weight [01/12/2022-09:32:20] [V] [TRT] Mul_839 [Mul] inputs: [1394 -> (-1, -1, 768)[FLOAT]], [decoder.layers.0.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: decoder.layers.0.self_attn_layer_norm.weight for ONNX node: decoder.layers.0.self_attn_layer_norm.weight [01/12/2022-09:32:20] [V] [TRT] Registering layer: Mul_839 for ONNX node: Mul_839 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1395 for ONNX tensor: 1395 [01/12/2022-09:32:20] [V] [TRT] Mul_839 [Mul] outputs: [1395 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_840 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1395 [01/12/2022-09:32:20] [V] [TRT] Searching for input: decoder.layers.0.self_attn_layer_norm.bias [01/12/2022-09:32:20] [V] [TRT] Add_840 [Add] inputs: [1395 -> (-1, -1, 768)[FLOAT]], [decoder.layers.0.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: decoder.layers.0.self_attn_layer_norm.bias for ONNX node: decoder.layers.0.self_attn_layer_norm.bias [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_840 for ONNX node: Add_840 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1396 for ONNX tensor: 1396 [01/12/2022-09:32:20] [V] [TRT] Add_840 [Add] outputs: [1396 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Shape_841 [Shape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1396 [01/12/2022-09:32:20] [V] [TRT] Shape_841 [Shape] inputs: [1396 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Shape_841 for ONNX node: Shape_841 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1397 for ONNX tensor: 1397 [01/12/2022-09:32:20] [V] [TRT] Shape_841 [Shape] outputs: [1397 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_842 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_842 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_842 [Constant] outputs: [1398 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Gather_843 [Gather] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1397 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1398 [01/12/2022-09:32:20] [V] [TRT] Gather_843 [Gather] inputs: [1397 -> (3)[INT32]], [1398 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1398 for ONNX node: 1398 [01/12/2022-09:32:20] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Gather_843 for ONNX node: Gather_843 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1399 for ONNX tensor: 1399 [01/12/2022-09:32:20] [V] [TRT] Gather_843 [Gather] outputs: [1399 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Shape_844 [Shape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1396 [01/12/2022-09:32:20] [V] [TRT] Shape_844 [Shape] inputs: [1396 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Shape_844 for ONNX node: Shape_844 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1400 for ONNX tensor: 1400 [01/12/2022-09:32:20] [V] [TRT] Shape_844 [Shape] outputs: [1400 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_845 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_845 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_845 [Constant] outputs: [1401 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Gather_846 [Gather] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1400 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1401 [01/12/2022-09:32:20] [V] [TRT] Gather_846 [Gather] inputs: [1400 -> (3)[INT32]], [1401 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1401 for ONNX node: 1401 [01/12/2022-09:32:20] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Gather_846 for ONNX node: Gather_846 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1402 for ONNX tensor: 1402 [01/12/2022-09:32:20] [V] [TRT] Gather_846 [Gather] outputs: [1402 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: MatMul_847 [MatMul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1396 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2944 [01/12/2022-09:32:20] [V] [TRT] MatMul_847 [MatMul] inputs: [1396 -> (-1, -1, 768)[FLOAT]], [2944 -> (768, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2944 for ONNX node: 2944 [01/12/2022-09:32:20] [V] [TRT] Registering layer: MatMul_847 for ONNX node: MatMul_847 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1404 for ONNX tensor: 1404 [01/12/2022-09:32:20] [V] [TRT] MatMul_847 [MatMul] outputs: [1404 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_848 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: decoder.layers.0.encoder_attn.q_proj.bias [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1404 [01/12/2022-09:32:20] [V] [TRT] Add_848 [Add] inputs: [decoder.layers.0.encoder_attn.q_proj.bias -> (768)[FLOAT]], [1404 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: decoder.layers.0.encoder_attn.q_proj.bias for ONNX node: decoder.layers.0.encoder_attn.q_proj.bias [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_848 for ONNX node: Add_848 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1405 for ONNX tensor: 1405 [01/12/2022-09:32:20] [V] [TRT] Add_848 [Add] outputs: [1405 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_849 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_849 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_849 [Constant] outputs: [1406 -> ()[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Mul_850 [Mul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1405 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1406 [01/12/2022-09:32:20] [V] [TRT] Mul_850 [Mul] inputs: [1405 -> (-1, -1, 768)[FLOAT]], [1406 -> ()[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1406 for ONNX node: 1406 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Mul_850 for ONNX node: Mul_850 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1407 for ONNX tensor: 1407 [01/12/2022-09:32:20] [V] [TRT] Mul_850 [Mul] outputs: [1407 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: MatMul_851 [MatMul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2945 [01/12/2022-09:32:20] [V] [TRT] MatMul_851 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [2945 -> (768, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2945 for ONNX node: 2945 [01/12/2022-09:32:20] [V] [TRT] Registering layer: MatMul_851 for ONNX node: MatMul_851 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1409 for ONNX tensor: 1409 [01/12/2022-09:32:20] [V] [TRT] MatMul_851 [MatMul] outputs: [1409 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_852 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: decoder.layers.0.encoder_attn.k_proj.bias [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1409 [01/12/2022-09:32:20] [V] [TRT] Add_852 [Add] inputs: [decoder.layers.0.encoder_attn.k_proj.bias -> (768)[FLOAT]], [1409 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: decoder.layers.0.encoder_attn.k_proj.bias for ONNX node: decoder.layers.0.encoder_attn.k_proj.bias [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_852 for ONNX node: Add_852 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1410 for ONNX tensor: 1410 [01/12/2022-09:32:20] [V] [TRT] Add_852 [Add] outputs: [1410 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_853 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1399 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_853 [Unsqueeze] inputs: [1399 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_853 for ONNX node: Unsqueeze_853 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1414 for ONNX tensor: 1414 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_853 [Unsqueeze] outputs: [1414 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_854 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1414 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2946 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2947 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2948 [01/12/2022-09:32:20] [V] [TRT] Concat_854 [Concat] inputs: [1414 -> (1)[INT32]], [2946 -> (1)[INT32]], [2947 -> (1)[INT32]], [2948 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2946 for ONNX node: 2946 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2947 for ONNX node: 2947 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2948 for ONNX node: 2948 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_854 for ONNX node: Concat_854 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1418 for ONNX tensor: 1418 [01/12/2022-09:32:20] [V] [TRT] Concat_854 [Concat] outputs: [1418 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_855 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1410 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1418 [01/12/2022-09:32:20] [V] [TRT] Reshape_855 [Reshape] inputs: [1410 -> (-1, -1, 768)[FLOAT]], [1418 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_855 for ONNX node: Reshape_855 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1419 for ONNX tensor: 1419 [01/12/2022-09:32:20] [V] [TRT] Reshape_855 [Reshape] outputs: [1419 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Transpose_856 [Transpose] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1419 [01/12/2022-09:32:20] [V] [TRT] Transpose_856 [Transpose] inputs: [1419 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Transpose_856 for ONNX node: Transpose_856 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1420_4 for ONNX tensor: 1420 [01/12/2022-09:32:20] [V] [TRT] Transpose_856 [Transpose] outputs: [1420 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: MatMul_857 [MatMul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2949 [01/12/2022-09:32:20] [V] [TRT] MatMul_857 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [2949 -> (768, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2949 for ONNX node: 2949 [01/12/2022-09:32:20] [V] [TRT] Registering layer: MatMul_857 for ONNX node: MatMul_857 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1422 for ONNX tensor: 1422 [01/12/2022-09:32:20] [V] [TRT] MatMul_857 [MatMul] outputs: [1422 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Add_858 [Add] [01/12/2022-09:32:20] [V] [TRT] Searching for input: decoder.layers.0.encoder_attn.v_proj.bias [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1422 [01/12/2022-09:32:20] [V] [TRT] Add_858 [Add] inputs: [decoder.layers.0.encoder_attn.v_proj.bias -> (768)[FLOAT]], [1422 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: decoder.layers.0.encoder_attn.v_proj.bias for ONNX node: decoder.layers.0.encoder_attn.v_proj.bias [01/12/2022-09:32:20] [V] [TRT] Registering layer: Add_858 for ONNX node: Add_858 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1423 for ONNX tensor: 1423 [01/12/2022-09:32:20] [V] [TRT] Add_858 [Add] outputs: [1423 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_859 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1399 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_859 [Unsqueeze] inputs: [1399 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_859 for ONNX node: Unsqueeze_859 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1427 for ONNX tensor: 1427 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_859 [Unsqueeze] outputs: [1427 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_860 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1427 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2950 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2951 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2952 [01/12/2022-09:32:20] [V] [TRT] Concat_860 [Concat] inputs: [1427 -> (1)[INT32]], [2950 -> (1)[INT32]], [2951 -> (1)[INT32]], [2952 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2950 for ONNX node: 2950 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2951 for ONNX node: 2951 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2952 for ONNX node: 2952 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_860 for ONNX node: Concat_860 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1431 for ONNX tensor: 1431 [01/12/2022-09:32:20] [V] [TRT] Concat_860 [Concat] outputs: [1431 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_861 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1423 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1431 [01/12/2022-09:32:20] [V] [TRT] Reshape_861 [Reshape] inputs: [1423 -> (-1, -1, 768)[FLOAT]], [1431 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_861 for ONNX node: Reshape_861 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1432 for ONNX tensor: 1432 [01/12/2022-09:32:20] [V] [TRT] Reshape_861 [Reshape] outputs: [1432 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Transpose_862 [Transpose] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1432 [01/12/2022-09:32:20] [V] [TRT] Transpose_862 [Transpose] inputs: [1432 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Transpose_862 for ONNX node: Transpose_862 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1433_5 for ONNX tensor: 1433 [01/12/2022-09:32:20] [V] [TRT] Transpose_862 [Transpose] outputs: [1433 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Constant_863 [Constant] [01/12/2022-09:32:20] [V] [TRT] Constant_863 [Constant] inputs: [01/12/2022-09:32:20] [V] [TRT] Constant_863 [Constant] outputs: [1434 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Mul_864 [Mul] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1399 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1434 [01/12/2022-09:32:20] [V] [TRT] Mul_864 [Mul] inputs: [1399 -> ()[INT32]], [1434 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 1434 for ONNX node: 1434 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Mul_864 for ONNX node: Mul_864 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1435 for ONNX tensor: 1435 [01/12/2022-09:32:20] [V] [TRT] Mul_864 [Mul] outputs: [1435 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_865 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1399 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_865 [Unsqueeze] inputs: [1399 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_865 for ONNX node: Unsqueeze_865 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1438 for ONNX tensor: 1438 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_865 [Unsqueeze] outputs: [1438 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_866 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1402 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_866 [Unsqueeze] inputs: [1402 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_866 for ONNX node: Unsqueeze_866 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1439 for ONNX tensor: 1439 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_866 [Unsqueeze] outputs: [1439 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_867 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1438 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1439 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2953 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2954 [01/12/2022-09:32:20] [V] [TRT] Concat_867 [Concat] inputs: [1438 -> (1)[INT32]], [1439 -> (1)[INT32]], [2953 -> (1)[INT32]], [2954 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2953 for ONNX node: 2953 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2954 for ONNX node: 2954 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_867 for ONNX node: Concat_867 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1442 for ONNX tensor: 1442 [01/12/2022-09:32:20] [V] [TRT] Concat_867 [Concat] outputs: [1442 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_868 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1407 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1442 [01/12/2022-09:32:20] [V] [TRT] Reshape_868 [Reshape] inputs: [1407 -> (-1, -1, 768)[FLOAT]], [1442 -> (4)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_868 for ONNX node: Reshape_868 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1443 for ONNX tensor: 1443 [01/12/2022-09:32:20] [V] [TRT] Reshape_868 [Reshape] outputs: [1443 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Transpose_869 [Transpose] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1443 [01/12/2022-09:32:20] [V] [TRT] Transpose_869 [Transpose] inputs: [1443 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Transpose_869 for ONNX node: Transpose_869 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1444 for ONNX tensor: 1444 [01/12/2022-09:32:20] [V] [TRT] Transpose_869 [Transpose] outputs: [1444 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_870 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1435 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_870 [Unsqueeze] inputs: [1435 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_870 for ONNX node: Unsqueeze_870 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1447 for ONNX tensor: 1447 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_870 [Unsqueeze] outputs: [1447 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_871 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1447 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2955 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2956 [01/12/2022-09:32:20] [V] [TRT] Concat_871 [Concat] inputs: [1447 -> (1)[INT32]], [2955 -> (1)[INT32]], [2956 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2955 for ONNX node: 2955 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2956 for ONNX node: 2956 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_871 for ONNX node: Concat_871 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1450 for ONNX tensor: 1450 [01/12/2022-09:32:20] [V] [TRT] Concat_871 [Concat] outputs: [1450 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_872 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1444 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1450 [01/12/2022-09:32:20] [V] [TRT] Reshape_872 [Reshape] inputs: [1444 -> (-1, 12, -1, 64)[FLOAT]], [1450 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_872 for ONNX node: Reshape_872 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1451 for ONNX tensor: 1451 [01/12/2022-09:32:20] [V] [TRT] Reshape_872 [Reshape] outputs: [1451 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Unsqueeze_873 [Unsqueeze] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1435 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_873 [Unsqueeze] inputs: [1435 -> ()[INT32]], [01/12/2022-09:32:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:20] [V] [TRT] Registering layer: Unsqueeze_873 for ONNX node: Unsqueeze_873 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1454 for ONNX tensor: 1454 [01/12/2022-09:32:20] [V] [TRT] Unsqueeze_873 [Unsqueeze] outputs: [1454 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Concat_874 [Concat] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1454 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2957 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 2958 [01/12/2022-09:32:20] [V] [TRT] Concat_874 [Concat] inputs: [1454 -> (1)[INT32]], [2957 -> (1)[INT32]], [2958 -> (1)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2957 for ONNX node: 2957 [01/12/2022-09:32:20] [V] [TRT] Registering layer: 2958 for ONNX node: 2958 [01/12/2022-09:32:20] [V] [TRT] Registering layer: Concat_874 for ONNX node: Concat_874 [01/12/2022-09:32:20] [V] [TRT] Registering tensor: 1457 for ONNX tensor: 1457 [01/12/2022-09:32:20] [V] [TRT] Concat_874 [Concat] outputs: [1457 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Parsing node: Reshape_875 [Reshape] [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1420 [01/12/2022-09:32:20] [V] [TRT] Searching for input: 1457 [01/12/2022-09:32:20] [V] [TRT] Reshape_875 [Reshape] inputs: [1420 -> (-1, 12, -1, 64)[FLOAT]], [1457 -> (3)[INT32]], [01/12/2022-09:32:20] [V] [TRT] Registering layer: Reshape_875 for ONNX node: Reshape_875 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1458 for ONNX tensor: 1458 [01/12/2022-09:32:21] [V] [TRT] Reshape_875 [Reshape] outputs: [1458 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Unsqueeze_876 [Unsqueeze] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1435 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_876 [Unsqueeze] inputs: [1435 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:21] [V] [TRT] Registering layer: Unsqueeze_876 for ONNX node: Unsqueeze_876 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1461 for ONNX tensor: 1461 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_876 [Unsqueeze] outputs: [1461 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Concat_877 [Concat] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1461 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2959 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2960 [01/12/2022-09:32:21] [V] [TRT] Concat_877 [Concat] inputs: [1461 -> (1)[INT32]], [2959 -> (1)[INT32]], [2960 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2959 for ONNX node: 2959 [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2960 for ONNX node: 2960 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Concat_877 for ONNX node: Concat_877 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1464 for ONNX tensor: 1464 [01/12/2022-09:32:21] [V] [TRT] Concat_877 [Concat] outputs: [1464 -> (3)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Reshape_878 [Reshape] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1433 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1464 [01/12/2022-09:32:21] [V] [TRT] Reshape_878 [Reshape] inputs: [1433 -> (-1, 12, -1, 64)[FLOAT]], [1464 -> (3)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Reshape_878 for ONNX node: Reshape_878 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1465 for ONNX tensor: 1465 [01/12/2022-09:32:21] [V] [TRT] Reshape_878 [Reshape] outputs: [1465 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Transpose_879 [Transpose] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1458 [01/12/2022-09:32:21] [V] [TRT] Transpose_879 [Transpose] inputs: [1458 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Transpose_879 for ONNX node: Transpose_879 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1466 for ONNX tensor: 1466 [01/12/2022-09:32:21] [V] [TRT] Transpose_879 [Transpose] outputs: [1466 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: MatMul_880 [MatMul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1451 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1466 [01/12/2022-09:32:21] [V] [TRT] MatMul_880 [MatMul] inputs: [1451 -> (-1, -1, 64)[FLOAT]], [1466 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: MatMul_880 for ONNX node: MatMul_880 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1467 for ONNX tensor: 1467 [01/12/2022-09:32:21] [V] [TRT] MatMul_880 [MatMul] outputs: [1467 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Softmax_881 [Softmax] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1467 [01/12/2022-09:32:21] [V] [TRT] Softmax_881 [Softmax] inputs: [1467 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Softmax_881 for ONNX node: Softmax_881 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1468 for ONNX tensor: 1468 [01/12/2022-09:32:21] [V] [TRT] Softmax_881 [Softmax] outputs: [1468 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: MatMul_882 [MatMul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1468 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1465 [01/12/2022-09:32:21] [V] [TRT] MatMul_882 [MatMul] inputs: [1468 -> (-1, -1, -1)[FLOAT]], [1465 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: MatMul_882 for ONNX node: MatMul_882 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1469 for ONNX tensor: 1469 [01/12/2022-09:32:21] [V] [TRT] MatMul_882 [MatMul] outputs: [1469 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Unsqueeze_883 [Unsqueeze] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1399 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_883 [Unsqueeze] inputs: [1399 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:21] [V] [TRT] Registering layer: Unsqueeze_883 for ONNX node: Unsqueeze_883 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1472 for ONNX tensor: 1472 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_883 [Unsqueeze] outputs: [1472 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Unsqueeze_884 [Unsqueeze] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1402 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_884 [Unsqueeze] inputs: [1402 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:21] [V] [TRT] Registering layer: Unsqueeze_884 for ONNX node: Unsqueeze_884 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1474 for ONNX tensor: 1474 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_884 [Unsqueeze] outputs: [1474 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Concat_885 [Concat] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1472 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2961 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1474 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2962 [01/12/2022-09:32:21] [V] [TRT] Concat_885 [Concat] inputs: [1472 -> (1)[INT32]], [2961 -> (1)[INT32]], [1474 -> (1)[INT32]], [2962 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2961 for ONNX node: 2961 [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2962 for ONNX node: 2962 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Concat_885 for ONNX node: Concat_885 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1476 for ONNX tensor: 1476 [01/12/2022-09:32:21] [V] [TRT] Concat_885 [Concat] outputs: [1476 -> (4)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Reshape_886 [Reshape] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1469 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1476 [01/12/2022-09:32:21] [V] [TRT] Reshape_886 [Reshape] inputs: [1469 -> (-1, -1, 64)[FLOAT]], [1476 -> (4)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Reshape_886 for ONNX node: Reshape_886 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1477 for ONNX tensor: 1477 [01/12/2022-09:32:21] [V] [TRT] Reshape_886 [Reshape] outputs: [1477 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Transpose_887 [Transpose] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1477 [01/12/2022-09:32:21] [V] [TRT] Transpose_887 [Transpose] inputs: [1477 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Transpose_887 for ONNX node: Transpose_887 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1478 for ONNX tensor: 1478 [01/12/2022-09:32:21] [V] [TRT] Transpose_887 [Transpose] outputs: [1478 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Unsqueeze_888 [Unsqueeze] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1399 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_888 [Unsqueeze] inputs: [1399 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:21] [V] [TRT] Registering layer: Unsqueeze_888 for ONNX node: Unsqueeze_888 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1480 for ONNX tensor: 1480 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_888 [Unsqueeze] outputs: [1480 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Unsqueeze_889 [Unsqueeze] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1402 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_889 [Unsqueeze] inputs: [1402 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:21] [V] [TRT] Registering layer: Unsqueeze_889 for ONNX node: Unsqueeze_889 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1481 for ONNX tensor: 1481 [01/12/2022-09:32:21] [V] [TRT] Unsqueeze_889 [Unsqueeze] outputs: [1481 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Concat_890 [Concat] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1480 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1481 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2963 [01/12/2022-09:32:21] [V] [TRT] Concat_890 [Concat] inputs: [1480 -> (1)[INT32]], [1481 -> (1)[INT32]], [2963 -> (1)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2963 for ONNX node: 2963 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Concat_890 for ONNX node: Concat_890 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1483 for ONNX tensor: 1483 [01/12/2022-09:32:21] [V] [TRT] Concat_890 [Concat] outputs: [1483 -> (3)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Reshape_891 [Reshape] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1478 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1483 [01/12/2022-09:32:21] [V] [TRT] Reshape_891 [Reshape] inputs: [1478 -> (-1, -1, 12, 64)[FLOAT]], [1483 -> (3)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Reshape_891 for ONNX node: Reshape_891 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1484 for ONNX tensor: 1484 [01/12/2022-09:32:21] [V] [TRT] Reshape_891 [Reshape] outputs: [1484 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: MatMul_892 [MatMul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1484 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2964 [01/12/2022-09:32:21] [V] [TRT] MatMul_892 [MatMul] inputs: [1484 -> (-1, -1, 768)[FLOAT]], [2964 -> (768, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2964 for ONNX node: 2964 [01/12/2022-09:32:21] [V] [TRT] Registering layer: MatMul_892 for ONNX node: MatMul_892 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1486 for ONNX tensor: 1486 [01/12/2022-09:32:21] [V] [TRT] MatMul_892 [MatMul] outputs: [1486 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_893 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.encoder_attn.out_proj.bias [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1486 [01/12/2022-09:32:21] [V] [TRT] Add_893 [Add] inputs: [decoder.layers.0.encoder_attn.out_proj.bias -> (768)[FLOAT]], [1486 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.encoder_attn.out_proj.bias for ONNX node: decoder.layers.0.encoder_attn.out_proj.bias [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_893 for ONNX node: Add_893 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1487 for ONNX tensor: 1487 [01/12/2022-09:32:21] [V] [TRT] Add_893 [Add] outputs: [1487 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_894 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1396 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1487 [01/12/2022-09:32:21] [V] [TRT] Add_894 [Add] inputs: [1396 -> (-1, -1, 768)[FLOAT]], [1487 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_894 for ONNX node: Add_894 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1488 for ONNX tensor: 1488 [01/12/2022-09:32:21] [V] [TRT] Add_894 [Add] outputs: [1488 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: ReduceMean_895 [ReduceMean] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1488 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_895 [ReduceMean] inputs: [1488 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: ReduceMean_895 for ONNX node: ReduceMean_895 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1489 for ONNX tensor: 1489 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_895 [ReduceMean] outputs: [1489 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Sub_896 [Sub] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1488 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1489 [01/12/2022-09:32:21] [V] [TRT] Sub_896 [Sub] inputs: [1488 -> (-1, -1, 768)[FLOAT]], [1489 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Sub_896 for ONNX node: Sub_896 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1490 for ONNX tensor: 1490 [01/12/2022-09:32:21] [V] [TRT] Sub_896 [Sub] outputs: [1490 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_897 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_897 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_897 [Constant] outputs: [1491 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Pow_898 [Pow] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1490 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1491 [01/12/2022-09:32:21] [V] [TRT] Pow_898 [Pow] inputs: [1490 -> (-1, -1, 768)[FLOAT]], [1491 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1491 for ONNX node: 1491 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Pow_898 for ONNX node: Pow_898 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1492 for ONNX tensor: 1492 [01/12/2022-09:32:21] [V] [TRT] Pow_898 [Pow] outputs: [1492 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: ReduceMean_899 [ReduceMean] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1492 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_899 [ReduceMean] inputs: [1492 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: ReduceMean_899 for ONNX node: ReduceMean_899 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1493 for ONNX tensor: 1493 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_899 [ReduceMean] outputs: [1493 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_900 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_900 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_900 [Constant] outputs: [1494 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_901 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1493 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1494 [01/12/2022-09:32:21] [V] [TRT] Add_901 [Add] inputs: [1493 -> (-1, -1, 1)[FLOAT]], [1494 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1494 for ONNX node: 1494 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_901 for ONNX node: Add_901 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1495 for ONNX tensor: 1495 [01/12/2022-09:32:21] [V] [TRT] Add_901 [Add] outputs: [1495 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Sqrt_902 [Sqrt] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1495 [01/12/2022-09:32:21] [V] [TRT] Sqrt_902 [Sqrt] inputs: [1495 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Sqrt_902 for ONNX node: Sqrt_902 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1496 for ONNX tensor: 1496 [01/12/2022-09:32:21] [V] [TRT] Sqrt_902 [Sqrt] outputs: [1496 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Div_903 [Div] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1490 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1496 [01/12/2022-09:32:21] [V] [TRT] Div_903 [Div] inputs: [1490 -> (-1, -1, 768)[FLOAT]], [1496 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Div_903 for ONNX node: Div_903 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1497 for ONNX tensor: 1497 [01/12/2022-09:32:21] [V] [TRT] Div_903 [Div] outputs: [1497 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Mul_904 [Mul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1497 [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.encoder_attn_layer_norm.weight [01/12/2022-09:32:21] [V] [TRT] Mul_904 [Mul] inputs: [1497 -> (-1, -1, 768)[FLOAT]], [decoder.layers.0.encoder_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.encoder_attn_layer_norm.weight for ONNX node: decoder.layers.0.encoder_attn_layer_norm.weight [01/12/2022-09:32:21] [V] [TRT] Registering layer: Mul_904 for ONNX node: Mul_904 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1498 for ONNX tensor: 1498 [01/12/2022-09:32:21] [V] [TRT] Mul_904 [Mul] outputs: [1498 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_905 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1498 [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.encoder_attn_layer_norm.bias [01/12/2022-09:32:21] [V] [TRT] Add_905 [Add] inputs: [1498 -> (-1, -1, 768)[FLOAT]], [decoder.layers.0.encoder_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.encoder_attn_layer_norm.bias for ONNX node: decoder.layers.0.encoder_attn_layer_norm.bias [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_905 for ONNX node: Add_905 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1499 for ONNX tensor: 1499 [01/12/2022-09:32:21] [V] [TRT] Add_905 [Add] outputs: [1499 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: MatMul_906 [MatMul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1499 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2965 [01/12/2022-09:32:21] [V] [TRT] MatMul_906 [MatMul] inputs: [1499 -> (-1, -1, 768)[FLOAT]], [2965 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2965 for ONNX node: 2965 [01/12/2022-09:32:21] [V] [TRT] Registering layer: MatMul_906 for ONNX node: MatMul_906 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1501 for ONNX tensor: 1501 [01/12/2022-09:32:21] [V] [TRT] MatMul_906 [MatMul] outputs: [1501 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_907 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.fc1.bias [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1501 [01/12/2022-09:32:21] [V] [TRT] Add_907 [Add] inputs: [decoder.layers.0.fc1.bias -> (3072)[FLOAT]], [1501 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.fc1.bias for ONNX node: decoder.layers.0.fc1.bias [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_907 for ONNX node: Add_907 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1502 for ONNX tensor: 1502 [01/12/2022-09:32:21] [V] [TRT] Add_907 [Add] outputs: [1502 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_908 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_908 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_908 [Constant] outputs: [1503 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Div_909 [Div] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1502 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1503 [01/12/2022-09:32:21] [V] [TRT] Div_909 [Div] inputs: [1502 -> (-1, -1, 3072)[FLOAT]], [1503 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1503 for ONNX node: 1503 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Div_909 for ONNX node: Div_909 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1504 for ONNX tensor: 1504 [01/12/2022-09:32:21] [V] [TRT] Div_909 [Div] outputs: [1504 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Erf_910 [Erf] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1504 [01/12/2022-09:32:21] [V] [TRT] Erf_910 [Erf] inputs: [1504 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Erf_910 for ONNX node: Erf_910 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1505 for ONNX tensor: 1505 [01/12/2022-09:32:21] [V] [TRT] Erf_910 [Erf] outputs: [1505 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_911 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_911 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_911 [Constant] outputs: [1506 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_912 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1505 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1506 [01/12/2022-09:32:21] [V] [TRT] Add_912 [Add] inputs: [1505 -> (-1, -1, 3072)[FLOAT]], [1506 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1506 for ONNX node: 1506 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_912 for ONNX node: Add_912 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1507 for ONNX tensor: 1507 [01/12/2022-09:32:21] [V] [TRT] Add_912 [Add] outputs: [1507 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Mul_913 [Mul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1502 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1507 [01/12/2022-09:32:21] [V] [TRT] Mul_913 [Mul] inputs: [1502 -> (-1, -1, 3072)[FLOAT]], [1507 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Mul_913 for ONNX node: Mul_913 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1508 for ONNX tensor: 1508 [01/12/2022-09:32:21] [V] [TRT] Mul_913 [Mul] outputs: [1508 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_914 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_914 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_914 [Constant] outputs: [1509 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Mul_915 [Mul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1508 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1509 [01/12/2022-09:32:21] [V] [TRT] Mul_915 [Mul] inputs: [1508 -> (-1, -1, 3072)[FLOAT]], [1509 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1509 for ONNX node: 1509 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Mul_915 for ONNX node: Mul_915 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1510 for ONNX tensor: 1510 [01/12/2022-09:32:21] [V] [TRT] Mul_915 [Mul] outputs: [1510 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: MatMul_916 [MatMul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1510 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 2966 [01/12/2022-09:32:21] [V] [TRT] MatMul_916 [MatMul] inputs: [1510 -> (-1, -1, 3072)[FLOAT]], [2966 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 2966 for ONNX node: 2966 [01/12/2022-09:32:21] [V] [TRT] Registering layer: MatMul_916 for ONNX node: MatMul_916 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1512 for ONNX tensor: 1512 [01/12/2022-09:32:21] [V] [TRT] MatMul_916 [MatMul] outputs: [1512 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_917 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.fc2.bias [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1512 [01/12/2022-09:32:21] [V] [TRT] Add_917 [Add] inputs: [decoder.layers.0.fc2.bias -> (768)[FLOAT]], [1512 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.fc2.bias for ONNX node: decoder.layers.0.fc2.bias [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_917 for ONNX node: Add_917 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1513 for ONNX tensor: 1513 [01/12/2022-09:32:21] [V] [TRT] Add_917 [Add] outputs: [1513 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_918 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1499 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1513 [01/12/2022-09:32:21] [V] [TRT] Add_918 [Add] inputs: [1499 -> (-1, -1, 768)[FLOAT]], [1513 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_918 for ONNX node: Add_918 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1514 for ONNX tensor: 1514 [01/12/2022-09:32:21] [V] [TRT] Add_918 [Add] outputs: [1514 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: ReduceMean_919 [ReduceMean] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1514 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_919 [ReduceMean] inputs: [1514 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: ReduceMean_919 for ONNX node: ReduceMean_919 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1515 for ONNX tensor: 1515 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_919 [ReduceMean] outputs: [1515 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Sub_920 [Sub] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1514 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1515 [01/12/2022-09:32:21] [V] [TRT] Sub_920 [Sub] inputs: [1514 -> (-1, -1, 768)[FLOAT]], [1515 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Sub_920 for ONNX node: Sub_920 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1516 for ONNX tensor: 1516 [01/12/2022-09:32:21] [V] [TRT] Sub_920 [Sub] outputs: [1516 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_921 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_921 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_921 [Constant] outputs: [1517 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Pow_922 [Pow] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1516 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1517 [01/12/2022-09:32:21] [V] [TRT] Pow_922 [Pow] inputs: [1516 -> (-1, -1, 768)[FLOAT]], [1517 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1517 for ONNX node: 1517 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Pow_922 for ONNX node: Pow_922 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1518 for ONNX tensor: 1518 [01/12/2022-09:32:21] [V] [TRT] Pow_922 [Pow] outputs: [1518 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: ReduceMean_923 [ReduceMean] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1518 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_923 [ReduceMean] inputs: [1518 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: ReduceMean_923 for ONNX node: ReduceMean_923 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1519 for ONNX tensor: 1519 [01/12/2022-09:32:21] [V] [TRT] ReduceMean_923 [ReduceMean] outputs: [1519 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_924 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_924 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_924 [Constant] outputs: [1520 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_925 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1519 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1520 [01/12/2022-09:32:21] [V] [TRT] Add_925 [Add] inputs: [1519 -> (-1, -1, 1)[FLOAT]], [1520 -> ()[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1520 for ONNX node: 1520 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_925 for ONNX node: Add_925 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1521 for ONNX tensor: 1521 [01/12/2022-09:32:21] [V] [TRT] Add_925 [Add] outputs: [1521 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Sqrt_926 [Sqrt] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1521 [01/12/2022-09:32:21] [V] [TRT] Sqrt_926 [Sqrt] inputs: [1521 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Sqrt_926 for ONNX node: Sqrt_926 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1522 for ONNX tensor: 1522 [01/12/2022-09:32:21] [V] [TRT] Sqrt_926 [Sqrt] outputs: [1522 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Div_927 [Div] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1516 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1522 [01/12/2022-09:32:21] [V] [TRT] Div_927 [Div] inputs: [1516 -> (-1, -1, 768)[FLOAT]], [1522 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Div_927 for ONNX node: Div_927 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1523 for ONNX tensor: 1523 [01/12/2022-09:32:21] [V] [TRT] Div_927 [Div] outputs: [1523 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Mul_928 [Mul] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1523 [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.final_layer_norm.weight [01/12/2022-09:32:21] [V] [TRT] Mul_928 [Mul] inputs: [1523 -> (-1, -1, 768)[FLOAT]], [decoder.layers.0.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.final_layer_norm.weight for ONNX node: decoder.layers.0.final_layer_norm.weight [01/12/2022-09:32:21] [V] [TRT] Registering layer: Mul_928 for ONNX node: Mul_928 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1524 for ONNX tensor: 1524 [01/12/2022-09:32:21] [V] [TRT] Mul_928 [Mul] outputs: [1524 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Add_929 [Add] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1524 [01/12/2022-09:32:21] [V] [TRT] Searching for input: decoder.layers.0.final_layer_norm.bias [01/12/2022-09:32:21] [V] [TRT] Add_929 [Add] inputs: [1524 -> (-1, -1, 768)[FLOAT]], [decoder.layers.0.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: decoder.layers.0.final_layer_norm.bias for ONNX node: decoder.layers.0.final_layer_norm.bias [01/12/2022-09:32:21] [V] [TRT] Registering layer: Add_929 for ONNX node: Add_929 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1525 for ONNX tensor: 1525 [01/12/2022-09:32:21] [V] [TRT] Add_929 [Add] outputs: [1525 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Shape_930 [Shape] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1525 [01/12/2022-09:32:21] [V] [TRT] Shape_930 [Shape] inputs: [1525 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: Shape_930 for ONNX node: Shape_930 [01/12/2022-09:32:21] [V] [TRT] Registering tensor: 1526 for ONNX tensor: 1526 [01/12/2022-09:32:21] [V] [TRT] Shape_930 [Shape] outputs: [1526 -> (3)[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Constant_931 [Constant] [01/12/2022-09:32:21] [V] [TRT] Constant_931 [Constant] inputs: [01/12/2022-09:32:21] [V] [TRT] Constant_931 [Constant] outputs: [1527 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Parsing node: Gather_932 [Gather] [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1526 [01/12/2022-09:32:21] [V] [TRT] Searching for input: 1527 [01/12/2022-09:32:21] [V] [TRT] Gather_932 [Gather] inputs: [1526 -> (3)[INT32]], [1527 -> ()[INT32]], [01/12/2022-09:32:21] [V] [TRT] Registering layer: 1527 for ONNX node: 1527 [01/12/2022-09:32:21] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:21] [V] [TRT] Registering layer: Gather_932 for ONNX node: Gather_932 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1528 for ONNX tensor: 1528 [01/12/2022-09:32:22] [V] [TRT] Gather_932 [Gather] outputs: [1528 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Shape_933 [Shape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1525 [01/12/2022-09:32:22] [V] [TRT] Shape_933 [Shape] inputs: [1525 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Shape_933 for ONNX node: Shape_933 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1529 for ONNX tensor: 1529 [01/12/2022-09:32:22] [V] [TRT] Shape_933 [Shape] outputs: [1529 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Constant_934 [Constant] [01/12/2022-09:32:22] [V] [TRT] Constant_934 [Constant] inputs: [01/12/2022-09:32:22] [V] [TRT] Constant_934 [Constant] outputs: [1530 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Gather_935 [Gather] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1529 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1530 [01/12/2022-09:32:22] [V] [TRT] Gather_935 [Gather] inputs: [1529 -> (3)[INT32]], [1530 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 1530 for ONNX node: 1530 [01/12/2022-09:32:22] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Gather_935 for ONNX node: Gather_935 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1531 for ONNX tensor: 1531 [01/12/2022-09:32:22] [V] [TRT] Gather_935 [Gather] outputs: [1531 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: MatMul_936 [MatMul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1525 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2967 [01/12/2022-09:32:22] [V] [TRT] MatMul_936 [MatMul] inputs: [1525 -> (-1, -1, 768)[FLOAT]], [2967 -> (768, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2967 for ONNX node: 2967 [01/12/2022-09:32:22] [V] [TRT] Registering layer: MatMul_936 for ONNX node: MatMul_936 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1533 for ONNX tensor: 1533 [01/12/2022-09:32:22] [V] [TRT] MatMul_936 [MatMul] outputs: [1533 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Add_937 [Add] [01/12/2022-09:32:22] [V] [TRT] Searching for input: decoder.layers.1.self_attn.q_proj.bias [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1533 [01/12/2022-09:32:22] [V] [TRT] Add_937 [Add] inputs: [decoder.layers.1.self_attn.q_proj.bias -> (768)[FLOAT]], [1533 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: decoder.layers.1.self_attn.q_proj.bias for ONNX node: decoder.layers.1.self_attn.q_proj.bias [01/12/2022-09:32:22] [V] [TRT] Registering layer: Add_937 for ONNX node: Add_937 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1534 for ONNX tensor: 1534 [01/12/2022-09:32:22] [V] [TRT] Add_937 [Add] outputs: [1534 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Constant_938 [Constant] [01/12/2022-09:32:22] [V] [TRT] Constant_938 [Constant] inputs: [01/12/2022-09:32:22] [V] [TRT] Constant_938 [Constant] outputs: [1535 -> ()[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Mul_939 [Mul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1534 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1535 [01/12/2022-09:32:22] [V] [TRT] Mul_939 [Mul] inputs: [1534 -> (-1, -1, 768)[FLOAT]], [1535 -> ()[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 1535 for ONNX node: 1535 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Mul_939 for ONNX node: Mul_939 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1536 for ONNX tensor: 1536 [01/12/2022-09:32:22] [V] [TRT] Mul_939 [Mul] outputs: [1536 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: MatMul_940 [MatMul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1525 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2968 [01/12/2022-09:32:22] [V] [TRT] MatMul_940 [MatMul] inputs: [1525 -> (-1, -1, 768)[FLOAT]], [2968 -> (768, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2968 for ONNX node: 2968 [01/12/2022-09:32:22] [V] [TRT] Registering layer: MatMul_940 for ONNX node: MatMul_940 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1538 for ONNX tensor: 1538 [01/12/2022-09:32:22] [V] [TRT] MatMul_940 [MatMul] outputs: [1538 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Add_941 [Add] [01/12/2022-09:32:22] [V] [TRT] Searching for input: decoder.layers.1.self_attn.k_proj.bias [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1538 [01/12/2022-09:32:22] [V] [TRT] Add_941 [Add] inputs: [decoder.layers.1.self_attn.k_proj.bias -> (768)[FLOAT]], [1538 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: decoder.layers.1.self_attn.k_proj.bias for ONNX node: decoder.layers.1.self_attn.k_proj.bias [01/12/2022-09:32:22] [V] [TRT] Registering layer: Add_941 for ONNX node: Add_941 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1539 for ONNX tensor: 1539 [01/12/2022-09:32:22] [V] [TRT] Add_941 [Add] outputs: [1539 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_942 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_942 [Unsqueeze] inputs: [1528 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_942 for ONNX node: Unsqueeze_942 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1543 for ONNX tensor: 1543 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_942 [Unsqueeze] outputs: [1543 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_943 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1543 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2969 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2970 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2971 [01/12/2022-09:32:22] [V] [TRT] Concat_943 [Concat] inputs: [1543 -> (1)[INT32]], [2969 -> (1)[INT32]], [2970 -> (1)[INT32]], [2971 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2969 for ONNX node: 2969 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2970 for ONNX node: 2970 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2971 for ONNX node: 2971 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_943 for ONNX node: Concat_943 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1547 for ONNX tensor: 1547 [01/12/2022-09:32:22] [V] [TRT] Concat_943 [Concat] outputs: [1547 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_944 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1539 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1547 [01/12/2022-09:32:22] [V] [TRT] Reshape_944 [Reshape] inputs: [1539 -> (-1, -1, 768)[FLOAT]], [1547 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_944 for ONNX node: Reshape_944 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1548 for ONNX tensor: 1548 [01/12/2022-09:32:22] [V] [TRT] Reshape_944 [Reshape] outputs: [1548 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Transpose_945 [Transpose] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1548 [01/12/2022-09:32:22] [V] [TRT] Transpose_945 [Transpose] inputs: [1548 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Transpose_945 for ONNX node: Transpose_945 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1549_6 for ONNX tensor: 1549 [01/12/2022-09:32:22] [V] [TRT] Transpose_945 [Transpose] outputs: [1549 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: MatMul_946 [MatMul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1525 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2972 [01/12/2022-09:32:22] [V] [TRT] MatMul_946 [MatMul] inputs: [1525 -> (-1, -1, 768)[FLOAT]], [2972 -> (768, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2972 for ONNX node: 2972 [01/12/2022-09:32:22] [V] [TRT] Registering layer: MatMul_946 for ONNX node: MatMul_946 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1551 for ONNX tensor: 1551 [01/12/2022-09:32:22] [V] [TRT] MatMul_946 [MatMul] outputs: [1551 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Add_947 [Add] [01/12/2022-09:32:22] [V] [TRT] Searching for input: decoder.layers.1.self_attn.v_proj.bias [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1551 [01/12/2022-09:32:22] [V] [TRT] Add_947 [Add] inputs: [decoder.layers.1.self_attn.v_proj.bias -> (768)[FLOAT]], [1551 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: decoder.layers.1.self_attn.v_proj.bias for ONNX node: decoder.layers.1.self_attn.v_proj.bias [01/12/2022-09:32:22] [V] [TRT] Registering layer: Add_947 for ONNX node: Add_947 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1552 for ONNX tensor: 1552 [01/12/2022-09:32:22] [V] [TRT] Add_947 [Add] outputs: [1552 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_948 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_948 [Unsqueeze] inputs: [1528 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_948 for ONNX node: Unsqueeze_948 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1556 for ONNX tensor: 1556 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_948 [Unsqueeze] outputs: [1556 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_949 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1556 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2973 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2974 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2975 [01/12/2022-09:32:22] [V] [TRT] Concat_949 [Concat] inputs: [1556 -> (1)[INT32]], [2973 -> (1)[INT32]], [2974 -> (1)[INT32]], [2975 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2973 for ONNX node: 2973 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2974 for ONNX node: 2974 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2975 for ONNX node: 2975 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_949 for ONNX node: Concat_949 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1560 for ONNX tensor: 1560 [01/12/2022-09:32:22] [V] [TRT] Concat_949 [Concat] outputs: [1560 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_950 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1552 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1560 [01/12/2022-09:32:22] [V] [TRT] Reshape_950 [Reshape] inputs: [1552 -> (-1, -1, 768)[FLOAT]], [1560 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_950 for ONNX node: Reshape_950 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1561 for ONNX tensor: 1561 [01/12/2022-09:32:22] [V] [TRT] Reshape_950 [Reshape] outputs: [1561 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Transpose_951 [Transpose] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1561 [01/12/2022-09:32:22] [V] [TRT] Transpose_951 [Transpose] inputs: [1561 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Transpose_951 for ONNX node: Transpose_951 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1562_7 for ONNX tensor: 1562 [01/12/2022-09:32:22] [V] [TRT] Transpose_951 [Transpose] outputs: [1562 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Constant_952 [Constant] [01/12/2022-09:32:22] [V] [TRT] Constant_952 [Constant] inputs: [01/12/2022-09:32:22] [V] [TRT] Constant_952 [Constant] outputs: [1563 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Mul_953 [Mul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1563 [01/12/2022-09:32:22] [V] [TRT] Mul_953 [Mul] inputs: [1528 -> ()[INT32]], [1563 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 1563 for ONNX node: 1563 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Mul_953 for ONNX node: Mul_953 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1564 for ONNX tensor: 1564 [01/12/2022-09:32:22] [V] [TRT] Mul_953 [Mul] outputs: [1564 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_954 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_954 [Unsqueeze] inputs: [1528 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_954 for ONNX node: Unsqueeze_954 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1567 for ONNX tensor: 1567 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_954 [Unsqueeze] outputs: [1567 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_955 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1531 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_955 [Unsqueeze] inputs: [1531 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_955 for ONNX node: Unsqueeze_955 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1568 for ONNX tensor: 1568 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_955 [Unsqueeze] outputs: [1568 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_956 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1567 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1568 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2976 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2977 [01/12/2022-09:32:22] [V] [TRT] Concat_956 [Concat] inputs: [1567 -> (1)[INT32]], [1568 -> (1)[INT32]], [2976 -> (1)[INT32]], [2977 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2976 for ONNX node: 2976 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2977 for ONNX node: 2977 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_956 for ONNX node: Concat_956 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1571 for ONNX tensor: 1571 [01/12/2022-09:32:22] [V] [TRT] Concat_956 [Concat] outputs: [1571 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_957 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1536 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1571 [01/12/2022-09:32:22] [V] [TRT] Reshape_957 [Reshape] inputs: [1536 -> (-1, -1, 768)[FLOAT]], [1571 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_957 for ONNX node: Reshape_957 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1572 for ONNX tensor: 1572 [01/12/2022-09:32:22] [V] [TRT] Reshape_957 [Reshape] outputs: [1572 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Transpose_958 [Transpose] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1572 [01/12/2022-09:32:22] [V] [TRT] Transpose_958 [Transpose] inputs: [1572 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Transpose_958 for ONNX node: Transpose_958 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1573 for ONNX tensor: 1573 [01/12/2022-09:32:22] [V] [TRT] Transpose_958 [Transpose] outputs: [1573 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_959 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1564 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_959 [Unsqueeze] inputs: [1564 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_959 for ONNX node: Unsqueeze_959 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1576 for ONNX tensor: 1576 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_959 [Unsqueeze] outputs: [1576 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_960 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1576 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2978 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2979 [01/12/2022-09:32:22] [V] [TRT] Concat_960 [Concat] inputs: [1576 -> (1)[INT32]], [2978 -> (1)[INT32]], [2979 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2978 for ONNX node: 2978 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2979 for ONNX node: 2979 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_960 for ONNX node: Concat_960 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1579 for ONNX tensor: 1579 [01/12/2022-09:32:22] [V] [TRT] Concat_960 [Concat] outputs: [1579 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_961 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1573 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1579 [01/12/2022-09:32:22] [V] [TRT] Reshape_961 [Reshape] inputs: [1573 -> (-1, 12, -1, 64)[FLOAT]], [1579 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_961 for ONNX node: Reshape_961 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1580 for ONNX tensor: 1580 [01/12/2022-09:32:22] [V] [TRT] Reshape_961 [Reshape] outputs: [1580 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_962 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1564 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_962 [Unsqueeze] inputs: [1564 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_962 for ONNX node: Unsqueeze_962 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1583 for ONNX tensor: 1583 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_962 [Unsqueeze] outputs: [1583 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_963 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1583 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2980 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2981 [01/12/2022-09:32:22] [V] [TRT] Concat_963 [Concat] inputs: [1583 -> (1)[INT32]], [2980 -> (1)[INT32]], [2981 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2980 for ONNX node: 2980 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2981 for ONNX node: 2981 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_963 for ONNX node: Concat_963 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1586 for ONNX tensor: 1586 [01/12/2022-09:32:22] [V] [TRT] Concat_963 [Concat] outputs: [1586 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_964 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1549 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1586 [01/12/2022-09:32:22] [V] [TRT] Reshape_964 [Reshape] inputs: [1549 -> (-1, 12, -1, 64)[FLOAT]], [1586 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_964 for ONNX node: Reshape_964 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1587 for ONNX tensor: 1587 [01/12/2022-09:32:22] [V] [TRT] Reshape_964 [Reshape] outputs: [1587 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_965 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1564 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_965 [Unsqueeze] inputs: [1564 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_965 for ONNX node: Unsqueeze_965 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1590 for ONNX tensor: 1590 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_965 [Unsqueeze] outputs: [1590 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_966 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1590 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2982 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2983 [01/12/2022-09:32:22] [V] [TRT] Concat_966 [Concat] inputs: [1590 -> (1)[INT32]], [2982 -> (1)[INT32]], [2983 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2982 for ONNX node: 2982 [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2983 for ONNX node: 2983 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_966 for ONNX node: Concat_966 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1593 for ONNX tensor: 1593 [01/12/2022-09:32:22] [V] [TRT] Concat_966 [Concat] outputs: [1593 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_967 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1562 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1593 [01/12/2022-09:32:22] [V] [TRT] Reshape_967 [Reshape] inputs: [1562 -> (-1, 12, -1, 64)[FLOAT]], [1593 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_967 for ONNX node: Reshape_967 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1594 for ONNX tensor: 1594 [01/12/2022-09:32:22] [V] [TRT] Reshape_967 [Reshape] outputs: [1594 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Shape_968 [Shape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1587 [01/12/2022-09:32:22] [V] [TRT] Shape_968 [Shape] inputs: [1587 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Shape_968 for ONNX node: Shape_968 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1595 for ONNX tensor: 1595 [01/12/2022-09:32:22] [V] [TRT] Shape_968 [Shape] outputs: [1595 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Constant_969 [Constant] [01/12/2022-09:32:22] [V] [TRT] Constant_969 [Constant] inputs: [01/12/2022-09:32:22] [V] [TRT] Constant_969 [Constant] outputs: [1596 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Gather_970 [Gather] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1595 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1596 [01/12/2022-09:32:22] [V] [TRT] Gather_970 [Gather] inputs: [1595 -> (3)[INT32]], [1596 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 1596 for ONNX node: 1596 [01/12/2022-09:32:22] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Gather_970 for ONNX node: Gather_970 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1597 for ONNX tensor: 1597 [01/12/2022-09:32:22] [V] [TRT] Gather_970 [Gather] outputs: [1597 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Transpose_971 [Transpose] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1587 [01/12/2022-09:32:22] [V] [TRT] Transpose_971 [Transpose] inputs: [1587 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Transpose_971 for ONNX node: Transpose_971 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1598 for ONNX tensor: 1598 [01/12/2022-09:32:22] [V] [TRT] Transpose_971 [Transpose] outputs: [1598 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: MatMul_972 [MatMul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1580 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1598 [01/12/2022-09:32:22] [V] [TRT] MatMul_972 [MatMul] inputs: [1580 -> (-1, -1, 64)[FLOAT]], [1598 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: MatMul_972 for ONNX node: MatMul_972 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1599 for ONNX tensor: 1599 [01/12/2022-09:32:22] [V] [TRT] MatMul_972 [MatMul] outputs: [1599 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_973 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_973 [Unsqueeze] inputs: [1528 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_973 for ONNX node: Unsqueeze_973 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1601 for ONNX tensor: 1601 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_973 [Unsqueeze] outputs: [1601 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_974 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1531 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_974 [Unsqueeze] inputs: [1531 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_974 for ONNX node: Unsqueeze_974 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1603 for ONNX tensor: 1603 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_974 [Unsqueeze] outputs: [1603 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_975 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1597 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_975 [Unsqueeze] inputs: [1597 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_975 for ONNX node: Unsqueeze_975 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1604 for ONNX tensor: 1604 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_975 [Unsqueeze] outputs: [1604 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_976 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1601 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 2984 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1603 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1604 [01/12/2022-09:32:22] [V] [TRT] Concat_976 [Concat] inputs: [1601 -> (1)[INT32]], [2984 -> (1)[INT32]], [1603 -> (1)[INT32]], [1604 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 2984 for ONNX node: 2984 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_976 for ONNX node: Concat_976 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1605 for ONNX tensor: 1605 [01/12/2022-09:32:22] [V] [TRT] Concat_976 [Concat] outputs: [1605 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_977 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1599 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1605 [01/12/2022-09:32:22] [V] [TRT] Reshape_977 [Reshape] inputs: [1599 -> (-1, -1, -1)[FLOAT]], [1605 -> (4)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_977 for ONNX node: Reshape_977 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1606 for ONNX tensor: 1606 [01/12/2022-09:32:22] [V] [TRT] Reshape_977 [Reshape] outputs: [1606 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Add_978 [Add] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1606 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1252 [01/12/2022-09:32:22] [V] [TRT] Add_978 [Add] inputs: [1606 -> (-1, 12, -1, -1)[FLOAT]], [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Add_978 for ONNX node: Add_978 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1607 for ONNX tensor: 1607 [01/12/2022-09:32:22] [V] [TRT] Add_978 [Add] outputs: [1607 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Constant_979 [Constant] [01/12/2022-09:32:22] [V] [TRT] Constant_979 [Constant] inputs: [01/12/2022-09:32:22] [V] [TRT] Constant_979 [Constant] outputs: [1608 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Mul_980 [Mul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1608 [01/12/2022-09:32:22] [V] [TRT] Mul_980 [Mul] inputs: [1528 -> ()[INT32]], [1608 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: 1608 for ONNX node: 1608 [01/12/2022-09:32:22] [V] [TRT] Registering layer: Mul_980 for ONNX node: Mul_980 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1609 for ONNX tensor: 1609 [01/12/2022-09:32:22] [V] [TRT] Mul_980 [Mul] outputs: [1609 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_981 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1609 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_981 [Unsqueeze] inputs: [1609 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_981 for ONNX node: Unsqueeze_981 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1610 for ONNX tensor: 1610 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_981 [Unsqueeze] outputs: [1610 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_982 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1531 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_982 [Unsqueeze] inputs: [1531 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_982 for ONNX node: Unsqueeze_982 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1611 for ONNX tensor: 1611 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_982 [Unsqueeze] outputs: [1611 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Unsqueeze_983 [Unsqueeze] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1597 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_983 [Unsqueeze] inputs: [1597 -> ()[INT32]], [01/12/2022-09:32:22] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:22] [V] [TRT] Registering layer: Unsqueeze_983 for ONNX node: Unsqueeze_983 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1612 for ONNX tensor: 1612 [01/12/2022-09:32:22] [V] [TRT] Unsqueeze_983 [Unsqueeze] outputs: [1612 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Concat_984 [Concat] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1610 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1611 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1612 [01/12/2022-09:32:22] [V] [TRT] Concat_984 [Concat] inputs: [1610 -> (1)[INT32]], [1611 -> (1)[INT32]], [1612 -> (1)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Concat_984 for ONNX node: Concat_984 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1613 for ONNX tensor: 1613 [01/12/2022-09:32:22] [V] [TRT] Concat_984 [Concat] outputs: [1613 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Reshape_985 [Reshape] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1607 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1613 [01/12/2022-09:32:22] [V] [TRT] Reshape_985 [Reshape] inputs: [1607 -> (-1, 12, -1, -1)[FLOAT]], [1613 -> (3)[INT32]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Reshape_985 for ONNX node: Reshape_985 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1614 for ONNX tensor: 1614 [01/12/2022-09:32:22] [V] [TRT] Reshape_985 [Reshape] outputs: [1614 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: Softmax_986 [Softmax] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1614 [01/12/2022-09:32:22] [V] [TRT] Softmax_986 [Softmax] inputs: [1614 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: Softmax_986 for ONNX node: Softmax_986 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1615 for ONNX tensor: 1615 [01/12/2022-09:32:22] [V] [TRT] Softmax_986 [Softmax] outputs: [1615 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Parsing node: MatMul_987 [MatMul] [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1615 [01/12/2022-09:32:22] [V] [TRT] Searching for input: 1594 [01/12/2022-09:32:22] [V] [TRT] MatMul_987 [MatMul] inputs: [1615 -> (-1, -1, -1)[FLOAT]], [1594 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:22] [V] [TRT] Registering layer: MatMul_987 for ONNX node: MatMul_987 [01/12/2022-09:32:22] [V] [TRT] Registering tensor: 1616 for ONNX tensor: 1616 [01/12/2022-09:32:22] [V] [TRT] MatMul_987 [MatMul] outputs: [1616 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Unsqueeze_988 [Unsqueeze] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_988 [Unsqueeze] inputs: [1528 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:23] [V] [TRT] Registering layer: Unsqueeze_988 for ONNX node: Unsqueeze_988 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1619 for ONNX tensor: 1619 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_988 [Unsqueeze] outputs: [1619 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Unsqueeze_989 [Unsqueeze] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1531 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_989 [Unsqueeze] inputs: [1531 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:23] [V] [TRT] Registering layer: Unsqueeze_989 for ONNX node: Unsqueeze_989 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1621 for ONNX tensor: 1621 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_989 [Unsqueeze] outputs: [1621 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Concat_990 [Concat] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1619 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2985 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1621 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2986 [01/12/2022-09:32:23] [V] [TRT] Concat_990 [Concat] inputs: [1619 -> (1)[INT32]], [2985 -> (1)[INT32]], [1621 -> (1)[INT32]], [2986 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2985 for ONNX node: 2985 [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2986 for ONNX node: 2986 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Concat_990 for ONNX node: Concat_990 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1623 for ONNX tensor: 1623 [01/12/2022-09:32:23] [V] [TRT] Concat_990 [Concat] outputs: [1623 -> (4)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Reshape_991 [Reshape] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1616 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1623 [01/12/2022-09:32:23] [V] [TRT] Reshape_991 [Reshape] inputs: [1616 -> (-1, -1, 64)[FLOAT]], [1623 -> (4)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Reshape_991 for ONNX node: Reshape_991 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1624 for ONNX tensor: 1624 [01/12/2022-09:32:23] [V] [TRT] Reshape_991 [Reshape] outputs: [1624 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Transpose_992 [Transpose] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1624 [01/12/2022-09:32:23] [V] [TRT] Transpose_992 [Transpose] inputs: [1624 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Transpose_992 for ONNX node: Transpose_992 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1625 for ONNX tensor: 1625 [01/12/2022-09:32:23] [V] [TRT] Transpose_992 [Transpose] outputs: [1625 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Unsqueeze_993 [Unsqueeze] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1528 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_993 [Unsqueeze] inputs: [1528 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:23] [V] [TRT] Registering layer: Unsqueeze_993 for ONNX node: Unsqueeze_993 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1627 for ONNX tensor: 1627 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_993 [Unsqueeze] outputs: [1627 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Unsqueeze_994 [Unsqueeze] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1531 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_994 [Unsqueeze] inputs: [1531 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:23] [V] [TRT] Registering layer: Unsqueeze_994 for ONNX node: Unsqueeze_994 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1628 for ONNX tensor: 1628 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_994 [Unsqueeze] outputs: [1628 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Concat_995 [Concat] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1627 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1628 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2987 [01/12/2022-09:32:23] [V] [TRT] Concat_995 [Concat] inputs: [1627 -> (1)[INT32]], [1628 -> (1)[INT32]], [2987 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2987 for ONNX node: 2987 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Concat_995 for ONNX node: Concat_995 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1630 for ONNX tensor: 1630 [01/12/2022-09:32:23] [V] [TRT] Concat_995 [Concat] outputs: [1630 -> (3)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Reshape_996 [Reshape] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1625 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1630 [01/12/2022-09:32:23] [V] [TRT] Reshape_996 [Reshape] inputs: [1625 -> (-1, -1, 12, 64)[FLOAT]], [1630 -> (3)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Reshape_996 for ONNX node: Reshape_996 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1631 for ONNX tensor: 1631 [01/12/2022-09:32:23] [V] [TRT] Reshape_996 [Reshape] outputs: [1631 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: MatMul_997 [MatMul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1631 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2988 [01/12/2022-09:32:23] [V] [TRT] MatMul_997 [MatMul] inputs: [1631 -> (-1, -1, 768)[FLOAT]], [2988 -> (768, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2988 for ONNX node: 2988 [01/12/2022-09:32:23] [V] [TRT] Registering layer: MatMul_997 for ONNX node: MatMul_997 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1633 for ONNX tensor: 1633 [01/12/2022-09:32:23] [V] [TRT] MatMul_997 [MatMul] outputs: [1633 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_998 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: decoder.layers.1.self_attn.out_proj.bias [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1633 [01/12/2022-09:32:23] [V] [TRT] Add_998 [Add] inputs: [decoder.layers.1.self_attn.out_proj.bias -> (768)[FLOAT]], [1633 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: decoder.layers.1.self_attn.out_proj.bias for ONNX node: decoder.layers.1.self_attn.out_proj.bias [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_998 for ONNX node: Add_998 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1634 for ONNX tensor: 1634 [01/12/2022-09:32:23] [V] [TRT] Add_998 [Add] outputs: [1634 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_999 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1525 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1634 [01/12/2022-09:32:23] [V] [TRT] Add_999 [Add] inputs: [1525 -> (-1, -1, 768)[FLOAT]], [1634 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_999 for ONNX node: Add_999 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1635 for ONNX tensor: 1635 [01/12/2022-09:32:23] [V] [TRT] Add_999 [Add] outputs: [1635 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: ReduceMean_1000 [ReduceMean] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1635 [01/12/2022-09:32:23] [V] [TRT] ReduceMean_1000 [ReduceMean] inputs: [1635 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: ReduceMean_1000 for ONNX node: ReduceMean_1000 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1636 for ONNX tensor: 1636 [01/12/2022-09:32:23] [V] [TRT] ReduceMean_1000 [ReduceMean] outputs: [1636 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Sub_1001 [Sub] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1635 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1636 [01/12/2022-09:32:23] [V] [TRT] Sub_1001 [Sub] inputs: [1635 -> (-1, -1, 768)[FLOAT]], [1636 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Sub_1001 for ONNX node: Sub_1001 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1637 for ONNX tensor: 1637 [01/12/2022-09:32:23] [V] [TRT] Sub_1001 [Sub] outputs: [1637 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Constant_1002 [Constant] [01/12/2022-09:32:23] [V] [TRT] Constant_1002 [Constant] inputs: [01/12/2022-09:32:23] [V] [TRT] Constant_1002 [Constant] outputs: [1638 -> ()[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Pow_1003 [Pow] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1637 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1638 [01/12/2022-09:32:23] [V] [TRT] Pow_1003 [Pow] inputs: [1637 -> (-1, -1, 768)[FLOAT]], [1638 -> ()[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 1638 for ONNX node: 1638 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Pow_1003 for ONNX node: Pow_1003 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1639 for ONNX tensor: 1639 [01/12/2022-09:32:23] [V] [TRT] Pow_1003 [Pow] outputs: [1639 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: ReduceMean_1004 [ReduceMean] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1639 [01/12/2022-09:32:23] [V] [TRT] ReduceMean_1004 [ReduceMean] inputs: [1639 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: ReduceMean_1004 for ONNX node: ReduceMean_1004 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1640 for ONNX tensor: 1640 [01/12/2022-09:32:23] [V] [TRT] ReduceMean_1004 [ReduceMean] outputs: [1640 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Constant_1005 [Constant] [01/12/2022-09:32:23] [V] [TRT] Constant_1005 [Constant] inputs: [01/12/2022-09:32:23] [V] [TRT] Constant_1005 [Constant] outputs: [1641 -> ()[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_1006 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1640 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1641 [01/12/2022-09:32:23] [V] [TRT] Add_1006 [Add] inputs: [1640 -> (-1, -1, 1)[FLOAT]], [1641 -> ()[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 1641 for ONNX node: 1641 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_1006 for ONNX node: Add_1006 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1642 for ONNX tensor: 1642 [01/12/2022-09:32:23] [V] [TRT] Add_1006 [Add] outputs: [1642 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Sqrt_1007 [Sqrt] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1642 [01/12/2022-09:32:23] [V] [TRT] Sqrt_1007 [Sqrt] inputs: [1642 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Sqrt_1007 for ONNX node: Sqrt_1007 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1643 for ONNX tensor: 1643 [01/12/2022-09:32:23] [V] [TRT] Sqrt_1007 [Sqrt] outputs: [1643 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Div_1008 [Div] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1637 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1643 [01/12/2022-09:32:23] [V] [TRT] Div_1008 [Div] inputs: [1637 -> (-1, -1, 768)[FLOAT]], [1643 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Div_1008 for ONNX node: Div_1008 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1644 for ONNX tensor: 1644 [01/12/2022-09:32:23] [V] [TRT] Div_1008 [Div] outputs: [1644 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Mul_1009 [Mul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1644 [01/12/2022-09:32:23] [V] [TRT] Searching for input: decoder.layers.1.self_attn_layer_norm.weight [01/12/2022-09:32:23] [V] [TRT] Mul_1009 [Mul] inputs: [1644 -> (-1, -1, 768)[FLOAT]], [decoder.layers.1.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: decoder.layers.1.self_attn_layer_norm.weight for ONNX node: decoder.layers.1.self_attn_layer_norm.weight [01/12/2022-09:32:23] [V] [TRT] Registering layer: Mul_1009 for ONNX node: Mul_1009 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1645 for ONNX tensor: 1645 [01/12/2022-09:32:23] [V] [TRT] Mul_1009 [Mul] outputs: [1645 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_1010 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1645 [01/12/2022-09:32:23] [V] [TRT] Searching for input: decoder.layers.1.self_attn_layer_norm.bias [01/12/2022-09:32:23] [V] [TRT] Add_1010 [Add] inputs: [1645 -> (-1, -1, 768)[FLOAT]], [decoder.layers.1.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: decoder.layers.1.self_attn_layer_norm.bias for ONNX node: decoder.layers.1.self_attn_layer_norm.bias [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_1010 for ONNX node: Add_1010 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1646 for ONNX tensor: 1646 [01/12/2022-09:32:23] [V] [TRT] Add_1010 [Add] outputs: [1646 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Shape_1011 [Shape] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1646 [01/12/2022-09:32:23] [V] [TRT] Shape_1011 [Shape] inputs: [1646 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Shape_1011 for ONNX node: Shape_1011 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1647 for ONNX tensor: 1647 [01/12/2022-09:32:23] [V] [TRT] Shape_1011 [Shape] outputs: [1647 -> (3)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Constant_1012 [Constant] [01/12/2022-09:32:23] [V] [TRT] Constant_1012 [Constant] inputs: [01/12/2022-09:32:23] [V] [TRT] Constant_1012 [Constant] outputs: [1648 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Gather_1013 [Gather] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1647 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1648 [01/12/2022-09:32:23] [V] [TRT] Gather_1013 [Gather] inputs: [1647 -> (3)[INT32]], [1648 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 1648 for ONNX node: 1648 [01/12/2022-09:32:23] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Gather_1013 for ONNX node: Gather_1013 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1649 for ONNX tensor: 1649 [01/12/2022-09:32:23] [V] [TRT] Gather_1013 [Gather] outputs: [1649 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Shape_1014 [Shape] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1646 [01/12/2022-09:32:23] [V] [TRT] Shape_1014 [Shape] inputs: [1646 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Shape_1014 for ONNX node: Shape_1014 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1650 for ONNX tensor: 1650 [01/12/2022-09:32:23] [V] [TRT] Shape_1014 [Shape] outputs: [1650 -> (3)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Constant_1015 [Constant] [01/12/2022-09:32:23] [V] [TRT] Constant_1015 [Constant] inputs: [01/12/2022-09:32:23] [V] [TRT] Constant_1015 [Constant] outputs: [1651 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Gather_1016 [Gather] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1650 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1651 [01/12/2022-09:32:23] [V] [TRT] Gather_1016 [Gather] inputs: [1650 -> (3)[INT32]], [1651 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 1651 for ONNX node: 1651 [01/12/2022-09:32:23] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Gather_1016 for ONNX node: Gather_1016 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1652 for ONNX tensor: 1652 [01/12/2022-09:32:23] [V] [TRT] Gather_1016 [Gather] outputs: [1652 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: MatMul_1017 [MatMul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1646 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2989 [01/12/2022-09:32:23] [V] [TRT] MatMul_1017 [MatMul] inputs: [1646 -> (-1, -1, 768)[FLOAT]], [2989 -> (768, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2989 for ONNX node: 2989 [01/12/2022-09:32:23] [V] [TRT] Registering layer: MatMul_1017 for ONNX node: MatMul_1017 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1654 for ONNX tensor: 1654 [01/12/2022-09:32:23] [V] [TRT] MatMul_1017 [MatMul] outputs: [1654 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_1018 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: decoder.layers.1.encoder_attn.q_proj.bias [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1654 [01/12/2022-09:32:23] [V] [TRT] Add_1018 [Add] inputs: [decoder.layers.1.encoder_attn.q_proj.bias -> (768)[FLOAT]], [1654 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: decoder.layers.1.encoder_attn.q_proj.bias for ONNX node: decoder.layers.1.encoder_attn.q_proj.bias [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_1018 for ONNX node: Add_1018 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1655 for ONNX tensor: 1655 [01/12/2022-09:32:23] [V] [TRT] Add_1018 [Add] outputs: [1655 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Constant_1019 [Constant] [01/12/2022-09:32:23] [V] [TRT] Constant_1019 [Constant] inputs: [01/12/2022-09:32:23] [V] [TRT] Constant_1019 [Constant] outputs: [1656 -> ()[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Mul_1020 [Mul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1655 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1656 [01/12/2022-09:32:23] [V] [TRT] Mul_1020 [Mul] inputs: [1655 -> (-1, -1, 768)[FLOAT]], [1656 -> ()[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 1656 for ONNX node: 1656 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Mul_1020 for ONNX node: Mul_1020 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1657 for ONNX tensor: 1657 [01/12/2022-09:32:23] [V] [TRT] Mul_1020 [Mul] outputs: [1657 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: MatMul_1021 [MatMul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2990 [01/12/2022-09:32:23] [V] [TRT] MatMul_1021 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [2990 -> (768, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2990 for ONNX node: 2990 [01/12/2022-09:32:23] [V] [TRT] Registering layer: MatMul_1021 for ONNX node: MatMul_1021 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1659 for ONNX tensor: 1659 [01/12/2022-09:32:23] [V] [TRT] MatMul_1021 [MatMul] outputs: [1659 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_1022 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: decoder.layers.1.encoder_attn.k_proj.bias [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1659 [01/12/2022-09:32:23] [V] [TRT] Add_1022 [Add] inputs: [decoder.layers.1.encoder_attn.k_proj.bias -> (768)[FLOAT]], [1659 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: decoder.layers.1.encoder_attn.k_proj.bias for ONNX node: decoder.layers.1.encoder_attn.k_proj.bias [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_1022 for ONNX node: Add_1022 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1660 for ONNX tensor: 1660 [01/12/2022-09:32:23] [V] [TRT] Add_1022 [Add] outputs: [1660 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Unsqueeze_1023 [Unsqueeze] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1649 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_1023 [Unsqueeze] inputs: [1649 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:23] [V] [TRT] Registering layer: Unsqueeze_1023 for ONNX node: Unsqueeze_1023 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1664 for ONNX tensor: 1664 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_1023 [Unsqueeze] outputs: [1664 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Concat_1024 [Concat] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1664 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2991 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2992 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2993 [01/12/2022-09:32:23] [V] [TRT] Concat_1024 [Concat] inputs: [1664 -> (1)[INT32]], [2991 -> (1)[INT32]], [2992 -> (1)[INT32]], [2993 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2991 for ONNX node: 2991 [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2992 for ONNX node: 2992 [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2993 for ONNX node: 2993 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Concat_1024 for ONNX node: Concat_1024 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1668 for ONNX tensor: 1668 [01/12/2022-09:32:23] [V] [TRT] Concat_1024 [Concat] outputs: [1668 -> (4)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Reshape_1025 [Reshape] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1660 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1668 [01/12/2022-09:32:23] [V] [TRT] Reshape_1025 [Reshape] inputs: [1660 -> (-1, -1, 768)[FLOAT]], [1668 -> (4)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Reshape_1025 for ONNX node: Reshape_1025 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1669 for ONNX tensor: 1669 [01/12/2022-09:32:23] [V] [TRT] Reshape_1025 [Reshape] outputs: [1669 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Transpose_1026 [Transpose] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1669 [01/12/2022-09:32:23] [V] [TRT] Transpose_1026 [Transpose] inputs: [1669 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Transpose_1026 for ONNX node: Transpose_1026 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1670_8 for ONNX tensor: 1670 [01/12/2022-09:32:23] [V] [TRT] Transpose_1026 [Transpose] outputs: [1670 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: MatMul_1027 [MatMul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2994 [01/12/2022-09:32:23] [V] [TRT] MatMul_1027 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [2994 -> (768, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2994 for ONNX node: 2994 [01/12/2022-09:32:23] [V] [TRT] Registering layer: MatMul_1027 for ONNX node: MatMul_1027 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1672 for ONNX tensor: 1672 [01/12/2022-09:32:23] [V] [TRT] MatMul_1027 [MatMul] outputs: [1672 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Add_1028 [Add] [01/12/2022-09:32:23] [V] [TRT] Searching for input: decoder.layers.1.encoder_attn.v_proj.bias [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1672 [01/12/2022-09:32:23] [V] [TRT] Add_1028 [Add] inputs: [decoder.layers.1.encoder_attn.v_proj.bias -> (768)[FLOAT]], [1672 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: decoder.layers.1.encoder_attn.v_proj.bias for ONNX node: decoder.layers.1.encoder_attn.v_proj.bias [01/12/2022-09:32:23] [V] [TRT] Registering layer: Add_1028 for ONNX node: Add_1028 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1673 for ONNX tensor: 1673 [01/12/2022-09:32:23] [V] [TRT] Add_1028 [Add] outputs: [1673 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Unsqueeze_1029 [Unsqueeze] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1649 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_1029 [Unsqueeze] inputs: [1649 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:23] [V] [TRT] Registering layer: Unsqueeze_1029 for ONNX node: Unsqueeze_1029 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1677 for ONNX tensor: 1677 [01/12/2022-09:32:23] [V] [TRT] Unsqueeze_1029 [Unsqueeze] outputs: [1677 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Concat_1030 [Concat] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1677 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2995 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2996 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 2997 [01/12/2022-09:32:23] [V] [TRT] Concat_1030 [Concat] inputs: [1677 -> (1)[INT32]], [2995 -> (1)[INT32]], [2996 -> (1)[INT32]], [2997 -> (1)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2995 for ONNX node: 2995 [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2996 for ONNX node: 2996 [01/12/2022-09:32:23] [V] [TRT] Registering layer: 2997 for ONNX node: 2997 [01/12/2022-09:32:23] [V] [TRT] Registering layer: Concat_1030 for ONNX node: Concat_1030 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1681 for ONNX tensor: 1681 [01/12/2022-09:32:23] [V] [TRT] Concat_1030 [Concat] outputs: [1681 -> (4)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Reshape_1031 [Reshape] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1673 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1681 [01/12/2022-09:32:23] [V] [TRT] Reshape_1031 [Reshape] inputs: [1673 -> (-1, -1, 768)[FLOAT]], [1681 -> (4)[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Reshape_1031 for ONNX node: Reshape_1031 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1682 for ONNX tensor: 1682 [01/12/2022-09:32:23] [V] [TRT] Reshape_1031 [Reshape] outputs: [1682 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Transpose_1032 [Transpose] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1682 [01/12/2022-09:32:23] [V] [TRT] Transpose_1032 [Transpose] inputs: [1682 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: Transpose_1032 for ONNX node: Transpose_1032 [01/12/2022-09:32:23] [V] [TRT] Registering tensor: 1683_9 for ONNX tensor: 1683 [01/12/2022-09:32:23] [V] [TRT] Transpose_1032 [Transpose] outputs: [1683 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Constant_1033 [Constant] [01/12/2022-09:32:23] [V] [TRT] Constant_1033 [Constant] inputs: [01/12/2022-09:32:23] [V] [TRT] Constant_1033 [Constant] outputs: [1684 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Parsing node: Mul_1034 [Mul] [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1649 [01/12/2022-09:32:23] [V] [TRT] Searching for input: 1684 [01/12/2022-09:32:23] [V] [TRT] Mul_1034 [Mul] inputs: [1649 -> ()[INT32]], [1684 -> ()[INT32]], [01/12/2022-09:32:23] [V] [TRT] Registering layer: 1684 for ONNX node: 1684 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Mul_1034 for ONNX node: Mul_1034 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1685 for ONNX tensor: 1685 [01/12/2022-09:32:24] [V] [TRT] Mul_1034 [Mul] outputs: [1685 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1035 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1649 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1035 [Unsqueeze] inputs: [1649 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1035 for ONNX node: Unsqueeze_1035 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1688 for ONNX tensor: 1688 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1035 [Unsqueeze] outputs: [1688 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1036 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1652 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1036 [Unsqueeze] inputs: [1652 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1036 for ONNX node: Unsqueeze_1036 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1689 for ONNX tensor: 1689 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1036 [Unsqueeze] outputs: [1689 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Concat_1037 [Concat] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1688 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1689 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 2998 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 2999 [01/12/2022-09:32:24] [V] [TRT] Concat_1037 [Concat] inputs: [1688 -> (1)[INT32]], [1689 -> (1)[INT32]], [2998 -> (1)[INT32]], [2999 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 2998 for ONNX node: 2998 [01/12/2022-09:32:24] [V] [TRT] Registering layer: 2999 for ONNX node: 2999 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Concat_1037 for ONNX node: Concat_1037 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1692 for ONNX tensor: 1692 [01/12/2022-09:32:24] [V] [TRT] Concat_1037 [Concat] outputs: [1692 -> (4)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Reshape_1038 [Reshape] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1657 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1692 [01/12/2022-09:32:24] [V] [TRT] Reshape_1038 [Reshape] inputs: [1657 -> (-1, -1, 768)[FLOAT]], [1692 -> (4)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Reshape_1038 for ONNX node: Reshape_1038 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1693 for ONNX tensor: 1693 [01/12/2022-09:32:24] [V] [TRT] Reshape_1038 [Reshape] outputs: [1693 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Transpose_1039 [Transpose] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1693 [01/12/2022-09:32:24] [V] [TRT] Transpose_1039 [Transpose] inputs: [1693 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Transpose_1039 for ONNX node: Transpose_1039 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1694 for ONNX tensor: 1694 [01/12/2022-09:32:24] [V] [TRT] Transpose_1039 [Transpose] outputs: [1694 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1040 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1685 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1040 [Unsqueeze] inputs: [1685 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1040 for ONNX node: Unsqueeze_1040 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1697 for ONNX tensor: 1697 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1040 [Unsqueeze] outputs: [1697 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Concat_1041 [Concat] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1697 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3000 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3001 [01/12/2022-09:32:24] [V] [TRT] Concat_1041 [Concat] inputs: [1697 -> (1)[INT32]], [3000 -> (1)[INT32]], [3001 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3000 for ONNX node: 3000 [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3001 for ONNX node: 3001 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Concat_1041 for ONNX node: Concat_1041 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1700 for ONNX tensor: 1700 [01/12/2022-09:32:24] [V] [TRT] Concat_1041 [Concat] outputs: [1700 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Reshape_1042 [Reshape] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1694 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1700 [01/12/2022-09:32:24] [V] [TRT] Reshape_1042 [Reshape] inputs: [1694 -> (-1, 12, -1, 64)[FLOAT]], [1700 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Reshape_1042 for ONNX node: Reshape_1042 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1701 for ONNX tensor: 1701 [01/12/2022-09:32:24] [V] [TRT] Reshape_1042 [Reshape] outputs: [1701 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1043 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1685 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1043 [Unsqueeze] inputs: [1685 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1043 for ONNX node: Unsqueeze_1043 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1704 for ONNX tensor: 1704 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1043 [Unsqueeze] outputs: [1704 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Concat_1044 [Concat] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1704 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3002 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3003 [01/12/2022-09:32:24] [V] [TRT] Concat_1044 [Concat] inputs: [1704 -> (1)[INT32]], [3002 -> (1)[INT32]], [3003 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3002 for ONNX node: 3002 [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3003 for ONNX node: 3003 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Concat_1044 for ONNX node: Concat_1044 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1707 for ONNX tensor: 1707 [01/12/2022-09:32:24] [V] [TRT] Concat_1044 [Concat] outputs: [1707 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Reshape_1045 [Reshape] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1670 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1707 [01/12/2022-09:32:24] [V] [TRT] Reshape_1045 [Reshape] inputs: [1670 -> (-1, 12, -1, 64)[FLOAT]], [1707 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Reshape_1045 for ONNX node: Reshape_1045 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1708 for ONNX tensor: 1708 [01/12/2022-09:32:24] [V] [TRT] Reshape_1045 [Reshape] outputs: [1708 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1046 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1685 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1046 [Unsqueeze] inputs: [1685 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1046 for ONNX node: Unsqueeze_1046 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1711 for ONNX tensor: 1711 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1046 [Unsqueeze] outputs: [1711 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Concat_1047 [Concat] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1711 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3004 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3005 [01/12/2022-09:32:24] [V] [TRT] Concat_1047 [Concat] inputs: [1711 -> (1)[INT32]], [3004 -> (1)[INT32]], [3005 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3004 for ONNX node: 3004 [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3005 for ONNX node: 3005 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Concat_1047 for ONNX node: Concat_1047 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1714 for ONNX tensor: 1714 [01/12/2022-09:32:24] [V] [TRT] Concat_1047 [Concat] outputs: [1714 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Reshape_1048 [Reshape] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1683 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1714 [01/12/2022-09:32:24] [V] [TRT] Reshape_1048 [Reshape] inputs: [1683 -> (-1, 12, -1, 64)[FLOAT]], [1714 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Reshape_1048 for ONNX node: Reshape_1048 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1715 for ONNX tensor: 1715 [01/12/2022-09:32:24] [V] [TRT] Reshape_1048 [Reshape] outputs: [1715 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Transpose_1049 [Transpose] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1708 [01/12/2022-09:32:24] [V] [TRT] Transpose_1049 [Transpose] inputs: [1708 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Transpose_1049 for ONNX node: Transpose_1049 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1716 for ONNX tensor: 1716 [01/12/2022-09:32:24] [V] [TRT] Transpose_1049 [Transpose] outputs: [1716 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: MatMul_1050 [MatMul] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1701 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1716 [01/12/2022-09:32:24] [V] [TRT] MatMul_1050 [MatMul] inputs: [1701 -> (-1, -1, 64)[FLOAT]], [1716 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: MatMul_1050 for ONNX node: MatMul_1050 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1717 for ONNX tensor: 1717 [01/12/2022-09:32:24] [V] [TRT] MatMul_1050 [MatMul] outputs: [1717 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Softmax_1051 [Softmax] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1717 [01/12/2022-09:32:24] [V] [TRT] Softmax_1051 [Softmax] inputs: [1717 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Softmax_1051 for ONNX node: Softmax_1051 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1718 for ONNX tensor: 1718 [01/12/2022-09:32:24] [V] [TRT] Softmax_1051 [Softmax] outputs: [1718 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: MatMul_1052 [MatMul] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1718 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1715 [01/12/2022-09:32:24] [V] [TRT] MatMul_1052 [MatMul] inputs: [1718 -> (-1, -1, -1)[FLOAT]], [1715 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: MatMul_1052 for ONNX node: MatMul_1052 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1719 for ONNX tensor: 1719 [01/12/2022-09:32:24] [V] [TRT] MatMul_1052 [MatMul] outputs: [1719 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1053 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1649 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1053 [Unsqueeze] inputs: [1649 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1053 for ONNX node: Unsqueeze_1053 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1722 for ONNX tensor: 1722 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1053 [Unsqueeze] outputs: [1722 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1054 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1652 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1054 [Unsqueeze] inputs: [1652 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1054 for ONNX node: Unsqueeze_1054 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1724 for ONNX tensor: 1724 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1054 [Unsqueeze] outputs: [1724 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Concat_1055 [Concat] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1722 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3006 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1724 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3007 [01/12/2022-09:32:24] [V] [TRT] Concat_1055 [Concat] inputs: [1722 -> (1)[INT32]], [3006 -> (1)[INT32]], [1724 -> (1)[INT32]], [3007 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3006 for ONNX node: 3006 [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3007 for ONNX node: 3007 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Concat_1055 for ONNX node: Concat_1055 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1726 for ONNX tensor: 1726 [01/12/2022-09:32:24] [V] [TRT] Concat_1055 [Concat] outputs: [1726 -> (4)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Reshape_1056 [Reshape] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1719 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1726 [01/12/2022-09:32:24] [V] [TRT] Reshape_1056 [Reshape] inputs: [1719 -> (-1, -1, 64)[FLOAT]], [1726 -> (4)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Reshape_1056 for ONNX node: Reshape_1056 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1727 for ONNX tensor: 1727 [01/12/2022-09:32:24] [V] [TRT] Reshape_1056 [Reshape] outputs: [1727 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Transpose_1057 [Transpose] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1727 [01/12/2022-09:32:24] [V] [TRT] Transpose_1057 [Transpose] inputs: [1727 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Transpose_1057 for ONNX node: Transpose_1057 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1728 for ONNX tensor: 1728 [01/12/2022-09:32:24] [V] [TRT] Transpose_1057 [Transpose] outputs: [1728 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1058 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1649 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1058 [Unsqueeze] inputs: [1649 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1058 for ONNX node: Unsqueeze_1058 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1730 for ONNX tensor: 1730 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1058 [Unsqueeze] outputs: [1730 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Unsqueeze_1059 [Unsqueeze] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1652 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1059 [Unsqueeze] inputs: [1652 -> ()[INT32]], [01/12/2022-09:32:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:24] [V] [TRT] Registering layer: Unsqueeze_1059 for ONNX node: Unsqueeze_1059 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1731 for ONNX tensor: 1731 [01/12/2022-09:32:24] [V] [TRT] Unsqueeze_1059 [Unsqueeze] outputs: [1731 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Concat_1060 [Concat] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1730 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1731 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3008 [01/12/2022-09:32:24] [V] [TRT] Concat_1060 [Concat] inputs: [1730 -> (1)[INT32]], [1731 -> (1)[INT32]], [3008 -> (1)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3008 for ONNX node: 3008 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Concat_1060 for ONNX node: Concat_1060 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1733 for ONNX tensor: 1733 [01/12/2022-09:32:24] [V] [TRT] Concat_1060 [Concat] outputs: [1733 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Reshape_1061 [Reshape] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1728 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1733 [01/12/2022-09:32:24] [V] [TRT] Reshape_1061 [Reshape] inputs: [1728 -> (-1, -1, 12, 64)[FLOAT]], [1733 -> (3)[INT32]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Reshape_1061 for ONNX node: Reshape_1061 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1734 for ONNX tensor: 1734 [01/12/2022-09:32:24] [V] [TRT] Reshape_1061 [Reshape] outputs: [1734 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: MatMul_1062 [MatMul] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1734 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 3009 [01/12/2022-09:32:24] [V] [TRT] MatMul_1062 [MatMul] inputs: [1734 -> (-1, -1, 768)[FLOAT]], [3009 -> (768, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 3009 for ONNX node: 3009 [01/12/2022-09:32:24] [V] [TRT] Registering layer: MatMul_1062 for ONNX node: MatMul_1062 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1736 for ONNX tensor: 1736 [01/12/2022-09:32:24] [V] [TRT] MatMul_1062 [MatMul] outputs: [1736 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Add_1063 [Add] [01/12/2022-09:32:24] [V] [TRT] Searching for input: decoder.layers.1.encoder_attn.out_proj.bias [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1736 [01/12/2022-09:32:24] [V] [TRT] Add_1063 [Add] inputs: [decoder.layers.1.encoder_attn.out_proj.bias -> (768)[FLOAT]], [1736 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: decoder.layers.1.encoder_attn.out_proj.bias for ONNX node: decoder.layers.1.encoder_attn.out_proj.bias [01/12/2022-09:32:24] [V] [TRT] Registering layer: Add_1063 for ONNX node: Add_1063 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1737 for ONNX tensor: 1737 [01/12/2022-09:32:24] [V] [TRT] Add_1063 [Add] outputs: [1737 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Add_1064 [Add] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1646 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1737 [01/12/2022-09:32:24] [V] [TRT] Add_1064 [Add] inputs: [1646 -> (-1, -1, 768)[FLOAT]], [1737 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Add_1064 for ONNX node: Add_1064 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1738 for ONNX tensor: 1738 [01/12/2022-09:32:24] [V] [TRT] Add_1064 [Add] outputs: [1738 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: ReduceMean_1065 [ReduceMean] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1738 [01/12/2022-09:32:24] [V] [TRT] ReduceMean_1065 [ReduceMean] inputs: [1738 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: ReduceMean_1065 for ONNX node: ReduceMean_1065 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1739 for ONNX tensor: 1739 [01/12/2022-09:32:24] [V] [TRT] ReduceMean_1065 [ReduceMean] outputs: [1739 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Sub_1066 [Sub] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1738 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1739 [01/12/2022-09:32:24] [V] [TRT] Sub_1066 [Sub] inputs: [1738 -> (-1, -1, 768)[FLOAT]], [1739 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Sub_1066 for ONNX node: Sub_1066 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1740 for ONNX tensor: 1740 [01/12/2022-09:32:24] [V] [TRT] Sub_1066 [Sub] outputs: [1740 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Constant_1067 [Constant] [01/12/2022-09:32:24] [V] [TRT] Constant_1067 [Constant] inputs: [01/12/2022-09:32:24] [V] [TRT] Constant_1067 [Constant] outputs: [1741 -> ()[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Pow_1068 [Pow] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1740 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1741 [01/12/2022-09:32:24] [V] [TRT] Pow_1068 [Pow] inputs: [1740 -> (-1, -1, 768)[FLOAT]], [1741 -> ()[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 1741 for ONNX node: 1741 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Pow_1068 for ONNX node: Pow_1068 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1742 for ONNX tensor: 1742 [01/12/2022-09:32:24] [V] [TRT] Pow_1068 [Pow] outputs: [1742 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: ReduceMean_1069 [ReduceMean] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1742 [01/12/2022-09:32:24] [V] [TRT] ReduceMean_1069 [ReduceMean] inputs: [1742 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: ReduceMean_1069 for ONNX node: ReduceMean_1069 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1743 for ONNX tensor: 1743 [01/12/2022-09:32:24] [V] [TRT] ReduceMean_1069 [ReduceMean] outputs: [1743 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Constant_1070 [Constant] [01/12/2022-09:32:24] [V] [TRT] Constant_1070 [Constant] inputs: [01/12/2022-09:32:24] [V] [TRT] Constant_1070 [Constant] outputs: [1744 -> ()[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Add_1071 [Add] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1743 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1744 [01/12/2022-09:32:24] [V] [TRT] Add_1071 [Add] inputs: [1743 -> (-1, -1, 1)[FLOAT]], [1744 -> ()[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: 1744 for ONNX node: 1744 [01/12/2022-09:32:24] [V] [TRT] Registering layer: Add_1071 for ONNX node: Add_1071 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1745 for ONNX tensor: 1745 [01/12/2022-09:32:24] [V] [TRT] Add_1071 [Add] outputs: [1745 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Sqrt_1072 [Sqrt] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1745 [01/12/2022-09:32:24] [V] [TRT] Sqrt_1072 [Sqrt] inputs: [1745 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Sqrt_1072 for ONNX node: Sqrt_1072 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1746 for ONNX tensor: 1746 [01/12/2022-09:32:24] [V] [TRT] Sqrt_1072 [Sqrt] outputs: [1746 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Div_1073 [Div] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1740 [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1746 [01/12/2022-09:32:24] [V] [TRT] Div_1073 [Div] inputs: [1740 -> (-1, -1, 768)[FLOAT]], [1746 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: Div_1073 for ONNX node: Div_1073 [01/12/2022-09:32:24] [V] [TRT] Registering tensor: 1747 for ONNX tensor: 1747 [01/12/2022-09:32:24] [V] [TRT] Div_1073 [Div] outputs: [1747 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Parsing node: Mul_1074 [Mul] [01/12/2022-09:32:24] [V] [TRT] Searching for input: 1747 [01/12/2022-09:32:24] [V] [TRT] Searching for input: decoder.layers.1.encoder_attn_layer_norm.weight [01/12/2022-09:32:24] [V] [TRT] Mul_1074 [Mul] inputs: [1747 -> (-1, -1, 768)[FLOAT]], [decoder.layers.1.encoder_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:24] [V] [TRT] Registering layer: decoder.layers.1.encoder_attn_layer_norm.weight for ONNX node: decoder.layers.1.encoder_attn_layer_norm.weight [01/12/2022-09:32:24] [V] [TRT] Registering layer: Mul_1074 for ONNX node: Mul_1074 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1748 for ONNX tensor: 1748 [01/12/2022-09:32:25] [V] [TRT] Mul_1074 [Mul] outputs: [1748 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1075 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1748 [01/12/2022-09:32:25] [V] [TRT] Searching for input: decoder.layers.1.encoder_attn_layer_norm.bias [01/12/2022-09:32:25] [V] [TRT] Add_1075 [Add] inputs: [1748 -> (-1, -1, 768)[FLOAT]], [decoder.layers.1.encoder_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: decoder.layers.1.encoder_attn_layer_norm.bias for ONNX node: decoder.layers.1.encoder_attn_layer_norm.bias [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1075 for ONNX node: Add_1075 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1749 for ONNX tensor: 1749 [01/12/2022-09:32:25] [V] [TRT] Add_1075 [Add] outputs: [1749 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: MatMul_1076 [MatMul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1749 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 3010 [01/12/2022-09:32:25] [V] [TRT] MatMul_1076 [MatMul] inputs: [1749 -> (-1, -1, 768)[FLOAT]], [3010 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 3010 for ONNX node: 3010 [01/12/2022-09:32:25] [V] [TRT] Registering layer: MatMul_1076 for ONNX node: MatMul_1076 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1751 for ONNX tensor: 1751 [01/12/2022-09:32:25] [V] [TRT] MatMul_1076 [MatMul] outputs: [1751 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1077 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: decoder.layers.1.fc1.bias [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1751 [01/12/2022-09:32:25] [V] [TRT] Add_1077 [Add] inputs: [decoder.layers.1.fc1.bias -> (3072)[FLOAT]], [1751 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: decoder.layers.1.fc1.bias for ONNX node: decoder.layers.1.fc1.bias [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1077 for ONNX node: Add_1077 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1752 for ONNX tensor: 1752 [01/12/2022-09:32:25] [V] [TRT] Add_1077 [Add] outputs: [1752 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1078 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1078 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1078 [Constant] outputs: [1753 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Div_1079 [Div] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1752 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1753 [01/12/2022-09:32:25] [V] [TRT] Div_1079 [Div] inputs: [1752 -> (-1, -1, 3072)[FLOAT]], [1753 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1753 for ONNX node: 1753 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Div_1079 for ONNX node: Div_1079 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1754 for ONNX tensor: 1754 [01/12/2022-09:32:25] [V] [TRT] Div_1079 [Div] outputs: [1754 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Erf_1080 [Erf] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1754 [01/12/2022-09:32:25] [V] [TRT] Erf_1080 [Erf] inputs: [1754 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Erf_1080 for ONNX node: Erf_1080 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1755 for ONNX tensor: 1755 [01/12/2022-09:32:25] [V] [TRT] Erf_1080 [Erf] outputs: [1755 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1081 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1081 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1081 [Constant] outputs: [1756 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1082 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1755 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1756 [01/12/2022-09:32:25] [V] [TRT] Add_1082 [Add] inputs: [1755 -> (-1, -1, 3072)[FLOAT]], [1756 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1756 for ONNX node: 1756 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1082 for ONNX node: Add_1082 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1757 for ONNX tensor: 1757 [01/12/2022-09:32:25] [V] [TRT] Add_1082 [Add] outputs: [1757 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Mul_1083 [Mul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1752 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1757 [01/12/2022-09:32:25] [V] [TRT] Mul_1083 [Mul] inputs: [1752 -> (-1, -1, 3072)[FLOAT]], [1757 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Mul_1083 for ONNX node: Mul_1083 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1758 for ONNX tensor: 1758 [01/12/2022-09:32:25] [V] [TRT] Mul_1083 [Mul] outputs: [1758 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1084 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1084 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1084 [Constant] outputs: [1759 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Mul_1085 [Mul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1758 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1759 [01/12/2022-09:32:25] [V] [TRT] Mul_1085 [Mul] inputs: [1758 -> (-1, -1, 3072)[FLOAT]], [1759 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1759 for ONNX node: 1759 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Mul_1085 for ONNX node: Mul_1085 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1760 for ONNX tensor: 1760 [01/12/2022-09:32:25] [V] [TRT] Mul_1085 [Mul] outputs: [1760 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: MatMul_1086 [MatMul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1760 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 3011 [01/12/2022-09:32:25] [V] [TRT] MatMul_1086 [MatMul] inputs: [1760 -> (-1, -1, 3072)[FLOAT]], [3011 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 3011 for ONNX node: 3011 [01/12/2022-09:32:25] [V] [TRT] Registering layer: MatMul_1086 for ONNX node: MatMul_1086 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1762 for ONNX tensor: 1762 [01/12/2022-09:32:25] [V] [TRT] MatMul_1086 [MatMul] outputs: [1762 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1087 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: decoder.layers.1.fc2.bias [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1762 [01/12/2022-09:32:25] [V] [TRT] Add_1087 [Add] inputs: [decoder.layers.1.fc2.bias -> (768)[FLOAT]], [1762 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: decoder.layers.1.fc2.bias for ONNX node: decoder.layers.1.fc2.bias [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1087 for ONNX node: Add_1087 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1763 for ONNX tensor: 1763 [01/12/2022-09:32:25] [V] [TRT] Add_1087 [Add] outputs: [1763 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1088 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1749 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1763 [01/12/2022-09:32:25] [V] [TRT] Add_1088 [Add] inputs: [1749 -> (-1, -1, 768)[FLOAT]], [1763 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1088 for ONNX node: Add_1088 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1764 for ONNX tensor: 1764 [01/12/2022-09:32:25] [V] [TRT] Add_1088 [Add] outputs: [1764 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: ReduceMean_1089 [ReduceMean] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1764 [01/12/2022-09:32:25] [V] [TRT] ReduceMean_1089 [ReduceMean] inputs: [1764 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: ReduceMean_1089 for ONNX node: ReduceMean_1089 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1765 for ONNX tensor: 1765 [01/12/2022-09:32:25] [V] [TRT] ReduceMean_1089 [ReduceMean] outputs: [1765 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Sub_1090 [Sub] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1764 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1765 [01/12/2022-09:32:25] [V] [TRT] Sub_1090 [Sub] inputs: [1764 -> (-1, -1, 768)[FLOAT]], [1765 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Sub_1090 for ONNX node: Sub_1090 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1766 for ONNX tensor: 1766 [01/12/2022-09:32:25] [V] [TRT] Sub_1090 [Sub] outputs: [1766 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1091 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1091 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1091 [Constant] outputs: [1767 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Pow_1092 [Pow] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1766 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1767 [01/12/2022-09:32:25] [V] [TRT] Pow_1092 [Pow] inputs: [1766 -> (-1, -1, 768)[FLOAT]], [1767 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1767 for ONNX node: 1767 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Pow_1092 for ONNX node: Pow_1092 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1768 for ONNX tensor: 1768 [01/12/2022-09:32:25] [V] [TRT] Pow_1092 [Pow] outputs: [1768 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: ReduceMean_1093 [ReduceMean] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1768 [01/12/2022-09:32:25] [V] [TRT] ReduceMean_1093 [ReduceMean] inputs: [1768 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: ReduceMean_1093 for ONNX node: ReduceMean_1093 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1769 for ONNX tensor: 1769 [01/12/2022-09:32:25] [V] [TRT] ReduceMean_1093 [ReduceMean] outputs: [1769 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1094 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1094 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1094 [Constant] outputs: [1770 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1095 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1769 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1770 [01/12/2022-09:32:25] [V] [TRT] Add_1095 [Add] inputs: [1769 -> (-1, -1, 1)[FLOAT]], [1770 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1770 for ONNX node: 1770 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1095 for ONNX node: Add_1095 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1771 for ONNX tensor: 1771 [01/12/2022-09:32:25] [V] [TRT] Add_1095 [Add] outputs: [1771 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Sqrt_1096 [Sqrt] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1771 [01/12/2022-09:32:25] [V] [TRT] Sqrt_1096 [Sqrt] inputs: [1771 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Sqrt_1096 for ONNX node: Sqrt_1096 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1772 for ONNX tensor: 1772 [01/12/2022-09:32:25] [V] [TRT] Sqrt_1096 [Sqrt] outputs: [1772 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Div_1097 [Div] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1766 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1772 [01/12/2022-09:32:25] [V] [TRT] Div_1097 [Div] inputs: [1766 -> (-1, -1, 768)[FLOAT]], [1772 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Div_1097 for ONNX node: Div_1097 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1773 for ONNX tensor: 1773 [01/12/2022-09:32:25] [V] [TRT] Div_1097 [Div] outputs: [1773 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Mul_1098 [Mul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1773 [01/12/2022-09:32:25] [V] [TRT] Searching for input: decoder.layers.1.final_layer_norm.weight [01/12/2022-09:32:25] [V] [TRT] Mul_1098 [Mul] inputs: [1773 -> (-1, -1, 768)[FLOAT]], [decoder.layers.1.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: decoder.layers.1.final_layer_norm.weight for ONNX node: decoder.layers.1.final_layer_norm.weight [01/12/2022-09:32:25] [V] [TRT] Registering layer: Mul_1098 for ONNX node: Mul_1098 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1774 for ONNX tensor: 1774 [01/12/2022-09:32:25] [V] [TRT] Mul_1098 [Mul] outputs: [1774 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1099 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1774 [01/12/2022-09:32:25] [V] [TRT] Searching for input: decoder.layers.1.final_layer_norm.bias [01/12/2022-09:32:25] [V] [TRT] Add_1099 [Add] inputs: [1774 -> (-1, -1, 768)[FLOAT]], [decoder.layers.1.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: decoder.layers.1.final_layer_norm.bias for ONNX node: decoder.layers.1.final_layer_norm.bias [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1099 for ONNX node: Add_1099 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1775 for ONNX tensor: 1775 [01/12/2022-09:32:25] [V] [TRT] Add_1099 [Add] outputs: [1775 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Shape_1100 [Shape] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1775 [01/12/2022-09:32:25] [V] [TRT] Shape_1100 [Shape] inputs: [1775 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Shape_1100 for ONNX node: Shape_1100 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1776 for ONNX tensor: 1776 [01/12/2022-09:32:25] [V] [TRT] Shape_1100 [Shape] outputs: [1776 -> (3)[INT32]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1101 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1101 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1101 [Constant] outputs: [1777 -> ()[INT32]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Gather_1102 [Gather] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1776 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1777 [01/12/2022-09:32:25] [V] [TRT] Gather_1102 [Gather] inputs: [1776 -> (3)[INT32]], [1777 -> ()[INT32]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1777 for ONNX node: 1777 [01/12/2022-09:32:25] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Gather_1102 for ONNX node: Gather_1102 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1778 for ONNX tensor: 1778 [01/12/2022-09:32:25] [V] [TRT] Gather_1102 [Gather] outputs: [1778 -> ()[INT32]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Shape_1103 [Shape] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1775 [01/12/2022-09:32:25] [V] [TRT] Shape_1103 [Shape] inputs: [1775 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: Shape_1103 for ONNX node: Shape_1103 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1779 for ONNX tensor: 1779 [01/12/2022-09:32:25] [V] [TRT] Shape_1103 [Shape] outputs: [1779 -> (3)[INT32]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1104 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1104 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1104 [Constant] outputs: [1780 -> ()[INT32]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Gather_1105 [Gather] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1779 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1780 [01/12/2022-09:32:25] [V] [TRT] Gather_1105 [Gather] inputs: [1779 -> (3)[INT32]], [1780 -> ()[INT32]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1780 for ONNX node: 1780 [01/12/2022-09:32:25] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:25] [V] [TRT] Registering layer: Gather_1105 for ONNX node: Gather_1105 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1781 for ONNX tensor: 1781 [01/12/2022-09:32:25] [V] [TRT] Gather_1105 [Gather] outputs: [1781 -> ()[INT32]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: MatMul_1106 [MatMul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1775 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 3012 [01/12/2022-09:32:25] [V] [TRT] MatMul_1106 [MatMul] inputs: [1775 -> (-1, -1, 768)[FLOAT]], [3012 -> (768, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 3012 for ONNX node: 3012 [01/12/2022-09:32:25] [V] [TRT] Registering layer: MatMul_1106 for ONNX node: MatMul_1106 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1783 for ONNX tensor: 1783 [01/12/2022-09:32:25] [V] [TRT] MatMul_1106 [MatMul] outputs: [1783 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Add_1107 [Add] [01/12/2022-09:32:25] [V] [TRT] Searching for input: decoder.layers.2.self_attn.q_proj.bias [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1783 [01/12/2022-09:32:25] [V] [TRT] Add_1107 [Add] inputs: [decoder.layers.2.self_attn.q_proj.bias -> (768)[FLOAT]], [1783 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: decoder.layers.2.self_attn.q_proj.bias for ONNX node: decoder.layers.2.self_attn.q_proj.bias [01/12/2022-09:32:25] [V] [TRT] Registering layer: Add_1107 for ONNX node: Add_1107 [01/12/2022-09:32:25] [V] [TRT] Registering tensor: 1784 for ONNX tensor: 1784 [01/12/2022-09:32:25] [V] [TRT] Add_1107 [Add] outputs: [1784 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Constant_1108 [Constant] [01/12/2022-09:32:25] [V] [TRT] Constant_1108 [Constant] inputs: [01/12/2022-09:32:25] [V] [TRT] Constant_1108 [Constant] outputs: [1785 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Parsing node: Mul_1109 [Mul] [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1784 [01/12/2022-09:32:25] [V] [TRT] Searching for input: 1785 [01/12/2022-09:32:25] [V] [TRT] Mul_1109 [Mul] inputs: [1784 -> (-1, -1, 768)[FLOAT]], [1785 -> ()[FLOAT]], [01/12/2022-09:32:25] [V] [TRT] Registering layer: 1785 for ONNX node: 1785 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Mul_1109 for ONNX node: Mul_1109 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1786 for ONNX tensor: 1786 [01/12/2022-09:32:26] [V] [TRT] Mul_1109 [Mul] outputs: [1786 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: MatMul_1110 [MatMul] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1775 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3013 [01/12/2022-09:32:26] [V] [TRT] MatMul_1110 [MatMul] inputs: [1775 -> (-1, -1, 768)[FLOAT]], [3013 -> (768, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3013 for ONNX node: 3013 [01/12/2022-09:32:26] [V] [TRT] Registering layer: MatMul_1110 for ONNX node: MatMul_1110 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1788 for ONNX tensor: 1788 [01/12/2022-09:32:26] [V] [TRT] MatMul_1110 [MatMul] outputs: [1788 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Add_1111 [Add] [01/12/2022-09:32:26] [V] [TRT] Searching for input: decoder.layers.2.self_attn.k_proj.bias [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1788 [01/12/2022-09:32:26] [V] [TRT] Add_1111 [Add] inputs: [decoder.layers.2.self_attn.k_proj.bias -> (768)[FLOAT]], [1788 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: decoder.layers.2.self_attn.k_proj.bias for ONNX node: decoder.layers.2.self_attn.k_proj.bias [01/12/2022-09:32:26] [V] [TRT] Registering layer: Add_1111 for ONNX node: Add_1111 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1789 for ONNX tensor: 1789 [01/12/2022-09:32:26] [V] [TRT] Add_1111 [Add] outputs: [1789 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1112 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1112 [Unsqueeze] inputs: [1778 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1112 for ONNX node: Unsqueeze_1112 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1793 for ONNX tensor: 1793 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1112 [Unsqueeze] outputs: [1793 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1113 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1793 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3014 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3015 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3016 [01/12/2022-09:32:26] [V] [TRT] Concat_1113 [Concat] inputs: [1793 -> (1)[INT32]], [3014 -> (1)[INT32]], [3015 -> (1)[INT32]], [3016 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3014 for ONNX node: 3014 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3015 for ONNX node: 3015 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3016 for ONNX node: 3016 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Concat_1113 for ONNX node: Concat_1113 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1797 for ONNX tensor: 1797 [01/12/2022-09:32:26] [V] [TRT] Concat_1113 [Concat] outputs: [1797 -> (4)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Reshape_1114 [Reshape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1789 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1797 [01/12/2022-09:32:26] [V] [TRT] Reshape_1114 [Reshape] inputs: [1789 -> (-1, -1, 768)[FLOAT]], [1797 -> (4)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Reshape_1114 for ONNX node: Reshape_1114 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1798 for ONNX tensor: 1798 [01/12/2022-09:32:26] [V] [TRT] Reshape_1114 [Reshape] outputs: [1798 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Transpose_1115 [Transpose] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1798 [01/12/2022-09:32:26] [V] [TRT] Transpose_1115 [Transpose] inputs: [1798 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Transpose_1115 for ONNX node: Transpose_1115 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1799_10 for ONNX tensor: 1799 [01/12/2022-09:32:26] [V] [TRT] Transpose_1115 [Transpose] outputs: [1799 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: MatMul_1116 [MatMul] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1775 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3017 [01/12/2022-09:32:26] [V] [TRT] MatMul_1116 [MatMul] inputs: [1775 -> (-1, -1, 768)[FLOAT]], [3017 -> (768, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3017 for ONNX node: 3017 [01/12/2022-09:32:26] [V] [TRT] Registering layer: MatMul_1116 for ONNX node: MatMul_1116 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1801 for ONNX tensor: 1801 [01/12/2022-09:32:26] [V] [TRT] MatMul_1116 [MatMul] outputs: [1801 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Add_1117 [Add] [01/12/2022-09:32:26] [V] [TRT] Searching for input: decoder.layers.2.self_attn.v_proj.bias [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1801 [01/12/2022-09:32:26] [V] [TRT] Add_1117 [Add] inputs: [decoder.layers.2.self_attn.v_proj.bias -> (768)[FLOAT]], [1801 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: decoder.layers.2.self_attn.v_proj.bias for ONNX node: decoder.layers.2.self_attn.v_proj.bias [01/12/2022-09:32:26] [V] [TRT] Registering layer: Add_1117 for ONNX node: Add_1117 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1802 for ONNX tensor: 1802 [01/12/2022-09:32:26] [V] [TRT] Add_1117 [Add] outputs: [1802 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1118 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1118 [Unsqueeze] inputs: [1778 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1118 for ONNX node: Unsqueeze_1118 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1806 for ONNX tensor: 1806 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1118 [Unsqueeze] outputs: [1806 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1119 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1806 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3018 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3019 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3020 [01/12/2022-09:32:26] [V] [TRT] Concat_1119 [Concat] inputs: [1806 -> (1)[INT32]], [3018 -> (1)[INT32]], [3019 -> (1)[INT32]], [3020 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3018 for ONNX node: 3018 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3019 for ONNX node: 3019 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3020 for ONNX node: 3020 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Concat_1119 for ONNX node: Concat_1119 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1810 for ONNX tensor: 1810 [01/12/2022-09:32:26] [V] [TRT] Concat_1119 [Concat] outputs: [1810 -> (4)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Reshape_1120 [Reshape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1802 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1810 [01/12/2022-09:32:26] [V] [TRT] Reshape_1120 [Reshape] inputs: [1802 -> (-1, -1, 768)[FLOAT]], [1810 -> (4)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Reshape_1120 for ONNX node: Reshape_1120 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1811 for ONNX tensor: 1811 [01/12/2022-09:32:26] [V] [TRT] Reshape_1120 [Reshape] outputs: [1811 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Transpose_1121 [Transpose] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1811 [01/12/2022-09:32:26] [V] [TRT] Transpose_1121 [Transpose] inputs: [1811 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Transpose_1121 for ONNX node: Transpose_1121 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1812_11 for ONNX tensor: 1812 [01/12/2022-09:32:26] [V] [TRT] Transpose_1121 [Transpose] outputs: [1812 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Constant_1122 [Constant] [01/12/2022-09:32:26] [V] [TRT] Constant_1122 [Constant] inputs: [01/12/2022-09:32:26] [V] [TRT] Constant_1122 [Constant] outputs: [1813 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Mul_1123 [Mul] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1813 [01/12/2022-09:32:26] [V] [TRT] Mul_1123 [Mul] inputs: [1778 -> ()[INT32]], [1813 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 1813 for ONNX node: 1813 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Mul_1123 for ONNX node: Mul_1123 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1814 for ONNX tensor: 1814 [01/12/2022-09:32:26] [V] [TRT] Mul_1123 [Mul] outputs: [1814 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1124 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1124 [Unsqueeze] inputs: [1778 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1124 for ONNX node: Unsqueeze_1124 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1817 for ONNX tensor: 1817 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1124 [Unsqueeze] outputs: [1817 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1125 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1781 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1125 [Unsqueeze] inputs: [1781 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1125 for ONNX node: Unsqueeze_1125 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1818 for ONNX tensor: 1818 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1125 [Unsqueeze] outputs: [1818 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1126 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1817 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1818 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3021 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3022 [01/12/2022-09:32:26] [V] [TRT] Concat_1126 [Concat] inputs: [1817 -> (1)[INT32]], [1818 -> (1)[INT32]], [3021 -> (1)[INT32]], [3022 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3021 for ONNX node: 3021 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3022 for ONNX node: 3022 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Concat_1126 for ONNX node: Concat_1126 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1821 for ONNX tensor: 1821 [01/12/2022-09:32:26] [V] [TRT] Concat_1126 [Concat] outputs: [1821 -> (4)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Reshape_1127 [Reshape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1786 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1821 [01/12/2022-09:32:26] [V] [TRT] Reshape_1127 [Reshape] inputs: [1786 -> (-1, -1, 768)[FLOAT]], [1821 -> (4)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Reshape_1127 for ONNX node: Reshape_1127 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1822 for ONNX tensor: 1822 [01/12/2022-09:32:26] [V] [TRT] Reshape_1127 [Reshape] outputs: [1822 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Transpose_1128 [Transpose] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1822 [01/12/2022-09:32:26] [V] [TRT] Transpose_1128 [Transpose] inputs: [1822 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Transpose_1128 for ONNX node: Transpose_1128 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1823 for ONNX tensor: 1823 [01/12/2022-09:32:26] [V] [TRT] Transpose_1128 [Transpose] outputs: [1823 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1129 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1814 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1129 [Unsqueeze] inputs: [1814 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1129 for ONNX node: Unsqueeze_1129 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1826 for ONNX tensor: 1826 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1129 [Unsqueeze] outputs: [1826 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1130 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1826 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3023 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3024 [01/12/2022-09:32:26] [V] [TRT] Concat_1130 [Concat] inputs: [1826 -> (1)[INT32]], [3023 -> (1)[INT32]], [3024 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3023 for ONNX node: 3023 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3024 for ONNX node: 3024 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Concat_1130 for ONNX node: Concat_1130 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1829 for ONNX tensor: 1829 [01/12/2022-09:32:26] [V] [TRT] Concat_1130 [Concat] outputs: [1829 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Reshape_1131 [Reshape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1823 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1829 [01/12/2022-09:32:26] [V] [TRT] Reshape_1131 [Reshape] inputs: [1823 -> (-1, 12, -1, 64)[FLOAT]], [1829 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Reshape_1131 for ONNX node: Reshape_1131 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1830 for ONNX tensor: 1830 [01/12/2022-09:32:26] [V] [TRT] Reshape_1131 [Reshape] outputs: [1830 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1132 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1814 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1132 [Unsqueeze] inputs: [1814 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1132 for ONNX node: Unsqueeze_1132 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1833 for ONNX tensor: 1833 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1132 [Unsqueeze] outputs: [1833 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1133 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1833 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3025 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3026 [01/12/2022-09:32:26] [V] [TRT] Concat_1133 [Concat] inputs: [1833 -> (1)[INT32]], [3025 -> (1)[INT32]], [3026 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3025 for ONNX node: 3025 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3026 for ONNX node: 3026 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Concat_1133 for ONNX node: Concat_1133 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1836 for ONNX tensor: 1836 [01/12/2022-09:32:26] [V] [TRT] Concat_1133 [Concat] outputs: [1836 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Reshape_1134 [Reshape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1799 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1836 [01/12/2022-09:32:26] [V] [TRT] Reshape_1134 [Reshape] inputs: [1799 -> (-1, 12, -1, 64)[FLOAT]], [1836 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Reshape_1134 for ONNX node: Reshape_1134 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1837 for ONNX tensor: 1837 [01/12/2022-09:32:26] [V] [TRT] Reshape_1134 [Reshape] outputs: [1837 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1135 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1814 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1135 [Unsqueeze] inputs: [1814 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1135 for ONNX node: Unsqueeze_1135 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1840 for ONNX tensor: 1840 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1135 [Unsqueeze] outputs: [1840 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1136 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1840 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3027 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3028 [01/12/2022-09:32:26] [V] [TRT] Concat_1136 [Concat] inputs: [1840 -> (1)[INT32]], [3027 -> (1)[INT32]], [3028 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3027 for ONNX node: 3027 [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3028 for ONNX node: 3028 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Concat_1136 for ONNX node: Concat_1136 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1843 for ONNX tensor: 1843 [01/12/2022-09:32:26] [V] [TRT] Concat_1136 [Concat] outputs: [1843 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Reshape_1137 [Reshape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1812 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1843 [01/12/2022-09:32:26] [V] [TRT] Reshape_1137 [Reshape] inputs: [1812 -> (-1, 12, -1, 64)[FLOAT]], [1843 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Reshape_1137 for ONNX node: Reshape_1137 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1844 for ONNX tensor: 1844 [01/12/2022-09:32:26] [V] [TRT] Reshape_1137 [Reshape] outputs: [1844 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Shape_1138 [Shape] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1837 [01/12/2022-09:32:26] [V] [TRT] Shape_1138 [Shape] inputs: [1837 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Shape_1138 for ONNX node: Shape_1138 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1845 for ONNX tensor: 1845 [01/12/2022-09:32:26] [V] [TRT] Shape_1138 [Shape] outputs: [1845 -> (3)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Constant_1139 [Constant] [01/12/2022-09:32:26] [V] [TRT] Constant_1139 [Constant] inputs: [01/12/2022-09:32:26] [V] [TRT] Constant_1139 [Constant] outputs: [1846 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Gather_1140 [Gather] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1845 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1846 [01/12/2022-09:32:26] [V] [TRT] Gather_1140 [Gather] inputs: [1845 -> (3)[INT32]], [1846 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 1846 for ONNX node: 1846 [01/12/2022-09:32:26] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:26] [V] [TRT] Registering layer: Gather_1140 for ONNX node: Gather_1140 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1847 for ONNX tensor: 1847 [01/12/2022-09:32:26] [V] [TRT] Gather_1140 [Gather] outputs: [1847 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Transpose_1141 [Transpose] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1837 [01/12/2022-09:32:26] [V] [TRT] Transpose_1141 [Transpose] inputs: [1837 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: Transpose_1141 for ONNX node: Transpose_1141 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1848 for ONNX tensor: 1848 [01/12/2022-09:32:26] [V] [TRT] Transpose_1141 [Transpose] outputs: [1848 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: MatMul_1142 [MatMul] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1830 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1848 [01/12/2022-09:32:26] [V] [TRT] MatMul_1142 [MatMul] inputs: [1830 -> (-1, -1, 64)[FLOAT]], [1848 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: MatMul_1142 for ONNX node: MatMul_1142 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1849 for ONNX tensor: 1849 [01/12/2022-09:32:26] [V] [TRT] MatMul_1142 [MatMul] outputs: [1849 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1143 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1143 [Unsqueeze] inputs: [1778 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1143 for ONNX node: Unsqueeze_1143 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1851 for ONNX tensor: 1851 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1143 [Unsqueeze] outputs: [1851 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1144 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1781 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1144 [Unsqueeze] inputs: [1781 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1144 for ONNX node: Unsqueeze_1144 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1853 for ONNX tensor: 1853 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1144 [Unsqueeze] outputs: [1853 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Unsqueeze_1145 [Unsqueeze] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1847 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1145 [Unsqueeze] inputs: [1847 -> ()[INT32]], [01/12/2022-09:32:26] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:26] [V] [TRT] Registering layer: Unsqueeze_1145 for ONNX node: Unsqueeze_1145 [01/12/2022-09:32:26] [V] [TRT] Registering tensor: 1854 for ONNX tensor: 1854 [01/12/2022-09:32:26] [V] [TRT] Unsqueeze_1145 [Unsqueeze] outputs: [1854 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Parsing node: Concat_1146 [Concat] [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1851 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 3029 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1853 [01/12/2022-09:32:26] [V] [TRT] Searching for input: 1854 [01/12/2022-09:32:26] [V] [TRT] Concat_1146 [Concat] inputs: [1851 -> (1)[INT32]], [3029 -> (1)[INT32]], [1853 -> (1)[INT32]], [1854 -> (1)[INT32]], [01/12/2022-09:32:26] [V] [TRT] Registering layer: 3029 for ONNX node: 3029 [01/12/2022-09:32:27] [V] [TRT] Registering layer: Concat_1146 for ONNX node: Concat_1146 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1855 for ONNX tensor: 1855 [01/12/2022-09:32:27] [V] [TRT] Concat_1146 [Concat] outputs: [1855 -> (4)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Reshape_1147 [Reshape] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1849 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1855 [01/12/2022-09:32:27] [V] [TRT] Reshape_1147 [Reshape] inputs: [1849 -> (-1, -1, -1)[FLOAT]], [1855 -> (4)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Reshape_1147 for ONNX node: Reshape_1147 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1856 for ONNX tensor: 1856 [01/12/2022-09:32:27] [V] [TRT] Reshape_1147 [Reshape] outputs: [1856 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Add_1148 [Add] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1856 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1252 [01/12/2022-09:32:27] [V] [TRT] Add_1148 [Add] inputs: [1856 -> (-1, 12, -1, -1)[FLOAT]], [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Add_1148 for ONNX node: Add_1148 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1857 for ONNX tensor: 1857 [01/12/2022-09:32:27] [V] [TRT] Add_1148 [Add] outputs: [1857 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Constant_1149 [Constant] [01/12/2022-09:32:27] [V] [TRT] Constant_1149 [Constant] inputs: [01/12/2022-09:32:27] [V] [TRT] Constant_1149 [Constant] outputs: [1858 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Mul_1150 [Mul] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1858 [01/12/2022-09:32:27] [V] [TRT] Mul_1150 [Mul] inputs: [1778 -> ()[INT32]], [1858 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: 1858 for ONNX node: 1858 [01/12/2022-09:32:27] [V] [TRT] Registering layer: Mul_1150 for ONNX node: Mul_1150 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1859 for ONNX tensor: 1859 [01/12/2022-09:32:27] [V] [TRT] Mul_1150 [Mul] outputs: [1859 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1151 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1859 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1151 [Unsqueeze] inputs: [1859 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1151 for ONNX node: Unsqueeze_1151 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1860 for ONNX tensor: 1860 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1151 [Unsqueeze] outputs: [1860 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1152 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1781 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1152 [Unsqueeze] inputs: [1781 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1152 for ONNX node: Unsqueeze_1152 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1861 for ONNX tensor: 1861 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1152 [Unsqueeze] outputs: [1861 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1153 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1847 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1153 [Unsqueeze] inputs: [1847 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1153 for ONNX node: Unsqueeze_1153 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1862 for ONNX tensor: 1862 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1153 [Unsqueeze] outputs: [1862 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Concat_1154 [Concat] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1860 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1861 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1862 [01/12/2022-09:32:27] [V] [TRT] Concat_1154 [Concat] inputs: [1860 -> (1)[INT32]], [1861 -> (1)[INT32]], [1862 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Concat_1154 for ONNX node: Concat_1154 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1863 for ONNX tensor: 1863 [01/12/2022-09:32:27] [V] [TRT] Concat_1154 [Concat] outputs: [1863 -> (3)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Reshape_1155 [Reshape] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1857 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1863 [01/12/2022-09:32:27] [V] [TRT] Reshape_1155 [Reshape] inputs: [1857 -> (-1, 12, -1, -1)[FLOAT]], [1863 -> (3)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Reshape_1155 for ONNX node: Reshape_1155 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1864 for ONNX tensor: 1864 [01/12/2022-09:32:27] [V] [TRT] Reshape_1155 [Reshape] outputs: [1864 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Softmax_1156 [Softmax] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1864 [01/12/2022-09:32:27] [V] [TRT] Softmax_1156 [Softmax] inputs: [1864 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Softmax_1156 for ONNX node: Softmax_1156 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1865 for ONNX tensor: 1865 [01/12/2022-09:32:27] [V] [TRT] Softmax_1156 [Softmax] outputs: [1865 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: MatMul_1157 [MatMul] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1865 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1844 [01/12/2022-09:32:27] [V] [TRT] MatMul_1157 [MatMul] inputs: [1865 -> (-1, -1, -1)[FLOAT]], [1844 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: MatMul_1157 for ONNX node: MatMul_1157 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1866 for ONNX tensor: 1866 [01/12/2022-09:32:27] [V] [TRT] MatMul_1157 [MatMul] outputs: [1866 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1158 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1158 [Unsqueeze] inputs: [1778 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1158 for ONNX node: Unsqueeze_1158 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1869 for ONNX tensor: 1869 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1158 [Unsqueeze] outputs: [1869 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1159 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1781 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1159 [Unsqueeze] inputs: [1781 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1159 for ONNX node: Unsqueeze_1159 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1871 for ONNX tensor: 1871 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1159 [Unsqueeze] outputs: [1871 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Concat_1160 [Concat] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1869 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 3030 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1871 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 3031 [01/12/2022-09:32:27] [V] [TRT] Concat_1160 [Concat] inputs: [1869 -> (1)[INT32]], [3030 -> (1)[INT32]], [1871 -> (1)[INT32]], [3031 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: 3030 for ONNX node: 3030 [01/12/2022-09:32:27] [V] [TRT] Registering layer: 3031 for ONNX node: 3031 [01/12/2022-09:32:27] [V] [TRT] Registering layer: Concat_1160 for ONNX node: Concat_1160 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1873 for ONNX tensor: 1873 [01/12/2022-09:32:27] [V] [TRT] Concat_1160 [Concat] outputs: [1873 -> (4)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Reshape_1161 [Reshape] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1866 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1873 [01/12/2022-09:32:27] [V] [TRT] Reshape_1161 [Reshape] inputs: [1866 -> (-1, -1, 64)[FLOAT]], [1873 -> (4)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Reshape_1161 for ONNX node: Reshape_1161 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1874 for ONNX tensor: 1874 [01/12/2022-09:32:27] [V] [TRT] Reshape_1161 [Reshape] outputs: [1874 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Transpose_1162 [Transpose] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1874 [01/12/2022-09:32:27] [V] [TRT] Transpose_1162 [Transpose] inputs: [1874 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Transpose_1162 for ONNX node: Transpose_1162 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1875 for ONNX tensor: 1875 [01/12/2022-09:32:27] [V] [TRT] Transpose_1162 [Transpose] outputs: [1875 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1163 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1778 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1163 [Unsqueeze] inputs: [1778 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1163 for ONNX node: Unsqueeze_1163 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1877 for ONNX tensor: 1877 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1163 [Unsqueeze] outputs: [1877 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Unsqueeze_1164 [Unsqueeze] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1781 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1164 [Unsqueeze] inputs: [1781 -> ()[INT32]], [01/12/2022-09:32:27] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:27] [V] [TRT] Registering layer: Unsqueeze_1164 for ONNX node: Unsqueeze_1164 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1878 for ONNX tensor: 1878 [01/12/2022-09:32:27] [V] [TRT] Unsqueeze_1164 [Unsqueeze] outputs: [1878 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Concat_1165 [Concat] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1877 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1878 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 3032 [01/12/2022-09:32:27] [V] [TRT] Concat_1165 [Concat] inputs: [1877 -> (1)[INT32]], [1878 -> (1)[INT32]], [3032 -> (1)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: 3032 for ONNX node: 3032 [01/12/2022-09:32:27] [V] [TRT] Registering layer: Concat_1165 for ONNX node: Concat_1165 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1880 for ONNX tensor: 1880 [01/12/2022-09:32:27] [V] [TRT] Concat_1165 [Concat] outputs: [1880 -> (3)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Reshape_1166 [Reshape] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1875 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1880 [01/12/2022-09:32:27] [V] [TRT] Reshape_1166 [Reshape] inputs: [1875 -> (-1, -1, 12, 64)[FLOAT]], [1880 -> (3)[INT32]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Reshape_1166 for ONNX node: Reshape_1166 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1881 for ONNX tensor: 1881 [01/12/2022-09:32:27] [V] [TRT] Reshape_1166 [Reshape] outputs: [1881 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: MatMul_1167 [MatMul] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1881 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 3033 [01/12/2022-09:32:27] [V] [TRT] MatMul_1167 [MatMul] inputs: [1881 -> (-1, -1, 768)[FLOAT]], [3033 -> (768, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: 3033 for ONNX node: 3033 [01/12/2022-09:32:27] [V] [TRT] Registering layer: MatMul_1167 for ONNX node: MatMul_1167 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1883 for ONNX tensor: 1883 [01/12/2022-09:32:27] [V] [TRT] MatMul_1167 [MatMul] outputs: [1883 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Add_1168 [Add] [01/12/2022-09:32:27] [V] [TRT] Searching for input: decoder.layers.2.self_attn.out_proj.bias [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1883 [01/12/2022-09:32:27] [V] [TRT] Add_1168 [Add] inputs: [decoder.layers.2.self_attn.out_proj.bias -> (768)[FLOAT]], [1883 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: decoder.layers.2.self_attn.out_proj.bias for ONNX node: decoder.layers.2.self_attn.out_proj.bias [01/12/2022-09:32:27] [V] [TRT] Registering layer: Add_1168 for ONNX node: Add_1168 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1884 for ONNX tensor: 1884 [01/12/2022-09:32:27] [V] [TRT] Add_1168 [Add] outputs: [1884 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Add_1169 [Add] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1775 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1884 [01/12/2022-09:32:27] [V] [TRT] Add_1169 [Add] inputs: [1775 -> (-1, -1, 768)[FLOAT]], [1884 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Add_1169 for ONNX node: Add_1169 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1885 for ONNX tensor: 1885 [01/12/2022-09:32:27] [V] [TRT] Add_1169 [Add] outputs: [1885 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: ReduceMean_1170 [ReduceMean] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1885 [01/12/2022-09:32:27] [V] [TRT] ReduceMean_1170 [ReduceMean] inputs: [1885 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: ReduceMean_1170 for ONNX node: ReduceMean_1170 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1886 for ONNX tensor: 1886 [01/12/2022-09:32:27] [V] [TRT] ReduceMean_1170 [ReduceMean] outputs: [1886 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Sub_1171 [Sub] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1885 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1886 [01/12/2022-09:32:27] [V] [TRT] Sub_1171 [Sub] inputs: [1885 -> (-1, -1, 768)[FLOAT]], [1886 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Sub_1171 for ONNX node: Sub_1171 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1887 for ONNX tensor: 1887 [01/12/2022-09:32:27] [V] [TRT] Sub_1171 [Sub] outputs: [1887 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Constant_1172 [Constant] [01/12/2022-09:32:27] [V] [TRT] Constant_1172 [Constant] inputs: [01/12/2022-09:32:27] [V] [TRT] Constant_1172 [Constant] outputs: [1888 -> ()[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Pow_1173 [Pow] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1887 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1888 [01/12/2022-09:32:27] [V] [TRT] Pow_1173 [Pow] inputs: [1887 -> (-1, -1, 768)[FLOAT]], [1888 -> ()[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: 1888 for ONNX node: 1888 [01/12/2022-09:32:27] [V] [TRT] Registering layer: Pow_1173 for ONNX node: Pow_1173 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1889 for ONNX tensor: 1889 [01/12/2022-09:32:27] [V] [TRT] Pow_1173 [Pow] outputs: [1889 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: ReduceMean_1174 [ReduceMean] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1889 [01/12/2022-09:32:27] [V] [TRT] ReduceMean_1174 [ReduceMean] inputs: [1889 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: ReduceMean_1174 for ONNX node: ReduceMean_1174 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1890 for ONNX tensor: 1890 [01/12/2022-09:32:27] [V] [TRT] ReduceMean_1174 [ReduceMean] outputs: [1890 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Constant_1175 [Constant] [01/12/2022-09:32:27] [V] [TRT] Constant_1175 [Constant] inputs: [01/12/2022-09:32:27] [V] [TRT] Constant_1175 [Constant] outputs: [1891 -> ()[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Add_1176 [Add] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1890 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1891 [01/12/2022-09:32:27] [V] [TRT] Add_1176 [Add] inputs: [1890 -> (-1, -1, 1)[FLOAT]], [1891 -> ()[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: 1891 for ONNX node: 1891 [01/12/2022-09:32:27] [V] [TRT] Registering layer: Add_1176 for ONNX node: Add_1176 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1892 for ONNX tensor: 1892 [01/12/2022-09:32:27] [V] [TRT] Add_1176 [Add] outputs: [1892 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Sqrt_1177 [Sqrt] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1892 [01/12/2022-09:32:27] [V] [TRT] Sqrt_1177 [Sqrt] inputs: [1892 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Sqrt_1177 for ONNX node: Sqrt_1177 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1893 for ONNX tensor: 1893 [01/12/2022-09:32:27] [V] [TRT] Sqrt_1177 [Sqrt] outputs: [1893 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Div_1178 [Div] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1887 [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1893 [01/12/2022-09:32:27] [V] [TRT] Div_1178 [Div] inputs: [1887 -> (-1, -1, 768)[FLOAT]], [1893 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: Div_1178 for ONNX node: Div_1178 [01/12/2022-09:32:27] [V] [TRT] Registering tensor: 1894 for ONNX tensor: 1894 [01/12/2022-09:32:27] [V] [TRT] Div_1178 [Div] outputs: [1894 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Parsing node: Mul_1179 [Mul] [01/12/2022-09:32:27] [V] [TRT] Searching for input: 1894 [01/12/2022-09:32:27] [V] [TRT] Searching for input: decoder.layers.2.self_attn_layer_norm.weight [01/12/2022-09:32:27] [V] [TRT] Mul_1179 [Mul] inputs: [1894 -> (-1, -1, 768)[FLOAT]], [decoder.layers.2.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:27] [V] [TRT] Registering layer: decoder.layers.2.self_attn_layer_norm.weight for ONNX node: decoder.layers.2.self_attn_layer_norm.weight [01/12/2022-09:32:28] [V] [TRT] Registering layer: Mul_1179 for ONNX node: Mul_1179 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1895 for ONNX tensor: 1895 [01/12/2022-09:32:28] [V] [TRT] Mul_1179 [Mul] outputs: [1895 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Add_1180 [Add] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1895 [01/12/2022-09:32:28] [V] [TRT] Searching for input: decoder.layers.2.self_attn_layer_norm.bias [01/12/2022-09:32:28] [V] [TRT] Add_1180 [Add] inputs: [1895 -> (-1, -1, 768)[FLOAT]], [decoder.layers.2.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: decoder.layers.2.self_attn_layer_norm.bias for ONNX node: decoder.layers.2.self_attn_layer_norm.bias [01/12/2022-09:32:28] [V] [TRT] Registering layer: Add_1180 for ONNX node: Add_1180 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1896 for ONNX tensor: 1896 [01/12/2022-09:32:28] [V] [TRT] Add_1180 [Add] outputs: [1896 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Shape_1181 [Shape] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1896 [01/12/2022-09:32:28] [V] [TRT] Shape_1181 [Shape] inputs: [1896 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: Shape_1181 for ONNX node: Shape_1181 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1897 for ONNX tensor: 1897 [01/12/2022-09:32:28] [V] [TRT] Shape_1181 [Shape] outputs: [1897 -> (3)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Constant_1182 [Constant] [01/12/2022-09:32:28] [V] [TRT] Constant_1182 [Constant] inputs: [01/12/2022-09:32:28] [V] [TRT] Constant_1182 [Constant] outputs: [1898 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Gather_1183 [Gather] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1897 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1898 [01/12/2022-09:32:28] [V] [TRT] Gather_1183 [Gather] inputs: [1897 -> (3)[INT32]], [1898 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 1898 for ONNX node: 1898 [01/12/2022-09:32:28] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:28] [V] [TRT] Registering layer: Gather_1183 for ONNX node: Gather_1183 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1899 for ONNX tensor: 1899 [01/12/2022-09:32:28] [V] [TRT] Gather_1183 [Gather] outputs: [1899 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Shape_1184 [Shape] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1896 [01/12/2022-09:32:28] [V] [TRT] Shape_1184 [Shape] inputs: [1896 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: Shape_1184 for ONNX node: Shape_1184 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1900 for ONNX tensor: 1900 [01/12/2022-09:32:28] [V] [TRT] Shape_1184 [Shape] outputs: [1900 -> (3)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Constant_1185 [Constant] [01/12/2022-09:32:28] [V] [TRT] Constant_1185 [Constant] inputs: [01/12/2022-09:32:28] [V] [TRT] Constant_1185 [Constant] outputs: [1901 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Gather_1186 [Gather] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1900 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1901 [01/12/2022-09:32:28] [V] [TRT] Gather_1186 [Gather] inputs: [1900 -> (3)[INT32]], [1901 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 1901 for ONNX node: 1901 [01/12/2022-09:32:28] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:28] [V] [TRT] Registering layer: Gather_1186 for ONNX node: Gather_1186 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1902 for ONNX tensor: 1902 [01/12/2022-09:32:28] [V] [TRT] Gather_1186 [Gather] outputs: [1902 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: MatMul_1187 [MatMul] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1896 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3034 [01/12/2022-09:32:28] [V] [TRT] MatMul_1187 [MatMul] inputs: [1896 -> (-1, -1, 768)[FLOAT]], [3034 -> (768, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3034 for ONNX node: 3034 [01/12/2022-09:32:28] [V] [TRT] Registering layer: MatMul_1187 for ONNX node: MatMul_1187 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1904 for ONNX tensor: 1904 [01/12/2022-09:32:28] [V] [TRT] MatMul_1187 [MatMul] outputs: [1904 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Add_1188 [Add] [01/12/2022-09:32:28] [V] [TRT] Searching for input: decoder.layers.2.encoder_attn.q_proj.bias [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1904 [01/12/2022-09:32:28] [V] [TRT] Add_1188 [Add] inputs: [decoder.layers.2.encoder_attn.q_proj.bias -> (768)[FLOAT]], [1904 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: decoder.layers.2.encoder_attn.q_proj.bias for ONNX node: decoder.layers.2.encoder_attn.q_proj.bias [01/12/2022-09:32:28] [V] [TRT] Registering layer: Add_1188 for ONNX node: Add_1188 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1905 for ONNX tensor: 1905 [01/12/2022-09:32:28] [V] [TRT] Add_1188 [Add] outputs: [1905 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Constant_1189 [Constant] [01/12/2022-09:32:28] [V] [TRT] Constant_1189 [Constant] inputs: [01/12/2022-09:32:28] [V] [TRT] Constant_1189 [Constant] outputs: [1906 -> ()[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Mul_1190 [Mul] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1905 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1906 [01/12/2022-09:32:28] [V] [TRT] Mul_1190 [Mul] inputs: [1905 -> (-1, -1, 768)[FLOAT]], [1906 -> ()[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 1906 for ONNX node: 1906 [01/12/2022-09:32:28] [V] [TRT] Registering layer: Mul_1190 for ONNX node: Mul_1190 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1907 for ONNX tensor: 1907 [01/12/2022-09:32:28] [V] [TRT] Mul_1190 [Mul] outputs: [1907 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: MatMul_1191 [MatMul] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3035 [01/12/2022-09:32:28] [V] [TRT] MatMul_1191 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3035 -> (768, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3035 for ONNX node: 3035 [01/12/2022-09:32:28] [V] [TRT] Registering layer: MatMul_1191 for ONNX node: MatMul_1191 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1909 for ONNX tensor: 1909 [01/12/2022-09:32:28] [V] [TRT] MatMul_1191 [MatMul] outputs: [1909 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Add_1192 [Add] [01/12/2022-09:32:28] [V] [TRT] Searching for input: decoder.layers.2.encoder_attn.k_proj.bias [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1909 [01/12/2022-09:32:28] [V] [TRT] Add_1192 [Add] inputs: [decoder.layers.2.encoder_attn.k_proj.bias -> (768)[FLOAT]], [1909 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: decoder.layers.2.encoder_attn.k_proj.bias for ONNX node: decoder.layers.2.encoder_attn.k_proj.bias [01/12/2022-09:32:28] [V] [TRT] Registering layer: Add_1192 for ONNX node: Add_1192 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1910 for ONNX tensor: 1910 [01/12/2022-09:32:28] [V] [TRT] Add_1192 [Add] outputs: [1910 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Unsqueeze_1193 [Unsqueeze] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1899 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1193 [Unsqueeze] inputs: [1899 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:28] [V] [TRT] Registering layer: Unsqueeze_1193 for ONNX node: Unsqueeze_1193 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1914 for ONNX tensor: 1914 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1193 [Unsqueeze] outputs: [1914 -> (1)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Concat_1194 [Concat] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1914 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3036 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3037 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3038 [01/12/2022-09:32:28] [V] [TRT] Concat_1194 [Concat] inputs: [1914 -> (1)[INT32]], [3036 -> (1)[INT32]], [3037 -> (1)[INT32]], [3038 -> (1)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3036 for ONNX node: 3036 [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3037 for ONNX node: 3037 [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3038 for ONNX node: 3038 [01/12/2022-09:32:28] [V] [TRT] Registering layer: Concat_1194 for ONNX node: Concat_1194 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1918 for ONNX tensor: 1918 [01/12/2022-09:32:28] [V] [TRT] Concat_1194 [Concat] outputs: [1918 -> (4)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Reshape_1195 [Reshape] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1910 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1918 [01/12/2022-09:32:28] [V] [TRT] Reshape_1195 [Reshape] inputs: [1910 -> (-1, -1, 768)[FLOAT]], [1918 -> (4)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: Reshape_1195 for ONNX node: Reshape_1195 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1919 for ONNX tensor: 1919 [01/12/2022-09:32:28] [V] [TRT] Reshape_1195 [Reshape] outputs: [1919 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Transpose_1196 [Transpose] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1919 [01/12/2022-09:32:28] [V] [TRT] Transpose_1196 [Transpose] inputs: [1919 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: Transpose_1196 for ONNX node: Transpose_1196 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1920_12 for ONNX tensor: 1920 [01/12/2022-09:32:28] [V] [TRT] Transpose_1196 [Transpose] outputs: [1920 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: MatMul_1197 [MatMul] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3039 [01/12/2022-09:32:28] [V] [TRT] MatMul_1197 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3039 -> (768, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3039 for ONNX node: 3039 [01/12/2022-09:32:28] [V] [TRT] Registering layer: MatMul_1197 for ONNX node: MatMul_1197 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1922 for ONNX tensor: 1922 [01/12/2022-09:32:28] [V] [TRT] MatMul_1197 [MatMul] outputs: [1922 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Add_1198 [Add] [01/12/2022-09:32:28] [V] [TRT] Searching for input: decoder.layers.2.encoder_attn.v_proj.bias [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1922 [01/12/2022-09:32:28] [V] [TRT] Add_1198 [Add] inputs: [decoder.layers.2.encoder_attn.v_proj.bias -> (768)[FLOAT]], [1922 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: decoder.layers.2.encoder_attn.v_proj.bias for ONNX node: decoder.layers.2.encoder_attn.v_proj.bias [01/12/2022-09:32:28] [V] [TRT] Registering layer: Add_1198 for ONNX node: Add_1198 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1923 for ONNX tensor: 1923 [01/12/2022-09:32:28] [V] [TRT] Add_1198 [Add] outputs: [1923 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Unsqueeze_1199 [Unsqueeze] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1899 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1199 [Unsqueeze] inputs: [1899 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:28] [V] [TRT] Registering layer: Unsqueeze_1199 for ONNX node: Unsqueeze_1199 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1927 for ONNX tensor: 1927 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1199 [Unsqueeze] outputs: [1927 -> (1)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Concat_1200 [Concat] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1927 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3040 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3041 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 3042 [01/12/2022-09:32:28] [V] [TRT] Concat_1200 [Concat] inputs: [1927 -> (1)[INT32]], [3040 -> (1)[INT32]], [3041 -> (1)[INT32]], [3042 -> (1)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3040 for ONNX node: 3040 [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3041 for ONNX node: 3041 [01/12/2022-09:32:28] [V] [TRT] Registering layer: 3042 for ONNX node: 3042 [01/12/2022-09:32:28] [V] [TRT] Registering layer: Concat_1200 for ONNX node: Concat_1200 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1931 for ONNX tensor: 1931 [01/12/2022-09:32:28] [V] [TRT] Concat_1200 [Concat] outputs: [1931 -> (4)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Reshape_1201 [Reshape] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1923 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1931 [01/12/2022-09:32:28] [V] [TRT] Reshape_1201 [Reshape] inputs: [1923 -> (-1, -1, 768)[FLOAT]], [1931 -> (4)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: Reshape_1201 for ONNX node: Reshape_1201 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1932 for ONNX tensor: 1932 [01/12/2022-09:32:28] [V] [TRT] Reshape_1201 [Reshape] outputs: [1932 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Transpose_1202 [Transpose] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1932 [01/12/2022-09:32:28] [V] [TRT] Transpose_1202 [Transpose] inputs: [1932 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: Transpose_1202 for ONNX node: Transpose_1202 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1933_13 for ONNX tensor: 1933 [01/12/2022-09:32:28] [V] [TRT] Transpose_1202 [Transpose] outputs: [1933 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Constant_1203 [Constant] [01/12/2022-09:32:28] [V] [TRT] Constant_1203 [Constant] inputs: [01/12/2022-09:32:28] [V] [TRT] Constant_1203 [Constant] outputs: [1934 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Mul_1204 [Mul] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1899 [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1934 [01/12/2022-09:32:28] [V] [TRT] Mul_1204 [Mul] inputs: [1899 -> ()[INT32]], [1934 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Registering layer: 1934 for ONNX node: 1934 [01/12/2022-09:32:28] [V] [TRT] Registering layer: Mul_1204 for ONNX node: Mul_1204 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1935 for ONNX tensor: 1935 [01/12/2022-09:32:28] [V] [TRT] Mul_1204 [Mul] outputs: [1935 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Unsqueeze_1205 [Unsqueeze] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1899 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1205 [Unsqueeze] inputs: [1899 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:28] [V] [TRT] Registering layer: Unsqueeze_1205 for ONNX node: Unsqueeze_1205 [01/12/2022-09:32:28] [V] [TRT] Registering tensor: 1938 for ONNX tensor: 1938 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1205 [Unsqueeze] outputs: [1938 -> (1)[INT32]], [01/12/2022-09:32:28] [V] [TRT] Parsing node: Unsqueeze_1206 [Unsqueeze] [01/12/2022-09:32:28] [V] [TRT] Searching for input: 1902 [01/12/2022-09:32:28] [V] [TRT] Unsqueeze_1206 [Unsqueeze] inputs: [1902 -> ()[INT32]], [01/12/2022-09:32:28] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:28] [V] [TRT] Registering layer: Unsqueeze_1206 for ONNX node: Unsqueeze_1206 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1939 for ONNX tensor: 1939 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1206 [Unsqueeze] outputs: [1939 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Concat_1207 [Concat] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1938 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1939 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3043 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3044 [01/12/2022-09:32:29] [V] [TRT] Concat_1207 [Concat] inputs: [1938 -> (1)[INT32]], [1939 -> (1)[INT32]], [3043 -> (1)[INT32]], [3044 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3043 for ONNX node: 3043 [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3044 for ONNX node: 3044 [01/12/2022-09:32:29] [V] [TRT] Registering layer: Concat_1207 for ONNX node: Concat_1207 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1942 for ONNX tensor: 1942 [01/12/2022-09:32:29] [V] [TRT] Concat_1207 [Concat] outputs: [1942 -> (4)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Reshape_1208 [Reshape] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1907 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1942 [01/12/2022-09:32:29] [V] [TRT] Reshape_1208 [Reshape] inputs: [1907 -> (-1, -1, 768)[FLOAT]], [1942 -> (4)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Reshape_1208 for ONNX node: Reshape_1208 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1943 for ONNX tensor: 1943 [01/12/2022-09:32:29] [V] [TRT] Reshape_1208 [Reshape] outputs: [1943 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Transpose_1209 [Transpose] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1943 [01/12/2022-09:32:29] [V] [TRT] Transpose_1209 [Transpose] inputs: [1943 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Transpose_1209 for ONNX node: Transpose_1209 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1944 for ONNX tensor: 1944 [01/12/2022-09:32:29] [V] [TRT] Transpose_1209 [Transpose] outputs: [1944 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1210 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1935 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1210 [Unsqueeze] inputs: [1935 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1210 for ONNX node: Unsqueeze_1210 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1947 for ONNX tensor: 1947 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1210 [Unsqueeze] outputs: [1947 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Concat_1211 [Concat] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1947 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3045 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3046 [01/12/2022-09:32:29] [V] [TRT] Concat_1211 [Concat] inputs: [1947 -> (1)[INT32]], [3045 -> (1)[INT32]], [3046 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3045 for ONNX node: 3045 [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3046 for ONNX node: 3046 [01/12/2022-09:32:29] [V] [TRT] Registering layer: Concat_1211 for ONNX node: Concat_1211 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1950 for ONNX tensor: 1950 [01/12/2022-09:32:29] [V] [TRT] Concat_1211 [Concat] outputs: [1950 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Reshape_1212 [Reshape] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1944 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1950 [01/12/2022-09:32:29] [V] [TRT] Reshape_1212 [Reshape] inputs: [1944 -> (-1, 12, -1, 64)[FLOAT]], [1950 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Reshape_1212 for ONNX node: Reshape_1212 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1951 for ONNX tensor: 1951 [01/12/2022-09:32:29] [V] [TRT] Reshape_1212 [Reshape] outputs: [1951 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1213 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1935 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1213 [Unsqueeze] inputs: [1935 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1213 for ONNX node: Unsqueeze_1213 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1954 for ONNX tensor: 1954 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1213 [Unsqueeze] outputs: [1954 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Concat_1214 [Concat] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1954 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3047 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3048 [01/12/2022-09:32:29] [V] [TRT] Concat_1214 [Concat] inputs: [1954 -> (1)[INT32]], [3047 -> (1)[INT32]], [3048 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3047 for ONNX node: 3047 [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3048 for ONNX node: 3048 [01/12/2022-09:32:29] [V] [TRT] Registering layer: Concat_1214 for ONNX node: Concat_1214 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1957 for ONNX tensor: 1957 [01/12/2022-09:32:29] [V] [TRT] Concat_1214 [Concat] outputs: [1957 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Reshape_1215 [Reshape] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1920 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1957 [01/12/2022-09:32:29] [V] [TRT] Reshape_1215 [Reshape] inputs: [1920 -> (-1, 12, -1, 64)[FLOAT]], [1957 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Reshape_1215 for ONNX node: Reshape_1215 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1958 for ONNX tensor: 1958 [01/12/2022-09:32:29] [V] [TRT] Reshape_1215 [Reshape] outputs: [1958 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1216 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1935 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1216 [Unsqueeze] inputs: [1935 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1216 for ONNX node: Unsqueeze_1216 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1961 for ONNX tensor: 1961 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1216 [Unsqueeze] outputs: [1961 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Concat_1217 [Concat] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1961 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3049 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3050 [01/12/2022-09:32:29] [V] [TRT] Concat_1217 [Concat] inputs: [1961 -> (1)[INT32]], [3049 -> (1)[INT32]], [3050 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3049 for ONNX node: 3049 [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3050 for ONNX node: 3050 [01/12/2022-09:32:29] [V] [TRT] Registering layer: Concat_1217 for ONNX node: Concat_1217 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1964 for ONNX tensor: 1964 [01/12/2022-09:32:29] [V] [TRT] Concat_1217 [Concat] outputs: [1964 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Reshape_1218 [Reshape] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1933 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1964 [01/12/2022-09:32:29] [V] [TRT] Reshape_1218 [Reshape] inputs: [1933 -> (-1, 12, -1, 64)[FLOAT]], [1964 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Reshape_1218 for ONNX node: Reshape_1218 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1965 for ONNX tensor: 1965 [01/12/2022-09:32:29] [V] [TRT] Reshape_1218 [Reshape] outputs: [1965 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Transpose_1219 [Transpose] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1958 [01/12/2022-09:32:29] [V] [TRT] Transpose_1219 [Transpose] inputs: [1958 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Transpose_1219 for ONNX node: Transpose_1219 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1966 for ONNX tensor: 1966 [01/12/2022-09:32:29] [V] [TRT] Transpose_1219 [Transpose] outputs: [1966 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: MatMul_1220 [MatMul] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1951 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1966 [01/12/2022-09:32:29] [V] [TRT] MatMul_1220 [MatMul] inputs: [1951 -> (-1, -1, 64)[FLOAT]], [1966 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: MatMul_1220 for ONNX node: MatMul_1220 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1967 for ONNX tensor: 1967 [01/12/2022-09:32:29] [V] [TRT] MatMul_1220 [MatMul] outputs: [1967 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Softmax_1221 [Softmax] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1967 [01/12/2022-09:32:29] [V] [TRT] Softmax_1221 [Softmax] inputs: [1967 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Softmax_1221 for ONNX node: Softmax_1221 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1968 for ONNX tensor: 1968 [01/12/2022-09:32:29] [V] [TRT] Softmax_1221 [Softmax] outputs: [1968 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: MatMul_1222 [MatMul] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1968 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1965 [01/12/2022-09:32:29] [V] [TRT] MatMul_1222 [MatMul] inputs: [1968 -> (-1, -1, -1)[FLOAT]], [1965 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: MatMul_1222 for ONNX node: MatMul_1222 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1969 for ONNX tensor: 1969 [01/12/2022-09:32:29] [V] [TRT] MatMul_1222 [MatMul] outputs: [1969 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1223 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1899 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1223 [Unsqueeze] inputs: [1899 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1223 for ONNX node: Unsqueeze_1223 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1972 for ONNX tensor: 1972 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1223 [Unsqueeze] outputs: [1972 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1224 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1902 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1224 [Unsqueeze] inputs: [1902 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1224 for ONNX node: Unsqueeze_1224 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1974 for ONNX tensor: 1974 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1224 [Unsqueeze] outputs: [1974 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Concat_1225 [Concat] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1972 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3051 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1974 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3052 [01/12/2022-09:32:29] [V] [TRT] Concat_1225 [Concat] inputs: [1972 -> (1)[INT32]], [3051 -> (1)[INT32]], [1974 -> (1)[INT32]], [3052 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3051 for ONNX node: 3051 [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3052 for ONNX node: 3052 [01/12/2022-09:32:29] [V] [TRT] Registering layer: Concat_1225 for ONNX node: Concat_1225 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1976 for ONNX tensor: 1976 [01/12/2022-09:32:29] [V] [TRT] Concat_1225 [Concat] outputs: [1976 -> (4)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Reshape_1226 [Reshape] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1969 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1976 [01/12/2022-09:32:29] [V] [TRT] Reshape_1226 [Reshape] inputs: [1969 -> (-1, -1, 64)[FLOAT]], [1976 -> (4)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Reshape_1226 for ONNX node: Reshape_1226 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1977 for ONNX tensor: 1977 [01/12/2022-09:32:29] [V] [TRT] Reshape_1226 [Reshape] outputs: [1977 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Transpose_1227 [Transpose] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1977 [01/12/2022-09:32:29] [V] [TRT] Transpose_1227 [Transpose] inputs: [1977 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Transpose_1227 for ONNX node: Transpose_1227 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1978 for ONNX tensor: 1978 [01/12/2022-09:32:29] [V] [TRT] Transpose_1227 [Transpose] outputs: [1978 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1228 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1899 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1228 [Unsqueeze] inputs: [1899 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1228 for ONNX node: Unsqueeze_1228 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1980 for ONNX tensor: 1980 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1228 [Unsqueeze] outputs: [1980 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Unsqueeze_1229 [Unsqueeze] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1902 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1229 [Unsqueeze] inputs: [1902 -> ()[INT32]], [01/12/2022-09:32:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:29] [V] [TRT] Registering layer: Unsqueeze_1229 for ONNX node: Unsqueeze_1229 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1981 for ONNX tensor: 1981 [01/12/2022-09:32:29] [V] [TRT] Unsqueeze_1229 [Unsqueeze] outputs: [1981 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Concat_1230 [Concat] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1980 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1981 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3053 [01/12/2022-09:32:29] [V] [TRT] Concat_1230 [Concat] inputs: [1980 -> (1)[INT32]], [1981 -> (1)[INT32]], [3053 -> (1)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3053 for ONNX node: 3053 [01/12/2022-09:32:29] [V] [TRT] Registering layer: Concat_1230 for ONNX node: Concat_1230 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1983 for ONNX tensor: 1983 [01/12/2022-09:32:29] [V] [TRT] Concat_1230 [Concat] outputs: [1983 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: Reshape_1231 [Reshape] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1978 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1983 [01/12/2022-09:32:29] [V] [TRT] Reshape_1231 [Reshape] inputs: [1978 -> (-1, -1, 12, 64)[FLOAT]], [1983 -> (3)[INT32]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: Reshape_1231 for ONNX node: Reshape_1231 [01/12/2022-09:32:29] [V] [TRT] Registering tensor: 1984 for ONNX tensor: 1984 [01/12/2022-09:32:29] [V] [TRT] Reshape_1231 [Reshape] outputs: [1984 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Parsing node: MatMul_1232 [MatMul] [01/12/2022-09:32:29] [V] [TRT] Searching for input: 1984 [01/12/2022-09:32:29] [V] [TRT] Searching for input: 3054 [01/12/2022-09:32:29] [V] [TRT] MatMul_1232 [MatMul] inputs: [1984 -> (-1, -1, 768)[FLOAT]], [3054 -> (768, 768)[FLOAT]], [01/12/2022-09:32:29] [V] [TRT] Registering layer: 3054 for ONNX node: 3054 [01/12/2022-09:32:29] [V] [TRT] Registering layer: MatMul_1232 for ONNX node: MatMul_1232 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1986 for ONNX tensor: 1986 [01/12/2022-09:32:30] [V] [TRT] MatMul_1232 [MatMul] outputs: [1986 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1233 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: decoder.layers.2.encoder_attn.out_proj.bias [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1986 [01/12/2022-09:32:30] [V] [TRT] Add_1233 [Add] inputs: [decoder.layers.2.encoder_attn.out_proj.bias -> (768)[FLOAT]], [1986 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: decoder.layers.2.encoder_attn.out_proj.bias for ONNX node: decoder.layers.2.encoder_attn.out_proj.bias [01/12/2022-09:32:30] [V] [TRT] Registering layer: Add_1233 for ONNX node: Add_1233 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1987 for ONNX tensor: 1987 [01/12/2022-09:32:30] [V] [TRT] Add_1233 [Add] outputs: [1987 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1234 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1896 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1987 [01/12/2022-09:32:30] [V] [TRT] Add_1234 [Add] inputs: [1896 -> (-1, -1, 768)[FLOAT]], [1987 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: Add_1234 for ONNX node: Add_1234 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1988 for ONNX tensor: 1988 [01/12/2022-09:32:30] [V] [TRT] Add_1234 [Add] outputs: [1988 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: ReduceMean_1235 [ReduceMean] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1988 [01/12/2022-09:32:30] [V] [TRT] ReduceMean_1235 [ReduceMean] inputs: [1988 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: ReduceMean_1235 for ONNX node: ReduceMean_1235 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1989 for ONNX tensor: 1989 [01/12/2022-09:32:30] [V] [TRT] ReduceMean_1235 [ReduceMean] outputs: [1989 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Sub_1236 [Sub] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1988 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1989 [01/12/2022-09:32:30] [V] [TRT] Sub_1236 [Sub] inputs: [1988 -> (-1, -1, 768)[FLOAT]], [1989 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: Sub_1236 for ONNX node: Sub_1236 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1990 for ONNX tensor: 1990 [01/12/2022-09:32:30] [V] [TRT] Sub_1236 [Sub] outputs: [1990 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Constant_1237 [Constant] [01/12/2022-09:32:30] [V] [TRT] Constant_1237 [Constant] inputs: [01/12/2022-09:32:30] [V] [TRT] Constant_1237 [Constant] outputs: [1991 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Pow_1238 [Pow] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1990 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1991 [01/12/2022-09:32:30] [V] [TRT] Pow_1238 [Pow] inputs: [1990 -> (-1, -1, 768)[FLOAT]], [1991 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 1991 for ONNX node: 1991 [01/12/2022-09:32:30] [V] [TRT] Registering layer: Pow_1238 for ONNX node: Pow_1238 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1992 for ONNX tensor: 1992 [01/12/2022-09:32:30] [V] [TRT] Pow_1238 [Pow] outputs: [1992 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: ReduceMean_1239 [ReduceMean] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1992 [01/12/2022-09:32:30] [V] [TRT] ReduceMean_1239 [ReduceMean] inputs: [1992 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: ReduceMean_1239 for ONNX node: ReduceMean_1239 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1993 for ONNX tensor: 1993 [01/12/2022-09:32:30] [V] [TRT] ReduceMean_1239 [ReduceMean] outputs: [1993 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Constant_1240 [Constant] [01/12/2022-09:32:30] [V] [TRT] Constant_1240 [Constant] inputs: [01/12/2022-09:32:30] [V] [TRT] Constant_1240 [Constant] outputs: [1994 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1241 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1993 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1994 [01/12/2022-09:32:30] [V] [TRT] Add_1241 [Add] inputs: [1993 -> (-1, -1, 1)[FLOAT]], [1994 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 1994 for ONNX node: 1994 [01/12/2022-09:32:30] [V] [TRT] Registering layer: Add_1241 for ONNX node: Add_1241 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1995 for ONNX tensor: 1995 [01/12/2022-09:32:30] [V] [TRT] Add_1241 [Add] outputs: [1995 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Sqrt_1242 [Sqrt] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1995 [01/12/2022-09:32:30] [V] [TRT] Sqrt_1242 [Sqrt] inputs: [1995 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: Sqrt_1242 for ONNX node: Sqrt_1242 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1996 for ONNX tensor: 1996 [01/12/2022-09:32:30] [V] [TRT] Sqrt_1242 [Sqrt] outputs: [1996 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Div_1243 [Div] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1990 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1996 [01/12/2022-09:32:30] [V] [TRT] Div_1243 [Div] inputs: [1990 -> (-1, -1, 768)[FLOAT]], [1996 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: Div_1243 for ONNX node: Div_1243 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1997 for ONNX tensor: 1997 [01/12/2022-09:32:30] [V] [TRT] Div_1243 [Div] outputs: [1997 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Mul_1244 [Mul] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1997 [01/12/2022-09:32:30] [V] [TRT] Searching for input: decoder.layers.2.encoder_attn_layer_norm.weight [01/12/2022-09:32:30] [V] [TRT] Mul_1244 [Mul] inputs: [1997 -> (-1, -1, 768)[FLOAT]], [decoder.layers.2.encoder_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: decoder.layers.2.encoder_attn_layer_norm.weight for ONNX node: decoder.layers.2.encoder_attn_layer_norm.weight [01/12/2022-09:32:30] [V] [TRT] Registering layer: Mul_1244 for ONNX node: Mul_1244 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1998 for ONNX tensor: 1998 [01/12/2022-09:32:30] [V] [TRT] Mul_1244 [Mul] outputs: [1998 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1245 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1998 [01/12/2022-09:32:30] [V] [TRT] Searching for input: decoder.layers.2.encoder_attn_layer_norm.bias [01/12/2022-09:32:30] [V] [TRT] Add_1245 [Add] inputs: [1998 -> (-1, -1, 768)[FLOAT]], [decoder.layers.2.encoder_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: decoder.layers.2.encoder_attn_layer_norm.bias for ONNX node: decoder.layers.2.encoder_attn_layer_norm.bias [01/12/2022-09:32:30] [V] [TRT] Registering layer: Add_1245 for ONNX node: Add_1245 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 1999 for ONNX tensor: 1999 [01/12/2022-09:32:30] [V] [TRT] Add_1245 [Add] outputs: [1999 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: MatMul_1246 [MatMul] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 1999 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 3055 [01/12/2022-09:32:30] [V] [TRT] MatMul_1246 [MatMul] inputs: [1999 -> (-1, -1, 768)[FLOAT]], [3055 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 3055 for ONNX node: 3055 [01/12/2022-09:32:30] [V] [TRT] Registering layer: MatMul_1246 for ONNX node: MatMul_1246 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2001 for ONNX tensor: 2001 [01/12/2022-09:32:30] [V] [TRT] MatMul_1246 [MatMul] outputs: [2001 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1247 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: decoder.layers.2.fc1.bias [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2001 [01/12/2022-09:32:30] [V] [TRT] Add_1247 [Add] inputs: [decoder.layers.2.fc1.bias -> (3072)[FLOAT]], [2001 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: decoder.layers.2.fc1.bias for ONNX node: decoder.layers.2.fc1.bias [01/12/2022-09:32:30] [V] [TRT] Registering layer: Add_1247 for ONNX node: Add_1247 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2002 for ONNX tensor: 2002 [01/12/2022-09:32:30] [V] [TRT] Add_1247 [Add] outputs: [2002 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Constant_1248 [Constant] [01/12/2022-09:32:30] [V] [TRT] Constant_1248 [Constant] inputs: [01/12/2022-09:32:30] [V] [TRT] Constant_1248 [Constant] outputs: [2003 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Div_1249 [Div] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2002 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2003 [01/12/2022-09:32:30] [V] [TRT] Div_1249 [Div] inputs: [2002 -> (-1, -1, 3072)[FLOAT]], [2003 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 2003 for ONNX node: 2003 [01/12/2022-09:32:30] [V] [TRT] Registering layer: Div_1249 for ONNX node: Div_1249 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2004 for ONNX tensor: 2004 [01/12/2022-09:32:30] [V] [TRT] Div_1249 [Div] outputs: [2004 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Erf_1250 [Erf] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2004 [01/12/2022-09:32:30] [V] [TRT] Erf_1250 [Erf] inputs: [2004 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: Erf_1250 for ONNX node: Erf_1250 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2005 for ONNX tensor: 2005 [01/12/2022-09:32:30] [V] [TRT] Erf_1250 [Erf] outputs: [2005 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Constant_1251 [Constant] [01/12/2022-09:32:30] [V] [TRT] Constant_1251 [Constant] inputs: [01/12/2022-09:32:30] [V] [TRT] Constant_1251 [Constant] outputs: [2006 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1252 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2005 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2006 [01/12/2022-09:32:30] [V] [TRT] Add_1252 [Add] inputs: [2005 -> (-1, -1, 3072)[FLOAT]], [2006 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 2006 for ONNX node: 2006 [01/12/2022-09:32:30] [V] [TRT] Registering layer: Add_1252 for ONNX node: Add_1252 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2007 for ONNX tensor: 2007 [01/12/2022-09:32:30] [V] [TRT] Add_1252 [Add] outputs: [2007 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Mul_1253 [Mul] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2002 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2007 [01/12/2022-09:32:30] [V] [TRT] Mul_1253 [Mul] inputs: [2002 -> (-1, -1, 3072)[FLOAT]], [2007 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: Mul_1253 for ONNX node: Mul_1253 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2008 for ONNX tensor: 2008 [01/12/2022-09:32:30] [V] [TRT] Mul_1253 [Mul] outputs: [2008 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Constant_1254 [Constant] [01/12/2022-09:32:30] [V] [TRT] Constant_1254 [Constant] inputs: [01/12/2022-09:32:30] [V] [TRT] Constant_1254 [Constant] outputs: [2009 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Mul_1255 [Mul] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2008 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2009 [01/12/2022-09:32:30] [V] [TRT] Mul_1255 [Mul] inputs: [2008 -> (-1, -1, 3072)[FLOAT]], [2009 -> ()[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 2009 for ONNX node: 2009 [01/12/2022-09:32:30] [V] [TRT] Registering layer: Mul_1255 for ONNX node: Mul_1255 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2010 for ONNX tensor: 2010 [01/12/2022-09:32:30] [V] [TRT] Mul_1255 [Mul] outputs: [2010 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: MatMul_1256 [MatMul] [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2010 [01/12/2022-09:32:30] [V] [TRT] Searching for input: 3056 [01/12/2022-09:32:30] [V] [TRT] MatMul_1256 [MatMul] inputs: [2010 -> (-1, -1, 3072)[FLOAT]], [3056 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: 3056 for ONNX node: 3056 [01/12/2022-09:32:30] [V] [TRT] Registering layer: MatMul_1256 for ONNX node: MatMul_1256 [01/12/2022-09:32:30] [V] [TRT] Registering tensor: 2012 for ONNX tensor: 2012 [01/12/2022-09:32:30] [V] [TRT] MatMul_1256 [MatMul] outputs: [2012 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Parsing node: Add_1257 [Add] [01/12/2022-09:32:30] [V] [TRT] Searching for input: decoder.layers.2.fc2.bias [01/12/2022-09:32:30] [V] [TRT] Searching for input: 2012 [01/12/2022-09:32:30] [V] [TRT] Add_1257 [Add] inputs: [decoder.layers.2.fc2.bias -> (768)[FLOAT]], [2012 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:30] [V] [TRT] Registering layer: decoder.layers.2.fc2.bias for ONNX node: decoder.layers.2.fc2.bias [01/12/2022-09:32:31] [V] [TRT] Registering layer: Add_1257 for ONNX node: Add_1257 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2013 for ONNX tensor: 2013 [01/12/2022-09:32:31] [V] [TRT] Add_1257 [Add] outputs: [2013 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Add_1258 [Add] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 1999 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2013 [01/12/2022-09:32:31] [V] [TRT] Add_1258 [Add] inputs: [1999 -> (-1, -1, 768)[FLOAT]], [2013 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: Add_1258 for ONNX node: Add_1258 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2014 for ONNX tensor: 2014 [01/12/2022-09:32:31] [V] [TRT] Add_1258 [Add] outputs: [2014 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: ReduceMean_1259 [ReduceMean] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2014 [01/12/2022-09:32:31] [V] [TRT] ReduceMean_1259 [ReduceMean] inputs: [2014 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: ReduceMean_1259 for ONNX node: ReduceMean_1259 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2015 for ONNX tensor: 2015 [01/12/2022-09:32:31] [V] [TRT] ReduceMean_1259 [ReduceMean] outputs: [2015 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Sub_1260 [Sub] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2014 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2015 [01/12/2022-09:32:31] [V] [TRT] Sub_1260 [Sub] inputs: [2014 -> (-1, -1, 768)[FLOAT]], [2015 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: Sub_1260 for ONNX node: Sub_1260 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2016 for ONNX tensor: 2016 [01/12/2022-09:32:31] [V] [TRT] Sub_1260 [Sub] outputs: [2016 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Constant_1261 [Constant] [01/12/2022-09:32:31] [V] [TRT] Constant_1261 [Constant] inputs: [01/12/2022-09:32:31] [V] [TRT] Constant_1261 [Constant] outputs: [2017 -> ()[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Pow_1262 [Pow] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2016 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2017 [01/12/2022-09:32:31] [V] [TRT] Pow_1262 [Pow] inputs: [2016 -> (-1, -1, 768)[FLOAT]], [2017 -> ()[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 2017 for ONNX node: 2017 [01/12/2022-09:32:31] [V] [TRT] Registering layer: Pow_1262 for ONNX node: Pow_1262 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2018 for ONNX tensor: 2018 [01/12/2022-09:32:31] [V] [TRT] Pow_1262 [Pow] outputs: [2018 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: ReduceMean_1263 [ReduceMean] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2018 [01/12/2022-09:32:31] [V] [TRT] ReduceMean_1263 [ReduceMean] inputs: [2018 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: ReduceMean_1263 for ONNX node: ReduceMean_1263 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2019 for ONNX tensor: 2019 [01/12/2022-09:32:31] [V] [TRT] ReduceMean_1263 [ReduceMean] outputs: [2019 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Constant_1264 [Constant] [01/12/2022-09:32:31] [V] [TRT] Constant_1264 [Constant] inputs: [01/12/2022-09:32:31] [V] [TRT] Constant_1264 [Constant] outputs: [2020 -> ()[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Add_1265 [Add] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2019 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2020 [01/12/2022-09:32:31] [V] [TRT] Add_1265 [Add] inputs: [2019 -> (-1, -1, 1)[FLOAT]], [2020 -> ()[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 2020 for ONNX node: 2020 [01/12/2022-09:32:31] [V] [TRT] Registering layer: Add_1265 for ONNX node: Add_1265 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2021 for ONNX tensor: 2021 [01/12/2022-09:32:31] [V] [TRT] Add_1265 [Add] outputs: [2021 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Sqrt_1266 [Sqrt] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2021 [01/12/2022-09:32:31] [V] [TRT] Sqrt_1266 [Sqrt] inputs: [2021 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: Sqrt_1266 for ONNX node: Sqrt_1266 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2022 for ONNX tensor: 2022 [01/12/2022-09:32:31] [V] [TRT] Sqrt_1266 [Sqrt] outputs: [2022 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Div_1267 [Div] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2016 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2022 [01/12/2022-09:32:31] [V] [TRT] Div_1267 [Div] inputs: [2016 -> (-1, -1, 768)[FLOAT]], [2022 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: Div_1267 for ONNX node: Div_1267 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2023 for ONNX tensor: 2023 [01/12/2022-09:32:31] [V] [TRT] Div_1267 [Div] outputs: [2023 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Mul_1268 [Mul] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2023 [01/12/2022-09:32:31] [V] [TRT] Searching for input: decoder.layers.2.final_layer_norm.weight [01/12/2022-09:32:31] [V] [TRT] Mul_1268 [Mul] inputs: [2023 -> (-1, -1, 768)[FLOAT]], [decoder.layers.2.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: decoder.layers.2.final_layer_norm.weight for ONNX node: decoder.layers.2.final_layer_norm.weight [01/12/2022-09:32:31] [V] [TRT] Registering layer: Mul_1268 for ONNX node: Mul_1268 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2024 for ONNX tensor: 2024 [01/12/2022-09:32:31] [V] [TRT] Mul_1268 [Mul] outputs: [2024 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Add_1269 [Add] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2024 [01/12/2022-09:32:31] [V] [TRT] Searching for input: decoder.layers.2.final_layer_norm.bias [01/12/2022-09:32:31] [V] [TRT] Add_1269 [Add] inputs: [2024 -> (-1, -1, 768)[FLOAT]], [decoder.layers.2.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: decoder.layers.2.final_layer_norm.bias for ONNX node: decoder.layers.2.final_layer_norm.bias [01/12/2022-09:32:31] [V] [TRT] Registering layer: Add_1269 for ONNX node: Add_1269 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2025 for ONNX tensor: 2025 [01/12/2022-09:32:31] [V] [TRT] Add_1269 [Add] outputs: [2025 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Shape_1270 [Shape] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2025 [01/12/2022-09:32:31] [V] [TRT] Shape_1270 [Shape] inputs: [2025 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: Shape_1270 for ONNX node: Shape_1270 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2026 for ONNX tensor: 2026 [01/12/2022-09:32:31] [V] [TRT] Shape_1270 [Shape] outputs: [2026 -> (3)[INT32]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Constant_1271 [Constant] [01/12/2022-09:32:31] [V] [TRT] Constant_1271 [Constant] inputs: [01/12/2022-09:32:31] [V] [TRT] Constant_1271 [Constant] outputs: [2027 -> ()[INT32]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Gather_1272 [Gather] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2026 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2027 [01/12/2022-09:32:31] [V] [TRT] Gather_1272 [Gather] inputs: [2026 -> (3)[INT32]], [2027 -> ()[INT32]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 2027 for ONNX node: 2027 [01/12/2022-09:32:31] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:31] [V] [TRT] Registering layer: Gather_1272 for ONNX node: Gather_1272 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2028 for ONNX tensor: 2028 [01/12/2022-09:32:31] [V] [TRT] Gather_1272 [Gather] outputs: [2028 -> ()[INT32]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Shape_1273 [Shape] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2025 [01/12/2022-09:32:31] [V] [TRT] Shape_1273 [Shape] inputs: [2025 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: Shape_1273 for ONNX node: Shape_1273 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2029 for ONNX tensor: 2029 [01/12/2022-09:32:31] [V] [TRT] Shape_1273 [Shape] outputs: [2029 -> (3)[INT32]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Constant_1274 [Constant] [01/12/2022-09:32:31] [V] [TRT] Constant_1274 [Constant] inputs: [01/12/2022-09:32:31] [V] [TRT] Constant_1274 [Constant] outputs: [2030 -> ()[INT32]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Gather_1275 [Gather] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2029 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2030 [01/12/2022-09:32:31] [V] [TRT] Gather_1275 [Gather] inputs: [2029 -> (3)[INT32]], [2030 -> ()[INT32]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 2030 for ONNX node: 2030 [01/12/2022-09:32:31] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:31] [V] [TRT] Registering layer: Gather_1275 for ONNX node: Gather_1275 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2031 for ONNX tensor: 2031 [01/12/2022-09:32:31] [V] [TRT] Gather_1275 [Gather] outputs: [2031 -> ()[INT32]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: MatMul_1276 [MatMul] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2025 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 3057 [01/12/2022-09:32:31] [V] [TRT] MatMul_1276 [MatMul] inputs: [2025 -> (-1, -1, 768)[FLOAT]], [3057 -> (768, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 3057 for ONNX node: 3057 [01/12/2022-09:32:31] [V] [TRT] Registering layer: MatMul_1276 for ONNX node: MatMul_1276 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2033 for ONNX tensor: 2033 [01/12/2022-09:32:31] [V] [TRT] MatMul_1276 [MatMul] outputs: [2033 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Add_1277 [Add] [01/12/2022-09:32:31] [V] [TRT] Searching for input: decoder.layers.3.self_attn.q_proj.bias [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2033 [01/12/2022-09:32:31] [V] [TRT] Add_1277 [Add] inputs: [decoder.layers.3.self_attn.q_proj.bias -> (768)[FLOAT]], [2033 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: decoder.layers.3.self_attn.q_proj.bias for ONNX node: decoder.layers.3.self_attn.q_proj.bias [01/12/2022-09:32:31] [V] [TRT] Registering layer: Add_1277 for ONNX node: Add_1277 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2034 for ONNX tensor: 2034 [01/12/2022-09:32:31] [V] [TRT] Add_1277 [Add] outputs: [2034 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Constant_1278 [Constant] [01/12/2022-09:32:31] [V] [TRT] Constant_1278 [Constant] inputs: [01/12/2022-09:32:31] [V] [TRT] Constant_1278 [Constant] outputs: [2035 -> ()[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Mul_1279 [Mul] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2034 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2035 [01/12/2022-09:32:31] [V] [TRT] Mul_1279 [Mul] inputs: [2034 -> (-1, -1, 768)[FLOAT]], [2035 -> ()[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 2035 for ONNX node: 2035 [01/12/2022-09:32:31] [V] [TRT] Registering layer: Mul_1279 for ONNX node: Mul_1279 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2036 for ONNX tensor: 2036 [01/12/2022-09:32:31] [V] [TRT] Mul_1279 [Mul] outputs: [2036 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: MatMul_1280 [MatMul] [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2025 [01/12/2022-09:32:31] [V] [TRT] Searching for input: 3058 [01/12/2022-09:32:31] [V] [TRT] MatMul_1280 [MatMul] inputs: [2025 -> (-1, -1, 768)[FLOAT]], [3058 -> (768, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: 3058 for ONNX node: 3058 [01/12/2022-09:32:31] [V] [TRT] Registering layer: MatMul_1280 for ONNX node: MatMul_1280 [01/12/2022-09:32:31] [V] [TRT] Registering tensor: 2038 for ONNX tensor: 2038 [01/12/2022-09:32:31] [V] [TRT] MatMul_1280 [MatMul] outputs: [2038 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Parsing node: Add_1281 [Add] [01/12/2022-09:32:31] [V] [TRT] Searching for input: decoder.layers.3.self_attn.k_proj.bias [01/12/2022-09:32:31] [V] [TRT] Searching for input: 2038 [01/12/2022-09:32:31] [V] [TRT] Add_1281 [Add] inputs: [decoder.layers.3.self_attn.k_proj.bias -> (768)[FLOAT]], [2038 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:31] [V] [TRT] Registering layer: decoder.layers.3.self_attn.k_proj.bias for ONNX node: decoder.layers.3.self_attn.k_proj.bias [01/12/2022-09:32:32] [V] [TRT] Registering layer: Add_1281 for ONNX node: Add_1281 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2039 for ONNX tensor: 2039 [01/12/2022-09:32:32] [V] [TRT] Add_1281 [Add] outputs: [2039 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1282 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1282 [Unsqueeze] inputs: [2028 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1282 for ONNX node: Unsqueeze_1282 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2043 for ONNX tensor: 2043 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1282 [Unsqueeze] outputs: [2043 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Concat_1283 [Concat] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2043 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3059 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3060 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3061 [01/12/2022-09:32:32] [V] [TRT] Concat_1283 [Concat] inputs: [2043 -> (1)[INT32]], [3059 -> (1)[INT32]], [3060 -> (1)[INT32]], [3061 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3059 for ONNX node: 3059 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3060 for ONNX node: 3060 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3061 for ONNX node: 3061 [01/12/2022-09:32:32] [V] [TRT] Registering layer: Concat_1283 for ONNX node: Concat_1283 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2047 for ONNX tensor: 2047 [01/12/2022-09:32:32] [V] [TRT] Concat_1283 [Concat] outputs: [2047 -> (4)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Reshape_1284 [Reshape] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2039 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2047 [01/12/2022-09:32:32] [V] [TRT] Reshape_1284 [Reshape] inputs: [2039 -> (-1, -1, 768)[FLOAT]], [2047 -> (4)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Reshape_1284 for ONNX node: Reshape_1284 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2048 for ONNX tensor: 2048 [01/12/2022-09:32:32] [V] [TRT] Reshape_1284 [Reshape] outputs: [2048 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Transpose_1285 [Transpose] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2048 [01/12/2022-09:32:32] [V] [TRT] Transpose_1285 [Transpose] inputs: [2048 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Transpose_1285 for ONNX node: Transpose_1285 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2049_14 for ONNX tensor: 2049 [01/12/2022-09:32:32] [V] [TRT] Transpose_1285 [Transpose] outputs: [2049 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: MatMul_1286 [MatMul] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2025 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3062 [01/12/2022-09:32:32] [V] [TRT] MatMul_1286 [MatMul] inputs: [2025 -> (-1, -1, 768)[FLOAT]], [3062 -> (768, 768)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3062 for ONNX node: 3062 [01/12/2022-09:32:32] [V] [TRT] Registering layer: MatMul_1286 for ONNX node: MatMul_1286 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2051 for ONNX tensor: 2051 [01/12/2022-09:32:32] [V] [TRT] MatMul_1286 [MatMul] outputs: [2051 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Add_1287 [Add] [01/12/2022-09:32:32] [V] [TRT] Searching for input: decoder.layers.3.self_attn.v_proj.bias [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2051 [01/12/2022-09:32:32] [V] [TRT] Add_1287 [Add] inputs: [decoder.layers.3.self_attn.v_proj.bias -> (768)[FLOAT]], [2051 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: decoder.layers.3.self_attn.v_proj.bias for ONNX node: decoder.layers.3.self_attn.v_proj.bias [01/12/2022-09:32:32] [V] [TRT] Registering layer: Add_1287 for ONNX node: Add_1287 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2052 for ONNX tensor: 2052 [01/12/2022-09:32:32] [V] [TRT] Add_1287 [Add] outputs: [2052 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1288 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1288 [Unsqueeze] inputs: [2028 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1288 for ONNX node: Unsqueeze_1288 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2056 for ONNX tensor: 2056 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1288 [Unsqueeze] outputs: [2056 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Concat_1289 [Concat] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2056 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3063 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3064 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3065 [01/12/2022-09:32:32] [V] [TRT] Concat_1289 [Concat] inputs: [2056 -> (1)[INT32]], [3063 -> (1)[INT32]], [3064 -> (1)[INT32]], [3065 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3063 for ONNX node: 3063 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3064 for ONNX node: 3064 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3065 for ONNX node: 3065 [01/12/2022-09:32:32] [V] [TRT] Registering layer: Concat_1289 for ONNX node: Concat_1289 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2060 for ONNX tensor: 2060 [01/12/2022-09:32:32] [V] [TRT] Concat_1289 [Concat] outputs: [2060 -> (4)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Reshape_1290 [Reshape] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2052 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2060 [01/12/2022-09:32:32] [V] [TRT] Reshape_1290 [Reshape] inputs: [2052 -> (-1, -1, 768)[FLOAT]], [2060 -> (4)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Reshape_1290 for ONNX node: Reshape_1290 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2061 for ONNX tensor: 2061 [01/12/2022-09:32:32] [V] [TRT] Reshape_1290 [Reshape] outputs: [2061 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Transpose_1291 [Transpose] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2061 [01/12/2022-09:32:32] [V] [TRT] Transpose_1291 [Transpose] inputs: [2061 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Transpose_1291 for ONNX node: Transpose_1291 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2062_15 for ONNX tensor: 2062 [01/12/2022-09:32:32] [V] [TRT] Transpose_1291 [Transpose] outputs: [2062 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Constant_1292 [Constant] [01/12/2022-09:32:32] [V] [TRT] Constant_1292 [Constant] inputs: [01/12/2022-09:32:32] [V] [TRT] Constant_1292 [Constant] outputs: [2063 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Mul_1293 [Mul] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2063 [01/12/2022-09:32:32] [V] [TRT] Mul_1293 [Mul] inputs: [2028 -> ()[INT32]], [2063 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 2063 for ONNX node: 2063 [01/12/2022-09:32:32] [V] [TRT] Registering layer: Mul_1293 for ONNX node: Mul_1293 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2064 for ONNX tensor: 2064 [01/12/2022-09:32:32] [V] [TRT] Mul_1293 [Mul] outputs: [2064 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1294 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1294 [Unsqueeze] inputs: [2028 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1294 for ONNX node: Unsqueeze_1294 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2067 for ONNX tensor: 2067 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1294 [Unsqueeze] outputs: [2067 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1295 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2031 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1295 [Unsqueeze] inputs: [2031 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1295 for ONNX node: Unsqueeze_1295 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2068 for ONNX tensor: 2068 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1295 [Unsqueeze] outputs: [2068 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Concat_1296 [Concat] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2067 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2068 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3066 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3067 [01/12/2022-09:32:32] [V] [TRT] Concat_1296 [Concat] inputs: [2067 -> (1)[INT32]], [2068 -> (1)[INT32]], [3066 -> (1)[INT32]], [3067 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3066 for ONNX node: 3066 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3067 for ONNX node: 3067 [01/12/2022-09:32:32] [V] [TRT] Registering layer: Concat_1296 for ONNX node: Concat_1296 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2071 for ONNX tensor: 2071 [01/12/2022-09:32:32] [V] [TRT] Concat_1296 [Concat] outputs: [2071 -> (4)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Reshape_1297 [Reshape] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2036 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2071 [01/12/2022-09:32:32] [V] [TRT] Reshape_1297 [Reshape] inputs: [2036 -> (-1, -1, 768)[FLOAT]], [2071 -> (4)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Reshape_1297 for ONNX node: Reshape_1297 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2072 for ONNX tensor: 2072 [01/12/2022-09:32:32] [V] [TRT] Reshape_1297 [Reshape] outputs: [2072 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Transpose_1298 [Transpose] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2072 [01/12/2022-09:32:32] [V] [TRT] Transpose_1298 [Transpose] inputs: [2072 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Transpose_1298 for ONNX node: Transpose_1298 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2073 for ONNX tensor: 2073 [01/12/2022-09:32:32] [V] [TRT] Transpose_1298 [Transpose] outputs: [2073 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1299 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2064 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1299 [Unsqueeze] inputs: [2064 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1299 for ONNX node: Unsqueeze_1299 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2076 for ONNX tensor: 2076 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1299 [Unsqueeze] outputs: [2076 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Concat_1300 [Concat] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2076 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3068 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3069 [01/12/2022-09:32:32] [V] [TRT] Concat_1300 [Concat] inputs: [2076 -> (1)[INT32]], [3068 -> (1)[INT32]], [3069 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3068 for ONNX node: 3068 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3069 for ONNX node: 3069 [01/12/2022-09:32:32] [V] [TRT] Registering layer: Concat_1300 for ONNX node: Concat_1300 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2079 for ONNX tensor: 2079 [01/12/2022-09:32:32] [V] [TRT] Concat_1300 [Concat] outputs: [2079 -> (3)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Reshape_1301 [Reshape] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2073 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2079 [01/12/2022-09:32:32] [V] [TRT] Reshape_1301 [Reshape] inputs: [2073 -> (-1, 12, -1, 64)[FLOAT]], [2079 -> (3)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Reshape_1301 for ONNX node: Reshape_1301 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2080 for ONNX tensor: 2080 [01/12/2022-09:32:32] [V] [TRT] Reshape_1301 [Reshape] outputs: [2080 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1302 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2064 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1302 [Unsqueeze] inputs: [2064 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1302 for ONNX node: Unsqueeze_1302 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2083 for ONNX tensor: 2083 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1302 [Unsqueeze] outputs: [2083 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Concat_1303 [Concat] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2083 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3070 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3071 [01/12/2022-09:32:32] [V] [TRT] Concat_1303 [Concat] inputs: [2083 -> (1)[INT32]], [3070 -> (1)[INT32]], [3071 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3070 for ONNX node: 3070 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3071 for ONNX node: 3071 [01/12/2022-09:32:32] [V] [TRT] Registering layer: Concat_1303 for ONNX node: Concat_1303 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2086 for ONNX tensor: 2086 [01/12/2022-09:32:32] [V] [TRT] Concat_1303 [Concat] outputs: [2086 -> (3)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Reshape_1304 [Reshape] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2049 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2086 [01/12/2022-09:32:32] [V] [TRT] Reshape_1304 [Reshape] inputs: [2049 -> (-1, 12, -1, 64)[FLOAT]], [2086 -> (3)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: Reshape_1304 for ONNX node: Reshape_1304 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2087 for ONNX tensor: 2087 [01/12/2022-09:32:32] [V] [TRT] Reshape_1304 [Reshape] outputs: [2087 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Unsqueeze_1305 [Unsqueeze] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2064 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1305 [Unsqueeze] inputs: [2064 -> ()[INT32]], [01/12/2022-09:32:32] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:32] [V] [TRT] Registering layer: Unsqueeze_1305 for ONNX node: Unsqueeze_1305 [01/12/2022-09:32:32] [V] [TRT] Registering tensor: 2090 for ONNX tensor: 2090 [01/12/2022-09:32:32] [V] [TRT] Unsqueeze_1305 [Unsqueeze] outputs: [2090 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Parsing node: Concat_1306 [Concat] [01/12/2022-09:32:32] [V] [TRT] Searching for input: 2090 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3072 [01/12/2022-09:32:32] [V] [TRT] Searching for input: 3073 [01/12/2022-09:32:32] [V] [TRT] Concat_1306 [Concat] inputs: [2090 -> (1)[INT32]], [3072 -> (1)[INT32]], [3073 -> (1)[INT32]], [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3072 for ONNX node: 3072 [01/12/2022-09:32:32] [V] [TRT] Registering layer: 3073 for ONNX node: 3073 [01/12/2022-09:32:33] [V] [TRT] Registering layer: Concat_1306 for ONNX node: Concat_1306 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2093 for ONNX tensor: 2093 [01/12/2022-09:32:33] [V] [TRT] Concat_1306 [Concat] outputs: [2093 -> (3)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Reshape_1307 [Reshape] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2062 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2093 [01/12/2022-09:32:33] [V] [TRT] Reshape_1307 [Reshape] inputs: [2062 -> (-1, 12, -1, 64)[FLOAT]], [2093 -> (3)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Reshape_1307 for ONNX node: Reshape_1307 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2094 for ONNX tensor: 2094 [01/12/2022-09:32:33] [V] [TRT] Reshape_1307 [Reshape] outputs: [2094 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Shape_1308 [Shape] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2087 [01/12/2022-09:32:33] [V] [TRT] Shape_1308 [Shape] inputs: [2087 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Shape_1308 for ONNX node: Shape_1308 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2095 for ONNX tensor: 2095 [01/12/2022-09:32:33] [V] [TRT] Shape_1308 [Shape] outputs: [2095 -> (3)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Constant_1309 [Constant] [01/12/2022-09:32:33] [V] [TRT] Constant_1309 [Constant] inputs: [01/12/2022-09:32:33] [V] [TRT] Constant_1309 [Constant] outputs: [2096 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Gather_1310 [Gather] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2095 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2096 [01/12/2022-09:32:33] [V] [TRT] Gather_1310 [Gather] inputs: [2095 -> (3)[INT32]], [2096 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: 2096 for ONNX node: 2096 [01/12/2022-09:32:33] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:33] [V] [TRT] Registering layer: Gather_1310 for ONNX node: Gather_1310 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2097 for ONNX tensor: 2097 [01/12/2022-09:32:33] [V] [TRT] Gather_1310 [Gather] outputs: [2097 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Transpose_1311 [Transpose] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2087 [01/12/2022-09:32:33] [V] [TRT] Transpose_1311 [Transpose] inputs: [2087 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Transpose_1311 for ONNX node: Transpose_1311 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2098 for ONNX tensor: 2098 [01/12/2022-09:32:33] [V] [TRT] Transpose_1311 [Transpose] outputs: [2098 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: MatMul_1312 [MatMul] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2080 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2098 [01/12/2022-09:32:33] [V] [TRT] MatMul_1312 [MatMul] inputs: [2080 -> (-1, -1, 64)[FLOAT]], [2098 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: MatMul_1312 for ONNX node: MatMul_1312 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2099 for ONNX tensor: 2099 [01/12/2022-09:32:33] [V] [TRT] MatMul_1312 [MatMul] outputs: [2099 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1313 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1313 [Unsqueeze] inputs: [2028 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1313 for ONNX node: Unsqueeze_1313 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2101 for ONNX tensor: 2101 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1313 [Unsqueeze] outputs: [2101 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1314 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2031 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1314 [Unsqueeze] inputs: [2031 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1314 for ONNX node: Unsqueeze_1314 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2103 for ONNX tensor: 2103 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1314 [Unsqueeze] outputs: [2103 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1315 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2097 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1315 [Unsqueeze] inputs: [2097 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1315 for ONNX node: Unsqueeze_1315 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2104 for ONNX tensor: 2104 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1315 [Unsqueeze] outputs: [2104 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Concat_1316 [Concat] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2101 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 3074 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2103 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2104 [01/12/2022-09:32:33] [V] [TRT] Concat_1316 [Concat] inputs: [2101 -> (1)[INT32]], [3074 -> (1)[INT32]], [2103 -> (1)[INT32]], [2104 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: 3074 for ONNX node: 3074 [01/12/2022-09:32:33] [V] [TRT] Registering layer: Concat_1316 for ONNX node: Concat_1316 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2105 for ONNX tensor: 2105 [01/12/2022-09:32:33] [V] [TRT] Concat_1316 [Concat] outputs: [2105 -> (4)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Reshape_1317 [Reshape] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2099 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2105 [01/12/2022-09:32:33] [V] [TRT] Reshape_1317 [Reshape] inputs: [2099 -> (-1, -1, -1)[FLOAT]], [2105 -> (4)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Reshape_1317 for ONNX node: Reshape_1317 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2106 for ONNX tensor: 2106 [01/12/2022-09:32:33] [V] [TRT] Reshape_1317 [Reshape] outputs: [2106 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Add_1318 [Add] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2106 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 1252 [01/12/2022-09:32:33] [V] [TRT] Add_1318 [Add] inputs: [2106 -> (-1, 12, -1, -1)[FLOAT]], [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Add_1318 for ONNX node: Add_1318 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2107 for ONNX tensor: 2107 [01/12/2022-09:32:33] [V] [TRT] Add_1318 [Add] outputs: [2107 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Constant_1319 [Constant] [01/12/2022-09:32:33] [V] [TRT] Constant_1319 [Constant] inputs: [01/12/2022-09:32:33] [V] [TRT] Constant_1319 [Constant] outputs: [2108 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Mul_1320 [Mul] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2108 [01/12/2022-09:32:33] [V] [TRT] Mul_1320 [Mul] inputs: [2028 -> ()[INT32]], [2108 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: 2108 for ONNX node: 2108 [01/12/2022-09:32:33] [V] [TRT] Registering layer: Mul_1320 for ONNX node: Mul_1320 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2109 for ONNX tensor: 2109 [01/12/2022-09:32:33] [V] [TRT] Mul_1320 [Mul] outputs: [2109 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1321 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2109 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1321 [Unsqueeze] inputs: [2109 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1321 for ONNX node: Unsqueeze_1321 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2110 for ONNX tensor: 2110 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1321 [Unsqueeze] outputs: [2110 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1322 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2031 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1322 [Unsqueeze] inputs: [2031 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1322 for ONNX node: Unsqueeze_1322 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2111 for ONNX tensor: 2111 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1322 [Unsqueeze] outputs: [2111 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1323 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2097 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1323 [Unsqueeze] inputs: [2097 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1323 for ONNX node: Unsqueeze_1323 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2112 for ONNX tensor: 2112 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1323 [Unsqueeze] outputs: [2112 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Concat_1324 [Concat] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2110 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2111 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2112 [01/12/2022-09:32:33] [V] [TRT] Concat_1324 [Concat] inputs: [2110 -> (1)[INT32]], [2111 -> (1)[INT32]], [2112 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Concat_1324 for ONNX node: Concat_1324 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2113 for ONNX tensor: 2113 [01/12/2022-09:32:33] [V] [TRT] Concat_1324 [Concat] outputs: [2113 -> (3)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Reshape_1325 [Reshape] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2107 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2113 [01/12/2022-09:32:33] [V] [TRT] Reshape_1325 [Reshape] inputs: [2107 -> (-1, 12, -1, -1)[FLOAT]], [2113 -> (3)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Reshape_1325 for ONNX node: Reshape_1325 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2114 for ONNX tensor: 2114 [01/12/2022-09:32:33] [V] [TRT] Reshape_1325 [Reshape] outputs: [2114 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Softmax_1326 [Softmax] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2114 [01/12/2022-09:32:33] [V] [TRT] Softmax_1326 [Softmax] inputs: [2114 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Softmax_1326 for ONNX node: Softmax_1326 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2115 for ONNX tensor: 2115 [01/12/2022-09:32:33] [V] [TRT] Softmax_1326 [Softmax] outputs: [2115 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: MatMul_1327 [MatMul] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2115 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2094 [01/12/2022-09:32:33] [V] [TRT] MatMul_1327 [MatMul] inputs: [2115 -> (-1, -1, -1)[FLOAT]], [2094 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: MatMul_1327 for ONNX node: MatMul_1327 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2116 for ONNX tensor: 2116 [01/12/2022-09:32:33] [V] [TRT] MatMul_1327 [MatMul] outputs: [2116 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1328 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1328 [Unsqueeze] inputs: [2028 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1328 for ONNX node: Unsqueeze_1328 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2119 for ONNX tensor: 2119 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1328 [Unsqueeze] outputs: [2119 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Unsqueeze_1329 [Unsqueeze] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2031 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1329 [Unsqueeze] inputs: [2031 -> ()[INT32]], [01/12/2022-09:32:33] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:33] [V] [TRT] Registering layer: Unsqueeze_1329 for ONNX node: Unsqueeze_1329 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2121 for ONNX tensor: 2121 [01/12/2022-09:32:33] [V] [TRT] Unsqueeze_1329 [Unsqueeze] outputs: [2121 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Concat_1330 [Concat] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2119 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 3075 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2121 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 3076 [01/12/2022-09:32:33] [V] [TRT] Concat_1330 [Concat] inputs: [2119 -> (1)[INT32]], [3075 -> (1)[INT32]], [2121 -> (1)[INT32]], [3076 -> (1)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: 3075 for ONNX node: 3075 [01/12/2022-09:32:33] [V] [TRT] Registering layer: 3076 for ONNX node: 3076 [01/12/2022-09:32:33] [V] [TRT] Registering layer: Concat_1330 for ONNX node: Concat_1330 [01/12/2022-09:32:33] [V] [TRT] Registering tensor: 2123 for ONNX tensor: 2123 [01/12/2022-09:32:33] [V] [TRT] Concat_1330 [Concat] outputs: [2123 -> (4)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Parsing node: Reshape_1331 [Reshape] [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2116 [01/12/2022-09:32:33] [V] [TRT] Searching for input: 2123 [01/12/2022-09:32:33] [V] [TRT] Reshape_1331 [Reshape] inputs: [2116 -> (-1, -1, 64)[FLOAT]], [2123 -> (4)[INT32]], [01/12/2022-09:32:33] [V] [TRT] Registering layer: Reshape_1331 for ONNX node: Reshape_1331 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2124 for ONNX tensor: 2124 [01/12/2022-09:32:34] [V] [TRT] Reshape_1331 [Reshape] outputs: [2124 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Transpose_1332 [Transpose] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2124 [01/12/2022-09:32:34] [V] [TRT] Transpose_1332 [Transpose] inputs: [2124 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Transpose_1332 for ONNX node: Transpose_1332 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2125 for ONNX tensor: 2125 [01/12/2022-09:32:34] [V] [TRT] Transpose_1332 [Transpose] outputs: [2125 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Unsqueeze_1333 [Unsqueeze] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2028 [01/12/2022-09:32:34] [V] [TRT] Unsqueeze_1333 [Unsqueeze] inputs: [2028 -> ()[INT32]], [01/12/2022-09:32:34] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:34] [V] [TRT] Registering layer: Unsqueeze_1333 for ONNX node: Unsqueeze_1333 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2127 for ONNX tensor: 2127 [01/12/2022-09:32:34] [V] [TRT] Unsqueeze_1333 [Unsqueeze] outputs: [2127 -> (1)[INT32]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Unsqueeze_1334 [Unsqueeze] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2031 [01/12/2022-09:32:34] [V] [TRT] Unsqueeze_1334 [Unsqueeze] inputs: [2031 -> ()[INT32]], [01/12/2022-09:32:34] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:34] [V] [TRT] Registering layer: Unsqueeze_1334 for ONNX node: Unsqueeze_1334 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2128 for ONNX tensor: 2128 [01/12/2022-09:32:34] [V] [TRT] Unsqueeze_1334 [Unsqueeze] outputs: [2128 -> (1)[INT32]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Concat_1335 [Concat] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2127 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2128 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 3077 [01/12/2022-09:32:34] [V] [TRT] Concat_1335 [Concat] inputs: [2127 -> (1)[INT32]], [2128 -> (1)[INT32]], [3077 -> (1)[INT32]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: 3077 for ONNX node: 3077 [01/12/2022-09:32:34] [V] [TRT] Registering layer: Concat_1335 for ONNX node: Concat_1335 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2130 for ONNX tensor: 2130 [01/12/2022-09:32:34] [V] [TRT] Concat_1335 [Concat] outputs: [2130 -> (3)[INT32]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Reshape_1336 [Reshape] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2125 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2130 [01/12/2022-09:32:34] [V] [TRT] Reshape_1336 [Reshape] inputs: [2125 -> (-1, -1, 12, 64)[FLOAT]], [2130 -> (3)[INT32]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Reshape_1336 for ONNX node: Reshape_1336 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2131 for ONNX tensor: 2131 [01/12/2022-09:32:34] [V] [TRT] Reshape_1336 [Reshape] outputs: [2131 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: MatMul_1337 [MatMul] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2131 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 3078 [01/12/2022-09:32:34] [V] [TRT] MatMul_1337 [MatMul] inputs: [2131 -> (-1, -1, 768)[FLOAT]], [3078 -> (768, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: 3078 for ONNX node: 3078 [01/12/2022-09:32:34] [V] [TRT] Registering layer: MatMul_1337 for ONNX node: MatMul_1337 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2133 for ONNX tensor: 2133 [01/12/2022-09:32:34] [V] [TRT] MatMul_1337 [MatMul] outputs: [2133 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Add_1338 [Add] [01/12/2022-09:32:34] [V] [TRT] Searching for input: decoder.layers.3.self_attn.out_proj.bias [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2133 [01/12/2022-09:32:34] [V] [TRT] Add_1338 [Add] inputs: [decoder.layers.3.self_attn.out_proj.bias -> (768)[FLOAT]], [2133 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: decoder.layers.3.self_attn.out_proj.bias for ONNX node: decoder.layers.3.self_attn.out_proj.bias [01/12/2022-09:32:34] [V] [TRT] Registering layer: Add_1338 for ONNX node: Add_1338 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2134 for ONNX tensor: 2134 [01/12/2022-09:32:34] [V] [TRT] Add_1338 [Add] outputs: [2134 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Add_1339 [Add] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2025 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2134 [01/12/2022-09:32:34] [V] [TRT] Add_1339 [Add] inputs: [2025 -> (-1, -1, 768)[FLOAT]], [2134 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Add_1339 for ONNX node: Add_1339 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2135 for ONNX tensor: 2135 [01/12/2022-09:32:34] [V] [TRT] Add_1339 [Add] outputs: [2135 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: ReduceMean_1340 [ReduceMean] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2135 [01/12/2022-09:32:34] [V] [TRT] ReduceMean_1340 [ReduceMean] inputs: [2135 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: ReduceMean_1340 for ONNX node: ReduceMean_1340 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2136 for ONNX tensor: 2136 [01/12/2022-09:32:34] [V] [TRT] ReduceMean_1340 [ReduceMean] outputs: [2136 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Sub_1341 [Sub] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2135 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2136 [01/12/2022-09:32:34] [V] [TRT] Sub_1341 [Sub] inputs: [2135 -> (-1, -1, 768)[FLOAT]], [2136 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Sub_1341 for ONNX node: Sub_1341 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2137 for ONNX tensor: 2137 [01/12/2022-09:32:34] [V] [TRT] Sub_1341 [Sub] outputs: [2137 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Constant_1342 [Constant] [01/12/2022-09:32:34] [V] [TRT] Constant_1342 [Constant] inputs: [01/12/2022-09:32:34] [V] [TRT] Constant_1342 [Constant] outputs: [2138 -> ()[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Pow_1343 [Pow] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2137 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2138 [01/12/2022-09:32:34] [V] [TRT] Pow_1343 [Pow] inputs: [2137 -> (-1, -1, 768)[FLOAT]], [2138 -> ()[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: 2138 for ONNX node: 2138 [01/12/2022-09:32:34] [V] [TRT] Registering layer: Pow_1343 for ONNX node: Pow_1343 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2139 for ONNX tensor: 2139 [01/12/2022-09:32:34] [V] [TRT] Pow_1343 [Pow] outputs: [2139 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: ReduceMean_1344 [ReduceMean] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2139 [01/12/2022-09:32:34] [V] [TRT] ReduceMean_1344 [ReduceMean] inputs: [2139 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: ReduceMean_1344 for ONNX node: ReduceMean_1344 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2140 for ONNX tensor: 2140 [01/12/2022-09:32:34] [V] [TRT] ReduceMean_1344 [ReduceMean] outputs: [2140 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Constant_1345 [Constant] [01/12/2022-09:32:34] [V] [TRT] Constant_1345 [Constant] inputs: [01/12/2022-09:32:34] [V] [TRT] Constant_1345 [Constant] outputs: [2141 -> ()[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Add_1346 [Add] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2140 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2141 [01/12/2022-09:32:34] [V] [TRT] Add_1346 [Add] inputs: [2140 -> (-1, -1, 1)[FLOAT]], [2141 -> ()[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: 2141 for ONNX node: 2141 [01/12/2022-09:32:34] [V] [TRT] Registering layer: Add_1346 for ONNX node: Add_1346 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2142 for ONNX tensor: 2142 [01/12/2022-09:32:34] [V] [TRT] Add_1346 [Add] outputs: [2142 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Sqrt_1347 [Sqrt] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2142 [01/12/2022-09:32:34] [V] [TRT] Sqrt_1347 [Sqrt] inputs: [2142 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Sqrt_1347 for ONNX node: Sqrt_1347 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2143 for ONNX tensor: 2143 [01/12/2022-09:32:34] [V] [TRT] Sqrt_1347 [Sqrt] outputs: [2143 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Div_1348 [Div] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2137 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2143 [01/12/2022-09:32:34] [V] [TRT] Div_1348 [Div] inputs: [2137 -> (-1, -1, 768)[FLOAT]], [2143 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Div_1348 for ONNX node: Div_1348 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2144 for ONNX tensor: 2144 [01/12/2022-09:32:34] [V] [TRT] Div_1348 [Div] outputs: [2144 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Mul_1349 [Mul] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2144 [01/12/2022-09:32:34] [V] [TRT] Searching for input: decoder.layers.3.self_attn_layer_norm.weight [01/12/2022-09:32:34] [V] [TRT] Mul_1349 [Mul] inputs: [2144 -> (-1, -1, 768)[FLOAT]], [decoder.layers.3.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: decoder.layers.3.self_attn_layer_norm.weight for ONNX node: decoder.layers.3.self_attn_layer_norm.weight [01/12/2022-09:32:34] [V] [TRT] Registering layer: Mul_1349 for ONNX node: Mul_1349 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2145 for ONNX tensor: 2145 [01/12/2022-09:32:34] [V] [TRT] Mul_1349 [Mul] outputs: [2145 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Add_1350 [Add] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2145 [01/12/2022-09:32:34] [V] [TRT] Searching for input: decoder.layers.3.self_attn_layer_norm.bias [01/12/2022-09:32:34] [V] [TRT] Add_1350 [Add] inputs: [2145 -> (-1, -1, 768)[FLOAT]], [decoder.layers.3.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: decoder.layers.3.self_attn_layer_norm.bias for ONNX node: decoder.layers.3.self_attn_layer_norm.bias [01/12/2022-09:32:34] [V] [TRT] Registering layer: Add_1350 for ONNX node: Add_1350 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2146 for ONNX tensor: 2146 [01/12/2022-09:32:34] [V] [TRT] Add_1350 [Add] outputs: [2146 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Shape_1351 [Shape] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2146 [01/12/2022-09:32:34] [V] [TRT] Shape_1351 [Shape] inputs: [2146 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Shape_1351 for ONNX node: Shape_1351 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2147 for ONNX tensor: 2147 [01/12/2022-09:32:34] [V] [TRT] Shape_1351 [Shape] outputs: [2147 -> (3)[INT32]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Constant_1352 [Constant] [01/12/2022-09:32:34] [V] [TRT] Constant_1352 [Constant] inputs: [01/12/2022-09:32:34] [V] [TRT] Constant_1352 [Constant] outputs: [2148 -> ()[INT32]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Gather_1353 [Gather] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2147 [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2148 [01/12/2022-09:32:34] [V] [TRT] Gather_1353 [Gather] inputs: [2147 -> (3)[INT32]], [2148 -> ()[INT32]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: 2148 for ONNX node: 2148 [01/12/2022-09:32:34] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:34] [V] [TRT] Registering layer: Gather_1353 for ONNX node: Gather_1353 [01/12/2022-09:32:34] [V] [TRT] Registering tensor: 2149 for ONNX tensor: 2149 [01/12/2022-09:32:34] [V] [TRT] Gather_1353 [Gather] outputs: [2149 -> ()[INT32]], [01/12/2022-09:32:34] [V] [TRT] Parsing node: Shape_1354 [Shape] [01/12/2022-09:32:34] [V] [TRT] Searching for input: 2146 [01/12/2022-09:32:34] [V] [TRT] Shape_1354 [Shape] inputs: [2146 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:34] [V] [TRT] Registering layer: Shape_1354 for ONNX node: Shape_1354 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2150 for ONNX tensor: 2150 [01/12/2022-09:32:35] [V] [TRT] Shape_1354 [Shape] outputs: [2150 -> (3)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Constant_1355 [Constant] [01/12/2022-09:32:35] [V] [TRT] Constant_1355 [Constant] inputs: [01/12/2022-09:32:35] [V] [TRT] Constant_1355 [Constant] outputs: [2151 -> ()[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Gather_1356 [Gather] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2150 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2151 [01/12/2022-09:32:35] [V] [TRT] Gather_1356 [Gather] inputs: [2150 -> (3)[INT32]], [2151 -> ()[INT32]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 2151 for ONNX node: 2151 [01/12/2022-09:32:35] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:35] [V] [TRT] Registering layer: Gather_1356 for ONNX node: Gather_1356 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2152 for ONNX tensor: 2152 [01/12/2022-09:32:35] [V] [TRT] Gather_1356 [Gather] outputs: [2152 -> ()[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: MatMul_1357 [MatMul] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2146 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3079 [01/12/2022-09:32:35] [V] [TRT] MatMul_1357 [MatMul] inputs: [2146 -> (-1, -1, 768)[FLOAT]], [3079 -> (768, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3079 for ONNX node: 3079 [01/12/2022-09:32:35] [V] [TRT] Registering layer: MatMul_1357 for ONNX node: MatMul_1357 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2154 for ONNX tensor: 2154 [01/12/2022-09:32:35] [V] [TRT] MatMul_1357 [MatMul] outputs: [2154 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Add_1358 [Add] [01/12/2022-09:32:35] [V] [TRT] Searching for input: decoder.layers.3.encoder_attn.q_proj.bias [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2154 [01/12/2022-09:32:35] [V] [TRT] Add_1358 [Add] inputs: [decoder.layers.3.encoder_attn.q_proj.bias -> (768)[FLOAT]], [2154 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: decoder.layers.3.encoder_attn.q_proj.bias for ONNX node: decoder.layers.3.encoder_attn.q_proj.bias [01/12/2022-09:32:35] [V] [TRT] Registering layer: Add_1358 for ONNX node: Add_1358 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2155 for ONNX tensor: 2155 [01/12/2022-09:32:35] [V] [TRT] Add_1358 [Add] outputs: [2155 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Constant_1359 [Constant] [01/12/2022-09:32:35] [V] [TRT] Constant_1359 [Constant] inputs: [01/12/2022-09:32:35] [V] [TRT] Constant_1359 [Constant] outputs: [2156 -> ()[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Mul_1360 [Mul] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2155 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2156 [01/12/2022-09:32:35] [V] [TRT] Mul_1360 [Mul] inputs: [2155 -> (-1, -1, 768)[FLOAT]], [2156 -> ()[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 2156 for ONNX node: 2156 [01/12/2022-09:32:35] [V] [TRT] Registering layer: Mul_1360 for ONNX node: Mul_1360 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2157 for ONNX tensor: 2157 [01/12/2022-09:32:35] [V] [TRT] Mul_1360 [Mul] outputs: [2157 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: MatMul_1361 [MatMul] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3080 [01/12/2022-09:32:35] [V] [TRT] MatMul_1361 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3080 -> (768, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3080 for ONNX node: 3080 [01/12/2022-09:32:35] [V] [TRT] Registering layer: MatMul_1361 for ONNX node: MatMul_1361 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2159 for ONNX tensor: 2159 [01/12/2022-09:32:35] [V] [TRT] MatMul_1361 [MatMul] outputs: [2159 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Add_1362 [Add] [01/12/2022-09:32:35] [V] [TRT] Searching for input: decoder.layers.3.encoder_attn.k_proj.bias [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2159 [01/12/2022-09:32:35] [V] [TRT] Add_1362 [Add] inputs: [decoder.layers.3.encoder_attn.k_proj.bias -> (768)[FLOAT]], [2159 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: decoder.layers.3.encoder_attn.k_proj.bias for ONNX node: decoder.layers.3.encoder_attn.k_proj.bias [01/12/2022-09:32:35] [V] [TRT] Registering layer: Add_1362 for ONNX node: Add_1362 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2160 for ONNX tensor: 2160 [01/12/2022-09:32:35] [V] [TRT] Add_1362 [Add] outputs: [2160 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Unsqueeze_1363 [Unsqueeze] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2149 [01/12/2022-09:32:35] [V] [TRT] Unsqueeze_1363 [Unsqueeze] inputs: [2149 -> ()[INT32]], [01/12/2022-09:32:35] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:35] [V] [TRT] Registering layer: Unsqueeze_1363 for ONNX node: Unsqueeze_1363 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2164 for ONNX tensor: 2164 [01/12/2022-09:32:35] [V] [TRT] Unsqueeze_1363 [Unsqueeze] outputs: [2164 -> (1)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Concat_1364 [Concat] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2164 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3081 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3082 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3083 [01/12/2022-09:32:35] [V] [TRT] Concat_1364 [Concat] inputs: [2164 -> (1)[INT32]], [3081 -> (1)[INT32]], [3082 -> (1)[INT32]], [3083 -> (1)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3081 for ONNX node: 3081 [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3082 for ONNX node: 3082 [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3083 for ONNX node: 3083 [01/12/2022-09:32:35] [V] [TRT] Registering layer: Concat_1364 for ONNX node: Concat_1364 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2168 for ONNX tensor: 2168 [01/12/2022-09:32:35] [V] [TRT] Concat_1364 [Concat] outputs: [2168 -> (4)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Reshape_1365 [Reshape] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2160 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2168 [01/12/2022-09:32:35] [V] [TRT] Reshape_1365 [Reshape] inputs: [2160 -> (-1, -1, 768)[FLOAT]], [2168 -> (4)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: Reshape_1365 for ONNX node: Reshape_1365 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2169 for ONNX tensor: 2169 [01/12/2022-09:32:35] [V] [TRT] Reshape_1365 [Reshape] outputs: [2169 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Transpose_1366 [Transpose] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2169 [01/12/2022-09:32:35] [V] [TRT] Transpose_1366 [Transpose] inputs: [2169 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: Transpose_1366 for ONNX node: Transpose_1366 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2170_16 for ONNX tensor: 2170 [01/12/2022-09:32:35] [V] [TRT] Transpose_1366 [Transpose] outputs: [2170 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: MatMul_1367 [MatMul] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3084 [01/12/2022-09:32:35] [V] [TRT] MatMul_1367 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3084 -> (768, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3084 for ONNX node: 3084 [01/12/2022-09:32:35] [V] [TRT] Registering layer: MatMul_1367 for ONNX node: MatMul_1367 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2172 for ONNX tensor: 2172 [01/12/2022-09:32:35] [V] [TRT] MatMul_1367 [MatMul] outputs: [2172 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Add_1368 [Add] [01/12/2022-09:32:35] [V] [TRT] Searching for input: decoder.layers.3.encoder_attn.v_proj.bias [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2172 [01/12/2022-09:32:35] [V] [TRT] Add_1368 [Add] inputs: [decoder.layers.3.encoder_attn.v_proj.bias -> (768)[FLOAT]], [2172 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: decoder.layers.3.encoder_attn.v_proj.bias for ONNX node: decoder.layers.3.encoder_attn.v_proj.bias [01/12/2022-09:32:35] [V] [TRT] Registering layer: Add_1368 for ONNX node: Add_1368 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2173 for ONNX tensor: 2173 [01/12/2022-09:32:35] [V] [TRT] Add_1368 [Add] outputs: [2173 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Unsqueeze_1369 [Unsqueeze] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2149 [01/12/2022-09:32:35] [V] [TRT] Unsqueeze_1369 [Unsqueeze] inputs: [2149 -> ()[INT32]], [01/12/2022-09:32:35] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:35] [V] [TRT] Registering layer: Unsqueeze_1369 for ONNX node: Unsqueeze_1369 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2177 for ONNX tensor: 2177 [01/12/2022-09:32:35] [V] [TRT] Unsqueeze_1369 [Unsqueeze] outputs: [2177 -> (1)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Concat_1370 [Concat] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2177 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3085 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3086 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 3087 [01/12/2022-09:32:35] [V] [TRT] Concat_1370 [Concat] inputs: [2177 -> (1)[INT32]], [3085 -> (1)[INT32]], [3086 -> (1)[INT32]], [3087 -> (1)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3085 for ONNX node: 3085 [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3086 for ONNX node: 3086 [01/12/2022-09:32:35] [V] [TRT] Registering layer: 3087 for ONNX node: 3087 [01/12/2022-09:32:35] [V] [TRT] Registering layer: Concat_1370 for ONNX node: Concat_1370 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2181 for ONNX tensor: 2181 [01/12/2022-09:32:35] [V] [TRT] Concat_1370 [Concat] outputs: [2181 -> (4)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Reshape_1371 [Reshape] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2173 [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2181 [01/12/2022-09:32:35] [V] [TRT] Reshape_1371 [Reshape] inputs: [2173 -> (-1, -1, 768)[FLOAT]], [2181 -> (4)[INT32]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: Reshape_1371 for ONNX node: Reshape_1371 [01/12/2022-09:32:35] [V] [TRT] Registering tensor: 2182 for ONNX tensor: 2182 [01/12/2022-09:32:35] [V] [TRT] Reshape_1371 [Reshape] outputs: [2182 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Parsing node: Transpose_1372 [Transpose] [01/12/2022-09:32:35] [V] [TRT] Searching for input: 2182 [01/12/2022-09:32:35] [V] [TRT] Transpose_1372 [Transpose] inputs: [2182 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:35] [V] [TRT] Registering layer: Transpose_1372 for ONNX node: Transpose_1372 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2183_17 for ONNX tensor: 2183 [01/12/2022-09:32:36] [V] [TRT] Transpose_1372 [Transpose] outputs: [2183 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Constant_1373 [Constant] [01/12/2022-09:32:36] [V] [TRT] Constant_1373 [Constant] inputs: [01/12/2022-09:32:36] [V] [TRT] Constant_1373 [Constant] outputs: [2184 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Mul_1374 [Mul] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2149 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2184 [01/12/2022-09:32:36] [V] [TRT] Mul_1374 [Mul] inputs: [2149 -> ()[INT32]], [2184 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: 2184 for ONNX node: 2184 [01/12/2022-09:32:36] [V] [TRT] Registering layer: Mul_1374 for ONNX node: Mul_1374 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2185 for ONNX tensor: 2185 [01/12/2022-09:32:36] [V] [TRT] Mul_1374 [Mul] outputs: [2185 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Unsqueeze_1375 [Unsqueeze] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2149 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1375 [Unsqueeze] inputs: [2149 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:36] [V] [TRT] Registering layer: Unsqueeze_1375 for ONNX node: Unsqueeze_1375 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2188 for ONNX tensor: 2188 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1375 [Unsqueeze] outputs: [2188 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Unsqueeze_1376 [Unsqueeze] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2152 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1376 [Unsqueeze] inputs: [2152 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:36] [V] [TRT] Registering layer: Unsqueeze_1376 for ONNX node: Unsqueeze_1376 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2189 for ONNX tensor: 2189 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1376 [Unsqueeze] outputs: [2189 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Concat_1377 [Concat] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2188 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2189 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3088 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3089 [01/12/2022-09:32:36] [V] [TRT] Concat_1377 [Concat] inputs: [2188 -> (1)[INT32]], [2189 -> (1)[INT32]], [3088 -> (1)[INT32]], [3089 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3088 for ONNX node: 3088 [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3089 for ONNX node: 3089 [01/12/2022-09:32:36] [V] [TRT] Registering layer: Concat_1377 for ONNX node: Concat_1377 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2192 for ONNX tensor: 2192 [01/12/2022-09:32:36] [V] [TRT] Concat_1377 [Concat] outputs: [2192 -> (4)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Reshape_1378 [Reshape] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2157 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2192 [01/12/2022-09:32:36] [V] [TRT] Reshape_1378 [Reshape] inputs: [2157 -> (-1, -1, 768)[FLOAT]], [2192 -> (4)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Reshape_1378 for ONNX node: Reshape_1378 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2193 for ONNX tensor: 2193 [01/12/2022-09:32:36] [V] [TRT] Reshape_1378 [Reshape] outputs: [2193 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Transpose_1379 [Transpose] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2193 [01/12/2022-09:32:36] [V] [TRT] Transpose_1379 [Transpose] inputs: [2193 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Transpose_1379 for ONNX node: Transpose_1379 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2194 for ONNX tensor: 2194 [01/12/2022-09:32:36] [V] [TRT] Transpose_1379 [Transpose] outputs: [2194 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Unsqueeze_1380 [Unsqueeze] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2185 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1380 [Unsqueeze] inputs: [2185 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:36] [V] [TRT] Registering layer: Unsqueeze_1380 for ONNX node: Unsqueeze_1380 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2197 for ONNX tensor: 2197 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1380 [Unsqueeze] outputs: [2197 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Concat_1381 [Concat] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2197 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3090 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3091 [01/12/2022-09:32:36] [V] [TRT] Concat_1381 [Concat] inputs: [2197 -> (1)[INT32]], [3090 -> (1)[INT32]], [3091 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3090 for ONNX node: 3090 [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3091 for ONNX node: 3091 [01/12/2022-09:32:36] [V] [TRT] Registering layer: Concat_1381 for ONNX node: Concat_1381 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2200 for ONNX tensor: 2200 [01/12/2022-09:32:36] [V] [TRT] Concat_1381 [Concat] outputs: [2200 -> (3)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Reshape_1382 [Reshape] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2194 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2200 [01/12/2022-09:32:36] [V] [TRT] Reshape_1382 [Reshape] inputs: [2194 -> (-1, 12, -1, 64)[FLOAT]], [2200 -> (3)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Reshape_1382 for ONNX node: Reshape_1382 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2201 for ONNX tensor: 2201 [01/12/2022-09:32:36] [V] [TRT] Reshape_1382 [Reshape] outputs: [2201 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Unsqueeze_1383 [Unsqueeze] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2185 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1383 [Unsqueeze] inputs: [2185 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:36] [V] [TRT] Registering layer: Unsqueeze_1383 for ONNX node: Unsqueeze_1383 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2204 for ONNX tensor: 2204 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1383 [Unsqueeze] outputs: [2204 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Concat_1384 [Concat] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2204 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3092 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3093 [01/12/2022-09:32:36] [V] [TRT] Concat_1384 [Concat] inputs: [2204 -> (1)[INT32]], [3092 -> (1)[INT32]], [3093 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3092 for ONNX node: 3092 [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3093 for ONNX node: 3093 [01/12/2022-09:32:36] [V] [TRT] Registering layer: Concat_1384 for ONNX node: Concat_1384 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2207 for ONNX tensor: 2207 [01/12/2022-09:32:36] [V] [TRT] Concat_1384 [Concat] outputs: [2207 -> (3)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Reshape_1385 [Reshape] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2170 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2207 [01/12/2022-09:32:36] [V] [TRT] Reshape_1385 [Reshape] inputs: [2170 -> (-1, 12, -1, 64)[FLOAT]], [2207 -> (3)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Reshape_1385 for ONNX node: Reshape_1385 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2208 for ONNX tensor: 2208 [01/12/2022-09:32:36] [V] [TRT] Reshape_1385 [Reshape] outputs: [2208 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Unsqueeze_1386 [Unsqueeze] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2185 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1386 [Unsqueeze] inputs: [2185 -> ()[INT32]], [01/12/2022-09:32:36] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:36] [V] [TRT] Registering layer: Unsqueeze_1386 for ONNX node: Unsqueeze_1386 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2211 for ONNX tensor: 2211 [01/12/2022-09:32:36] [V] [TRT] Unsqueeze_1386 [Unsqueeze] outputs: [2211 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Concat_1387 [Concat] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2211 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3094 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 3095 [01/12/2022-09:32:36] [V] [TRT] Concat_1387 [Concat] inputs: [2211 -> (1)[INT32]], [3094 -> (1)[INT32]], [3095 -> (1)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3094 for ONNX node: 3094 [01/12/2022-09:32:36] [V] [TRT] Registering layer: 3095 for ONNX node: 3095 [01/12/2022-09:32:36] [V] [TRT] Registering layer: Concat_1387 for ONNX node: Concat_1387 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2214 for ONNX tensor: 2214 [01/12/2022-09:32:36] [V] [TRT] Concat_1387 [Concat] outputs: [2214 -> (3)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Reshape_1388 [Reshape] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2183 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2214 [01/12/2022-09:32:36] [V] [TRT] Reshape_1388 [Reshape] inputs: [2183 -> (-1, 12, -1, 64)[FLOAT]], [2214 -> (3)[INT32]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Reshape_1388 for ONNX node: Reshape_1388 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2215 for ONNX tensor: 2215 [01/12/2022-09:32:36] [V] [TRT] Reshape_1388 [Reshape] outputs: [2215 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Transpose_1389 [Transpose] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2208 [01/12/2022-09:32:36] [V] [TRT] Transpose_1389 [Transpose] inputs: [2208 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Transpose_1389 for ONNX node: Transpose_1389 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2216 for ONNX tensor: 2216 [01/12/2022-09:32:36] [V] [TRT] Transpose_1389 [Transpose] outputs: [2216 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: MatMul_1390 [MatMul] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2201 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2216 [01/12/2022-09:32:36] [V] [TRT] MatMul_1390 [MatMul] inputs: [2201 -> (-1, -1, 64)[FLOAT]], [2216 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: MatMul_1390 for ONNX node: MatMul_1390 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2217 for ONNX tensor: 2217 [01/12/2022-09:32:36] [V] [TRT] MatMul_1390 [MatMul] outputs: [2217 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: Softmax_1391 [Softmax] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2217 [01/12/2022-09:32:36] [V] [TRT] Softmax_1391 [Softmax] inputs: [2217 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: Softmax_1391 for ONNX node: Softmax_1391 [01/12/2022-09:32:36] [V] [TRT] Registering tensor: 2218 for ONNX tensor: 2218 [01/12/2022-09:32:36] [V] [TRT] Softmax_1391 [Softmax] outputs: [2218 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Parsing node: MatMul_1392 [MatMul] [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2218 [01/12/2022-09:32:36] [V] [TRT] Searching for input: 2215 [01/12/2022-09:32:36] [V] [TRT] MatMul_1392 [MatMul] inputs: [2218 -> (-1, -1, -1)[FLOAT]], [2215 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:36] [V] [TRT] Registering layer: MatMul_1392 for ONNX node: MatMul_1392 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2219 for ONNX tensor: 2219 [01/12/2022-09:32:37] [V] [TRT] MatMul_1392 [MatMul] outputs: [2219 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Unsqueeze_1393 [Unsqueeze] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2149 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1393 [Unsqueeze] inputs: [2149 -> ()[INT32]], [01/12/2022-09:32:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:37] [V] [TRT] Registering layer: Unsqueeze_1393 for ONNX node: Unsqueeze_1393 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2222 for ONNX tensor: 2222 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1393 [Unsqueeze] outputs: [2222 -> (1)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Unsqueeze_1394 [Unsqueeze] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2152 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1394 [Unsqueeze] inputs: [2152 -> ()[INT32]], [01/12/2022-09:32:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:37] [V] [TRT] Registering layer: Unsqueeze_1394 for ONNX node: Unsqueeze_1394 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2224 for ONNX tensor: 2224 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1394 [Unsqueeze] outputs: [2224 -> (1)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Concat_1395 [Concat] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2222 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 3096 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2224 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 3097 [01/12/2022-09:32:37] [V] [TRT] Concat_1395 [Concat] inputs: [2222 -> (1)[INT32]], [3096 -> (1)[INT32]], [2224 -> (1)[INT32]], [3097 -> (1)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: 3096 for ONNX node: 3096 [01/12/2022-09:32:37] [V] [TRT] Registering layer: 3097 for ONNX node: 3097 [01/12/2022-09:32:37] [V] [TRT] Registering layer: Concat_1395 for ONNX node: Concat_1395 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2226 for ONNX tensor: 2226 [01/12/2022-09:32:37] [V] [TRT] Concat_1395 [Concat] outputs: [2226 -> (4)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Reshape_1396 [Reshape] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2219 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2226 [01/12/2022-09:32:37] [V] [TRT] Reshape_1396 [Reshape] inputs: [2219 -> (-1, -1, 64)[FLOAT]], [2226 -> (4)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Reshape_1396 for ONNX node: Reshape_1396 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2227 for ONNX tensor: 2227 [01/12/2022-09:32:37] [V] [TRT] Reshape_1396 [Reshape] outputs: [2227 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Transpose_1397 [Transpose] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2227 [01/12/2022-09:32:37] [V] [TRT] Transpose_1397 [Transpose] inputs: [2227 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Transpose_1397 for ONNX node: Transpose_1397 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2228 for ONNX tensor: 2228 [01/12/2022-09:32:37] [V] [TRT] Transpose_1397 [Transpose] outputs: [2228 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Unsqueeze_1398 [Unsqueeze] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2149 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1398 [Unsqueeze] inputs: [2149 -> ()[INT32]], [01/12/2022-09:32:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:37] [V] [TRT] Registering layer: Unsqueeze_1398 for ONNX node: Unsqueeze_1398 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2230 for ONNX tensor: 2230 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1398 [Unsqueeze] outputs: [2230 -> (1)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Unsqueeze_1399 [Unsqueeze] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2152 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1399 [Unsqueeze] inputs: [2152 -> ()[INT32]], [01/12/2022-09:32:37] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:37] [V] [TRT] Registering layer: Unsqueeze_1399 for ONNX node: Unsqueeze_1399 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2231 for ONNX tensor: 2231 [01/12/2022-09:32:37] [V] [TRT] Unsqueeze_1399 [Unsqueeze] outputs: [2231 -> (1)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Concat_1400 [Concat] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2230 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2231 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 3098 [01/12/2022-09:32:37] [V] [TRT] Concat_1400 [Concat] inputs: [2230 -> (1)[INT32]], [2231 -> (1)[INT32]], [3098 -> (1)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: 3098 for ONNX node: 3098 [01/12/2022-09:32:37] [V] [TRT] Registering layer: Concat_1400 for ONNX node: Concat_1400 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2233 for ONNX tensor: 2233 [01/12/2022-09:32:37] [V] [TRT] Concat_1400 [Concat] outputs: [2233 -> (3)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Reshape_1401 [Reshape] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2228 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2233 [01/12/2022-09:32:37] [V] [TRT] Reshape_1401 [Reshape] inputs: [2228 -> (-1, -1, 12, 64)[FLOAT]], [2233 -> (3)[INT32]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Reshape_1401 for ONNX node: Reshape_1401 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2234 for ONNX tensor: 2234 [01/12/2022-09:32:37] [V] [TRT] Reshape_1401 [Reshape] outputs: [2234 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: MatMul_1402 [MatMul] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2234 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 3099 [01/12/2022-09:32:37] [V] [TRT] MatMul_1402 [MatMul] inputs: [2234 -> (-1, -1, 768)[FLOAT]], [3099 -> (768, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: 3099 for ONNX node: 3099 [01/12/2022-09:32:37] [V] [TRT] Registering layer: MatMul_1402 for ONNX node: MatMul_1402 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2236 for ONNX tensor: 2236 [01/12/2022-09:32:37] [V] [TRT] MatMul_1402 [MatMul] outputs: [2236 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Add_1403 [Add] [01/12/2022-09:32:37] [V] [TRT] Searching for input: decoder.layers.3.encoder_attn.out_proj.bias [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2236 [01/12/2022-09:32:37] [V] [TRT] Add_1403 [Add] inputs: [decoder.layers.3.encoder_attn.out_proj.bias -> (768)[FLOAT]], [2236 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: decoder.layers.3.encoder_attn.out_proj.bias for ONNX node: decoder.layers.3.encoder_attn.out_proj.bias [01/12/2022-09:32:37] [V] [TRT] Registering layer: Add_1403 for ONNX node: Add_1403 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2237 for ONNX tensor: 2237 [01/12/2022-09:32:37] [V] [TRT] Add_1403 [Add] outputs: [2237 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Add_1404 [Add] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2146 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2237 [01/12/2022-09:32:37] [V] [TRT] Add_1404 [Add] inputs: [2146 -> (-1, -1, 768)[FLOAT]], [2237 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Add_1404 for ONNX node: Add_1404 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2238 for ONNX tensor: 2238 [01/12/2022-09:32:37] [V] [TRT] Add_1404 [Add] outputs: [2238 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: ReduceMean_1405 [ReduceMean] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2238 [01/12/2022-09:32:37] [V] [TRT] ReduceMean_1405 [ReduceMean] inputs: [2238 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: ReduceMean_1405 for ONNX node: ReduceMean_1405 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2239 for ONNX tensor: 2239 [01/12/2022-09:32:37] [V] [TRT] ReduceMean_1405 [ReduceMean] outputs: [2239 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Sub_1406 [Sub] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2238 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2239 [01/12/2022-09:32:37] [V] [TRT] Sub_1406 [Sub] inputs: [2238 -> (-1, -1, 768)[FLOAT]], [2239 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Sub_1406 for ONNX node: Sub_1406 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2240 for ONNX tensor: 2240 [01/12/2022-09:32:37] [V] [TRT] Sub_1406 [Sub] outputs: [2240 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Constant_1407 [Constant] [01/12/2022-09:32:37] [V] [TRT] Constant_1407 [Constant] inputs: [01/12/2022-09:32:37] [V] [TRT] Constant_1407 [Constant] outputs: [2241 -> ()[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Pow_1408 [Pow] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2240 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2241 [01/12/2022-09:32:37] [V] [TRT] Pow_1408 [Pow] inputs: [2240 -> (-1, -1, 768)[FLOAT]], [2241 -> ()[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: 2241 for ONNX node: 2241 [01/12/2022-09:32:37] [V] [TRT] Registering layer: Pow_1408 for ONNX node: Pow_1408 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2242 for ONNX tensor: 2242 [01/12/2022-09:32:37] [V] [TRT] Pow_1408 [Pow] outputs: [2242 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: ReduceMean_1409 [ReduceMean] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2242 [01/12/2022-09:32:37] [V] [TRT] ReduceMean_1409 [ReduceMean] inputs: [2242 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: ReduceMean_1409 for ONNX node: ReduceMean_1409 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2243 for ONNX tensor: 2243 [01/12/2022-09:32:37] [V] [TRT] ReduceMean_1409 [ReduceMean] outputs: [2243 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Constant_1410 [Constant] [01/12/2022-09:32:37] [V] [TRT] Constant_1410 [Constant] inputs: [01/12/2022-09:32:37] [V] [TRT] Constant_1410 [Constant] outputs: [2244 -> ()[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Add_1411 [Add] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2243 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2244 [01/12/2022-09:32:37] [V] [TRT] Add_1411 [Add] inputs: [2243 -> (-1, -1, 1)[FLOAT]], [2244 -> ()[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: 2244 for ONNX node: 2244 [01/12/2022-09:32:37] [V] [TRT] Registering layer: Add_1411 for ONNX node: Add_1411 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2245 for ONNX tensor: 2245 [01/12/2022-09:32:37] [V] [TRT] Add_1411 [Add] outputs: [2245 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Sqrt_1412 [Sqrt] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2245 [01/12/2022-09:32:37] [V] [TRT] Sqrt_1412 [Sqrt] inputs: [2245 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Sqrt_1412 for ONNX node: Sqrt_1412 [01/12/2022-09:32:37] [V] [TRT] Registering tensor: 2246 for ONNX tensor: 2246 [01/12/2022-09:32:37] [V] [TRT] Sqrt_1412 [Sqrt] outputs: [2246 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Parsing node: Div_1413 [Div] [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2240 [01/12/2022-09:32:37] [V] [TRT] Searching for input: 2246 [01/12/2022-09:32:37] [V] [TRT] Div_1413 [Div] inputs: [2240 -> (-1, -1, 768)[FLOAT]], [2246 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:37] [V] [TRT] Registering layer: Div_1413 for ONNX node: Div_1413 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2247 for ONNX tensor: 2247 [01/12/2022-09:32:38] [V] [TRT] Div_1413 [Div] outputs: [2247 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Mul_1414 [Mul] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2247 [01/12/2022-09:32:38] [V] [TRT] Searching for input: decoder.layers.3.encoder_attn_layer_norm.weight [01/12/2022-09:32:38] [V] [TRT] Mul_1414 [Mul] inputs: [2247 -> (-1, -1, 768)[FLOAT]], [decoder.layers.3.encoder_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: decoder.layers.3.encoder_attn_layer_norm.weight for ONNX node: decoder.layers.3.encoder_attn_layer_norm.weight [01/12/2022-09:32:38] [V] [TRT] Registering layer: Mul_1414 for ONNX node: Mul_1414 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2248 for ONNX tensor: 2248 [01/12/2022-09:32:38] [V] [TRT] Mul_1414 [Mul] outputs: [2248 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Add_1415 [Add] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2248 [01/12/2022-09:32:38] [V] [TRT] Searching for input: decoder.layers.3.encoder_attn_layer_norm.bias [01/12/2022-09:32:38] [V] [TRT] Add_1415 [Add] inputs: [2248 -> (-1, -1, 768)[FLOAT]], [decoder.layers.3.encoder_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: decoder.layers.3.encoder_attn_layer_norm.bias for ONNX node: decoder.layers.3.encoder_attn_layer_norm.bias [01/12/2022-09:32:38] [V] [TRT] Registering layer: Add_1415 for ONNX node: Add_1415 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2249 for ONNX tensor: 2249 [01/12/2022-09:32:38] [V] [TRT] Add_1415 [Add] outputs: [2249 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: MatMul_1416 [MatMul] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2249 [01/12/2022-09:32:38] [V] [TRT] Searching for input: 3100 [01/12/2022-09:32:38] [V] [TRT] MatMul_1416 [MatMul] inputs: [2249 -> (-1, -1, 768)[FLOAT]], [3100 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: 3100 for ONNX node: 3100 [01/12/2022-09:32:38] [V] [TRT] Registering layer: MatMul_1416 for ONNX node: MatMul_1416 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2251 for ONNX tensor: 2251 [01/12/2022-09:32:38] [V] [TRT] MatMul_1416 [MatMul] outputs: [2251 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Add_1417 [Add] [01/12/2022-09:32:38] [V] [TRT] Searching for input: decoder.layers.3.fc1.bias [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2251 [01/12/2022-09:32:38] [V] [TRT] Add_1417 [Add] inputs: [decoder.layers.3.fc1.bias -> (3072)[FLOAT]], [2251 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: decoder.layers.3.fc1.bias for ONNX node: decoder.layers.3.fc1.bias [01/12/2022-09:32:38] [V] [TRT] Registering layer: Add_1417 for ONNX node: Add_1417 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2252 for ONNX tensor: 2252 [01/12/2022-09:32:38] [V] [TRT] Add_1417 [Add] outputs: [2252 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Constant_1418 [Constant] [01/12/2022-09:32:38] [V] [TRT] Constant_1418 [Constant] inputs: [01/12/2022-09:32:38] [V] [TRT] Constant_1418 [Constant] outputs: [2253 -> ()[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Div_1419 [Div] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2252 [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2253 [01/12/2022-09:32:38] [V] [TRT] Div_1419 [Div] inputs: [2252 -> (-1, -1, 3072)[FLOAT]], [2253 -> ()[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: 2253 for ONNX node: 2253 [01/12/2022-09:32:38] [V] [TRT] Registering layer: Div_1419 for ONNX node: Div_1419 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2254 for ONNX tensor: 2254 [01/12/2022-09:32:38] [V] [TRT] Div_1419 [Div] outputs: [2254 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Erf_1420 [Erf] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2254 [01/12/2022-09:32:38] [V] [TRT] Erf_1420 [Erf] inputs: [2254 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: Erf_1420 for ONNX node: Erf_1420 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2255 for ONNX tensor: 2255 [01/12/2022-09:32:38] [V] [TRT] Erf_1420 [Erf] outputs: [2255 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Constant_1421 [Constant] [01/12/2022-09:32:38] [V] [TRT] Constant_1421 [Constant] inputs: [01/12/2022-09:32:38] [V] [TRT] Constant_1421 [Constant] outputs: [2256 -> ()[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Add_1422 [Add] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2255 [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2256 [01/12/2022-09:32:38] [V] [TRT] Add_1422 [Add] inputs: [2255 -> (-1, -1, 3072)[FLOAT]], [2256 -> ()[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: 2256 for ONNX node: 2256 [01/12/2022-09:32:38] [V] [TRT] Registering layer: Add_1422 for ONNX node: Add_1422 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2257 for ONNX tensor: 2257 [01/12/2022-09:32:38] [V] [TRT] Add_1422 [Add] outputs: [2257 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Mul_1423 [Mul] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2252 [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2257 [01/12/2022-09:32:38] [V] [TRT] Mul_1423 [Mul] inputs: [2252 -> (-1, -1, 3072)[FLOAT]], [2257 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: Mul_1423 for ONNX node: Mul_1423 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2258 for ONNX tensor: 2258 [01/12/2022-09:32:38] [V] [TRT] Mul_1423 [Mul] outputs: [2258 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Constant_1424 [Constant] [01/12/2022-09:32:38] [V] [TRT] Constant_1424 [Constant] inputs: [01/12/2022-09:32:38] [V] [TRT] Constant_1424 [Constant] outputs: [2259 -> ()[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Mul_1425 [Mul] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2258 [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2259 [01/12/2022-09:32:38] [V] [TRT] Mul_1425 [Mul] inputs: [2258 -> (-1, -1, 3072)[FLOAT]], [2259 -> ()[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: 2259 for ONNX node: 2259 [01/12/2022-09:32:38] [V] [TRT] Registering layer: Mul_1425 for ONNX node: Mul_1425 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2260 for ONNX tensor: 2260 [01/12/2022-09:32:38] [V] [TRT] Mul_1425 [Mul] outputs: [2260 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: MatMul_1426 [MatMul] [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2260 [01/12/2022-09:32:38] [V] [TRT] Searching for input: 3101 [01/12/2022-09:32:38] [V] [TRT] MatMul_1426 [MatMul] inputs: [2260 -> (-1, -1, 3072)[FLOAT]], [3101 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: 3101 for ONNX node: 3101 [01/12/2022-09:32:38] [V] [TRT] Registering layer: MatMul_1426 for ONNX node: MatMul_1426 [01/12/2022-09:32:38] [V] [TRT] Registering tensor: 2262 for ONNX tensor: 2262 [01/12/2022-09:32:38] [V] [TRT] MatMul_1426 [MatMul] outputs: [2262 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Parsing node: Add_1427 [Add] [01/12/2022-09:32:38] [V] [TRT] Searching for input: decoder.layers.3.fc2.bias [01/12/2022-09:32:38] [V] [TRT] Searching for input: 2262 [01/12/2022-09:32:38] [V] [TRT] Add_1427 [Add] inputs: [decoder.layers.3.fc2.bias -> (768)[FLOAT]], [2262 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:38] [V] [TRT] Registering layer: decoder.layers.3.fc2.bias for ONNX node: decoder.layers.3.fc2.bias [01/12/2022-09:32:39] [V] [TRT] Registering layer: Add_1427 for ONNX node: Add_1427 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2263 for ONNX tensor: 2263 [01/12/2022-09:32:39] [V] [TRT] Add_1427 [Add] outputs: [2263 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Add_1428 [Add] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2249 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2263 [01/12/2022-09:32:39] [V] [TRT] Add_1428 [Add] inputs: [2249 -> (-1, -1, 768)[FLOAT]], [2263 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: Add_1428 for ONNX node: Add_1428 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2264 for ONNX tensor: 2264 [01/12/2022-09:32:39] [V] [TRT] Add_1428 [Add] outputs: [2264 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: ReduceMean_1429 [ReduceMean] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2264 [01/12/2022-09:32:39] [V] [TRT] ReduceMean_1429 [ReduceMean] inputs: [2264 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: ReduceMean_1429 for ONNX node: ReduceMean_1429 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2265 for ONNX tensor: 2265 [01/12/2022-09:32:39] [V] [TRT] ReduceMean_1429 [ReduceMean] outputs: [2265 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Sub_1430 [Sub] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2264 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2265 [01/12/2022-09:32:39] [V] [TRT] Sub_1430 [Sub] inputs: [2264 -> (-1, -1, 768)[FLOAT]], [2265 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: Sub_1430 for ONNX node: Sub_1430 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2266 for ONNX tensor: 2266 [01/12/2022-09:32:39] [V] [TRT] Sub_1430 [Sub] outputs: [2266 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Constant_1431 [Constant] [01/12/2022-09:32:39] [V] [TRT] Constant_1431 [Constant] inputs: [01/12/2022-09:32:39] [V] [TRT] Constant_1431 [Constant] outputs: [2267 -> ()[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Pow_1432 [Pow] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2266 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2267 [01/12/2022-09:32:39] [V] [TRT] Pow_1432 [Pow] inputs: [2266 -> (-1, -1, 768)[FLOAT]], [2267 -> ()[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: 2267 for ONNX node: 2267 [01/12/2022-09:32:39] [V] [TRT] Registering layer: Pow_1432 for ONNX node: Pow_1432 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2268 for ONNX tensor: 2268 [01/12/2022-09:32:39] [V] [TRT] Pow_1432 [Pow] outputs: [2268 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: ReduceMean_1433 [ReduceMean] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2268 [01/12/2022-09:32:39] [V] [TRT] ReduceMean_1433 [ReduceMean] inputs: [2268 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: ReduceMean_1433 for ONNX node: ReduceMean_1433 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2269 for ONNX tensor: 2269 [01/12/2022-09:32:39] [V] [TRT] ReduceMean_1433 [ReduceMean] outputs: [2269 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Constant_1434 [Constant] [01/12/2022-09:32:39] [V] [TRT] Constant_1434 [Constant] inputs: [01/12/2022-09:32:39] [V] [TRT] Constant_1434 [Constant] outputs: [2270 -> ()[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Add_1435 [Add] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2269 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2270 [01/12/2022-09:32:39] [V] [TRT] Add_1435 [Add] inputs: [2269 -> (-1, -1, 1)[FLOAT]], [2270 -> ()[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: 2270 for ONNX node: 2270 [01/12/2022-09:32:39] [V] [TRT] Registering layer: Add_1435 for ONNX node: Add_1435 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2271 for ONNX tensor: 2271 [01/12/2022-09:32:39] [V] [TRT] Add_1435 [Add] outputs: [2271 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Sqrt_1436 [Sqrt] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2271 [01/12/2022-09:32:39] [V] [TRT] Sqrt_1436 [Sqrt] inputs: [2271 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: Sqrt_1436 for ONNX node: Sqrt_1436 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2272 for ONNX tensor: 2272 [01/12/2022-09:32:39] [V] [TRT] Sqrt_1436 [Sqrt] outputs: [2272 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Div_1437 [Div] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2266 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2272 [01/12/2022-09:32:39] [V] [TRT] Div_1437 [Div] inputs: [2266 -> (-1, -1, 768)[FLOAT]], [2272 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: Div_1437 for ONNX node: Div_1437 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2273 for ONNX tensor: 2273 [01/12/2022-09:32:39] [V] [TRT] Div_1437 [Div] outputs: [2273 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Mul_1438 [Mul] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2273 [01/12/2022-09:32:39] [V] [TRT] Searching for input: decoder.layers.3.final_layer_norm.weight [01/12/2022-09:32:39] [V] [TRT] Mul_1438 [Mul] inputs: [2273 -> (-1, -1, 768)[FLOAT]], [decoder.layers.3.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: decoder.layers.3.final_layer_norm.weight for ONNX node: decoder.layers.3.final_layer_norm.weight [01/12/2022-09:32:39] [V] [TRT] Registering layer: Mul_1438 for ONNX node: Mul_1438 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2274 for ONNX tensor: 2274 [01/12/2022-09:32:39] [V] [TRT] Mul_1438 [Mul] outputs: [2274 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Add_1439 [Add] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2274 [01/12/2022-09:32:39] [V] [TRT] Searching for input: decoder.layers.3.final_layer_norm.bias [01/12/2022-09:32:39] [V] [TRT] Add_1439 [Add] inputs: [2274 -> (-1, -1, 768)[FLOAT]], [decoder.layers.3.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: decoder.layers.3.final_layer_norm.bias for ONNX node: decoder.layers.3.final_layer_norm.bias [01/12/2022-09:32:39] [V] [TRT] Registering layer: Add_1439 for ONNX node: Add_1439 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2275 for ONNX tensor: 2275 [01/12/2022-09:32:39] [V] [TRT] Add_1439 [Add] outputs: [2275 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Shape_1440 [Shape] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2275 [01/12/2022-09:32:39] [V] [TRT] Shape_1440 [Shape] inputs: [2275 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: Shape_1440 for ONNX node: Shape_1440 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2276 for ONNX tensor: 2276 [01/12/2022-09:32:39] [V] [TRT] Shape_1440 [Shape] outputs: [2276 -> (3)[INT32]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Constant_1441 [Constant] [01/12/2022-09:32:39] [V] [TRT] Constant_1441 [Constant] inputs: [01/12/2022-09:32:39] [V] [TRT] Constant_1441 [Constant] outputs: [2277 -> ()[INT32]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Gather_1442 [Gather] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2276 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2277 [01/12/2022-09:32:39] [V] [TRT] Gather_1442 [Gather] inputs: [2276 -> (3)[INT32]], [2277 -> ()[INT32]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: 2277 for ONNX node: 2277 [01/12/2022-09:32:39] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:39] [V] [TRT] Registering layer: Gather_1442 for ONNX node: Gather_1442 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2278 for ONNX tensor: 2278 [01/12/2022-09:32:39] [V] [TRT] Gather_1442 [Gather] outputs: [2278 -> ()[INT32]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Shape_1443 [Shape] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2275 [01/12/2022-09:32:39] [V] [TRT] Shape_1443 [Shape] inputs: [2275 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: Shape_1443 for ONNX node: Shape_1443 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2279 for ONNX tensor: 2279 [01/12/2022-09:32:39] [V] [TRT] Shape_1443 [Shape] outputs: [2279 -> (3)[INT32]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Constant_1444 [Constant] [01/12/2022-09:32:39] [V] [TRT] Constant_1444 [Constant] inputs: [01/12/2022-09:32:39] [V] [TRT] Constant_1444 [Constant] outputs: [2280 -> ()[INT32]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: Gather_1445 [Gather] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2279 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2280 [01/12/2022-09:32:39] [V] [TRT] Gather_1445 [Gather] inputs: [2279 -> (3)[INT32]], [2280 -> ()[INT32]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: 2280 for ONNX node: 2280 [01/12/2022-09:32:39] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:39] [V] [TRT] Registering layer: Gather_1445 for ONNX node: Gather_1445 [01/12/2022-09:32:39] [V] [TRT] Registering tensor: 2281 for ONNX tensor: 2281 [01/12/2022-09:32:39] [V] [TRT] Gather_1445 [Gather] outputs: [2281 -> ()[INT32]], [01/12/2022-09:32:39] [V] [TRT] Parsing node: MatMul_1446 [MatMul] [01/12/2022-09:32:39] [V] [TRT] Searching for input: 2275 [01/12/2022-09:32:39] [V] [TRT] Searching for input: 3102 [01/12/2022-09:32:39] [V] [TRT] MatMul_1446 [MatMul] inputs: [2275 -> (-1, -1, 768)[FLOAT]], [3102 -> (768, 768)[FLOAT]], [01/12/2022-09:32:39] [V] [TRT] Registering layer: 3102 for ONNX node: 3102 [01/12/2022-09:32:40] [V] [TRT] Registering layer: MatMul_1446 for ONNX node: MatMul_1446 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2283 for ONNX tensor: 2283 [01/12/2022-09:32:40] [V] [TRT] MatMul_1446 [MatMul] outputs: [2283 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Add_1447 [Add] [01/12/2022-09:32:40] [V] [TRT] Searching for input: decoder.layers.4.self_attn.q_proj.bias [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2283 [01/12/2022-09:32:40] [V] [TRT] Add_1447 [Add] inputs: [decoder.layers.4.self_attn.q_proj.bias -> (768)[FLOAT]], [2283 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: decoder.layers.4.self_attn.q_proj.bias for ONNX node: decoder.layers.4.self_attn.q_proj.bias [01/12/2022-09:32:40] [V] [TRT] Registering layer: Add_1447 for ONNX node: Add_1447 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2284 for ONNX tensor: 2284 [01/12/2022-09:32:40] [V] [TRT] Add_1447 [Add] outputs: [2284 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Constant_1448 [Constant] [01/12/2022-09:32:40] [V] [TRT] Constant_1448 [Constant] inputs: [01/12/2022-09:32:40] [V] [TRT] Constant_1448 [Constant] outputs: [2285 -> ()[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Mul_1449 [Mul] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2284 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2285 [01/12/2022-09:32:40] [V] [TRT] Mul_1449 [Mul] inputs: [2284 -> (-1, -1, 768)[FLOAT]], [2285 -> ()[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: 2285 for ONNX node: 2285 [01/12/2022-09:32:40] [V] [TRT] Registering layer: Mul_1449 for ONNX node: Mul_1449 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2286 for ONNX tensor: 2286 [01/12/2022-09:32:40] [V] [TRT] Mul_1449 [Mul] outputs: [2286 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: MatMul_1450 [MatMul] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2275 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 3103 [01/12/2022-09:32:40] [V] [TRT] MatMul_1450 [MatMul] inputs: [2275 -> (-1, -1, 768)[FLOAT]], [3103 -> (768, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: 3103 for ONNX node: 3103 [01/12/2022-09:32:40] [V] [TRT] Registering layer: MatMul_1450 for ONNX node: MatMul_1450 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2288 for ONNX tensor: 2288 [01/12/2022-09:32:40] [V] [TRT] MatMul_1450 [MatMul] outputs: [2288 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Add_1451 [Add] [01/12/2022-09:32:40] [V] [TRT] Searching for input: decoder.layers.4.self_attn.k_proj.bias [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2288 [01/12/2022-09:32:40] [V] [TRT] Add_1451 [Add] inputs: [decoder.layers.4.self_attn.k_proj.bias -> (768)[FLOAT]], [2288 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: decoder.layers.4.self_attn.k_proj.bias for ONNX node: decoder.layers.4.self_attn.k_proj.bias [01/12/2022-09:32:40] [V] [TRT] Registering layer: Add_1451 for ONNX node: Add_1451 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2289 for ONNX tensor: 2289 [01/12/2022-09:32:40] [V] [TRT] Add_1451 [Add] outputs: [2289 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Unsqueeze_1452 [Unsqueeze] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:40] [V] [TRT] Unsqueeze_1452 [Unsqueeze] inputs: [2278 -> ()[INT32]], [01/12/2022-09:32:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:40] [V] [TRT] Registering layer: Unsqueeze_1452 for ONNX node: Unsqueeze_1452 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2293 for ONNX tensor: 2293 [01/12/2022-09:32:40] [V] [TRT] Unsqueeze_1452 [Unsqueeze] outputs: [2293 -> (1)[INT32]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Concat_1453 [Concat] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2293 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 3104 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 3105 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 3106 [01/12/2022-09:32:40] [V] [TRT] Concat_1453 [Concat] inputs: [2293 -> (1)[INT32]], [3104 -> (1)[INT32]], [3105 -> (1)[INT32]], [3106 -> (1)[INT32]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: 3104 for ONNX node: 3104 [01/12/2022-09:32:40] [V] [TRT] Registering layer: 3105 for ONNX node: 3105 [01/12/2022-09:32:40] [V] [TRT] Registering layer: 3106 for ONNX node: 3106 [01/12/2022-09:32:40] [V] [TRT] Registering layer: Concat_1453 for ONNX node: Concat_1453 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2297 for ONNX tensor: 2297 [01/12/2022-09:32:40] [V] [TRT] Concat_1453 [Concat] outputs: [2297 -> (4)[INT32]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Reshape_1454 [Reshape] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2289 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2297 [01/12/2022-09:32:40] [V] [TRT] Reshape_1454 [Reshape] inputs: [2289 -> (-1, -1, 768)[FLOAT]], [2297 -> (4)[INT32]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: Reshape_1454 for ONNX node: Reshape_1454 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2298 for ONNX tensor: 2298 [01/12/2022-09:32:40] [V] [TRT] Reshape_1454 [Reshape] outputs: [2298 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Transpose_1455 [Transpose] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2298 [01/12/2022-09:32:40] [V] [TRT] Transpose_1455 [Transpose] inputs: [2298 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: Transpose_1455 for ONNX node: Transpose_1455 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2299_18 for ONNX tensor: 2299 [01/12/2022-09:32:40] [V] [TRT] Transpose_1455 [Transpose] outputs: [2299 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: MatMul_1456 [MatMul] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2275 [01/12/2022-09:32:40] [V] [TRT] Searching for input: 3107 [01/12/2022-09:32:40] [V] [TRT] MatMul_1456 [MatMul] inputs: [2275 -> (-1, -1, 768)[FLOAT]], [3107 -> (768, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: 3107 for ONNX node: 3107 [01/12/2022-09:32:40] [V] [TRT] Registering layer: MatMul_1456 for ONNX node: MatMul_1456 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2301 for ONNX tensor: 2301 [01/12/2022-09:32:40] [V] [TRT] MatMul_1456 [MatMul] outputs: [2301 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Add_1457 [Add] [01/12/2022-09:32:40] [V] [TRT] Searching for input: decoder.layers.4.self_attn.v_proj.bias [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2301 [01/12/2022-09:32:40] [V] [TRT] Add_1457 [Add] inputs: [decoder.layers.4.self_attn.v_proj.bias -> (768)[FLOAT]], [2301 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Registering layer: decoder.layers.4.self_attn.v_proj.bias for ONNX node: decoder.layers.4.self_attn.v_proj.bias [01/12/2022-09:32:40] [V] [TRT] Registering layer: Add_1457 for ONNX node: Add_1457 [01/12/2022-09:32:40] [V] [TRT] Registering tensor: 2302 for ONNX tensor: 2302 [01/12/2022-09:32:40] [V] [TRT] Add_1457 [Add] outputs: [2302 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:40] [V] [TRT] Parsing node: Unsqueeze_1458 [Unsqueeze] [01/12/2022-09:32:40] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:40] [V] [TRT] Unsqueeze_1458 [Unsqueeze] inputs: [2278 -> ()[INT32]], [01/12/2022-09:32:40] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:40] [V] [TRT] Registering layer: Unsqueeze_1458 for ONNX node: Unsqueeze_1458 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2306 for ONNX tensor: 2306 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1458 [Unsqueeze] outputs: [2306 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Concat_1459 [Concat] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2306 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3108 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3109 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3110 [01/12/2022-09:32:41] [V] [TRT] Concat_1459 [Concat] inputs: [2306 -> (1)[INT32]], [3108 -> (1)[INT32]], [3109 -> (1)[INT32]], [3110 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3108 for ONNX node: 3108 [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3109 for ONNX node: 3109 [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3110 for ONNX node: 3110 [01/12/2022-09:32:41] [V] [TRT] Registering layer: Concat_1459 for ONNX node: Concat_1459 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2310 for ONNX tensor: 2310 [01/12/2022-09:32:41] [V] [TRT] Concat_1459 [Concat] outputs: [2310 -> (4)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Reshape_1460 [Reshape] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2302 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2310 [01/12/2022-09:32:41] [V] [TRT] Reshape_1460 [Reshape] inputs: [2302 -> (-1, -1, 768)[FLOAT]], [2310 -> (4)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Reshape_1460 for ONNX node: Reshape_1460 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2311 for ONNX tensor: 2311 [01/12/2022-09:32:41] [V] [TRT] Reshape_1460 [Reshape] outputs: [2311 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Transpose_1461 [Transpose] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2311 [01/12/2022-09:32:41] [V] [TRT] Transpose_1461 [Transpose] inputs: [2311 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Transpose_1461 for ONNX node: Transpose_1461 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2312_19 for ONNX tensor: 2312 [01/12/2022-09:32:41] [V] [TRT] Transpose_1461 [Transpose] outputs: [2312 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Constant_1462 [Constant] [01/12/2022-09:32:41] [V] [TRT] Constant_1462 [Constant] inputs: [01/12/2022-09:32:41] [V] [TRT] Constant_1462 [Constant] outputs: [2313 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Mul_1463 [Mul] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2313 [01/12/2022-09:32:41] [V] [TRT] Mul_1463 [Mul] inputs: [2278 -> ()[INT32]], [2313 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: 2313 for ONNX node: 2313 [01/12/2022-09:32:41] [V] [TRT] Registering layer: Mul_1463 for ONNX node: Mul_1463 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2314 for ONNX tensor: 2314 [01/12/2022-09:32:41] [V] [TRT] Mul_1463 [Mul] outputs: [2314 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Unsqueeze_1464 [Unsqueeze] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1464 [Unsqueeze] inputs: [2278 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:41] [V] [TRT] Registering layer: Unsqueeze_1464 for ONNX node: Unsqueeze_1464 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2317 for ONNX tensor: 2317 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1464 [Unsqueeze] outputs: [2317 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Unsqueeze_1465 [Unsqueeze] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2281 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1465 [Unsqueeze] inputs: [2281 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:41] [V] [TRT] Registering layer: Unsqueeze_1465 for ONNX node: Unsqueeze_1465 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2318 for ONNX tensor: 2318 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1465 [Unsqueeze] outputs: [2318 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Concat_1466 [Concat] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2317 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2318 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3111 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3112 [01/12/2022-09:32:41] [V] [TRT] Concat_1466 [Concat] inputs: [2317 -> (1)[INT32]], [2318 -> (1)[INT32]], [3111 -> (1)[INT32]], [3112 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3111 for ONNX node: 3111 [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3112 for ONNX node: 3112 [01/12/2022-09:32:41] [V] [TRT] Registering layer: Concat_1466 for ONNX node: Concat_1466 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2321 for ONNX tensor: 2321 [01/12/2022-09:32:41] [V] [TRT] Concat_1466 [Concat] outputs: [2321 -> (4)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Reshape_1467 [Reshape] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2286 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2321 [01/12/2022-09:32:41] [V] [TRT] Reshape_1467 [Reshape] inputs: [2286 -> (-1, -1, 768)[FLOAT]], [2321 -> (4)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Reshape_1467 for ONNX node: Reshape_1467 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2322 for ONNX tensor: 2322 [01/12/2022-09:32:41] [V] [TRT] Reshape_1467 [Reshape] outputs: [2322 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Transpose_1468 [Transpose] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2322 [01/12/2022-09:32:41] [V] [TRT] Transpose_1468 [Transpose] inputs: [2322 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Transpose_1468 for ONNX node: Transpose_1468 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2323 for ONNX tensor: 2323 [01/12/2022-09:32:41] [V] [TRT] Transpose_1468 [Transpose] outputs: [2323 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Unsqueeze_1469 [Unsqueeze] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2314 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1469 [Unsqueeze] inputs: [2314 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:41] [V] [TRT] Registering layer: Unsqueeze_1469 for ONNX node: Unsqueeze_1469 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2326 for ONNX tensor: 2326 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1469 [Unsqueeze] outputs: [2326 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Concat_1470 [Concat] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2326 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3113 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3114 [01/12/2022-09:32:41] [V] [TRT] Concat_1470 [Concat] inputs: [2326 -> (1)[INT32]], [3113 -> (1)[INT32]], [3114 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3113 for ONNX node: 3113 [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3114 for ONNX node: 3114 [01/12/2022-09:32:41] [V] [TRT] Registering layer: Concat_1470 for ONNX node: Concat_1470 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2329 for ONNX tensor: 2329 [01/12/2022-09:32:41] [V] [TRT] Concat_1470 [Concat] outputs: [2329 -> (3)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Reshape_1471 [Reshape] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2323 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2329 [01/12/2022-09:32:41] [V] [TRT] Reshape_1471 [Reshape] inputs: [2323 -> (-1, 12, -1, 64)[FLOAT]], [2329 -> (3)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Reshape_1471 for ONNX node: Reshape_1471 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2330 for ONNX tensor: 2330 [01/12/2022-09:32:41] [V] [TRT] Reshape_1471 [Reshape] outputs: [2330 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Unsqueeze_1472 [Unsqueeze] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2314 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1472 [Unsqueeze] inputs: [2314 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:41] [V] [TRT] Registering layer: Unsqueeze_1472 for ONNX node: Unsqueeze_1472 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2333 for ONNX tensor: 2333 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1472 [Unsqueeze] outputs: [2333 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Concat_1473 [Concat] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2333 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3115 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3116 [01/12/2022-09:32:41] [V] [TRT] Concat_1473 [Concat] inputs: [2333 -> (1)[INT32]], [3115 -> (1)[INT32]], [3116 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3115 for ONNX node: 3115 [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3116 for ONNX node: 3116 [01/12/2022-09:32:41] [V] [TRT] Registering layer: Concat_1473 for ONNX node: Concat_1473 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2336 for ONNX tensor: 2336 [01/12/2022-09:32:41] [V] [TRT] Concat_1473 [Concat] outputs: [2336 -> (3)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Reshape_1474 [Reshape] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2299 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2336 [01/12/2022-09:32:41] [V] [TRT] Reshape_1474 [Reshape] inputs: [2299 -> (-1, 12, -1, 64)[FLOAT]], [2336 -> (3)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Reshape_1474 for ONNX node: Reshape_1474 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2337 for ONNX tensor: 2337 [01/12/2022-09:32:41] [V] [TRT] Reshape_1474 [Reshape] outputs: [2337 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Unsqueeze_1475 [Unsqueeze] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2314 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1475 [Unsqueeze] inputs: [2314 -> ()[INT32]], [01/12/2022-09:32:41] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:41] [V] [TRT] Registering layer: Unsqueeze_1475 for ONNX node: Unsqueeze_1475 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2340 for ONNX tensor: 2340 [01/12/2022-09:32:41] [V] [TRT] Unsqueeze_1475 [Unsqueeze] outputs: [2340 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Concat_1476 [Concat] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2340 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3117 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 3118 [01/12/2022-09:32:41] [V] [TRT] Concat_1476 [Concat] inputs: [2340 -> (1)[INT32]], [3117 -> (1)[INT32]], [3118 -> (1)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3117 for ONNX node: 3117 [01/12/2022-09:32:41] [V] [TRT] Registering layer: 3118 for ONNX node: 3118 [01/12/2022-09:32:41] [V] [TRT] Registering layer: Concat_1476 for ONNX node: Concat_1476 [01/12/2022-09:32:41] [V] [TRT] Registering tensor: 2343 for ONNX tensor: 2343 [01/12/2022-09:32:41] [V] [TRT] Concat_1476 [Concat] outputs: [2343 -> (3)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Parsing node: Reshape_1477 [Reshape] [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2312 [01/12/2022-09:32:41] [V] [TRT] Searching for input: 2343 [01/12/2022-09:32:41] [V] [TRT] Reshape_1477 [Reshape] inputs: [2312 -> (-1, 12, -1, 64)[FLOAT]], [2343 -> (3)[INT32]], [01/12/2022-09:32:41] [V] [TRT] Registering layer: Reshape_1477 for ONNX node: Reshape_1477 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2344 for ONNX tensor: 2344 [01/12/2022-09:32:42] [V] [TRT] Reshape_1477 [Reshape] outputs: [2344 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Shape_1478 [Shape] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2337 [01/12/2022-09:32:42] [V] [TRT] Shape_1478 [Shape] inputs: [2337 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: Shape_1478 for ONNX node: Shape_1478 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2345 for ONNX tensor: 2345 [01/12/2022-09:32:42] [V] [TRT] Shape_1478 [Shape] outputs: [2345 -> (3)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Constant_1479 [Constant] [01/12/2022-09:32:42] [V] [TRT] Constant_1479 [Constant] inputs: [01/12/2022-09:32:42] [V] [TRT] Constant_1479 [Constant] outputs: [2346 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Gather_1480 [Gather] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2345 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2346 [01/12/2022-09:32:42] [V] [TRT] Gather_1480 [Gather] inputs: [2345 -> (3)[INT32]], [2346 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: 2346 for ONNX node: 2346 [01/12/2022-09:32:42] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:42] [V] [TRT] Registering layer: Gather_1480 for ONNX node: Gather_1480 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2347 for ONNX tensor: 2347 [01/12/2022-09:32:42] [V] [TRT] Gather_1480 [Gather] outputs: [2347 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Transpose_1481 [Transpose] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2337 [01/12/2022-09:32:42] [V] [TRT] Transpose_1481 [Transpose] inputs: [2337 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: Transpose_1481 for ONNX node: Transpose_1481 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2348 for ONNX tensor: 2348 [01/12/2022-09:32:42] [V] [TRT] Transpose_1481 [Transpose] outputs: [2348 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: MatMul_1482 [MatMul] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2330 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2348 [01/12/2022-09:32:42] [V] [TRT] MatMul_1482 [MatMul] inputs: [2330 -> (-1, -1, 64)[FLOAT]], [2348 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: MatMul_1482 for ONNX node: MatMul_1482 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2349 for ONNX tensor: 2349 [01/12/2022-09:32:42] [V] [TRT] MatMul_1482 [MatMul] outputs: [2349 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Unsqueeze_1483 [Unsqueeze] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1483 [Unsqueeze] inputs: [2278 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:42] [V] [TRT] Registering layer: Unsqueeze_1483 for ONNX node: Unsqueeze_1483 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2351 for ONNX tensor: 2351 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1483 [Unsqueeze] outputs: [2351 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Unsqueeze_1484 [Unsqueeze] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2281 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1484 [Unsqueeze] inputs: [2281 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:42] [V] [TRT] Registering layer: Unsqueeze_1484 for ONNX node: Unsqueeze_1484 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2353 for ONNX tensor: 2353 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1484 [Unsqueeze] outputs: [2353 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Unsqueeze_1485 [Unsqueeze] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2347 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1485 [Unsqueeze] inputs: [2347 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:42] [V] [TRT] Registering layer: Unsqueeze_1485 for ONNX node: Unsqueeze_1485 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2354 for ONNX tensor: 2354 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1485 [Unsqueeze] outputs: [2354 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Concat_1486 [Concat] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2351 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 3119 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2353 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2354 [01/12/2022-09:32:42] [V] [TRT] Concat_1486 [Concat] inputs: [2351 -> (1)[INT32]], [3119 -> (1)[INT32]], [2353 -> (1)[INT32]], [2354 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: 3119 for ONNX node: 3119 [01/12/2022-09:32:42] [V] [TRT] Registering layer: Concat_1486 for ONNX node: Concat_1486 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2355 for ONNX tensor: 2355 [01/12/2022-09:32:42] [V] [TRT] Concat_1486 [Concat] outputs: [2355 -> (4)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Reshape_1487 [Reshape] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2349 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2355 [01/12/2022-09:32:42] [V] [TRT] Reshape_1487 [Reshape] inputs: [2349 -> (-1, -1, -1)[FLOAT]], [2355 -> (4)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: Reshape_1487 for ONNX node: Reshape_1487 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2356 for ONNX tensor: 2356 [01/12/2022-09:32:42] [V] [TRT] Reshape_1487 [Reshape] outputs: [2356 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Add_1488 [Add] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2356 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 1252 [01/12/2022-09:32:42] [V] [TRT] Add_1488 [Add] inputs: [2356 -> (-1, 12, -1, -1)[FLOAT]], [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: Add_1488 for ONNX node: Add_1488 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2357 for ONNX tensor: 2357 [01/12/2022-09:32:42] [V] [TRT] Add_1488 [Add] outputs: [2357 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Constant_1489 [Constant] [01/12/2022-09:32:42] [V] [TRT] Constant_1489 [Constant] inputs: [01/12/2022-09:32:42] [V] [TRT] Constant_1489 [Constant] outputs: [2358 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Mul_1490 [Mul] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2358 [01/12/2022-09:32:42] [V] [TRT] Mul_1490 [Mul] inputs: [2278 -> ()[INT32]], [2358 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: 2358 for ONNX node: 2358 [01/12/2022-09:32:42] [V] [TRT] Registering layer: Mul_1490 for ONNX node: Mul_1490 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2359 for ONNX tensor: 2359 [01/12/2022-09:32:42] [V] [TRT] Mul_1490 [Mul] outputs: [2359 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Unsqueeze_1491 [Unsqueeze] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2359 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1491 [Unsqueeze] inputs: [2359 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:42] [V] [TRT] Registering layer: Unsqueeze_1491 for ONNX node: Unsqueeze_1491 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2360 for ONNX tensor: 2360 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1491 [Unsqueeze] outputs: [2360 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Unsqueeze_1492 [Unsqueeze] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2281 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1492 [Unsqueeze] inputs: [2281 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:42] [V] [TRT] Registering layer: Unsqueeze_1492 for ONNX node: Unsqueeze_1492 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2361 for ONNX tensor: 2361 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1492 [Unsqueeze] outputs: [2361 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Unsqueeze_1493 [Unsqueeze] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2347 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1493 [Unsqueeze] inputs: [2347 -> ()[INT32]], [01/12/2022-09:32:42] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:42] [V] [TRT] Registering layer: Unsqueeze_1493 for ONNX node: Unsqueeze_1493 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2362 for ONNX tensor: 2362 [01/12/2022-09:32:42] [V] [TRT] Unsqueeze_1493 [Unsqueeze] outputs: [2362 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Concat_1494 [Concat] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2360 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2361 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2362 [01/12/2022-09:32:42] [V] [TRT] Concat_1494 [Concat] inputs: [2360 -> (1)[INT32]], [2361 -> (1)[INT32]], [2362 -> (1)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: Concat_1494 for ONNX node: Concat_1494 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2363 for ONNX tensor: 2363 [01/12/2022-09:32:42] [V] [TRT] Concat_1494 [Concat] outputs: [2363 -> (3)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Reshape_1495 [Reshape] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2357 [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2363 [01/12/2022-09:32:42] [V] [TRT] Reshape_1495 [Reshape] inputs: [2357 -> (-1, 12, -1, -1)[FLOAT]], [2363 -> (3)[INT32]], [01/12/2022-09:32:42] [V] [TRT] Registering layer: Reshape_1495 for ONNX node: Reshape_1495 [01/12/2022-09:32:42] [V] [TRT] Registering tensor: 2364 for ONNX tensor: 2364 [01/12/2022-09:32:42] [V] [TRT] Reshape_1495 [Reshape] outputs: [2364 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:42] [V] [TRT] Parsing node: Softmax_1496 [Softmax] [01/12/2022-09:32:42] [V] [TRT] Searching for input: 2364 [01/12/2022-09:32:42] [V] [TRT] Softmax_1496 [Softmax] inputs: [2364 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: Softmax_1496 for ONNX node: Softmax_1496 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2365 for ONNX tensor: 2365 [01/12/2022-09:32:43] [V] [TRT] Softmax_1496 [Softmax] outputs: [2365 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: MatMul_1497 [MatMul] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2365 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2344 [01/12/2022-09:32:43] [V] [TRT] MatMul_1497 [MatMul] inputs: [2365 -> (-1, -1, -1)[FLOAT]], [2344 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: MatMul_1497 for ONNX node: MatMul_1497 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2366 for ONNX tensor: 2366 [01/12/2022-09:32:43] [V] [TRT] MatMul_1497 [MatMul] outputs: [2366 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Unsqueeze_1498 [Unsqueeze] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1498 [Unsqueeze] inputs: [2278 -> ()[INT32]], [01/12/2022-09:32:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:43] [V] [TRT] Registering layer: Unsqueeze_1498 for ONNX node: Unsqueeze_1498 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2369 for ONNX tensor: 2369 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1498 [Unsqueeze] outputs: [2369 -> (1)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Unsqueeze_1499 [Unsqueeze] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2281 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1499 [Unsqueeze] inputs: [2281 -> ()[INT32]], [01/12/2022-09:32:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:43] [V] [TRT] Registering layer: Unsqueeze_1499 for ONNX node: Unsqueeze_1499 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2371 for ONNX tensor: 2371 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1499 [Unsqueeze] outputs: [2371 -> (1)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Concat_1500 [Concat] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2369 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 3120 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2371 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 3121 [01/12/2022-09:32:43] [V] [TRT] Concat_1500 [Concat] inputs: [2369 -> (1)[INT32]], [3120 -> (1)[INT32]], [2371 -> (1)[INT32]], [3121 -> (1)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: 3120 for ONNX node: 3120 [01/12/2022-09:32:43] [V] [TRT] Registering layer: 3121 for ONNX node: 3121 [01/12/2022-09:32:43] [V] [TRT] Registering layer: Concat_1500 for ONNX node: Concat_1500 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2373 for ONNX tensor: 2373 [01/12/2022-09:32:43] [V] [TRT] Concat_1500 [Concat] outputs: [2373 -> (4)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Reshape_1501 [Reshape] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2366 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2373 [01/12/2022-09:32:43] [V] [TRT] Reshape_1501 [Reshape] inputs: [2366 -> (-1, -1, 64)[FLOAT]], [2373 -> (4)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: Reshape_1501 for ONNX node: Reshape_1501 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2374 for ONNX tensor: 2374 [01/12/2022-09:32:43] [V] [TRT] Reshape_1501 [Reshape] outputs: [2374 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Transpose_1502 [Transpose] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2374 [01/12/2022-09:32:43] [V] [TRT] Transpose_1502 [Transpose] inputs: [2374 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: Transpose_1502 for ONNX node: Transpose_1502 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2375 for ONNX tensor: 2375 [01/12/2022-09:32:43] [V] [TRT] Transpose_1502 [Transpose] outputs: [2375 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Unsqueeze_1503 [Unsqueeze] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2278 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1503 [Unsqueeze] inputs: [2278 -> ()[INT32]], [01/12/2022-09:32:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:43] [V] [TRT] Registering layer: Unsqueeze_1503 for ONNX node: Unsqueeze_1503 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2377 for ONNX tensor: 2377 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1503 [Unsqueeze] outputs: [2377 -> (1)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Unsqueeze_1504 [Unsqueeze] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2281 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1504 [Unsqueeze] inputs: [2281 -> ()[INT32]], [01/12/2022-09:32:43] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:43] [V] [TRT] Registering layer: Unsqueeze_1504 for ONNX node: Unsqueeze_1504 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2378 for ONNX tensor: 2378 [01/12/2022-09:32:43] [V] [TRT] Unsqueeze_1504 [Unsqueeze] outputs: [2378 -> (1)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Concat_1505 [Concat] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2377 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2378 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 3122 [01/12/2022-09:32:43] [V] [TRT] Concat_1505 [Concat] inputs: [2377 -> (1)[INT32]], [2378 -> (1)[INT32]], [3122 -> (1)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: 3122 for ONNX node: 3122 [01/12/2022-09:32:43] [V] [TRT] Registering layer: Concat_1505 for ONNX node: Concat_1505 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2380 for ONNX tensor: 2380 [01/12/2022-09:32:43] [V] [TRT] Concat_1505 [Concat] outputs: [2380 -> (3)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Reshape_1506 [Reshape] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2375 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2380 [01/12/2022-09:32:43] [V] [TRT] Reshape_1506 [Reshape] inputs: [2375 -> (-1, -1, 12, 64)[FLOAT]], [2380 -> (3)[INT32]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: Reshape_1506 for ONNX node: Reshape_1506 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2381 for ONNX tensor: 2381 [01/12/2022-09:32:43] [V] [TRT] Reshape_1506 [Reshape] outputs: [2381 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: MatMul_1507 [MatMul] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2381 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 3123 [01/12/2022-09:32:43] [V] [TRT] MatMul_1507 [MatMul] inputs: [2381 -> (-1, -1, 768)[FLOAT]], [3123 -> (768, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: 3123 for ONNX node: 3123 [01/12/2022-09:32:43] [V] [TRT] Registering layer: MatMul_1507 for ONNX node: MatMul_1507 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2383 for ONNX tensor: 2383 [01/12/2022-09:32:43] [V] [TRT] MatMul_1507 [MatMul] outputs: [2383 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Add_1508 [Add] [01/12/2022-09:32:43] [V] [TRT] Searching for input: decoder.layers.4.self_attn.out_proj.bias [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2383 [01/12/2022-09:32:43] [V] [TRT] Add_1508 [Add] inputs: [decoder.layers.4.self_attn.out_proj.bias -> (768)[FLOAT]], [2383 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: decoder.layers.4.self_attn.out_proj.bias for ONNX node: decoder.layers.4.self_attn.out_proj.bias [01/12/2022-09:32:43] [V] [TRT] Registering layer: Add_1508 for ONNX node: Add_1508 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2384 for ONNX tensor: 2384 [01/12/2022-09:32:43] [V] [TRT] Add_1508 [Add] outputs: [2384 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Add_1509 [Add] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2275 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2384 [01/12/2022-09:32:43] [V] [TRT] Add_1509 [Add] inputs: [2275 -> (-1, -1, 768)[FLOAT]], [2384 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: Add_1509 for ONNX node: Add_1509 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2385 for ONNX tensor: 2385 [01/12/2022-09:32:43] [V] [TRT] Add_1509 [Add] outputs: [2385 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: ReduceMean_1510 [ReduceMean] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2385 [01/12/2022-09:32:43] [V] [TRT] ReduceMean_1510 [ReduceMean] inputs: [2385 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: ReduceMean_1510 for ONNX node: ReduceMean_1510 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2386 for ONNX tensor: 2386 [01/12/2022-09:32:43] [V] [TRT] ReduceMean_1510 [ReduceMean] outputs: [2386 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Sub_1511 [Sub] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2385 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2386 [01/12/2022-09:32:43] [V] [TRT] Sub_1511 [Sub] inputs: [2385 -> (-1, -1, 768)[FLOAT]], [2386 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: Sub_1511 for ONNX node: Sub_1511 [01/12/2022-09:32:43] [V] [TRT] Registering tensor: 2387 for ONNX tensor: 2387 [01/12/2022-09:32:43] [V] [TRT] Sub_1511 [Sub] outputs: [2387 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Constant_1512 [Constant] [01/12/2022-09:32:43] [V] [TRT] Constant_1512 [Constant] inputs: [01/12/2022-09:32:43] [V] [TRT] Constant_1512 [Constant] outputs: [2388 -> ()[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Parsing node: Pow_1513 [Pow] [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2387 [01/12/2022-09:32:43] [V] [TRT] Searching for input: 2388 [01/12/2022-09:32:43] [V] [TRT] Pow_1513 [Pow] inputs: [2387 -> (-1, -1, 768)[FLOAT]], [2388 -> ()[FLOAT]], [01/12/2022-09:32:43] [V] [TRT] Registering layer: 2388 for ONNX node: 2388 [01/12/2022-09:32:44] [V] [TRT] Registering layer: Pow_1513 for ONNX node: Pow_1513 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2389 for ONNX tensor: 2389 [01/12/2022-09:32:44] [V] [TRT] Pow_1513 [Pow] outputs: [2389 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: ReduceMean_1514 [ReduceMean] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2389 [01/12/2022-09:32:44] [V] [TRT] ReduceMean_1514 [ReduceMean] inputs: [2389 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: ReduceMean_1514 for ONNX node: ReduceMean_1514 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2390 for ONNX tensor: 2390 [01/12/2022-09:32:44] [V] [TRT] ReduceMean_1514 [ReduceMean] outputs: [2390 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Constant_1515 [Constant] [01/12/2022-09:32:44] [V] [TRT] Constant_1515 [Constant] inputs: [01/12/2022-09:32:44] [V] [TRT] Constant_1515 [Constant] outputs: [2391 -> ()[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Add_1516 [Add] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2390 [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2391 [01/12/2022-09:32:44] [V] [TRT] Add_1516 [Add] inputs: [2390 -> (-1, -1, 1)[FLOAT]], [2391 -> ()[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: 2391 for ONNX node: 2391 [01/12/2022-09:32:44] [V] [TRT] Registering layer: Add_1516 for ONNX node: Add_1516 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2392 for ONNX tensor: 2392 [01/12/2022-09:32:44] [V] [TRT] Add_1516 [Add] outputs: [2392 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Sqrt_1517 [Sqrt] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2392 [01/12/2022-09:32:44] [V] [TRT] Sqrt_1517 [Sqrt] inputs: [2392 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: Sqrt_1517 for ONNX node: Sqrt_1517 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2393 for ONNX tensor: 2393 [01/12/2022-09:32:44] [V] [TRT] Sqrt_1517 [Sqrt] outputs: [2393 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Div_1518 [Div] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2387 [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2393 [01/12/2022-09:32:44] [V] [TRT] Div_1518 [Div] inputs: [2387 -> (-1, -1, 768)[FLOAT]], [2393 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: Div_1518 for ONNX node: Div_1518 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2394 for ONNX tensor: 2394 [01/12/2022-09:32:44] [V] [TRT] Div_1518 [Div] outputs: [2394 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Mul_1519 [Mul] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2394 [01/12/2022-09:32:44] [V] [TRT] Searching for input: decoder.layers.4.self_attn_layer_norm.weight [01/12/2022-09:32:44] [V] [TRT] Mul_1519 [Mul] inputs: [2394 -> (-1, -1, 768)[FLOAT]], [decoder.layers.4.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: decoder.layers.4.self_attn_layer_norm.weight for ONNX node: decoder.layers.4.self_attn_layer_norm.weight [01/12/2022-09:32:44] [V] [TRT] Registering layer: Mul_1519 for ONNX node: Mul_1519 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2395 for ONNX tensor: 2395 [01/12/2022-09:32:44] [V] [TRT] Mul_1519 [Mul] outputs: [2395 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Add_1520 [Add] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2395 [01/12/2022-09:32:44] [V] [TRT] Searching for input: decoder.layers.4.self_attn_layer_norm.bias [01/12/2022-09:32:44] [V] [TRT] Add_1520 [Add] inputs: [2395 -> (-1, -1, 768)[FLOAT]], [decoder.layers.4.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: decoder.layers.4.self_attn_layer_norm.bias for ONNX node: decoder.layers.4.self_attn_layer_norm.bias [01/12/2022-09:32:44] [V] [TRT] Registering layer: Add_1520 for ONNX node: Add_1520 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2396 for ONNX tensor: 2396 [01/12/2022-09:32:44] [V] [TRT] Add_1520 [Add] outputs: [2396 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Shape_1521 [Shape] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2396 [01/12/2022-09:32:44] [V] [TRT] Shape_1521 [Shape] inputs: [2396 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: Shape_1521 for ONNX node: Shape_1521 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2397 for ONNX tensor: 2397 [01/12/2022-09:32:44] [V] [TRT] Shape_1521 [Shape] outputs: [2397 -> (3)[INT32]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Constant_1522 [Constant] [01/12/2022-09:32:44] [V] [TRT] Constant_1522 [Constant] inputs: [01/12/2022-09:32:44] [V] [TRT] Constant_1522 [Constant] outputs: [2398 -> ()[INT32]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Gather_1523 [Gather] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2397 [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2398 [01/12/2022-09:32:44] [V] [TRT] Gather_1523 [Gather] inputs: [2397 -> (3)[INT32]], [2398 -> ()[INT32]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: 2398 for ONNX node: 2398 [01/12/2022-09:32:44] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:44] [V] [TRT] Registering layer: Gather_1523 for ONNX node: Gather_1523 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2399 for ONNX tensor: 2399 [01/12/2022-09:32:44] [V] [TRT] Gather_1523 [Gather] outputs: [2399 -> ()[INT32]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Shape_1524 [Shape] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2396 [01/12/2022-09:32:44] [V] [TRT] Shape_1524 [Shape] inputs: [2396 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: Shape_1524 for ONNX node: Shape_1524 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2400 for ONNX tensor: 2400 [01/12/2022-09:32:44] [V] [TRT] Shape_1524 [Shape] outputs: [2400 -> (3)[INT32]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Constant_1525 [Constant] [01/12/2022-09:32:44] [V] [TRT] Constant_1525 [Constant] inputs: [01/12/2022-09:32:44] [V] [TRT] Constant_1525 [Constant] outputs: [2401 -> ()[INT32]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Gather_1526 [Gather] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2400 [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2401 [01/12/2022-09:32:44] [V] [TRT] Gather_1526 [Gather] inputs: [2400 -> (3)[INT32]], [2401 -> ()[INT32]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: 2401 for ONNX node: 2401 [01/12/2022-09:32:44] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:44] [V] [TRT] Registering layer: Gather_1526 for ONNX node: Gather_1526 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2402 for ONNX tensor: 2402 [01/12/2022-09:32:44] [V] [TRT] Gather_1526 [Gather] outputs: [2402 -> ()[INT32]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: MatMul_1527 [MatMul] [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2396 [01/12/2022-09:32:44] [V] [TRT] Searching for input: 3124 [01/12/2022-09:32:44] [V] [TRT] MatMul_1527 [MatMul] inputs: [2396 -> (-1, -1, 768)[FLOAT]], [3124 -> (768, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: 3124 for ONNX node: 3124 [01/12/2022-09:32:44] [V] [TRT] Registering layer: MatMul_1527 for ONNX node: MatMul_1527 [01/12/2022-09:32:44] [V] [TRT] Registering tensor: 2404 for ONNX tensor: 2404 [01/12/2022-09:32:44] [V] [TRT] MatMul_1527 [MatMul] outputs: [2404 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Parsing node: Add_1528 [Add] [01/12/2022-09:32:44] [V] [TRT] Searching for input: decoder.layers.4.encoder_attn.q_proj.bias [01/12/2022-09:32:44] [V] [TRT] Searching for input: 2404 [01/12/2022-09:32:44] [V] [TRT] Add_1528 [Add] inputs: [decoder.layers.4.encoder_attn.q_proj.bias -> (768)[FLOAT]], [2404 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:44] [V] [TRT] Registering layer: decoder.layers.4.encoder_attn.q_proj.bias for ONNX node: decoder.layers.4.encoder_attn.q_proj.bias [01/12/2022-09:32:45] [V] [TRT] Registering layer: Add_1528 for ONNX node: Add_1528 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2405 for ONNX tensor: 2405 [01/12/2022-09:32:45] [V] [TRT] Add_1528 [Add] outputs: [2405 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Constant_1529 [Constant] [01/12/2022-09:32:45] [V] [TRT] Constant_1529 [Constant] inputs: [01/12/2022-09:32:45] [V] [TRT] Constant_1529 [Constant] outputs: [2406 -> ()[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Mul_1530 [Mul] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2405 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2406 [01/12/2022-09:32:45] [V] [TRT] Mul_1530 [Mul] inputs: [2405 -> (-1, -1, 768)[FLOAT]], [2406 -> ()[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: 2406 for ONNX node: 2406 [01/12/2022-09:32:45] [V] [TRT] Registering layer: Mul_1530 for ONNX node: Mul_1530 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2407 for ONNX tensor: 2407 [01/12/2022-09:32:45] [V] [TRT] Mul_1530 [Mul] outputs: [2407 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: MatMul_1531 [MatMul] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3125 [01/12/2022-09:32:45] [V] [TRT] MatMul_1531 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3125 -> (768, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3125 for ONNX node: 3125 [01/12/2022-09:32:45] [V] [TRT] Registering layer: MatMul_1531 for ONNX node: MatMul_1531 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2409 for ONNX tensor: 2409 [01/12/2022-09:32:45] [V] [TRT] MatMul_1531 [MatMul] outputs: [2409 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Add_1532 [Add] [01/12/2022-09:32:45] [V] [TRT] Searching for input: decoder.layers.4.encoder_attn.k_proj.bias [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2409 [01/12/2022-09:32:45] [V] [TRT] Add_1532 [Add] inputs: [decoder.layers.4.encoder_attn.k_proj.bias -> (768)[FLOAT]], [2409 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: decoder.layers.4.encoder_attn.k_proj.bias for ONNX node: decoder.layers.4.encoder_attn.k_proj.bias [01/12/2022-09:32:45] [V] [TRT] Registering layer: Add_1532 for ONNX node: Add_1532 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2410 for ONNX tensor: 2410 [01/12/2022-09:32:45] [V] [TRT] Add_1532 [Add] outputs: [2410 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Unsqueeze_1533 [Unsqueeze] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2399 [01/12/2022-09:32:45] [V] [TRT] Unsqueeze_1533 [Unsqueeze] inputs: [2399 -> ()[INT32]], [01/12/2022-09:32:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:45] [V] [TRT] Registering layer: Unsqueeze_1533 for ONNX node: Unsqueeze_1533 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2414 for ONNX tensor: 2414 [01/12/2022-09:32:45] [V] [TRT] Unsqueeze_1533 [Unsqueeze] outputs: [2414 -> (1)[INT32]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Concat_1534 [Concat] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2414 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3126 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3127 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3128 [01/12/2022-09:32:45] [V] [TRT] Concat_1534 [Concat] inputs: [2414 -> (1)[INT32]], [3126 -> (1)[INT32]], [3127 -> (1)[INT32]], [3128 -> (1)[INT32]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3126 for ONNX node: 3126 [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3127 for ONNX node: 3127 [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3128 for ONNX node: 3128 [01/12/2022-09:32:45] [V] [TRT] Registering layer: Concat_1534 for ONNX node: Concat_1534 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2418 for ONNX tensor: 2418 [01/12/2022-09:32:45] [V] [TRT] Concat_1534 [Concat] outputs: [2418 -> (4)[INT32]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Reshape_1535 [Reshape] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2410 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2418 [01/12/2022-09:32:45] [V] [TRT] Reshape_1535 [Reshape] inputs: [2410 -> (-1, -1, 768)[FLOAT]], [2418 -> (4)[INT32]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: Reshape_1535 for ONNX node: Reshape_1535 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2419 for ONNX tensor: 2419 [01/12/2022-09:32:45] [V] [TRT] Reshape_1535 [Reshape] outputs: [2419 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Transpose_1536 [Transpose] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2419 [01/12/2022-09:32:45] [V] [TRT] Transpose_1536 [Transpose] inputs: [2419 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: Transpose_1536 for ONNX node: Transpose_1536 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2420_20 for ONNX tensor: 2420 [01/12/2022-09:32:45] [V] [TRT] Transpose_1536 [Transpose] outputs: [2420 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: MatMul_1537 [MatMul] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3129 [01/12/2022-09:32:45] [V] [TRT] MatMul_1537 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3129 -> (768, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3129 for ONNX node: 3129 [01/12/2022-09:32:45] [V] [TRT] Registering layer: MatMul_1537 for ONNX node: MatMul_1537 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2422 for ONNX tensor: 2422 [01/12/2022-09:32:45] [V] [TRT] MatMul_1537 [MatMul] outputs: [2422 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Add_1538 [Add] [01/12/2022-09:32:45] [V] [TRT] Searching for input: decoder.layers.4.encoder_attn.v_proj.bias [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2422 [01/12/2022-09:32:45] [V] [TRT] Add_1538 [Add] inputs: [decoder.layers.4.encoder_attn.v_proj.bias -> (768)[FLOAT]], [2422 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: decoder.layers.4.encoder_attn.v_proj.bias for ONNX node: decoder.layers.4.encoder_attn.v_proj.bias [01/12/2022-09:32:45] [V] [TRT] Registering layer: Add_1538 for ONNX node: Add_1538 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2423 for ONNX tensor: 2423 [01/12/2022-09:32:45] [V] [TRT] Add_1538 [Add] outputs: [2423 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Unsqueeze_1539 [Unsqueeze] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2399 [01/12/2022-09:32:45] [V] [TRT] Unsqueeze_1539 [Unsqueeze] inputs: [2399 -> ()[INT32]], [01/12/2022-09:32:45] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:45] [V] [TRT] Registering layer: Unsqueeze_1539 for ONNX node: Unsqueeze_1539 [01/12/2022-09:32:45] [V] [TRT] Registering tensor: 2427 for ONNX tensor: 2427 [01/12/2022-09:32:45] [V] [TRT] Unsqueeze_1539 [Unsqueeze] outputs: [2427 -> (1)[INT32]], [01/12/2022-09:32:45] [V] [TRT] Parsing node: Concat_1540 [Concat] [01/12/2022-09:32:45] [V] [TRT] Searching for input: 2427 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3130 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3131 [01/12/2022-09:32:45] [V] [TRT] Searching for input: 3132 [01/12/2022-09:32:45] [V] [TRT] Concat_1540 [Concat] inputs: [2427 -> (1)[INT32]], [3130 -> (1)[INT32]], [3131 -> (1)[INT32]], [3132 -> (1)[INT32]], [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3130 for ONNX node: 3130 [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3131 for ONNX node: 3131 [01/12/2022-09:32:45] [V] [TRT] Registering layer: 3132 for ONNX node: 3132 [01/12/2022-09:32:45] [V] [TRT] Registering layer: Concat_1540 for ONNX node: Concat_1540 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2431 for ONNX tensor: 2431 [01/12/2022-09:32:46] [V] [TRT] Concat_1540 [Concat] outputs: [2431 -> (4)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Reshape_1541 [Reshape] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2423 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2431 [01/12/2022-09:32:46] [V] [TRT] Reshape_1541 [Reshape] inputs: [2423 -> (-1, -1, 768)[FLOAT]], [2431 -> (4)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Reshape_1541 for ONNX node: Reshape_1541 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2432 for ONNX tensor: 2432 [01/12/2022-09:32:46] [V] [TRT] Reshape_1541 [Reshape] outputs: [2432 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Transpose_1542 [Transpose] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2432 [01/12/2022-09:32:46] [V] [TRT] Transpose_1542 [Transpose] inputs: [2432 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Transpose_1542 for ONNX node: Transpose_1542 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2433_21 for ONNX tensor: 2433 [01/12/2022-09:32:46] [V] [TRT] Transpose_1542 [Transpose] outputs: [2433 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Constant_1543 [Constant] [01/12/2022-09:32:46] [V] [TRT] Constant_1543 [Constant] inputs: [01/12/2022-09:32:46] [V] [TRT] Constant_1543 [Constant] outputs: [2434 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Mul_1544 [Mul] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2399 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2434 [01/12/2022-09:32:46] [V] [TRT] Mul_1544 [Mul] inputs: [2399 -> ()[INT32]], [2434 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: 2434 for ONNX node: 2434 [01/12/2022-09:32:46] [V] [TRT] Registering layer: Mul_1544 for ONNX node: Mul_1544 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2435 for ONNX tensor: 2435 [01/12/2022-09:32:46] [V] [TRT] Mul_1544 [Mul] outputs: [2435 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Unsqueeze_1545 [Unsqueeze] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2399 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1545 [Unsqueeze] inputs: [2399 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:46] [V] [TRT] Registering layer: Unsqueeze_1545 for ONNX node: Unsqueeze_1545 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2438 for ONNX tensor: 2438 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1545 [Unsqueeze] outputs: [2438 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Unsqueeze_1546 [Unsqueeze] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2402 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1546 [Unsqueeze] inputs: [2402 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:46] [V] [TRT] Registering layer: Unsqueeze_1546 for ONNX node: Unsqueeze_1546 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2439 for ONNX tensor: 2439 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1546 [Unsqueeze] outputs: [2439 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Concat_1547 [Concat] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2438 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2439 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3133 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3134 [01/12/2022-09:32:46] [V] [TRT] Concat_1547 [Concat] inputs: [2438 -> (1)[INT32]], [2439 -> (1)[INT32]], [3133 -> (1)[INT32]], [3134 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3133 for ONNX node: 3133 [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3134 for ONNX node: 3134 [01/12/2022-09:32:46] [V] [TRT] Registering layer: Concat_1547 for ONNX node: Concat_1547 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2442 for ONNX tensor: 2442 [01/12/2022-09:32:46] [V] [TRT] Concat_1547 [Concat] outputs: [2442 -> (4)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Reshape_1548 [Reshape] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2407 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2442 [01/12/2022-09:32:46] [V] [TRT] Reshape_1548 [Reshape] inputs: [2407 -> (-1, -1, 768)[FLOAT]], [2442 -> (4)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Reshape_1548 for ONNX node: Reshape_1548 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2443 for ONNX tensor: 2443 [01/12/2022-09:32:46] [V] [TRT] Reshape_1548 [Reshape] outputs: [2443 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Transpose_1549 [Transpose] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2443 [01/12/2022-09:32:46] [V] [TRT] Transpose_1549 [Transpose] inputs: [2443 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Transpose_1549 for ONNX node: Transpose_1549 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2444 for ONNX tensor: 2444 [01/12/2022-09:32:46] [V] [TRT] Transpose_1549 [Transpose] outputs: [2444 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Unsqueeze_1550 [Unsqueeze] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2435 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1550 [Unsqueeze] inputs: [2435 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:46] [V] [TRT] Registering layer: Unsqueeze_1550 for ONNX node: Unsqueeze_1550 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2447 for ONNX tensor: 2447 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1550 [Unsqueeze] outputs: [2447 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Concat_1551 [Concat] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2447 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3135 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3136 [01/12/2022-09:32:46] [V] [TRT] Concat_1551 [Concat] inputs: [2447 -> (1)[INT32]], [3135 -> (1)[INT32]], [3136 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3135 for ONNX node: 3135 [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3136 for ONNX node: 3136 [01/12/2022-09:32:46] [V] [TRT] Registering layer: Concat_1551 for ONNX node: Concat_1551 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2450 for ONNX tensor: 2450 [01/12/2022-09:32:46] [V] [TRT] Concat_1551 [Concat] outputs: [2450 -> (3)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Reshape_1552 [Reshape] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2444 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2450 [01/12/2022-09:32:46] [V] [TRT] Reshape_1552 [Reshape] inputs: [2444 -> (-1, 12, -1, 64)[FLOAT]], [2450 -> (3)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Reshape_1552 for ONNX node: Reshape_1552 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2451 for ONNX tensor: 2451 [01/12/2022-09:32:46] [V] [TRT] Reshape_1552 [Reshape] outputs: [2451 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Unsqueeze_1553 [Unsqueeze] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2435 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1553 [Unsqueeze] inputs: [2435 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:46] [V] [TRT] Registering layer: Unsqueeze_1553 for ONNX node: Unsqueeze_1553 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2454 for ONNX tensor: 2454 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1553 [Unsqueeze] outputs: [2454 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Concat_1554 [Concat] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2454 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3137 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3138 [01/12/2022-09:32:46] [V] [TRT] Concat_1554 [Concat] inputs: [2454 -> (1)[INT32]], [3137 -> (1)[INT32]], [3138 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3137 for ONNX node: 3137 [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3138 for ONNX node: 3138 [01/12/2022-09:32:46] [V] [TRT] Registering layer: Concat_1554 for ONNX node: Concat_1554 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2457 for ONNX tensor: 2457 [01/12/2022-09:32:46] [V] [TRT] Concat_1554 [Concat] outputs: [2457 -> (3)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Reshape_1555 [Reshape] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2420 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2457 [01/12/2022-09:32:46] [V] [TRT] Reshape_1555 [Reshape] inputs: [2420 -> (-1, 12, -1, 64)[FLOAT]], [2457 -> (3)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Reshape_1555 for ONNX node: Reshape_1555 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2458 for ONNX tensor: 2458 [01/12/2022-09:32:46] [V] [TRT] Reshape_1555 [Reshape] outputs: [2458 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Unsqueeze_1556 [Unsqueeze] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2435 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1556 [Unsqueeze] inputs: [2435 -> ()[INT32]], [01/12/2022-09:32:46] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:46] [V] [TRT] Registering layer: Unsqueeze_1556 for ONNX node: Unsqueeze_1556 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2461 for ONNX tensor: 2461 [01/12/2022-09:32:46] [V] [TRT] Unsqueeze_1556 [Unsqueeze] outputs: [2461 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Concat_1557 [Concat] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2461 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3139 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 3140 [01/12/2022-09:32:46] [V] [TRT] Concat_1557 [Concat] inputs: [2461 -> (1)[INT32]], [3139 -> (1)[INT32]], [3140 -> (1)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3139 for ONNX node: 3139 [01/12/2022-09:32:46] [V] [TRT] Registering layer: 3140 for ONNX node: 3140 [01/12/2022-09:32:46] [V] [TRT] Registering layer: Concat_1557 for ONNX node: Concat_1557 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2464 for ONNX tensor: 2464 [01/12/2022-09:32:46] [V] [TRT] Concat_1557 [Concat] outputs: [2464 -> (3)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Reshape_1558 [Reshape] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2433 [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2464 [01/12/2022-09:32:46] [V] [TRT] Reshape_1558 [Reshape] inputs: [2433 -> (-1, 12, -1, 64)[FLOAT]], [2464 -> (3)[INT32]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Reshape_1558 for ONNX node: Reshape_1558 [01/12/2022-09:32:46] [V] [TRT] Registering tensor: 2465 for ONNX tensor: 2465 [01/12/2022-09:32:46] [V] [TRT] Reshape_1558 [Reshape] outputs: [2465 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Parsing node: Transpose_1559 [Transpose] [01/12/2022-09:32:46] [V] [TRT] Searching for input: 2458 [01/12/2022-09:32:46] [V] [TRT] Transpose_1559 [Transpose] inputs: [2458 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:46] [V] [TRT] Registering layer: Transpose_1559 for ONNX node: Transpose_1559 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2466 for ONNX tensor: 2466 [01/12/2022-09:32:47] [V] [TRT] Transpose_1559 [Transpose] outputs: [2466 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: MatMul_1560 [MatMul] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2451 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2466 [01/12/2022-09:32:47] [V] [TRT] MatMul_1560 [MatMul] inputs: [2451 -> (-1, -1, 64)[FLOAT]], [2466 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: MatMul_1560 for ONNX node: MatMul_1560 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2467 for ONNX tensor: 2467 [01/12/2022-09:32:47] [V] [TRT] MatMul_1560 [MatMul] outputs: [2467 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Softmax_1561 [Softmax] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2467 [01/12/2022-09:32:47] [V] [TRT] Softmax_1561 [Softmax] inputs: [2467 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: Softmax_1561 for ONNX node: Softmax_1561 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2468 for ONNX tensor: 2468 [01/12/2022-09:32:47] [V] [TRT] Softmax_1561 [Softmax] outputs: [2468 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: MatMul_1562 [MatMul] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2468 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2465 [01/12/2022-09:32:47] [V] [TRT] MatMul_1562 [MatMul] inputs: [2468 -> (-1, -1, -1)[FLOAT]], [2465 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: MatMul_1562 for ONNX node: MatMul_1562 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2469 for ONNX tensor: 2469 [01/12/2022-09:32:47] [V] [TRT] MatMul_1562 [MatMul] outputs: [2469 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Unsqueeze_1563 [Unsqueeze] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2399 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1563 [Unsqueeze] inputs: [2399 -> ()[INT32]], [01/12/2022-09:32:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:47] [V] [TRT] Registering layer: Unsqueeze_1563 for ONNX node: Unsqueeze_1563 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2472 for ONNX tensor: 2472 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1563 [Unsqueeze] outputs: [2472 -> (1)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Unsqueeze_1564 [Unsqueeze] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2402 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1564 [Unsqueeze] inputs: [2402 -> ()[INT32]], [01/12/2022-09:32:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:47] [V] [TRT] Registering layer: Unsqueeze_1564 for ONNX node: Unsqueeze_1564 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2474 for ONNX tensor: 2474 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1564 [Unsqueeze] outputs: [2474 -> (1)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Concat_1565 [Concat] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2472 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 3141 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2474 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 3142 [01/12/2022-09:32:47] [V] [TRT] Concat_1565 [Concat] inputs: [2472 -> (1)[INT32]], [3141 -> (1)[INT32]], [2474 -> (1)[INT32]], [3142 -> (1)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: 3141 for ONNX node: 3141 [01/12/2022-09:32:47] [V] [TRT] Registering layer: 3142 for ONNX node: 3142 [01/12/2022-09:32:47] [V] [TRT] Registering layer: Concat_1565 for ONNX node: Concat_1565 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2476 for ONNX tensor: 2476 [01/12/2022-09:32:47] [V] [TRT] Concat_1565 [Concat] outputs: [2476 -> (4)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Reshape_1566 [Reshape] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2469 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2476 [01/12/2022-09:32:47] [V] [TRT] Reshape_1566 [Reshape] inputs: [2469 -> (-1, -1, 64)[FLOAT]], [2476 -> (4)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: Reshape_1566 for ONNX node: Reshape_1566 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2477 for ONNX tensor: 2477 [01/12/2022-09:32:47] [V] [TRT] Reshape_1566 [Reshape] outputs: [2477 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Transpose_1567 [Transpose] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2477 [01/12/2022-09:32:47] [V] [TRT] Transpose_1567 [Transpose] inputs: [2477 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: Transpose_1567 for ONNX node: Transpose_1567 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2478 for ONNX tensor: 2478 [01/12/2022-09:32:47] [V] [TRT] Transpose_1567 [Transpose] outputs: [2478 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Unsqueeze_1568 [Unsqueeze] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2399 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1568 [Unsqueeze] inputs: [2399 -> ()[INT32]], [01/12/2022-09:32:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:47] [V] [TRT] Registering layer: Unsqueeze_1568 for ONNX node: Unsqueeze_1568 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2480 for ONNX tensor: 2480 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1568 [Unsqueeze] outputs: [2480 -> (1)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Unsqueeze_1569 [Unsqueeze] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2402 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1569 [Unsqueeze] inputs: [2402 -> ()[INT32]], [01/12/2022-09:32:47] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:47] [V] [TRT] Registering layer: Unsqueeze_1569 for ONNX node: Unsqueeze_1569 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2481 for ONNX tensor: 2481 [01/12/2022-09:32:47] [V] [TRT] Unsqueeze_1569 [Unsqueeze] outputs: [2481 -> (1)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Concat_1570 [Concat] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2480 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2481 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 3143 [01/12/2022-09:32:47] [V] [TRT] Concat_1570 [Concat] inputs: [2480 -> (1)[INT32]], [2481 -> (1)[INT32]], [3143 -> (1)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: 3143 for ONNX node: 3143 [01/12/2022-09:32:47] [V] [TRT] Registering layer: Concat_1570 for ONNX node: Concat_1570 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2483 for ONNX tensor: 2483 [01/12/2022-09:32:47] [V] [TRT] Concat_1570 [Concat] outputs: [2483 -> (3)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: Reshape_1571 [Reshape] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2478 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2483 [01/12/2022-09:32:47] [V] [TRT] Reshape_1571 [Reshape] inputs: [2478 -> (-1, -1, 12, 64)[FLOAT]], [2483 -> (3)[INT32]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: Reshape_1571 for ONNX node: Reshape_1571 [01/12/2022-09:32:47] [V] [TRT] Registering tensor: 2484 for ONNX tensor: 2484 [01/12/2022-09:32:47] [V] [TRT] Reshape_1571 [Reshape] outputs: [2484 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Parsing node: MatMul_1572 [MatMul] [01/12/2022-09:32:47] [V] [TRT] Searching for input: 2484 [01/12/2022-09:32:47] [V] [TRT] Searching for input: 3144 [01/12/2022-09:32:47] [V] [TRT] MatMul_1572 [MatMul] inputs: [2484 -> (-1, -1, 768)[FLOAT]], [3144 -> (768, 768)[FLOAT]], [01/12/2022-09:32:47] [V] [TRT] Registering layer: 3144 for ONNX node: 3144 [01/12/2022-09:32:48] [V] [TRT] Registering layer: MatMul_1572 for ONNX node: MatMul_1572 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2486 for ONNX tensor: 2486 [01/12/2022-09:32:48] [V] [TRT] MatMul_1572 [MatMul] outputs: [2486 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Add_1573 [Add] [01/12/2022-09:32:48] [V] [TRT] Searching for input: decoder.layers.4.encoder_attn.out_proj.bias [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2486 [01/12/2022-09:32:48] [V] [TRT] Add_1573 [Add] inputs: [decoder.layers.4.encoder_attn.out_proj.bias -> (768)[FLOAT]], [2486 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: decoder.layers.4.encoder_attn.out_proj.bias for ONNX node: decoder.layers.4.encoder_attn.out_proj.bias [01/12/2022-09:32:48] [V] [TRT] Registering layer: Add_1573 for ONNX node: Add_1573 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2487 for ONNX tensor: 2487 [01/12/2022-09:32:48] [V] [TRT] Add_1573 [Add] outputs: [2487 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Add_1574 [Add] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2396 [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2487 [01/12/2022-09:32:48] [V] [TRT] Add_1574 [Add] inputs: [2396 -> (-1, -1, 768)[FLOAT]], [2487 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: Add_1574 for ONNX node: Add_1574 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2488 for ONNX tensor: 2488 [01/12/2022-09:32:48] [V] [TRT] Add_1574 [Add] outputs: [2488 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: ReduceMean_1575 [ReduceMean] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2488 [01/12/2022-09:32:48] [V] [TRT] ReduceMean_1575 [ReduceMean] inputs: [2488 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: ReduceMean_1575 for ONNX node: ReduceMean_1575 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2489 for ONNX tensor: 2489 [01/12/2022-09:32:48] [V] [TRT] ReduceMean_1575 [ReduceMean] outputs: [2489 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Sub_1576 [Sub] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2488 [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2489 [01/12/2022-09:32:48] [V] [TRT] Sub_1576 [Sub] inputs: [2488 -> (-1, -1, 768)[FLOAT]], [2489 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: Sub_1576 for ONNX node: Sub_1576 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2490 for ONNX tensor: 2490 [01/12/2022-09:32:48] [V] [TRT] Sub_1576 [Sub] outputs: [2490 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Constant_1577 [Constant] [01/12/2022-09:32:48] [V] [TRT] Constant_1577 [Constant] inputs: [01/12/2022-09:32:48] [V] [TRT] Constant_1577 [Constant] outputs: [2491 -> ()[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Pow_1578 [Pow] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2490 [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2491 [01/12/2022-09:32:48] [V] [TRT] Pow_1578 [Pow] inputs: [2490 -> (-1, -1, 768)[FLOAT]], [2491 -> ()[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: 2491 for ONNX node: 2491 [01/12/2022-09:32:48] [V] [TRT] Registering layer: Pow_1578 for ONNX node: Pow_1578 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2492 for ONNX tensor: 2492 [01/12/2022-09:32:48] [V] [TRT] Pow_1578 [Pow] outputs: [2492 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: ReduceMean_1579 [ReduceMean] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2492 [01/12/2022-09:32:48] [V] [TRT] ReduceMean_1579 [ReduceMean] inputs: [2492 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: ReduceMean_1579 for ONNX node: ReduceMean_1579 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2493 for ONNX tensor: 2493 [01/12/2022-09:32:48] [V] [TRT] ReduceMean_1579 [ReduceMean] outputs: [2493 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Constant_1580 [Constant] [01/12/2022-09:32:48] [V] [TRT] Constant_1580 [Constant] inputs: [01/12/2022-09:32:48] [V] [TRT] Constant_1580 [Constant] outputs: [2494 -> ()[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Add_1581 [Add] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2493 [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2494 [01/12/2022-09:32:48] [V] [TRT] Add_1581 [Add] inputs: [2493 -> (-1, -1, 1)[FLOAT]], [2494 -> ()[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: 2494 for ONNX node: 2494 [01/12/2022-09:32:48] [V] [TRT] Registering layer: Add_1581 for ONNX node: Add_1581 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2495 for ONNX tensor: 2495 [01/12/2022-09:32:48] [V] [TRT] Add_1581 [Add] outputs: [2495 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Sqrt_1582 [Sqrt] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2495 [01/12/2022-09:32:48] [V] [TRT] Sqrt_1582 [Sqrt] inputs: [2495 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: Sqrt_1582 for ONNX node: Sqrt_1582 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2496 for ONNX tensor: 2496 [01/12/2022-09:32:48] [V] [TRT] Sqrt_1582 [Sqrt] outputs: [2496 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Div_1583 [Div] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2490 [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2496 [01/12/2022-09:32:48] [V] [TRT] Div_1583 [Div] inputs: [2490 -> (-1, -1, 768)[FLOAT]], [2496 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: Div_1583 for ONNX node: Div_1583 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2497 for ONNX tensor: 2497 [01/12/2022-09:32:48] [V] [TRT] Div_1583 [Div] outputs: [2497 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Mul_1584 [Mul] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2497 [01/12/2022-09:32:48] [V] [TRT] Searching for input: decoder.layers.4.encoder_attn_layer_norm.weight [01/12/2022-09:32:48] [V] [TRT] Mul_1584 [Mul] inputs: [2497 -> (-1, -1, 768)[FLOAT]], [decoder.layers.4.encoder_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: decoder.layers.4.encoder_attn_layer_norm.weight for ONNX node: decoder.layers.4.encoder_attn_layer_norm.weight [01/12/2022-09:32:48] [V] [TRT] Registering layer: Mul_1584 for ONNX node: Mul_1584 [01/12/2022-09:32:48] [V] [TRT] Registering tensor: 2498 for ONNX tensor: 2498 [01/12/2022-09:32:48] [V] [TRT] Mul_1584 [Mul] outputs: [2498 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Parsing node: Add_1585 [Add] [01/12/2022-09:32:48] [V] [TRT] Searching for input: 2498 [01/12/2022-09:32:48] [V] [TRT] Searching for input: decoder.layers.4.encoder_attn_layer_norm.bias [01/12/2022-09:32:48] [V] [TRT] Add_1585 [Add] inputs: [2498 -> (-1, -1, 768)[FLOAT]], [decoder.layers.4.encoder_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:48] [V] [TRT] Registering layer: decoder.layers.4.encoder_attn_layer_norm.bias for ONNX node: decoder.layers.4.encoder_attn_layer_norm.bias [01/12/2022-09:32:48] [V] [TRT] Registering layer: Add_1585 for ONNX node: Add_1585 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2499 for ONNX tensor: 2499 [01/12/2022-09:32:49] [V] [TRT] Add_1585 [Add] outputs: [2499 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: MatMul_1586 [MatMul] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2499 [01/12/2022-09:32:49] [V] [TRT] Searching for input: 3145 [01/12/2022-09:32:49] [V] [TRT] MatMul_1586 [MatMul] inputs: [2499 -> (-1, -1, 768)[FLOAT]], [3145 -> (768, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: 3145 for ONNX node: 3145 [01/12/2022-09:32:49] [V] [TRT] Registering layer: MatMul_1586 for ONNX node: MatMul_1586 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2501 for ONNX tensor: 2501 [01/12/2022-09:32:49] [V] [TRT] MatMul_1586 [MatMul] outputs: [2501 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Add_1587 [Add] [01/12/2022-09:32:49] [V] [TRT] Searching for input: decoder.layers.4.fc1.bias [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2501 [01/12/2022-09:32:49] [V] [TRT] Add_1587 [Add] inputs: [decoder.layers.4.fc1.bias -> (3072)[FLOAT]], [2501 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: decoder.layers.4.fc1.bias for ONNX node: decoder.layers.4.fc1.bias [01/12/2022-09:32:49] [V] [TRT] Registering layer: Add_1587 for ONNX node: Add_1587 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2502 for ONNX tensor: 2502 [01/12/2022-09:32:49] [V] [TRT] Add_1587 [Add] outputs: [2502 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Constant_1588 [Constant] [01/12/2022-09:32:49] [V] [TRT] Constant_1588 [Constant] inputs: [01/12/2022-09:32:49] [V] [TRT] Constant_1588 [Constant] outputs: [2503 -> ()[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Div_1589 [Div] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2502 [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2503 [01/12/2022-09:32:49] [V] [TRT] Div_1589 [Div] inputs: [2502 -> (-1, -1, 3072)[FLOAT]], [2503 -> ()[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: 2503 for ONNX node: 2503 [01/12/2022-09:32:49] [V] [TRT] Registering layer: Div_1589 for ONNX node: Div_1589 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2504 for ONNX tensor: 2504 [01/12/2022-09:32:49] [V] [TRT] Div_1589 [Div] outputs: [2504 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Erf_1590 [Erf] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2504 [01/12/2022-09:32:49] [V] [TRT] Erf_1590 [Erf] inputs: [2504 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: Erf_1590 for ONNX node: Erf_1590 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2505 for ONNX tensor: 2505 [01/12/2022-09:32:49] [V] [TRT] Erf_1590 [Erf] outputs: [2505 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Constant_1591 [Constant] [01/12/2022-09:32:49] [V] [TRT] Constant_1591 [Constant] inputs: [01/12/2022-09:32:49] [V] [TRT] Constant_1591 [Constant] outputs: [2506 -> ()[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Add_1592 [Add] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2505 [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2506 [01/12/2022-09:32:49] [V] [TRT] Add_1592 [Add] inputs: [2505 -> (-1, -1, 3072)[FLOAT]], [2506 -> ()[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: 2506 for ONNX node: 2506 [01/12/2022-09:32:49] [V] [TRT] Registering layer: Add_1592 for ONNX node: Add_1592 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2507 for ONNX tensor: 2507 [01/12/2022-09:32:49] [V] [TRT] Add_1592 [Add] outputs: [2507 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Mul_1593 [Mul] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2502 [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2507 [01/12/2022-09:32:49] [V] [TRT] Mul_1593 [Mul] inputs: [2502 -> (-1, -1, 3072)[FLOAT]], [2507 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: Mul_1593 for ONNX node: Mul_1593 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2508 for ONNX tensor: 2508 [01/12/2022-09:32:49] [V] [TRT] Mul_1593 [Mul] outputs: [2508 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Constant_1594 [Constant] [01/12/2022-09:32:49] [V] [TRT] Constant_1594 [Constant] inputs: [01/12/2022-09:32:49] [V] [TRT] Constant_1594 [Constant] outputs: [2509 -> ()[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Mul_1595 [Mul] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2508 [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2509 [01/12/2022-09:32:49] [V] [TRT] Mul_1595 [Mul] inputs: [2508 -> (-1, -1, 3072)[FLOAT]], [2509 -> ()[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: 2509 for ONNX node: 2509 [01/12/2022-09:32:49] [V] [TRT] Registering layer: Mul_1595 for ONNX node: Mul_1595 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2510 for ONNX tensor: 2510 [01/12/2022-09:32:49] [V] [TRT] Mul_1595 [Mul] outputs: [2510 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: MatMul_1596 [MatMul] [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2510 [01/12/2022-09:32:49] [V] [TRT] Searching for input: 3146 [01/12/2022-09:32:49] [V] [TRT] MatMul_1596 [MatMul] inputs: [2510 -> (-1, -1, 3072)[FLOAT]], [3146 -> (3072, 768)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: 3146 for ONNX node: 3146 [01/12/2022-09:32:49] [V] [TRT] Registering layer: MatMul_1596 for ONNX node: MatMul_1596 [01/12/2022-09:32:49] [V] [TRT] Registering tensor: 2512 for ONNX tensor: 2512 [01/12/2022-09:32:49] [V] [TRT] MatMul_1596 [MatMul] outputs: [2512 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Parsing node: Add_1597 [Add] [01/12/2022-09:32:49] [V] [TRT] Searching for input: decoder.layers.4.fc2.bias [01/12/2022-09:32:49] [V] [TRT] Searching for input: 2512 [01/12/2022-09:32:49] [V] [TRT] Add_1597 [Add] inputs: [decoder.layers.4.fc2.bias -> (768)[FLOAT]], [2512 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:49] [V] [TRT] Registering layer: decoder.layers.4.fc2.bias for ONNX node: decoder.layers.4.fc2.bias [01/12/2022-09:32:50] [V] [TRT] Registering layer: Add_1597 for ONNX node: Add_1597 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2513 for ONNX tensor: 2513 [01/12/2022-09:32:50] [V] [TRT] Add_1597 [Add] outputs: [2513 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Add_1598 [Add] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2499 [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2513 [01/12/2022-09:32:50] [V] [TRT] Add_1598 [Add] inputs: [2499 -> (-1, -1, 768)[FLOAT]], [2513 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: Add_1598 for ONNX node: Add_1598 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2514 for ONNX tensor: 2514 [01/12/2022-09:32:50] [V] [TRT] Add_1598 [Add] outputs: [2514 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: ReduceMean_1599 [ReduceMean] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2514 [01/12/2022-09:32:50] [V] [TRT] ReduceMean_1599 [ReduceMean] inputs: [2514 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: ReduceMean_1599 for ONNX node: ReduceMean_1599 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2515 for ONNX tensor: 2515 [01/12/2022-09:32:50] [V] [TRT] ReduceMean_1599 [ReduceMean] outputs: [2515 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Sub_1600 [Sub] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2514 [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2515 [01/12/2022-09:32:50] [V] [TRT] Sub_1600 [Sub] inputs: [2514 -> (-1, -1, 768)[FLOAT]], [2515 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: Sub_1600 for ONNX node: Sub_1600 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2516 for ONNX tensor: 2516 [01/12/2022-09:32:50] [V] [TRT] Sub_1600 [Sub] outputs: [2516 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Constant_1601 [Constant] [01/12/2022-09:32:50] [V] [TRT] Constant_1601 [Constant] inputs: [01/12/2022-09:32:50] [V] [TRT] Constant_1601 [Constant] outputs: [2517 -> ()[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Pow_1602 [Pow] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2516 [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2517 [01/12/2022-09:32:50] [V] [TRT] Pow_1602 [Pow] inputs: [2516 -> (-1, -1, 768)[FLOAT]], [2517 -> ()[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: 2517 for ONNX node: 2517 [01/12/2022-09:32:50] [V] [TRT] Registering layer: Pow_1602 for ONNX node: Pow_1602 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2518 for ONNX tensor: 2518 [01/12/2022-09:32:50] [V] [TRT] Pow_1602 [Pow] outputs: [2518 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: ReduceMean_1603 [ReduceMean] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2518 [01/12/2022-09:32:50] [V] [TRT] ReduceMean_1603 [ReduceMean] inputs: [2518 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: ReduceMean_1603 for ONNX node: ReduceMean_1603 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2519 for ONNX tensor: 2519 [01/12/2022-09:32:50] [V] [TRT] ReduceMean_1603 [ReduceMean] outputs: [2519 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Constant_1604 [Constant] [01/12/2022-09:32:50] [V] [TRT] Constant_1604 [Constant] inputs: [01/12/2022-09:32:50] [V] [TRT] Constant_1604 [Constant] outputs: [2520 -> ()[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Add_1605 [Add] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2519 [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2520 [01/12/2022-09:32:50] [V] [TRT] Add_1605 [Add] inputs: [2519 -> (-1, -1, 1)[FLOAT]], [2520 -> ()[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: 2520 for ONNX node: 2520 [01/12/2022-09:32:50] [V] [TRT] Registering layer: Add_1605 for ONNX node: Add_1605 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2521 for ONNX tensor: 2521 [01/12/2022-09:32:50] [V] [TRT] Add_1605 [Add] outputs: [2521 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Sqrt_1606 [Sqrt] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2521 [01/12/2022-09:32:50] [V] [TRT] Sqrt_1606 [Sqrt] inputs: [2521 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: Sqrt_1606 for ONNX node: Sqrt_1606 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2522 for ONNX tensor: 2522 [01/12/2022-09:32:50] [V] [TRT] Sqrt_1606 [Sqrt] outputs: [2522 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Div_1607 [Div] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2516 [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2522 [01/12/2022-09:32:50] [V] [TRT] Div_1607 [Div] inputs: [2516 -> (-1, -1, 768)[FLOAT]], [2522 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: Div_1607 for ONNX node: Div_1607 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2523 for ONNX tensor: 2523 [01/12/2022-09:32:50] [V] [TRT] Div_1607 [Div] outputs: [2523 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Mul_1608 [Mul] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2523 [01/12/2022-09:32:50] [V] [TRT] Searching for input: decoder.layers.4.final_layer_norm.weight [01/12/2022-09:32:50] [V] [TRT] Mul_1608 [Mul] inputs: [2523 -> (-1, -1, 768)[FLOAT]], [decoder.layers.4.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: decoder.layers.4.final_layer_norm.weight for ONNX node: decoder.layers.4.final_layer_norm.weight [01/12/2022-09:32:50] [V] [TRT] Registering layer: Mul_1608 for ONNX node: Mul_1608 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2524 for ONNX tensor: 2524 [01/12/2022-09:32:50] [V] [TRT] Mul_1608 [Mul] outputs: [2524 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Add_1609 [Add] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2524 [01/12/2022-09:32:50] [V] [TRT] Searching for input: decoder.layers.4.final_layer_norm.bias [01/12/2022-09:32:50] [V] [TRT] Add_1609 [Add] inputs: [2524 -> (-1, -1, 768)[FLOAT]], [decoder.layers.4.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: decoder.layers.4.final_layer_norm.bias for ONNX node: decoder.layers.4.final_layer_norm.bias [01/12/2022-09:32:50] [V] [TRT] Registering layer: Add_1609 for ONNX node: Add_1609 [01/12/2022-09:32:50] [V] [TRT] Registering tensor: 2525 for ONNX tensor: 2525 [01/12/2022-09:32:50] [V] [TRT] Add_1609 [Add] outputs: [2525 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Parsing node: Shape_1610 [Shape] [01/12/2022-09:32:50] [V] [TRT] Searching for input: 2525 [01/12/2022-09:32:50] [V] [TRT] Shape_1610 [Shape] inputs: [2525 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:50] [V] [TRT] Registering layer: Shape_1610 for ONNX node: Shape_1610 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2526 for ONNX tensor: 2526 [01/12/2022-09:32:51] [V] [TRT] Shape_1610 [Shape] outputs: [2526 -> (3)[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Constant_1611 [Constant] [01/12/2022-09:32:51] [V] [TRT] Constant_1611 [Constant] inputs: [01/12/2022-09:32:51] [V] [TRT] Constant_1611 [Constant] outputs: [2527 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Gather_1612 [Gather] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2526 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2527 [01/12/2022-09:32:51] [V] [TRT] Gather_1612 [Gather] inputs: [2526 -> (3)[INT32]], [2527 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: 2527 for ONNX node: 2527 [01/12/2022-09:32:51] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:51] [V] [TRT] Registering layer: Gather_1612 for ONNX node: Gather_1612 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2528 for ONNX tensor: 2528 [01/12/2022-09:32:51] [V] [TRT] Gather_1612 [Gather] outputs: [2528 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Shape_1613 [Shape] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2525 [01/12/2022-09:32:51] [V] [TRT] Shape_1613 [Shape] inputs: [2525 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: Shape_1613 for ONNX node: Shape_1613 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2529 for ONNX tensor: 2529 [01/12/2022-09:32:51] [V] [TRT] Shape_1613 [Shape] outputs: [2529 -> (3)[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Constant_1614 [Constant] [01/12/2022-09:32:51] [V] [TRT] Constant_1614 [Constant] inputs: [01/12/2022-09:32:51] [V] [TRT] Constant_1614 [Constant] outputs: [2530 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Gather_1615 [Gather] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2529 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2530 [01/12/2022-09:32:51] [V] [TRT] Gather_1615 [Gather] inputs: [2529 -> (3)[INT32]], [2530 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: 2530 for ONNX node: 2530 [01/12/2022-09:32:51] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:51] [V] [TRT] Registering layer: Gather_1615 for ONNX node: Gather_1615 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2531 for ONNX tensor: 2531 [01/12/2022-09:32:51] [V] [TRT] Gather_1615 [Gather] outputs: [2531 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: MatMul_1616 [MatMul] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2525 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 3147 [01/12/2022-09:32:51] [V] [TRT] MatMul_1616 [MatMul] inputs: [2525 -> (-1, -1, 768)[FLOAT]], [3147 -> (768, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: 3147 for ONNX node: 3147 [01/12/2022-09:32:51] [V] [TRT] Registering layer: MatMul_1616 for ONNX node: MatMul_1616 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2533 for ONNX tensor: 2533 [01/12/2022-09:32:51] [V] [TRT] MatMul_1616 [MatMul] outputs: [2533 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Add_1617 [Add] [01/12/2022-09:32:51] [V] [TRT] Searching for input: decoder.layers.5.self_attn.q_proj.bias [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2533 [01/12/2022-09:32:51] [V] [TRT] Add_1617 [Add] inputs: [decoder.layers.5.self_attn.q_proj.bias -> (768)[FLOAT]], [2533 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: decoder.layers.5.self_attn.q_proj.bias for ONNX node: decoder.layers.5.self_attn.q_proj.bias [01/12/2022-09:32:51] [V] [TRT] Registering layer: Add_1617 for ONNX node: Add_1617 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2534 for ONNX tensor: 2534 [01/12/2022-09:32:51] [V] [TRT] Add_1617 [Add] outputs: [2534 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Constant_1618 [Constant] [01/12/2022-09:32:51] [V] [TRT] Constant_1618 [Constant] inputs: [01/12/2022-09:32:51] [V] [TRT] Constant_1618 [Constant] outputs: [2535 -> ()[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Mul_1619 [Mul] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2534 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2535 [01/12/2022-09:32:51] [V] [TRT] Mul_1619 [Mul] inputs: [2534 -> (-1, -1, 768)[FLOAT]], [2535 -> ()[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: 2535 for ONNX node: 2535 [01/12/2022-09:32:51] [V] [TRT] Registering layer: Mul_1619 for ONNX node: Mul_1619 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2536 for ONNX tensor: 2536 [01/12/2022-09:32:51] [V] [TRT] Mul_1619 [Mul] outputs: [2536 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: MatMul_1620 [MatMul] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2525 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 3148 [01/12/2022-09:32:51] [V] [TRT] MatMul_1620 [MatMul] inputs: [2525 -> (-1, -1, 768)[FLOAT]], [3148 -> (768, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: 3148 for ONNX node: 3148 [01/12/2022-09:32:51] [V] [TRT] Registering layer: MatMul_1620 for ONNX node: MatMul_1620 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2538 for ONNX tensor: 2538 [01/12/2022-09:32:51] [V] [TRT] MatMul_1620 [MatMul] outputs: [2538 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Add_1621 [Add] [01/12/2022-09:32:51] [V] [TRT] Searching for input: decoder.layers.5.self_attn.k_proj.bias [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2538 [01/12/2022-09:32:51] [V] [TRT] Add_1621 [Add] inputs: [decoder.layers.5.self_attn.k_proj.bias -> (768)[FLOAT]], [2538 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: decoder.layers.5.self_attn.k_proj.bias for ONNX node: decoder.layers.5.self_attn.k_proj.bias [01/12/2022-09:32:51] [V] [TRT] Registering layer: Add_1621 for ONNX node: Add_1621 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2539 for ONNX tensor: 2539 [01/12/2022-09:32:51] [V] [TRT] Add_1621 [Add] outputs: [2539 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Unsqueeze_1622 [Unsqueeze] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:51] [V] [TRT] Unsqueeze_1622 [Unsqueeze] inputs: [2528 -> ()[INT32]], [01/12/2022-09:32:51] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:51] [V] [TRT] Registering layer: Unsqueeze_1622 for ONNX node: Unsqueeze_1622 [01/12/2022-09:32:51] [V] [TRT] Registering tensor: 2543 for ONNX tensor: 2543 [01/12/2022-09:32:51] [V] [TRT] Unsqueeze_1622 [Unsqueeze] outputs: [2543 -> (1)[INT32]], [01/12/2022-09:32:51] [V] [TRT] Parsing node: Concat_1623 [Concat] [01/12/2022-09:32:51] [V] [TRT] Searching for input: 2543 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 3149 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 3150 [01/12/2022-09:32:51] [V] [TRT] Searching for input: 3151 [01/12/2022-09:32:51] [V] [TRT] Concat_1623 [Concat] inputs: [2543 -> (1)[INT32]], [3149 -> (1)[INT32]], [3150 -> (1)[INT32]], [3151 -> (1)[INT32]], [01/12/2022-09:32:51] [V] [TRT] Registering layer: 3149 for ONNX node: 3149 [01/12/2022-09:32:51] [V] [TRT] Registering layer: 3150 for ONNX node: 3150 [01/12/2022-09:32:51] [V] [TRT] Registering layer: 3151 for ONNX node: 3151 [01/12/2022-09:32:52] [V] [TRT] Registering layer: Concat_1623 for ONNX node: Concat_1623 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2547 for ONNX tensor: 2547 [01/12/2022-09:32:52] [V] [TRT] Concat_1623 [Concat] outputs: [2547 -> (4)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Reshape_1624 [Reshape] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2539 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2547 [01/12/2022-09:32:52] [V] [TRT] Reshape_1624 [Reshape] inputs: [2539 -> (-1, -1, 768)[FLOAT]], [2547 -> (4)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: Reshape_1624 for ONNX node: Reshape_1624 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2548 for ONNX tensor: 2548 [01/12/2022-09:32:52] [V] [TRT] Reshape_1624 [Reshape] outputs: [2548 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Transpose_1625 [Transpose] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2548 [01/12/2022-09:32:52] [V] [TRT] Transpose_1625 [Transpose] inputs: [2548 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: Transpose_1625 for ONNX node: Transpose_1625 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2549_22 for ONNX tensor: 2549 [01/12/2022-09:32:52] [V] [TRT] Transpose_1625 [Transpose] outputs: [2549 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: MatMul_1626 [MatMul] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2525 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 3152 [01/12/2022-09:32:52] [V] [TRT] MatMul_1626 [MatMul] inputs: [2525 -> (-1, -1, 768)[FLOAT]], [3152 -> (768, 768)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: 3152 for ONNX node: 3152 [01/12/2022-09:32:52] [V] [TRT] Registering layer: MatMul_1626 for ONNX node: MatMul_1626 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2551 for ONNX tensor: 2551 [01/12/2022-09:32:52] [V] [TRT] MatMul_1626 [MatMul] outputs: [2551 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Add_1627 [Add] [01/12/2022-09:32:52] [V] [TRT] Searching for input: decoder.layers.5.self_attn.v_proj.bias [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2551 [01/12/2022-09:32:52] [V] [TRT] Add_1627 [Add] inputs: [decoder.layers.5.self_attn.v_proj.bias -> (768)[FLOAT]], [2551 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: decoder.layers.5.self_attn.v_proj.bias for ONNX node: decoder.layers.5.self_attn.v_proj.bias [01/12/2022-09:32:52] [V] [TRT] Registering layer: Add_1627 for ONNX node: Add_1627 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2552 for ONNX tensor: 2552 [01/12/2022-09:32:52] [V] [TRT] Add_1627 [Add] outputs: [2552 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Unsqueeze_1628 [Unsqueeze] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:52] [V] [TRT] Unsqueeze_1628 [Unsqueeze] inputs: [2528 -> ()[INT32]], [01/12/2022-09:32:52] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:52] [V] [TRT] Registering layer: Unsqueeze_1628 for ONNX node: Unsqueeze_1628 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2556 for ONNX tensor: 2556 [01/12/2022-09:32:52] [V] [TRT] Unsqueeze_1628 [Unsqueeze] outputs: [2556 -> (1)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Concat_1629 [Concat] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2556 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 3153 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 3154 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 3155 [01/12/2022-09:32:52] [V] [TRT] Concat_1629 [Concat] inputs: [2556 -> (1)[INT32]], [3153 -> (1)[INT32]], [3154 -> (1)[INT32]], [3155 -> (1)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: 3153 for ONNX node: 3153 [01/12/2022-09:32:52] [V] [TRT] Registering layer: 3154 for ONNX node: 3154 [01/12/2022-09:32:52] [V] [TRT] Registering layer: 3155 for ONNX node: 3155 [01/12/2022-09:32:52] [V] [TRT] Registering layer: Concat_1629 for ONNX node: Concat_1629 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2560 for ONNX tensor: 2560 [01/12/2022-09:32:52] [V] [TRT] Concat_1629 [Concat] outputs: [2560 -> (4)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Reshape_1630 [Reshape] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2552 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2560 [01/12/2022-09:32:52] [V] [TRT] Reshape_1630 [Reshape] inputs: [2552 -> (-1, -1, 768)[FLOAT]], [2560 -> (4)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: Reshape_1630 for ONNX node: Reshape_1630 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2561 for ONNX tensor: 2561 [01/12/2022-09:32:52] [V] [TRT] Reshape_1630 [Reshape] outputs: [2561 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Transpose_1631 [Transpose] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2561 [01/12/2022-09:32:52] [V] [TRT] Transpose_1631 [Transpose] inputs: [2561 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: Transpose_1631 for ONNX node: Transpose_1631 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2562_23 for ONNX tensor: 2562 [01/12/2022-09:32:52] [V] [TRT] Transpose_1631 [Transpose] outputs: [2562 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Constant_1632 [Constant] [01/12/2022-09:32:52] [V] [TRT] Constant_1632 [Constant] inputs: [01/12/2022-09:32:52] [V] [TRT] Constant_1632 [Constant] outputs: [2563 -> ()[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Mul_1633 [Mul] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2563 [01/12/2022-09:32:52] [V] [TRT] Mul_1633 [Mul] inputs: [2528 -> ()[INT32]], [2563 -> ()[INT32]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: 2563 for ONNX node: 2563 [01/12/2022-09:32:52] [V] [TRT] Registering layer: Mul_1633 for ONNX node: Mul_1633 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2564 for ONNX tensor: 2564 [01/12/2022-09:32:52] [V] [TRT] Mul_1633 [Mul] outputs: [2564 -> ()[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Unsqueeze_1634 [Unsqueeze] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:52] [V] [TRT] Unsqueeze_1634 [Unsqueeze] inputs: [2528 -> ()[INT32]], [01/12/2022-09:32:52] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:52] [V] [TRT] Registering layer: Unsqueeze_1634 for ONNX node: Unsqueeze_1634 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2567 for ONNX tensor: 2567 [01/12/2022-09:32:52] [V] [TRT] Unsqueeze_1634 [Unsqueeze] outputs: [2567 -> (1)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Unsqueeze_1635 [Unsqueeze] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2531 [01/12/2022-09:32:52] [V] [TRT] Unsqueeze_1635 [Unsqueeze] inputs: [2531 -> ()[INT32]], [01/12/2022-09:32:52] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:52] [V] [TRT] Registering layer: Unsqueeze_1635 for ONNX node: Unsqueeze_1635 [01/12/2022-09:32:52] [V] [TRT] Registering tensor: 2568 for ONNX tensor: 2568 [01/12/2022-09:32:52] [V] [TRT] Unsqueeze_1635 [Unsqueeze] outputs: [2568 -> (1)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Parsing node: Concat_1636 [Concat] [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2567 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 2568 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 3156 [01/12/2022-09:32:52] [V] [TRT] Searching for input: 3157 [01/12/2022-09:32:52] [V] [TRT] Concat_1636 [Concat] inputs: [2567 -> (1)[INT32]], [2568 -> (1)[INT32]], [3156 -> (1)[INT32]], [3157 -> (1)[INT32]], [01/12/2022-09:32:52] [V] [TRT] Registering layer: 3156 for ONNX node: 3156 [01/12/2022-09:32:52] [V] [TRT] Registering layer: 3157 for ONNX node: 3157 [01/12/2022-09:32:52] [V] [TRT] Registering layer: Concat_1636 for ONNX node: Concat_1636 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2571 for ONNX tensor: 2571 [01/12/2022-09:32:53] [V] [TRT] Concat_1636 [Concat] outputs: [2571 -> (4)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Reshape_1637 [Reshape] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2536 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2571 [01/12/2022-09:32:53] [V] [TRT] Reshape_1637 [Reshape] inputs: [2536 -> (-1, -1, 768)[FLOAT]], [2571 -> (4)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Reshape_1637 for ONNX node: Reshape_1637 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2572 for ONNX tensor: 2572 [01/12/2022-09:32:53] [V] [TRT] Reshape_1637 [Reshape] outputs: [2572 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Transpose_1638 [Transpose] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2572 [01/12/2022-09:32:53] [V] [TRT] Transpose_1638 [Transpose] inputs: [2572 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Transpose_1638 for ONNX node: Transpose_1638 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2573 for ONNX tensor: 2573 [01/12/2022-09:32:53] [V] [TRT] Transpose_1638 [Transpose] outputs: [2573 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Unsqueeze_1639 [Unsqueeze] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2564 [01/12/2022-09:32:53] [V] [TRT] Unsqueeze_1639 [Unsqueeze] inputs: [2564 -> ()[INT32]], [01/12/2022-09:32:53] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:53] [V] [TRT] Registering layer: Unsqueeze_1639 for ONNX node: Unsqueeze_1639 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2576 for ONNX tensor: 2576 [01/12/2022-09:32:53] [V] [TRT] Unsqueeze_1639 [Unsqueeze] outputs: [2576 -> (1)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Concat_1640 [Concat] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2576 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 3158 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 3159 [01/12/2022-09:32:53] [V] [TRT] Concat_1640 [Concat] inputs: [2576 -> (1)[INT32]], [3158 -> (1)[INT32]], [3159 -> (1)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: 3158 for ONNX node: 3158 [01/12/2022-09:32:53] [V] [TRT] Registering layer: 3159 for ONNX node: 3159 [01/12/2022-09:32:53] [V] [TRT] Registering layer: Concat_1640 for ONNX node: Concat_1640 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2579 for ONNX tensor: 2579 [01/12/2022-09:32:53] [V] [TRT] Concat_1640 [Concat] outputs: [2579 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Reshape_1641 [Reshape] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2573 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2579 [01/12/2022-09:32:53] [V] [TRT] Reshape_1641 [Reshape] inputs: [2573 -> (-1, 12, -1, 64)[FLOAT]], [2579 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Reshape_1641 for ONNX node: Reshape_1641 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2580 for ONNX tensor: 2580 [01/12/2022-09:32:53] [V] [TRT] Reshape_1641 [Reshape] outputs: [2580 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Unsqueeze_1642 [Unsqueeze] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2564 [01/12/2022-09:32:53] [V] [TRT] Unsqueeze_1642 [Unsqueeze] inputs: [2564 -> ()[INT32]], [01/12/2022-09:32:53] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:53] [V] [TRT] Registering layer: Unsqueeze_1642 for ONNX node: Unsqueeze_1642 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2583 for ONNX tensor: 2583 [01/12/2022-09:32:53] [V] [TRT] Unsqueeze_1642 [Unsqueeze] outputs: [2583 -> (1)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Concat_1643 [Concat] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2583 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 3160 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 3161 [01/12/2022-09:32:53] [V] [TRT] Concat_1643 [Concat] inputs: [2583 -> (1)[INT32]], [3160 -> (1)[INT32]], [3161 -> (1)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: 3160 for ONNX node: 3160 [01/12/2022-09:32:53] [V] [TRT] Registering layer: 3161 for ONNX node: 3161 [01/12/2022-09:32:53] [V] [TRT] Registering layer: Concat_1643 for ONNX node: Concat_1643 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2586 for ONNX tensor: 2586 [01/12/2022-09:32:53] [V] [TRT] Concat_1643 [Concat] outputs: [2586 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Reshape_1644 [Reshape] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2549 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2586 [01/12/2022-09:32:53] [V] [TRT] Reshape_1644 [Reshape] inputs: [2549 -> (-1, 12, -1, 64)[FLOAT]], [2586 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Reshape_1644 for ONNX node: Reshape_1644 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2587 for ONNX tensor: 2587 [01/12/2022-09:32:53] [V] [TRT] Reshape_1644 [Reshape] outputs: [2587 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Unsqueeze_1645 [Unsqueeze] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2564 [01/12/2022-09:32:53] [V] [TRT] Unsqueeze_1645 [Unsqueeze] inputs: [2564 -> ()[INT32]], [01/12/2022-09:32:53] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:53] [V] [TRT] Registering layer: Unsqueeze_1645 for ONNX node: Unsqueeze_1645 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2590 for ONNX tensor: 2590 [01/12/2022-09:32:53] [V] [TRT] Unsqueeze_1645 [Unsqueeze] outputs: [2590 -> (1)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Concat_1646 [Concat] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2590 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 3162 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 3163 [01/12/2022-09:32:53] [V] [TRT] Concat_1646 [Concat] inputs: [2590 -> (1)[INT32]], [3162 -> (1)[INT32]], [3163 -> (1)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: 3162 for ONNX node: 3162 [01/12/2022-09:32:53] [V] [TRT] Registering layer: 3163 for ONNX node: 3163 [01/12/2022-09:32:53] [V] [TRT] Registering layer: Concat_1646 for ONNX node: Concat_1646 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2593 for ONNX tensor: 2593 [01/12/2022-09:32:53] [V] [TRT] Concat_1646 [Concat] outputs: [2593 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Reshape_1647 [Reshape] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2562 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2593 [01/12/2022-09:32:53] [V] [TRT] Reshape_1647 [Reshape] inputs: [2562 -> (-1, 12, -1, 64)[FLOAT]], [2593 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Reshape_1647 for ONNX node: Reshape_1647 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2594 for ONNX tensor: 2594 [01/12/2022-09:32:53] [V] [TRT] Reshape_1647 [Reshape] outputs: [2594 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Shape_1648 [Shape] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2587 [01/12/2022-09:32:53] [V] [TRT] Shape_1648 [Shape] inputs: [2587 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Shape_1648 for ONNX node: Shape_1648 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2595 for ONNX tensor: 2595 [01/12/2022-09:32:53] [V] [TRT] Shape_1648 [Shape] outputs: [2595 -> (3)[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Constant_1649 [Constant] [01/12/2022-09:32:53] [V] [TRT] Constant_1649 [Constant] inputs: [01/12/2022-09:32:53] [V] [TRT] Constant_1649 [Constant] outputs: [2596 -> ()[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Gather_1650 [Gather] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2595 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2596 [01/12/2022-09:32:53] [V] [TRT] Gather_1650 [Gather] inputs: [2595 -> (3)[INT32]], [2596 -> ()[INT32]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: 2596 for ONNX node: 2596 [01/12/2022-09:32:53] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:53] [V] [TRT] Registering layer: Gather_1650 for ONNX node: Gather_1650 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2597 for ONNX tensor: 2597 [01/12/2022-09:32:53] [V] [TRT] Gather_1650 [Gather] outputs: [2597 -> ()[INT32]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: Transpose_1651 [Transpose] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2587 [01/12/2022-09:32:53] [V] [TRT] Transpose_1651 [Transpose] inputs: [2587 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: Transpose_1651 for ONNX node: Transpose_1651 [01/12/2022-09:32:53] [V] [TRT] Registering tensor: 2598 for ONNX tensor: 2598 [01/12/2022-09:32:53] [V] [TRT] Transpose_1651 [Transpose] outputs: [2598 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Parsing node: MatMul_1652 [MatMul] [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2580 [01/12/2022-09:32:53] [V] [TRT] Searching for input: 2598 [01/12/2022-09:32:53] [V] [TRT] MatMul_1652 [MatMul] inputs: [2580 -> (-1, -1, 64)[FLOAT]], [2598 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:32:53] [V] [TRT] Registering layer: MatMul_1652 for ONNX node: MatMul_1652 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2599 for ONNX tensor: 2599 [01/12/2022-09:32:54] [V] [TRT] MatMul_1652 [MatMul] outputs: [2599 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Unsqueeze_1653 [Unsqueeze] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1653 [Unsqueeze] inputs: [2528 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:54] [V] [TRT] Registering layer: Unsqueeze_1653 for ONNX node: Unsqueeze_1653 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2601 for ONNX tensor: 2601 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1653 [Unsqueeze] outputs: [2601 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Unsqueeze_1654 [Unsqueeze] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2531 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1654 [Unsqueeze] inputs: [2531 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:54] [V] [TRT] Registering layer: Unsqueeze_1654 for ONNX node: Unsqueeze_1654 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2603 for ONNX tensor: 2603 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1654 [Unsqueeze] outputs: [2603 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Unsqueeze_1655 [Unsqueeze] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2597 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1655 [Unsqueeze] inputs: [2597 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:54] [V] [TRT] Registering layer: Unsqueeze_1655 for ONNX node: Unsqueeze_1655 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2604 for ONNX tensor: 2604 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1655 [Unsqueeze] outputs: [2604 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Concat_1656 [Concat] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2601 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 3164 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2603 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2604 [01/12/2022-09:32:54] [V] [TRT] Concat_1656 [Concat] inputs: [2601 -> (1)[INT32]], [3164 -> (1)[INT32]], [2603 -> (1)[INT32]], [2604 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Registering layer: 3164 for ONNX node: 3164 [01/12/2022-09:32:54] [V] [TRT] Registering layer: Concat_1656 for ONNX node: Concat_1656 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2605 for ONNX tensor: 2605 [01/12/2022-09:32:54] [V] [TRT] Concat_1656 [Concat] outputs: [2605 -> (4)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Reshape_1657 [Reshape] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2599 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2605 [01/12/2022-09:32:54] [V] [TRT] Reshape_1657 [Reshape] inputs: [2599 -> (-1, -1, -1)[FLOAT]], [2605 -> (4)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Registering layer: Reshape_1657 for ONNX node: Reshape_1657 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2606 for ONNX tensor: 2606 [01/12/2022-09:32:54] [V] [TRT] Reshape_1657 [Reshape] outputs: [2606 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Add_1658 [Add] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2606 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 1252 [01/12/2022-09:32:54] [V] [TRT] Add_1658 [Add] inputs: [2606 -> (-1, 12, -1, -1)[FLOAT]], [1252 -> (-1, 1, -1, -1)[FLOAT]], [01/12/2022-09:32:54] [V] [TRT] Registering layer: Add_1658 for ONNX node: Add_1658 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2607 for ONNX tensor: 2607 [01/12/2022-09:32:54] [V] [TRT] Add_1658 [Add] outputs: [2607 -> (-1, 12, -1, -1)[FLOAT]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Constant_1659 [Constant] [01/12/2022-09:32:54] [V] [TRT] Constant_1659 [Constant] inputs: [01/12/2022-09:32:54] [V] [TRT] Constant_1659 [Constant] outputs: [2608 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Mul_1660 [Mul] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2608 [01/12/2022-09:32:54] [V] [TRT] Mul_1660 [Mul] inputs: [2528 -> ()[INT32]], [2608 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Registering layer: 2608 for ONNX node: 2608 [01/12/2022-09:32:54] [V] [TRT] Registering layer: Mul_1660 for ONNX node: Mul_1660 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2609 for ONNX tensor: 2609 [01/12/2022-09:32:54] [V] [TRT] Mul_1660 [Mul] outputs: [2609 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Unsqueeze_1661 [Unsqueeze] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2609 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1661 [Unsqueeze] inputs: [2609 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:54] [V] [TRT] Registering layer: Unsqueeze_1661 for ONNX node: Unsqueeze_1661 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2610 for ONNX tensor: 2610 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1661 [Unsqueeze] outputs: [2610 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Unsqueeze_1662 [Unsqueeze] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2531 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1662 [Unsqueeze] inputs: [2531 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:54] [V] [TRT] Registering layer: Unsqueeze_1662 for ONNX node: Unsqueeze_1662 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2611 for ONNX tensor: 2611 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1662 [Unsqueeze] outputs: [2611 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Unsqueeze_1663 [Unsqueeze] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2597 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1663 [Unsqueeze] inputs: [2597 -> ()[INT32]], [01/12/2022-09:32:54] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:54] [V] [TRT] Registering layer: Unsqueeze_1663 for ONNX node: Unsqueeze_1663 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2612 for ONNX tensor: 2612 [01/12/2022-09:32:54] [V] [TRT] Unsqueeze_1663 [Unsqueeze] outputs: [2612 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Concat_1664 [Concat] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2610 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2611 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2612 [01/12/2022-09:32:54] [V] [TRT] Concat_1664 [Concat] inputs: [2610 -> (1)[INT32]], [2611 -> (1)[INT32]], [2612 -> (1)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Registering layer: Concat_1664 for ONNX node: Concat_1664 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2613 for ONNX tensor: 2613 [01/12/2022-09:32:54] [V] [TRT] Concat_1664 [Concat] outputs: [2613 -> (3)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Reshape_1665 [Reshape] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2607 [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2613 [01/12/2022-09:32:54] [V] [TRT] Reshape_1665 [Reshape] inputs: [2607 -> (-1, 12, -1, -1)[FLOAT]], [2613 -> (3)[INT32]], [01/12/2022-09:32:54] [V] [TRT] Registering layer: Reshape_1665 for ONNX node: Reshape_1665 [01/12/2022-09:32:54] [V] [TRT] Registering tensor: 2614 for ONNX tensor: 2614 [01/12/2022-09:32:54] [V] [TRT] Reshape_1665 [Reshape] outputs: [2614 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:54] [V] [TRT] Parsing node: Softmax_1666 [Softmax] [01/12/2022-09:32:54] [V] [TRT] Searching for input: 2614 [01/12/2022-09:32:54] [V] [TRT] Softmax_1666 [Softmax] inputs: [2614 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: Softmax_1666 for ONNX node: Softmax_1666 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2615 for ONNX tensor: 2615 [01/12/2022-09:32:55] [V] [TRT] Softmax_1666 [Softmax] outputs: [2615 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: MatMul_1667 [MatMul] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2615 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2594 [01/12/2022-09:32:55] [V] [TRT] MatMul_1667 [MatMul] inputs: [2615 -> (-1, -1, -1)[FLOAT]], [2594 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: MatMul_1667 for ONNX node: MatMul_1667 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2616 for ONNX tensor: 2616 [01/12/2022-09:32:55] [V] [TRT] MatMul_1667 [MatMul] outputs: [2616 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Unsqueeze_1668 [Unsqueeze] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1668 [Unsqueeze] inputs: [2528 -> ()[INT32]], [01/12/2022-09:32:55] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:55] [V] [TRT] Registering layer: Unsqueeze_1668 for ONNX node: Unsqueeze_1668 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2619 for ONNX tensor: 2619 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1668 [Unsqueeze] outputs: [2619 -> (1)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Unsqueeze_1669 [Unsqueeze] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2531 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1669 [Unsqueeze] inputs: [2531 -> ()[INT32]], [01/12/2022-09:32:55] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:55] [V] [TRT] Registering layer: Unsqueeze_1669 for ONNX node: Unsqueeze_1669 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2621 for ONNX tensor: 2621 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1669 [Unsqueeze] outputs: [2621 -> (1)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Concat_1670 [Concat] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2619 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 3165 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2621 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 3166 [01/12/2022-09:32:55] [V] [TRT] Concat_1670 [Concat] inputs: [2619 -> (1)[INT32]], [3165 -> (1)[INT32]], [2621 -> (1)[INT32]], [3166 -> (1)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: 3165 for ONNX node: 3165 [01/12/2022-09:32:55] [V] [TRT] Registering layer: 3166 for ONNX node: 3166 [01/12/2022-09:32:55] [V] [TRT] Registering layer: Concat_1670 for ONNX node: Concat_1670 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2623 for ONNX tensor: 2623 [01/12/2022-09:32:55] [V] [TRT] Concat_1670 [Concat] outputs: [2623 -> (4)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Reshape_1671 [Reshape] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2616 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2623 [01/12/2022-09:32:55] [V] [TRT] Reshape_1671 [Reshape] inputs: [2616 -> (-1, -1, 64)[FLOAT]], [2623 -> (4)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: Reshape_1671 for ONNX node: Reshape_1671 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2624 for ONNX tensor: 2624 [01/12/2022-09:32:55] [V] [TRT] Reshape_1671 [Reshape] outputs: [2624 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Transpose_1672 [Transpose] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2624 [01/12/2022-09:32:55] [V] [TRT] Transpose_1672 [Transpose] inputs: [2624 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: Transpose_1672 for ONNX node: Transpose_1672 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2625 for ONNX tensor: 2625 [01/12/2022-09:32:55] [V] [TRT] Transpose_1672 [Transpose] outputs: [2625 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Unsqueeze_1673 [Unsqueeze] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2528 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1673 [Unsqueeze] inputs: [2528 -> ()[INT32]], [01/12/2022-09:32:55] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:55] [V] [TRT] Registering layer: Unsqueeze_1673 for ONNX node: Unsqueeze_1673 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2627 for ONNX tensor: 2627 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1673 [Unsqueeze] outputs: [2627 -> (1)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Unsqueeze_1674 [Unsqueeze] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2531 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1674 [Unsqueeze] inputs: [2531 -> ()[INT32]], [01/12/2022-09:32:55] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:55] [V] [TRT] Registering layer: Unsqueeze_1674 for ONNX node: Unsqueeze_1674 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2628 for ONNX tensor: 2628 [01/12/2022-09:32:55] [V] [TRT] Unsqueeze_1674 [Unsqueeze] outputs: [2628 -> (1)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Concat_1675 [Concat] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2627 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2628 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 3167 [01/12/2022-09:32:55] [V] [TRT] Concat_1675 [Concat] inputs: [2627 -> (1)[INT32]], [2628 -> (1)[INT32]], [3167 -> (1)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: 3167 for ONNX node: 3167 [01/12/2022-09:32:55] [V] [TRT] Registering layer: Concat_1675 for ONNX node: Concat_1675 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2630 for ONNX tensor: 2630 [01/12/2022-09:32:55] [V] [TRT] Concat_1675 [Concat] outputs: [2630 -> (3)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Reshape_1676 [Reshape] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2625 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2630 [01/12/2022-09:32:55] [V] [TRT] Reshape_1676 [Reshape] inputs: [2625 -> (-1, -1, 12, 64)[FLOAT]], [2630 -> (3)[INT32]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: Reshape_1676 for ONNX node: Reshape_1676 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2631 for ONNX tensor: 2631 [01/12/2022-09:32:55] [V] [TRT] Reshape_1676 [Reshape] outputs: [2631 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: MatMul_1677 [MatMul] [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2631 [01/12/2022-09:32:55] [V] [TRT] Searching for input: 3168 [01/12/2022-09:32:55] [V] [TRT] MatMul_1677 [MatMul] inputs: [2631 -> (-1, -1, 768)[FLOAT]], [3168 -> (768, 768)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: 3168 for ONNX node: 3168 [01/12/2022-09:32:55] [V] [TRT] Registering layer: MatMul_1677 for ONNX node: MatMul_1677 [01/12/2022-09:32:55] [V] [TRT] Registering tensor: 2633 for ONNX tensor: 2633 [01/12/2022-09:32:55] [V] [TRT] MatMul_1677 [MatMul] outputs: [2633 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Parsing node: Add_1678 [Add] [01/12/2022-09:32:55] [V] [TRT] Searching for input: decoder.layers.5.self_attn.out_proj.bias [01/12/2022-09:32:55] [V] [TRT] Searching for input: 2633 [01/12/2022-09:32:55] [V] [TRT] Add_1678 [Add] inputs: [decoder.layers.5.self_attn.out_proj.bias -> (768)[FLOAT]], [2633 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:55] [V] [TRT] Registering layer: decoder.layers.5.self_attn.out_proj.bias for ONNX node: decoder.layers.5.self_attn.out_proj.bias [01/12/2022-09:32:56] [V] [TRT] Registering layer: Add_1678 for ONNX node: Add_1678 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2634 for ONNX tensor: 2634 [01/12/2022-09:32:56] [V] [TRT] Add_1678 [Add] outputs: [2634 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Add_1679 [Add] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2525 [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2634 [01/12/2022-09:32:56] [V] [TRT] Add_1679 [Add] inputs: [2525 -> (-1, -1, 768)[FLOAT]], [2634 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: Add_1679 for ONNX node: Add_1679 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2635 for ONNX tensor: 2635 [01/12/2022-09:32:56] [V] [TRT] Add_1679 [Add] outputs: [2635 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: ReduceMean_1680 [ReduceMean] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2635 [01/12/2022-09:32:56] [V] [TRT] ReduceMean_1680 [ReduceMean] inputs: [2635 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: ReduceMean_1680 for ONNX node: ReduceMean_1680 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2636 for ONNX tensor: 2636 [01/12/2022-09:32:56] [V] [TRT] ReduceMean_1680 [ReduceMean] outputs: [2636 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Sub_1681 [Sub] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2635 [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2636 [01/12/2022-09:32:56] [V] [TRT] Sub_1681 [Sub] inputs: [2635 -> (-1, -1, 768)[FLOAT]], [2636 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: Sub_1681 for ONNX node: Sub_1681 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2637 for ONNX tensor: 2637 [01/12/2022-09:32:56] [V] [TRT] Sub_1681 [Sub] outputs: [2637 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Constant_1682 [Constant] [01/12/2022-09:32:56] [V] [TRT] Constant_1682 [Constant] inputs: [01/12/2022-09:32:56] [V] [TRT] Constant_1682 [Constant] outputs: [2638 -> ()[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Pow_1683 [Pow] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2637 [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2638 [01/12/2022-09:32:56] [V] [TRT] Pow_1683 [Pow] inputs: [2637 -> (-1, -1, 768)[FLOAT]], [2638 -> ()[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: 2638 for ONNX node: 2638 [01/12/2022-09:32:56] [V] [TRT] Registering layer: Pow_1683 for ONNX node: Pow_1683 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2639 for ONNX tensor: 2639 [01/12/2022-09:32:56] [V] [TRT] Pow_1683 [Pow] outputs: [2639 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: ReduceMean_1684 [ReduceMean] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2639 [01/12/2022-09:32:56] [V] [TRT] ReduceMean_1684 [ReduceMean] inputs: [2639 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: ReduceMean_1684 for ONNX node: ReduceMean_1684 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2640 for ONNX tensor: 2640 [01/12/2022-09:32:56] [V] [TRT] ReduceMean_1684 [ReduceMean] outputs: [2640 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Constant_1685 [Constant] [01/12/2022-09:32:56] [V] [TRT] Constant_1685 [Constant] inputs: [01/12/2022-09:32:56] [V] [TRT] Constant_1685 [Constant] outputs: [2641 -> ()[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Add_1686 [Add] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2640 [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2641 [01/12/2022-09:32:56] [V] [TRT] Add_1686 [Add] inputs: [2640 -> (-1, -1, 1)[FLOAT]], [2641 -> ()[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: 2641 for ONNX node: 2641 [01/12/2022-09:32:56] [V] [TRT] Registering layer: Add_1686 for ONNX node: Add_1686 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2642 for ONNX tensor: 2642 [01/12/2022-09:32:56] [V] [TRT] Add_1686 [Add] outputs: [2642 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Sqrt_1687 [Sqrt] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2642 [01/12/2022-09:32:56] [V] [TRT] Sqrt_1687 [Sqrt] inputs: [2642 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: Sqrt_1687 for ONNX node: Sqrt_1687 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2643 for ONNX tensor: 2643 [01/12/2022-09:32:56] [V] [TRT] Sqrt_1687 [Sqrt] outputs: [2643 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Div_1688 [Div] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2637 [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2643 [01/12/2022-09:32:56] [V] [TRT] Div_1688 [Div] inputs: [2637 -> (-1, -1, 768)[FLOAT]], [2643 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: Div_1688 for ONNX node: Div_1688 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2644 for ONNX tensor: 2644 [01/12/2022-09:32:56] [V] [TRT] Div_1688 [Div] outputs: [2644 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Mul_1689 [Mul] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2644 [01/12/2022-09:32:56] [V] [TRT] Searching for input: decoder.layers.5.self_attn_layer_norm.weight [01/12/2022-09:32:56] [V] [TRT] Mul_1689 [Mul] inputs: [2644 -> (-1, -1, 768)[FLOAT]], [decoder.layers.5.self_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: decoder.layers.5.self_attn_layer_norm.weight for ONNX node: decoder.layers.5.self_attn_layer_norm.weight [01/12/2022-09:32:56] [V] [TRT] Registering layer: Mul_1689 for ONNX node: Mul_1689 [01/12/2022-09:32:56] [V] [TRT] Registering tensor: 2645 for ONNX tensor: 2645 [01/12/2022-09:32:56] [V] [TRT] Mul_1689 [Mul] outputs: [2645 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Parsing node: Add_1690 [Add] [01/12/2022-09:32:56] [V] [TRT] Searching for input: 2645 [01/12/2022-09:32:56] [V] [TRT] Searching for input: decoder.layers.5.self_attn_layer_norm.bias [01/12/2022-09:32:56] [V] [TRT] Add_1690 [Add] inputs: [2645 -> (-1, -1, 768)[FLOAT]], [decoder.layers.5.self_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:32:56] [V] [TRT] Registering layer: decoder.layers.5.self_attn_layer_norm.bias for ONNX node: decoder.layers.5.self_attn_layer_norm.bias [01/12/2022-09:32:57] [V] [TRT] Registering layer: Add_1690 for ONNX node: Add_1690 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2646 for ONNX tensor: 2646 [01/12/2022-09:32:57] [V] [TRT] Add_1690 [Add] outputs: [2646 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Shape_1691 [Shape] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2646 [01/12/2022-09:32:57] [V] [TRT] Shape_1691 [Shape] inputs: [2646 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: Shape_1691 for ONNX node: Shape_1691 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2647 for ONNX tensor: 2647 [01/12/2022-09:32:57] [V] [TRT] Shape_1691 [Shape] outputs: [2647 -> (3)[INT32]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Constant_1692 [Constant] [01/12/2022-09:32:57] [V] [TRT] Constant_1692 [Constant] inputs: [01/12/2022-09:32:57] [V] [TRT] Constant_1692 [Constant] outputs: [2648 -> ()[INT32]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Gather_1693 [Gather] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2647 [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2648 [01/12/2022-09:32:57] [V] [TRT] Gather_1693 [Gather] inputs: [2647 -> (3)[INT32]], [2648 -> ()[INT32]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: 2648 for ONNX node: 2648 [01/12/2022-09:32:57] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:57] [V] [TRT] Registering layer: Gather_1693 for ONNX node: Gather_1693 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2649 for ONNX tensor: 2649 [01/12/2022-09:32:57] [V] [TRT] Gather_1693 [Gather] outputs: [2649 -> ()[INT32]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Shape_1694 [Shape] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2646 [01/12/2022-09:32:57] [V] [TRT] Shape_1694 [Shape] inputs: [2646 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: Shape_1694 for ONNX node: Shape_1694 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2650 for ONNX tensor: 2650 [01/12/2022-09:32:57] [V] [TRT] Shape_1694 [Shape] outputs: [2650 -> (3)[INT32]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Constant_1695 [Constant] [01/12/2022-09:32:57] [V] [TRT] Constant_1695 [Constant] inputs: [01/12/2022-09:32:57] [V] [TRT] Constant_1695 [Constant] outputs: [2651 -> ()[INT32]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Gather_1696 [Gather] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2650 [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2651 [01/12/2022-09:32:57] [V] [TRT] Gather_1696 [Gather] inputs: [2650 -> (3)[INT32]], [2651 -> ()[INT32]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: 2651 for ONNX node: 2651 [01/12/2022-09:32:57] [V] [TRT] Using Gather axis: 0 [01/12/2022-09:32:57] [V] [TRT] Registering layer: Gather_1696 for ONNX node: Gather_1696 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2652 for ONNX tensor: 2652 [01/12/2022-09:32:57] [V] [TRT] Gather_1696 [Gather] outputs: [2652 -> ()[INT32]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: MatMul_1697 [MatMul] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2646 [01/12/2022-09:32:57] [V] [TRT] Searching for input: 3169 [01/12/2022-09:32:57] [V] [TRT] MatMul_1697 [MatMul] inputs: [2646 -> (-1, -1, 768)[FLOAT]], [3169 -> (768, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: 3169 for ONNX node: 3169 [01/12/2022-09:32:57] [V] [TRT] Registering layer: MatMul_1697 for ONNX node: MatMul_1697 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2654 for ONNX tensor: 2654 [01/12/2022-09:32:57] [V] [TRT] MatMul_1697 [MatMul] outputs: [2654 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Add_1698 [Add] [01/12/2022-09:32:57] [V] [TRT] Searching for input: decoder.layers.5.encoder_attn.q_proj.bias [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2654 [01/12/2022-09:32:57] [V] [TRT] Add_1698 [Add] inputs: [decoder.layers.5.encoder_attn.q_proj.bias -> (768)[FLOAT]], [2654 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: decoder.layers.5.encoder_attn.q_proj.bias for ONNX node: decoder.layers.5.encoder_attn.q_proj.bias [01/12/2022-09:32:57] [V] [TRT] Registering layer: Add_1698 for ONNX node: Add_1698 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2655 for ONNX tensor: 2655 [01/12/2022-09:32:57] [V] [TRT] Add_1698 [Add] outputs: [2655 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Constant_1699 [Constant] [01/12/2022-09:32:57] [V] [TRT] Constant_1699 [Constant] inputs: [01/12/2022-09:32:57] [V] [TRT] Constant_1699 [Constant] outputs: [2656 -> ()[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: Mul_1700 [Mul] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2655 [01/12/2022-09:32:57] [V] [TRT] Searching for input: 2656 [01/12/2022-09:32:57] [V] [TRT] Mul_1700 [Mul] inputs: [2655 -> (-1, -1, 768)[FLOAT]], [2656 -> ()[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: 2656 for ONNX node: 2656 [01/12/2022-09:32:57] [V] [TRT] Registering layer: Mul_1700 for ONNX node: Mul_1700 [01/12/2022-09:32:57] [V] [TRT] Registering tensor: 2657 for ONNX tensor: 2657 [01/12/2022-09:32:57] [V] [TRT] Mul_1700 [Mul] outputs: [2657 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Parsing node: MatMul_1701 [MatMul] [01/12/2022-09:32:57] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:57] [V] [TRT] Searching for input: 3170 [01/12/2022-09:32:57] [V] [TRT] MatMul_1701 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3170 -> (768, 768)[FLOAT]], [01/12/2022-09:32:57] [V] [TRT] Registering layer: 3170 for ONNX node: 3170 [01/12/2022-09:32:58] [V] [TRT] Registering layer: MatMul_1701 for ONNX node: MatMul_1701 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2659 for ONNX tensor: 2659 [01/12/2022-09:32:58] [V] [TRT] MatMul_1701 [MatMul] outputs: [2659 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Add_1702 [Add] [01/12/2022-09:32:58] [V] [TRT] Searching for input: decoder.layers.5.encoder_attn.k_proj.bias [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2659 [01/12/2022-09:32:58] [V] [TRT] Add_1702 [Add] inputs: [decoder.layers.5.encoder_attn.k_proj.bias -> (768)[FLOAT]], [2659 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: decoder.layers.5.encoder_attn.k_proj.bias for ONNX node: decoder.layers.5.encoder_attn.k_proj.bias [01/12/2022-09:32:58] [V] [TRT] Registering layer: Add_1702 for ONNX node: Add_1702 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2660 for ONNX tensor: 2660 [01/12/2022-09:32:58] [V] [TRT] Add_1702 [Add] outputs: [2660 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Unsqueeze_1703 [Unsqueeze] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2649 [01/12/2022-09:32:58] [V] [TRT] Unsqueeze_1703 [Unsqueeze] inputs: [2649 -> ()[INT32]], [01/12/2022-09:32:58] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:58] [V] [TRT] Registering layer: Unsqueeze_1703 for ONNX node: Unsqueeze_1703 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2664 for ONNX tensor: 2664 [01/12/2022-09:32:58] [V] [TRT] Unsqueeze_1703 [Unsqueeze] outputs: [2664 -> (1)[INT32]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Concat_1704 [Concat] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2664 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3171 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3172 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3173 [01/12/2022-09:32:58] [V] [TRT] Concat_1704 [Concat] inputs: [2664 -> (1)[INT32]], [3171 -> (1)[INT32]], [3172 -> (1)[INT32]], [3173 -> (1)[INT32]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3171 for ONNX node: 3171 [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3172 for ONNX node: 3172 [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3173 for ONNX node: 3173 [01/12/2022-09:32:58] [V] [TRT] Registering layer: Concat_1704 for ONNX node: Concat_1704 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2668 for ONNX tensor: 2668 [01/12/2022-09:32:58] [V] [TRT] Concat_1704 [Concat] outputs: [2668 -> (4)[INT32]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Reshape_1705 [Reshape] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2660 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2668 [01/12/2022-09:32:58] [V] [TRT] Reshape_1705 [Reshape] inputs: [2660 -> (-1, -1, 768)[FLOAT]], [2668 -> (4)[INT32]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: Reshape_1705 for ONNX node: Reshape_1705 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2669 for ONNX tensor: 2669 [01/12/2022-09:32:58] [V] [TRT] Reshape_1705 [Reshape] outputs: [2669 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Transpose_1706 [Transpose] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2669 [01/12/2022-09:32:58] [V] [TRT] Transpose_1706 [Transpose] inputs: [2669 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: Transpose_1706 for ONNX node: Transpose_1706 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2670_24 for ONNX tensor: 2670 [01/12/2022-09:32:58] [V] [TRT] Transpose_1706 [Transpose] outputs: [2670 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: MatMul_1707 [MatMul] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 1186 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3174 [01/12/2022-09:32:58] [V] [TRT] MatMul_1707 [MatMul] inputs: [1186 -> (-1, -1, 768)[FLOAT]], [3174 -> (768, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3174 for ONNX node: 3174 [01/12/2022-09:32:58] [V] [TRT] Registering layer: MatMul_1707 for ONNX node: MatMul_1707 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2672 for ONNX tensor: 2672 [01/12/2022-09:32:58] [V] [TRT] MatMul_1707 [MatMul] outputs: [2672 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Add_1708 [Add] [01/12/2022-09:32:58] [V] [TRT] Searching for input: decoder.layers.5.encoder_attn.v_proj.bias [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2672 [01/12/2022-09:32:58] [V] [TRT] Add_1708 [Add] inputs: [decoder.layers.5.encoder_attn.v_proj.bias -> (768)[FLOAT]], [2672 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: decoder.layers.5.encoder_attn.v_proj.bias for ONNX node: decoder.layers.5.encoder_attn.v_proj.bias [01/12/2022-09:32:58] [V] [TRT] Registering layer: Add_1708 for ONNX node: Add_1708 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2673 for ONNX tensor: 2673 [01/12/2022-09:32:58] [V] [TRT] Add_1708 [Add] outputs: [2673 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Unsqueeze_1709 [Unsqueeze] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2649 [01/12/2022-09:32:58] [V] [TRT] Unsqueeze_1709 [Unsqueeze] inputs: [2649 -> ()[INT32]], [01/12/2022-09:32:58] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:58] [V] [TRT] Registering layer: Unsqueeze_1709 for ONNX node: Unsqueeze_1709 [01/12/2022-09:32:58] [V] [TRT] Registering tensor: 2677 for ONNX tensor: 2677 [01/12/2022-09:32:58] [V] [TRT] Unsqueeze_1709 [Unsqueeze] outputs: [2677 -> (1)[INT32]], [01/12/2022-09:32:58] [V] [TRT] Parsing node: Concat_1710 [Concat] [01/12/2022-09:32:58] [V] [TRT] Searching for input: 2677 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3175 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3176 [01/12/2022-09:32:58] [V] [TRT] Searching for input: 3177 [01/12/2022-09:32:58] [V] [TRT] Concat_1710 [Concat] inputs: [2677 -> (1)[INT32]], [3175 -> (1)[INT32]], [3176 -> (1)[INT32]], [3177 -> (1)[INT32]], [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3175 for ONNX node: 3175 [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3176 for ONNX node: 3176 [01/12/2022-09:32:58] [V] [TRT] Registering layer: 3177 for ONNX node: 3177 [01/12/2022-09:32:58] [V] [TRT] Registering layer: Concat_1710 for ONNX node: Concat_1710 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2681 for ONNX tensor: 2681 [01/12/2022-09:32:59] [V] [TRT] Concat_1710 [Concat] outputs: [2681 -> (4)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Reshape_1711 [Reshape] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2673 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2681 [01/12/2022-09:32:59] [V] [TRT] Reshape_1711 [Reshape] inputs: [2673 -> (-1, -1, 768)[FLOAT]], [2681 -> (4)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: Reshape_1711 for ONNX node: Reshape_1711 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2682 for ONNX tensor: 2682 [01/12/2022-09:32:59] [V] [TRT] Reshape_1711 [Reshape] outputs: [2682 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Transpose_1712 [Transpose] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2682 [01/12/2022-09:32:59] [V] [TRT] Transpose_1712 [Transpose] inputs: [2682 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: Transpose_1712 for ONNX node: Transpose_1712 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2683_25 for ONNX tensor: 2683 [01/12/2022-09:32:59] [V] [TRT] Transpose_1712 [Transpose] outputs: [2683 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Constant_1713 [Constant] [01/12/2022-09:32:59] [V] [TRT] Constant_1713 [Constant] inputs: [01/12/2022-09:32:59] [V] [TRT] Constant_1713 [Constant] outputs: [2684 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Mul_1714 [Mul] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2649 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2684 [01/12/2022-09:32:59] [V] [TRT] Mul_1714 [Mul] inputs: [2649 -> ()[INT32]], [2684 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: 2684 for ONNX node: 2684 [01/12/2022-09:32:59] [V] [TRT] Registering layer: Mul_1714 for ONNX node: Mul_1714 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2685 for ONNX tensor: 2685 [01/12/2022-09:32:59] [V] [TRT] Mul_1714 [Mul] outputs: [2685 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Unsqueeze_1715 [Unsqueeze] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2649 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1715 [Unsqueeze] inputs: [2649 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:59] [V] [TRT] Registering layer: Unsqueeze_1715 for ONNX node: Unsqueeze_1715 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2688 for ONNX tensor: 2688 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1715 [Unsqueeze] outputs: [2688 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Unsqueeze_1716 [Unsqueeze] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2652 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1716 [Unsqueeze] inputs: [2652 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:59] [V] [TRT] Registering layer: Unsqueeze_1716 for ONNX node: Unsqueeze_1716 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2689 for ONNX tensor: 2689 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1716 [Unsqueeze] outputs: [2689 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Concat_1717 [Concat] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2688 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2689 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 3178 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 3179 [01/12/2022-09:32:59] [V] [TRT] Concat_1717 [Concat] inputs: [2688 -> (1)[INT32]], [2689 -> (1)[INT32]], [3178 -> (1)[INT32]], [3179 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: 3178 for ONNX node: 3178 [01/12/2022-09:32:59] [V] [TRT] Registering layer: 3179 for ONNX node: 3179 [01/12/2022-09:32:59] [V] [TRT] Registering layer: Concat_1717 for ONNX node: Concat_1717 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2692 for ONNX tensor: 2692 [01/12/2022-09:32:59] [V] [TRT] Concat_1717 [Concat] outputs: [2692 -> (4)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Reshape_1718 [Reshape] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2657 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2692 [01/12/2022-09:32:59] [V] [TRT] Reshape_1718 [Reshape] inputs: [2657 -> (-1, -1, 768)[FLOAT]], [2692 -> (4)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: Reshape_1718 for ONNX node: Reshape_1718 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2693 for ONNX tensor: 2693 [01/12/2022-09:32:59] [V] [TRT] Reshape_1718 [Reshape] outputs: [2693 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Transpose_1719 [Transpose] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2693 [01/12/2022-09:32:59] [V] [TRT] Transpose_1719 [Transpose] inputs: [2693 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: Transpose_1719 for ONNX node: Transpose_1719 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2694 for ONNX tensor: 2694 [01/12/2022-09:32:59] [V] [TRT] Transpose_1719 [Transpose] outputs: [2694 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Unsqueeze_1720 [Unsqueeze] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2685 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1720 [Unsqueeze] inputs: [2685 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:59] [V] [TRT] Registering layer: Unsqueeze_1720 for ONNX node: Unsqueeze_1720 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2697 for ONNX tensor: 2697 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1720 [Unsqueeze] outputs: [2697 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Concat_1721 [Concat] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2697 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 3180 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 3181 [01/12/2022-09:32:59] [V] [TRT] Concat_1721 [Concat] inputs: [2697 -> (1)[INT32]], [3180 -> (1)[INT32]], [3181 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: 3180 for ONNX node: 3180 [01/12/2022-09:32:59] [V] [TRT] Registering layer: 3181 for ONNX node: 3181 [01/12/2022-09:32:59] [V] [TRT] Registering layer: Concat_1721 for ONNX node: Concat_1721 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2700 for ONNX tensor: 2700 [01/12/2022-09:32:59] [V] [TRT] Concat_1721 [Concat] outputs: [2700 -> (3)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Reshape_1722 [Reshape] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2694 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2700 [01/12/2022-09:32:59] [V] [TRT] Reshape_1722 [Reshape] inputs: [2694 -> (-1, 12, -1, 64)[FLOAT]], [2700 -> (3)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: Reshape_1722 for ONNX node: Reshape_1722 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2701 for ONNX tensor: 2701 [01/12/2022-09:32:59] [V] [TRT] Reshape_1722 [Reshape] outputs: [2701 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Unsqueeze_1723 [Unsqueeze] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2685 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1723 [Unsqueeze] inputs: [2685 -> ()[INT32]], [01/12/2022-09:32:59] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:32:59] [V] [TRT] Registering layer: Unsqueeze_1723 for ONNX node: Unsqueeze_1723 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2704 for ONNX tensor: 2704 [01/12/2022-09:32:59] [V] [TRT] Unsqueeze_1723 [Unsqueeze] outputs: [2704 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Concat_1724 [Concat] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2704 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 3182 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 3183 [01/12/2022-09:32:59] [V] [TRT] Concat_1724 [Concat] inputs: [2704 -> (1)[INT32]], [3182 -> (1)[INT32]], [3183 -> (1)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: 3182 for ONNX node: 3182 [01/12/2022-09:32:59] [V] [TRT] Registering layer: 3183 for ONNX node: 3183 [01/12/2022-09:32:59] [V] [TRT] Registering layer: Concat_1724 for ONNX node: Concat_1724 [01/12/2022-09:32:59] [V] [TRT] Registering tensor: 2707 for ONNX tensor: 2707 [01/12/2022-09:32:59] [V] [TRT] Concat_1724 [Concat] outputs: [2707 -> (3)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Parsing node: Reshape_1725 [Reshape] [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2670 [01/12/2022-09:32:59] [V] [TRT] Searching for input: 2707 [01/12/2022-09:32:59] [V] [TRT] Reshape_1725 [Reshape] inputs: [2670 -> (-1, 12, -1, 64)[FLOAT]], [2707 -> (3)[INT32]], [01/12/2022-09:32:59] [V] [TRT] Registering layer: Reshape_1725 for ONNX node: Reshape_1725 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2708 for ONNX tensor: 2708 [01/12/2022-09:33:00] [V] [TRT] Reshape_1725 [Reshape] outputs: [2708 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Unsqueeze_1726 [Unsqueeze] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2685 [01/12/2022-09:33:00] [V] [TRT] Unsqueeze_1726 [Unsqueeze] inputs: [2685 -> ()[INT32]], [01/12/2022-09:33:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:33:00] [V] [TRT] Registering layer: Unsqueeze_1726 for ONNX node: Unsqueeze_1726 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2711 for ONNX tensor: 2711 [01/12/2022-09:33:00] [V] [TRT] Unsqueeze_1726 [Unsqueeze] outputs: [2711 -> (1)[INT32]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Concat_1727 [Concat] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2711 [01/12/2022-09:33:00] [V] [TRT] Searching for input: 3184 [01/12/2022-09:33:00] [V] [TRT] Searching for input: 3185 [01/12/2022-09:33:00] [V] [TRT] Concat_1727 [Concat] inputs: [2711 -> (1)[INT32]], [3184 -> (1)[INT32]], [3185 -> (1)[INT32]], [01/12/2022-09:33:00] [V] [TRT] Registering layer: 3184 for ONNX node: 3184 [01/12/2022-09:33:00] [V] [TRT] Registering layer: 3185 for ONNX node: 3185 [01/12/2022-09:33:00] [V] [TRT] Registering layer: Concat_1727 for ONNX node: Concat_1727 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2714 for ONNX tensor: 2714 [01/12/2022-09:33:00] [V] [TRT] Concat_1727 [Concat] outputs: [2714 -> (3)[INT32]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Reshape_1728 [Reshape] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2683 [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2714 [01/12/2022-09:33:00] [V] [TRT] Reshape_1728 [Reshape] inputs: [2683 -> (-1, 12, -1, 64)[FLOAT]], [2714 -> (3)[INT32]], [01/12/2022-09:33:00] [V] [TRT] Registering layer: Reshape_1728 for ONNX node: Reshape_1728 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2715 for ONNX tensor: 2715 [01/12/2022-09:33:00] [V] [TRT] Reshape_1728 [Reshape] outputs: [2715 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Transpose_1729 [Transpose] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2708 [01/12/2022-09:33:00] [V] [TRT] Transpose_1729 [Transpose] inputs: [2708 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Registering layer: Transpose_1729 for ONNX node: Transpose_1729 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2716 for ONNX tensor: 2716 [01/12/2022-09:33:00] [V] [TRT] Transpose_1729 [Transpose] outputs: [2716 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: MatMul_1730 [MatMul] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2701 [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2716 [01/12/2022-09:33:00] [V] [TRT] MatMul_1730 [MatMul] inputs: [2701 -> (-1, -1, 64)[FLOAT]], [2716 -> (-1, 64, -1)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Registering layer: MatMul_1730 for ONNX node: MatMul_1730 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2717 for ONNX tensor: 2717 [01/12/2022-09:33:00] [V] [TRT] MatMul_1730 [MatMul] outputs: [2717 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Softmax_1731 [Softmax] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2717 [01/12/2022-09:33:00] [V] [TRT] Softmax_1731 [Softmax] inputs: [2717 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Registering layer: Softmax_1731 for ONNX node: Softmax_1731 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2718 for ONNX tensor: 2718 [01/12/2022-09:33:00] [V] [TRT] Softmax_1731 [Softmax] outputs: [2718 -> (-1, -1, -1)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: MatMul_1732 [MatMul] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2718 [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2715 [01/12/2022-09:33:00] [V] [TRT] MatMul_1732 [MatMul] inputs: [2718 -> (-1, -1, -1)[FLOAT]], [2715 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Registering layer: MatMul_1732 for ONNX node: MatMul_1732 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2719 for ONNX tensor: 2719 [01/12/2022-09:33:00] [V] [TRT] MatMul_1732 [MatMul] outputs: [2719 -> (-1, -1, 64)[FLOAT]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Unsqueeze_1733 [Unsqueeze] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2649 [01/12/2022-09:33:00] [V] [TRT] Unsqueeze_1733 [Unsqueeze] inputs: [2649 -> ()[INT32]], [01/12/2022-09:33:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:33:00] [V] [TRT] Registering layer: Unsqueeze_1733 for ONNX node: Unsqueeze_1733 [01/12/2022-09:33:00] [V] [TRT] Registering tensor: 2722 for ONNX tensor: 2722 [01/12/2022-09:33:00] [V] [TRT] Unsqueeze_1733 [Unsqueeze] outputs: [2722 -> (1)[INT32]], [01/12/2022-09:33:00] [V] [TRT] Parsing node: Unsqueeze_1734 [Unsqueeze] [01/12/2022-09:33:00] [V] [TRT] Searching for input: 2652 [01/12/2022-09:33:00] [V] [TRT] Unsqueeze_1734 [Unsqueeze] inputs: [2652 -> ()[INT32]], [01/12/2022-09:33:00] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:33:00] [V] [TRT] Registering layer: Unsqueeze_1734 for ONNX node: Unsqueeze_1734 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2724 for ONNX tensor: 2724 [01/12/2022-09:33:01] [V] [TRT] Unsqueeze_1734 [Unsqueeze] outputs: [2724 -> (1)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Concat_1735 [Concat] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2722 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 3186 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2724 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 3187 [01/12/2022-09:33:01] [V] [TRT] Concat_1735 [Concat] inputs: [2722 -> (1)[INT32]], [3186 -> (1)[INT32]], [2724 -> (1)[INT32]], [3187 -> (1)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: 3186 for ONNX node: 3186 [01/12/2022-09:33:01] [V] [TRT] Registering layer: 3187 for ONNX node: 3187 [01/12/2022-09:33:01] [V] [TRT] Registering layer: Concat_1735 for ONNX node: Concat_1735 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2726 for ONNX tensor: 2726 [01/12/2022-09:33:01] [V] [TRT] Concat_1735 [Concat] outputs: [2726 -> (4)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Reshape_1736 [Reshape] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2719 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2726 [01/12/2022-09:33:01] [V] [TRT] Reshape_1736 [Reshape] inputs: [2719 -> (-1, -1, 64)[FLOAT]], [2726 -> (4)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: Reshape_1736 for ONNX node: Reshape_1736 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2727 for ONNX tensor: 2727 [01/12/2022-09:33:01] [V] [TRT] Reshape_1736 [Reshape] outputs: [2727 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Transpose_1737 [Transpose] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2727 [01/12/2022-09:33:01] [V] [TRT] Transpose_1737 [Transpose] inputs: [2727 -> (-1, 12, -1, 64)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: Transpose_1737 for ONNX node: Transpose_1737 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2728 for ONNX tensor: 2728 [01/12/2022-09:33:01] [V] [TRT] Transpose_1737 [Transpose] outputs: [2728 -> (-1, -1, 12, 64)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Unsqueeze_1738 [Unsqueeze] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2649 [01/12/2022-09:33:01] [V] [TRT] Unsqueeze_1738 [Unsqueeze] inputs: [2649 -> ()[INT32]], [01/12/2022-09:33:01] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:33:01] [V] [TRT] Registering layer: Unsqueeze_1738 for ONNX node: Unsqueeze_1738 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2730 for ONNX tensor: 2730 [01/12/2022-09:33:01] [V] [TRT] Unsqueeze_1738 [Unsqueeze] outputs: [2730 -> (1)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Unsqueeze_1739 [Unsqueeze] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2652 [01/12/2022-09:33:01] [V] [TRT] Unsqueeze_1739 [Unsqueeze] inputs: [2652 -> ()[INT32]], [01/12/2022-09:33:01] [V] [TRT] Original shape: (), unsqueezing to: (1,) [01/12/2022-09:33:01] [V] [TRT] Registering layer: Unsqueeze_1739 for ONNX node: Unsqueeze_1739 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2731 for ONNX tensor: 2731 [01/12/2022-09:33:01] [V] [TRT] Unsqueeze_1739 [Unsqueeze] outputs: [2731 -> (1)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Concat_1740 [Concat] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2730 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2731 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 3188 [01/12/2022-09:33:01] [V] [TRT] Concat_1740 [Concat] inputs: [2730 -> (1)[INT32]], [2731 -> (1)[INT32]], [3188 -> (1)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: 3188 for ONNX node: 3188 [01/12/2022-09:33:01] [V] [TRT] Registering layer: Concat_1740 for ONNX node: Concat_1740 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2733 for ONNX tensor: 2733 [01/12/2022-09:33:01] [V] [TRT] Concat_1740 [Concat] outputs: [2733 -> (3)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Reshape_1741 [Reshape] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2728 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2733 [01/12/2022-09:33:01] [V] [TRT] Reshape_1741 [Reshape] inputs: [2728 -> (-1, -1, 12, 64)[FLOAT]], [2733 -> (3)[INT32]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: Reshape_1741 for ONNX node: Reshape_1741 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2734 for ONNX tensor: 2734 [01/12/2022-09:33:01] [V] [TRT] Reshape_1741 [Reshape] outputs: [2734 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: MatMul_1742 [MatMul] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2734 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 3189 [01/12/2022-09:33:01] [V] [TRT] MatMul_1742 [MatMul] inputs: [2734 -> (-1, -1, 768)[FLOAT]], [3189 -> (768, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: 3189 for ONNX node: 3189 [01/12/2022-09:33:01] [V] [TRT] Registering layer: MatMul_1742 for ONNX node: MatMul_1742 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2736 for ONNX tensor: 2736 [01/12/2022-09:33:01] [V] [TRT] MatMul_1742 [MatMul] outputs: [2736 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Add_1743 [Add] [01/12/2022-09:33:01] [V] [TRT] Searching for input: decoder.layers.5.encoder_attn.out_proj.bias [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2736 [01/12/2022-09:33:01] [V] [TRT] Add_1743 [Add] inputs: [decoder.layers.5.encoder_attn.out_proj.bias -> (768)[FLOAT]], [2736 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: decoder.layers.5.encoder_attn.out_proj.bias for ONNX node: decoder.layers.5.encoder_attn.out_proj.bias [01/12/2022-09:33:01] [V] [TRT] Registering layer: Add_1743 for ONNX node: Add_1743 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2737 for ONNX tensor: 2737 [01/12/2022-09:33:01] [V] [TRT] Add_1743 [Add] outputs: [2737 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: Add_1744 [Add] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2646 [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2737 [01/12/2022-09:33:01] [V] [TRT] Add_1744 [Add] inputs: [2646 -> (-1, -1, 768)[FLOAT]], [2737 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: Add_1744 for ONNX node: Add_1744 [01/12/2022-09:33:01] [V] [TRT] Registering tensor: 2738 for ONNX tensor: 2738 [01/12/2022-09:33:01] [V] [TRT] Add_1744 [Add] outputs: [2738 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Parsing node: ReduceMean_1745 [ReduceMean] [01/12/2022-09:33:01] [V] [TRT] Searching for input: 2738 [01/12/2022-09:33:01] [V] [TRT] ReduceMean_1745 [ReduceMean] inputs: [2738 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:01] [V] [TRT] Registering layer: ReduceMean_1745 for ONNX node: ReduceMean_1745 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2739 for ONNX tensor: 2739 [01/12/2022-09:33:02] [V] [TRT] ReduceMean_1745 [ReduceMean] outputs: [2739 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Sub_1746 [Sub] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2738 [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2739 [01/12/2022-09:33:02] [V] [TRT] Sub_1746 [Sub] inputs: [2738 -> (-1, -1, 768)[FLOAT]], [2739 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: Sub_1746 for ONNX node: Sub_1746 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2740 for ONNX tensor: 2740 [01/12/2022-09:33:02] [V] [TRT] Sub_1746 [Sub] outputs: [2740 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Constant_1747 [Constant] [01/12/2022-09:33:02] [V] [TRT] Constant_1747 [Constant] inputs: [01/12/2022-09:33:02] [V] [TRT] Constant_1747 [Constant] outputs: [2741 -> ()[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Pow_1748 [Pow] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2740 [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2741 [01/12/2022-09:33:02] [V] [TRT] Pow_1748 [Pow] inputs: [2740 -> (-1, -1, 768)[FLOAT]], [2741 -> ()[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: 2741 for ONNX node: 2741 [01/12/2022-09:33:02] [V] [TRT] Registering layer: Pow_1748 for ONNX node: Pow_1748 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2742 for ONNX tensor: 2742 [01/12/2022-09:33:02] [V] [TRT] Pow_1748 [Pow] outputs: [2742 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: ReduceMean_1749 [ReduceMean] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2742 [01/12/2022-09:33:02] [V] [TRT] ReduceMean_1749 [ReduceMean] inputs: [2742 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: ReduceMean_1749 for ONNX node: ReduceMean_1749 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2743 for ONNX tensor: 2743 [01/12/2022-09:33:02] [V] [TRT] ReduceMean_1749 [ReduceMean] outputs: [2743 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Constant_1750 [Constant] [01/12/2022-09:33:02] [V] [TRT] Constant_1750 [Constant] inputs: [01/12/2022-09:33:02] [V] [TRT] Constant_1750 [Constant] outputs: [2744 -> ()[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Add_1751 [Add] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2743 [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2744 [01/12/2022-09:33:02] [V] [TRT] Add_1751 [Add] inputs: [2743 -> (-1, -1, 1)[FLOAT]], [2744 -> ()[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: 2744 for ONNX node: 2744 [01/12/2022-09:33:02] [V] [TRT] Registering layer: Add_1751 for ONNX node: Add_1751 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2745 for ONNX tensor: 2745 [01/12/2022-09:33:02] [V] [TRT] Add_1751 [Add] outputs: [2745 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Sqrt_1752 [Sqrt] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2745 [01/12/2022-09:33:02] [V] [TRT] Sqrt_1752 [Sqrt] inputs: [2745 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: Sqrt_1752 for ONNX node: Sqrt_1752 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2746 for ONNX tensor: 2746 [01/12/2022-09:33:02] [V] [TRT] Sqrt_1752 [Sqrt] outputs: [2746 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Div_1753 [Div] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2740 [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2746 [01/12/2022-09:33:02] [V] [TRT] Div_1753 [Div] inputs: [2740 -> (-1, -1, 768)[FLOAT]], [2746 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: Div_1753 for ONNX node: Div_1753 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2747 for ONNX tensor: 2747 [01/12/2022-09:33:02] [V] [TRT] Div_1753 [Div] outputs: [2747 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Mul_1754 [Mul] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2747 [01/12/2022-09:33:02] [V] [TRT] Searching for input: decoder.layers.5.encoder_attn_layer_norm.weight [01/12/2022-09:33:02] [V] [TRT] Mul_1754 [Mul] inputs: [2747 -> (-1, -1, 768)[FLOAT]], [decoder.layers.5.encoder_attn_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: decoder.layers.5.encoder_attn_layer_norm.weight for ONNX node: decoder.layers.5.encoder_attn_layer_norm.weight [01/12/2022-09:33:02] [V] [TRT] Registering layer: Mul_1754 for ONNX node: Mul_1754 [01/12/2022-09:33:02] [V] [TRT] Registering tensor: 2748 for ONNX tensor: 2748 [01/12/2022-09:33:02] [V] [TRT] Mul_1754 [Mul] outputs: [2748 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Parsing node: Add_1755 [Add] [01/12/2022-09:33:02] [V] [TRT] Searching for input: 2748 [01/12/2022-09:33:02] [V] [TRT] Searching for input: decoder.layers.5.encoder_attn_layer_norm.bias [01/12/2022-09:33:02] [V] [TRT] Add_1755 [Add] inputs: [2748 -> (-1, -1, 768)[FLOAT]], [decoder.layers.5.encoder_attn_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:33:02] [V] [TRT] Registering layer: decoder.layers.5.encoder_attn_layer_norm.bias for ONNX node: decoder.layers.5.encoder_attn_layer_norm.bias [01/12/2022-09:33:02] [V] [TRT] Registering layer: Add_1755 for ONNX node: Add_1755 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2749 for ONNX tensor: 2749 [01/12/2022-09:33:03] [V] [TRT] Add_1755 [Add] outputs: [2749 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: MatMul_1756 [MatMul] [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2749 [01/12/2022-09:33:03] [V] [TRT] Searching for input: 3190 [01/12/2022-09:33:03] [V] [TRT] MatMul_1756 [MatMul] inputs: [2749 -> (-1, -1, 768)[FLOAT]], [3190 -> (768, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: 3190 for ONNX node: 3190 [01/12/2022-09:33:03] [V] [TRT] Registering layer: MatMul_1756 for ONNX node: MatMul_1756 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2751 for ONNX tensor: 2751 [01/12/2022-09:33:03] [V] [TRT] MatMul_1756 [MatMul] outputs: [2751 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Add_1757 [Add] [01/12/2022-09:33:03] [V] [TRT] Searching for input: decoder.layers.5.fc1.bias [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2751 [01/12/2022-09:33:03] [V] [TRT] Add_1757 [Add] inputs: [decoder.layers.5.fc1.bias -> (3072)[FLOAT]], [2751 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: decoder.layers.5.fc1.bias for ONNX node: decoder.layers.5.fc1.bias [01/12/2022-09:33:03] [V] [TRT] Registering layer: Add_1757 for ONNX node: Add_1757 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2752 for ONNX tensor: 2752 [01/12/2022-09:33:03] [V] [TRT] Add_1757 [Add] outputs: [2752 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Constant_1758 [Constant] [01/12/2022-09:33:03] [V] [TRT] Constant_1758 [Constant] inputs: [01/12/2022-09:33:03] [V] [TRT] Constant_1758 [Constant] outputs: [2753 -> ()[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Div_1759 [Div] [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2752 [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2753 [01/12/2022-09:33:03] [V] [TRT] Div_1759 [Div] inputs: [2752 -> (-1, -1, 3072)[FLOAT]], [2753 -> ()[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: 2753 for ONNX node: 2753 [01/12/2022-09:33:03] [V] [TRT] Registering layer: Div_1759 for ONNX node: Div_1759 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2754 for ONNX tensor: 2754 [01/12/2022-09:33:03] [V] [TRT] Div_1759 [Div] outputs: [2754 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Erf_1760 [Erf] [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2754 [01/12/2022-09:33:03] [V] [TRT] Erf_1760 [Erf] inputs: [2754 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: Erf_1760 for ONNX node: Erf_1760 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2755 for ONNX tensor: 2755 [01/12/2022-09:33:03] [V] [TRT] Erf_1760 [Erf] outputs: [2755 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Constant_1761 [Constant] [01/12/2022-09:33:03] [V] [TRT] Constant_1761 [Constant] inputs: [01/12/2022-09:33:03] [V] [TRT] Constant_1761 [Constant] outputs: [2756 -> ()[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Add_1762 [Add] [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2755 [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2756 [01/12/2022-09:33:03] [V] [TRT] Add_1762 [Add] inputs: [2755 -> (-1, -1, 3072)[FLOAT]], [2756 -> ()[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: 2756 for ONNX node: 2756 [01/12/2022-09:33:03] [V] [TRT] Registering layer: Add_1762 for ONNX node: Add_1762 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2757 for ONNX tensor: 2757 [01/12/2022-09:33:03] [V] [TRT] Add_1762 [Add] outputs: [2757 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Mul_1763 [Mul] [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2752 [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2757 [01/12/2022-09:33:03] [V] [TRT] Mul_1763 [Mul] inputs: [2752 -> (-1, -1, 3072)[FLOAT]], [2757 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: Mul_1763 for ONNX node: Mul_1763 [01/12/2022-09:33:03] [V] [TRT] Registering tensor: 2758 for ONNX tensor: 2758 [01/12/2022-09:33:03] [V] [TRT] Mul_1763 [Mul] outputs: [2758 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Constant_1764 [Constant] [01/12/2022-09:33:03] [V] [TRT] Constant_1764 [Constant] inputs: [01/12/2022-09:33:03] [V] [TRT] Constant_1764 [Constant] outputs: [2759 -> ()[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Parsing node: Mul_1765 [Mul] [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2758 [01/12/2022-09:33:03] [V] [TRT] Searching for input: 2759 [01/12/2022-09:33:03] [V] [TRT] Mul_1765 [Mul] inputs: [2758 -> (-1, -1, 3072)[FLOAT]], [2759 -> ()[FLOAT]], [01/12/2022-09:33:03] [V] [TRT] Registering layer: 2759 for ONNX node: 2759 [01/12/2022-09:33:03] [V] [TRT] Registering layer: Mul_1765 for ONNX node: Mul_1765 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2760 for ONNX tensor: 2760 [01/12/2022-09:33:04] [V] [TRT] Mul_1765 [Mul] outputs: [2760 -> (-1, -1, 3072)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: MatMul_1766 [MatMul] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2760 [01/12/2022-09:33:04] [V] [TRT] Searching for input: 3191 [01/12/2022-09:33:04] [V] [TRT] MatMul_1766 [MatMul] inputs: [2760 -> (-1, -1, 3072)[FLOAT]], [3191 -> (3072, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: 3191 for ONNX node: 3191 [01/12/2022-09:33:04] [V] [TRT] Registering layer: MatMul_1766 for ONNX node: MatMul_1766 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2762 for ONNX tensor: 2762 [01/12/2022-09:33:04] [V] [TRT] MatMul_1766 [MatMul] outputs: [2762 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Add_1767 [Add] [01/12/2022-09:33:04] [V] [TRT] Searching for input: decoder.layers.5.fc2.bias [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2762 [01/12/2022-09:33:04] [V] [TRT] Add_1767 [Add] inputs: [decoder.layers.5.fc2.bias -> (768)[FLOAT]], [2762 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: decoder.layers.5.fc2.bias for ONNX node: decoder.layers.5.fc2.bias [01/12/2022-09:33:04] [V] [TRT] Registering layer: Add_1767 for ONNX node: Add_1767 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2763 for ONNX tensor: 2763 [01/12/2022-09:33:04] [V] [TRT] Add_1767 [Add] outputs: [2763 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Add_1768 [Add] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2749 [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2763 [01/12/2022-09:33:04] [V] [TRT] Add_1768 [Add] inputs: [2749 -> (-1, -1, 768)[FLOAT]], [2763 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: Add_1768 for ONNX node: Add_1768 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2764 for ONNX tensor: 2764 [01/12/2022-09:33:04] [V] [TRT] Add_1768 [Add] outputs: [2764 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: ReduceMean_1769 [ReduceMean] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2764 [01/12/2022-09:33:04] [V] [TRT] ReduceMean_1769 [ReduceMean] inputs: [2764 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: ReduceMean_1769 for ONNX node: ReduceMean_1769 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2765 for ONNX tensor: 2765 [01/12/2022-09:33:04] [V] [TRT] ReduceMean_1769 [ReduceMean] outputs: [2765 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Sub_1770 [Sub] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2764 [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2765 [01/12/2022-09:33:04] [V] [TRT] Sub_1770 [Sub] inputs: [2764 -> (-1, -1, 768)[FLOAT]], [2765 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: Sub_1770 for ONNX node: Sub_1770 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2766 for ONNX tensor: 2766 [01/12/2022-09:33:04] [V] [TRT] Sub_1770 [Sub] outputs: [2766 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Constant_1771 [Constant] [01/12/2022-09:33:04] [V] [TRT] Constant_1771 [Constant] inputs: [01/12/2022-09:33:04] [V] [TRT] Constant_1771 [Constant] outputs: [2767 -> ()[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Pow_1772 [Pow] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2766 [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2767 [01/12/2022-09:33:04] [V] [TRT] Pow_1772 [Pow] inputs: [2766 -> (-1, -1, 768)[FLOAT]], [2767 -> ()[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: 2767 for ONNX node: 2767 [01/12/2022-09:33:04] [V] [TRT] Registering layer: Pow_1772 for ONNX node: Pow_1772 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2768 for ONNX tensor: 2768 [01/12/2022-09:33:04] [V] [TRT] Pow_1772 [Pow] outputs: [2768 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: ReduceMean_1773 [ReduceMean] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2768 [01/12/2022-09:33:04] [V] [TRT] ReduceMean_1773 [ReduceMean] inputs: [2768 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: ReduceMean_1773 for ONNX node: ReduceMean_1773 [01/12/2022-09:33:04] [V] [TRT] Registering tensor: 2769 for ONNX tensor: 2769 [01/12/2022-09:33:04] [V] [TRT] ReduceMean_1773 [ReduceMean] outputs: [2769 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Constant_1774 [Constant] [01/12/2022-09:33:04] [V] [TRT] Constant_1774 [Constant] inputs: [01/12/2022-09:33:04] [V] [TRT] Constant_1774 [Constant] outputs: [2770 -> ()[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Parsing node: Add_1775 [Add] [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2769 [01/12/2022-09:33:04] [V] [TRT] Searching for input: 2770 [01/12/2022-09:33:04] [V] [TRT] Add_1775 [Add] inputs: [2769 -> (-1, -1, 1)[FLOAT]], [2770 -> ()[FLOAT]], [01/12/2022-09:33:04] [V] [TRT] Registering layer: 2770 for ONNX node: 2770 [01/12/2022-09:33:04] [V] [TRT] Registering layer: Add_1775 for ONNX node: Add_1775 [01/12/2022-09:33:05] [V] [TRT] Registering tensor: 2771 for ONNX tensor: 2771 [01/12/2022-09:33:05] [V] [TRT] Add_1775 [Add] outputs: [2771 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Parsing node: Sqrt_1776 [Sqrt] [01/12/2022-09:33:05] [V] [TRT] Searching for input: 2771 [01/12/2022-09:33:05] [V] [TRT] Sqrt_1776 [Sqrt] inputs: [2771 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Registering layer: Sqrt_1776 for ONNX node: Sqrt_1776 [01/12/2022-09:33:05] [V] [TRT] Registering tensor: 2772 for ONNX tensor: 2772 [01/12/2022-09:33:05] [V] [TRT] Sqrt_1776 [Sqrt] outputs: [2772 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Parsing node: Div_1777 [Div] [01/12/2022-09:33:05] [V] [TRT] Searching for input: 2766 [01/12/2022-09:33:05] [V] [TRT] Searching for input: 2772 [01/12/2022-09:33:05] [V] [TRT] Div_1777 [Div] inputs: [2766 -> (-1, -1, 768)[FLOAT]], [2772 -> (-1, -1, 1)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Registering layer: Div_1777 for ONNX node: Div_1777 [01/12/2022-09:33:05] [V] [TRT] Registering tensor: 2773 for ONNX tensor: 2773 [01/12/2022-09:33:05] [V] [TRT] Div_1777 [Div] outputs: [2773 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Parsing node: Mul_1778 [Mul] [01/12/2022-09:33:05] [V] [TRT] Searching for input: 2773 [01/12/2022-09:33:05] [V] [TRT] Searching for input: decoder.layers.5.final_layer_norm.weight [01/12/2022-09:33:05] [V] [TRT] Mul_1778 [Mul] inputs: [2773 -> (-1, -1, 768)[FLOAT]], [decoder.layers.5.final_layer_norm.weight -> (768)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Registering layer: decoder.layers.5.final_layer_norm.weight for ONNX node: decoder.layers.5.final_layer_norm.weight [01/12/2022-09:33:05] [V] [TRT] Registering layer: Mul_1778 for ONNX node: Mul_1778 [01/12/2022-09:33:05] [V] [TRT] Registering tensor: 2774 for ONNX tensor: 2774 [01/12/2022-09:33:05] [V] [TRT] Mul_1778 [Mul] outputs: [2774 -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Parsing node: Add_1779 [Add] [01/12/2022-09:33:05] [V] [TRT] Searching for input: 2774 [01/12/2022-09:33:05] [V] [TRT] Searching for input: decoder.layers.5.final_layer_norm.bias [01/12/2022-09:33:05] [V] [TRT] Add_1779 [Add] inputs: [2774 -> (-1, -1, 768)[FLOAT]], [decoder.layers.5.final_layer_norm.bias -> (768)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Registering layer: decoder.layers.5.final_layer_norm.bias for ONNX node: decoder.layers.5.final_layer_norm.bias [01/12/2022-09:33:05] [V] [TRT] Registering layer: Add_1779 for ONNX node: Add_1779 [01/12/2022-09:33:05] [V] [TRT] Registering tensor: logits_26 for ONNX tensor: logits [01/12/2022-09:33:05] [V] [TRT] Add_1779 [Add] outputs: [logits -> (-1, -1, 768)[FLOAT]], [01/12/2022-09:33:05] [V] [TRT] Marking logits_26 as output: logits [01/12/2022-09:33:05] [V] [TRT] Marking 1299_2 as output: 1299 [01/12/2022-09:33:05] [V] [TRT] Marking 1312_3 as output: 1312 [01/12/2022-09:33:05] [V] [TRT] Marking 1420_4 as output: 1420 [01/12/2022-09:33:05] [V] [TRT] Marking 1433_5 as output: 1433 [01/12/2022-09:33:05] [V] [TRT] Marking 1549_6 as output: 1549 [01/12/2022-09:33:05] [V] [TRT] Marking 1562_7 as output: 1562 [01/12/2022-09:33:05] [V] [TRT] Marking 1670_8 as output: 1670 [01/12/2022-09:33:05] [V] [TRT] Marking 1683_9 as output: 1683 [01/12/2022-09:33:05] [V] [TRT] Marking 1799_10 as output: 1799 [01/12/2022-09:33:05] [V] [TRT] Marking 1812_11 as output: 1812 [01/12/2022-09:33:05] [V] [TRT] Marking 1920_12 as output: 1920 [01/12/2022-09:33:05] [V] [TRT] Marking 1933_13 as output: 1933 [01/12/2022-09:33:05] [V] [TRT] Marking 2049_14 as output: 2049 [01/12/2022-09:33:05] [V] [TRT] Marking 2062_15 as output: 2062 [01/12/2022-09:33:05] [V] [TRT] Marking 2170_16 as output: 2170 [01/12/2022-09:33:05] [V] [TRT] Marking 2183_17 as output: 2183 [01/12/2022-09:33:05] [V] [TRT] Marking 2299_18 as output: 2299 [01/12/2022-09:33:05] [V] [TRT] Marking 2312_19 as output: 2312 [01/12/2022-09:33:05] [V] [TRT] Marking 2420_20 as output: 2420 [01/12/2022-09:33:05] [V] [TRT] Marking 2433_21 as output: 2433 [01/12/2022-09:33:05] [V] [TRT] Marking 2549_22 as output: 2549 [01/12/2022-09:33:05] [V] [TRT] Marking 2562_23 as output: 2562 [01/12/2022-09:33:05] [V] [TRT] Marking 2670_24 as output: 2670 [01/12/2022-09:33:05] [V] [TRT] Marking 2683_25 as output: 2683 [01/12/2022-09:33:05] [V] [TRT] Marking 1186_0 as output: 1186 [01/12/2022-09:33:05] [I] Finish parsing network model [01/12/2022-09:33:05] [V] [TRT] Applying generic optimizations to the graph for inference. [01/12/2022-09:33:05] [V] [TRT] Original: 1757 layers [01/12/2022-09:33:05] [V] [TRT] After dead-layer removal: 1757 layers [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 9) [Constant] with (Unnamed Layer* 10) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 343 with (Unnamed Layer* 248) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 374 with (Unnamed Layer* 269) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 377 with (Unnamed Layer* 273) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 388 with (Unnamed Layer* 285) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 404 with (Unnamed Layer* 310) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 407 with (Unnamed Layer* 314) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layernorm_embedding.weight with (Unnamed Layer* 319) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layernorm_embedding.bias with (Unnamed Layer* 322) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2779 with (Unnamed Layer* 331) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.self_attn.q_proj.bias with (Unnamed Layer* 334) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 422 with (Unnamed Layer* 337) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2780 with (Unnamed Layer* 340) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.self_attn.k_proj.bias with (Unnamed Layer* 343) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2784 with (Unnamed Layer* 353) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.self_attn.v_proj.bias with (Unnamed Layer* 356) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2799 with (Unnamed Layer* 418) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.self_attn.out_proj.bias with (Unnamed Layer* 421) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 507 with (Unnamed Layer* 427) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 510 with (Unnamed Layer* 431) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.self_attn_layer_norm.weight with (Unnamed Layer* 436) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.self_attn_layer_norm.bias with (Unnamed Layer* 439) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2800 with (Unnamed Layer* 442) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.fc1.bias with (Unnamed Layer* 445) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 519 with (Unnamed Layer* 448) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 522 with (Unnamed Layer* 452) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 525 with (Unnamed Layer* 456) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2801 with (Unnamed Layer* 459) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.fc2.bias with (Unnamed Layer* 462) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 533 with (Unnamed Layer* 468) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 536 with (Unnamed Layer* 472) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.final_layer_norm.weight with (Unnamed Layer* 477) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.0.final_layer_norm.bias with (Unnamed Layer* 480) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2802 with (Unnamed Layer* 489) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.self_attn.q_proj.bias with (Unnamed Layer* 492) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 551 with (Unnamed Layer* 495) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2803 with (Unnamed Layer* 498) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.self_attn.k_proj.bias with (Unnamed Layer* 501) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2807 with (Unnamed Layer* 511) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.self_attn.v_proj.bias with (Unnamed Layer* 514) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2822 with (Unnamed Layer* 576) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.self_attn.out_proj.bias with (Unnamed Layer* 579) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 636 with (Unnamed Layer* 585) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 639 with (Unnamed Layer* 589) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.self_attn_layer_norm.weight with (Unnamed Layer* 594) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.self_attn_layer_norm.bias with (Unnamed Layer* 597) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2823 with (Unnamed Layer* 600) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.fc1.bias with (Unnamed Layer* 603) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 648 with (Unnamed Layer* 606) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 651 with (Unnamed Layer* 610) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 654 with (Unnamed Layer* 614) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2824 with (Unnamed Layer* 617) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.fc2.bias with (Unnamed Layer* 620) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 662 with (Unnamed Layer* 626) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 665 with (Unnamed Layer* 630) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.final_layer_norm.weight with (Unnamed Layer* 635) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.1.final_layer_norm.bias with (Unnamed Layer* 638) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2825 with (Unnamed Layer* 647) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.self_attn.q_proj.bias with (Unnamed Layer* 650) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 680 with (Unnamed Layer* 653) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2826 with (Unnamed Layer* 656) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.self_attn.k_proj.bias with (Unnamed Layer* 659) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2830 with (Unnamed Layer* 669) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.self_attn.v_proj.bias with (Unnamed Layer* 672) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2845 with (Unnamed Layer* 734) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.self_attn.out_proj.bias with (Unnamed Layer* 737) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 765 with (Unnamed Layer* 743) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 768 with (Unnamed Layer* 747) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.self_attn_layer_norm.weight with (Unnamed Layer* 752) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.self_attn_layer_norm.bias with (Unnamed Layer* 755) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2846 with (Unnamed Layer* 758) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.fc1.bias with (Unnamed Layer* 761) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 777 with (Unnamed Layer* 764) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 780 with (Unnamed Layer* 768) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 783 with (Unnamed Layer* 772) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2847 with (Unnamed Layer* 775) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.fc2.bias with (Unnamed Layer* 778) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 791 with (Unnamed Layer* 784) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 794 with (Unnamed Layer* 788) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.final_layer_norm.weight with (Unnamed Layer* 793) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.2.final_layer_norm.bias with (Unnamed Layer* 796) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2848 with (Unnamed Layer* 805) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.self_attn.q_proj.bias with (Unnamed Layer* 808) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 809 with (Unnamed Layer* 811) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2849 with (Unnamed Layer* 814) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.self_attn.k_proj.bias with (Unnamed Layer* 817) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2853 with (Unnamed Layer* 827) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.self_attn.v_proj.bias with (Unnamed Layer* 830) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 2868 with (Unnamed Layer* 892) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.self_attn.out_proj.bias with (Unnamed Layer* 895) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 894 with (Unnamed Layer* 901) [Shuffle] [01/12/2022-09:33:05] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:05] [V] [TRT] ConstShuffleFusion: Fusing 897 with (Unnamed Layer* 905) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.self_attn_layer_norm.weight with (Unnamed Layer* 910) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.self_attn_layer_norm.bias with (Unnamed Layer* 913) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2869 with (Unnamed Layer* 916) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.fc1.bias with (Unnamed Layer* 919) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 906 with (Unnamed Layer* 922) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 909 with (Unnamed Layer* 926) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 912 with (Unnamed Layer* 930) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2870 with (Unnamed Layer* 933) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.fc2.bias with (Unnamed Layer* 936) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 920 with (Unnamed Layer* 942) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 923 with (Unnamed Layer* 946) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.final_layer_norm.weight with (Unnamed Layer* 951) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.3.final_layer_norm.bias with (Unnamed Layer* 954) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2871 with (Unnamed Layer* 963) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.self_attn.q_proj.bias with (Unnamed Layer* 966) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 938 with (Unnamed Layer* 969) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2872 with (Unnamed Layer* 972) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.self_attn.k_proj.bias with (Unnamed Layer* 975) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2876 with (Unnamed Layer* 985) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.self_attn.v_proj.bias with (Unnamed Layer* 988) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2891 with (Unnamed Layer* 1050) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.self_attn.out_proj.bias with (Unnamed Layer* 1053) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1023 with (Unnamed Layer* 1059) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1026 with (Unnamed Layer* 1063) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.self_attn_layer_norm.weight with (Unnamed Layer* 1068) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.self_attn_layer_norm.bias with (Unnamed Layer* 1071) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2892 with (Unnamed Layer* 1074) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.fc1.bias with (Unnamed Layer* 1077) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1035 with (Unnamed Layer* 1080) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1038 with (Unnamed Layer* 1084) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1041 with (Unnamed Layer* 1088) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2893 with (Unnamed Layer* 1091) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.fc2.bias with (Unnamed Layer* 1094) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1049 with (Unnamed Layer* 1100) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1052 with (Unnamed Layer* 1104) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.final_layer_norm.weight with (Unnamed Layer* 1109) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.4.final_layer_norm.bias with (Unnamed Layer* 1112) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2894 with (Unnamed Layer* 1121) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.self_attn.q_proj.bias with (Unnamed Layer* 1124) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1067 with (Unnamed Layer* 1127) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2895 with (Unnamed Layer* 1130) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.self_attn.k_proj.bias with (Unnamed Layer* 1133) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2899 with (Unnamed Layer* 1143) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.self_attn.v_proj.bias with (Unnamed Layer* 1146) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2914 with (Unnamed Layer* 1208) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.self_attn.out_proj.bias with (Unnamed Layer* 1211) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1152 with (Unnamed Layer* 1217) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1155 with (Unnamed Layer* 1221) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.self_attn_layer_norm.weight with (Unnamed Layer* 1226) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.self_attn_layer_norm.bias with (Unnamed Layer* 1229) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2915 with (Unnamed Layer* 1232) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.fc1.bias with (Unnamed Layer* 1235) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1164 with (Unnamed Layer* 1238) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1167 with (Unnamed Layer* 1242) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1170 with (Unnamed Layer* 1246) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2916 with (Unnamed Layer* 1249) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.fc2.bias with (Unnamed Layer* 1252) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1178 with (Unnamed Layer* 1258) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1181 with (Unnamed Layer* 1262) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.final_layer_norm.weight with (Unnamed Layer* 1267) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing encoder.layers.5.final_layer_norm.bias with (Unnamed Layer* 1270) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1199 with (Unnamed Layer* 1285) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing (Unnamed Layer* 1290) [Constant] with (Unnamed Layer* 1291) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1230 with (Unnamed Layer* 1322) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1267 with (Unnamed Layer* 1389) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1270 with (Unnamed Layer* 1393) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layernorm_embedding.weight with (Unnamed Layer* 1398) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layernorm_embedding.bias with (Unnamed Layer* 1401) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2922 with (Unnamed Layer* 1410) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.self_attn.q_proj.bias with (Unnamed Layer* 1413) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1285 with (Unnamed Layer* 1416) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2923 with (Unnamed Layer* 1419) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.self_attn.k_proj.bias with (Unnamed Layer* 1422) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2927 with (Unnamed Layer* 1432) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.self_attn.v_proj.bias with (Unnamed Layer* 1435) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2943 with (Unnamed Layer* 1514) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.self_attn.out_proj.bias with (Unnamed Layer* 1517) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1388 with (Unnamed Layer* 1523) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1391 with (Unnamed Layer* 1527) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.self_attn_layer_norm.weight with (Unnamed Layer* 1532) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.self_attn_layer_norm.bias with (Unnamed Layer* 1535) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2944 with (Unnamed Layer* 1544) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.encoder_attn.q_proj.bias with (Unnamed Layer* 1547) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1406 with (Unnamed Layer* 1550) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2945 with (Unnamed Layer* 1553) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.encoder_attn.k_proj.bias with (Unnamed Layer* 1556) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2949 with (Unnamed Layer* 1566) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.encoder_attn.v_proj.bias with (Unnamed Layer* 1569) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2964 with (Unnamed Layer* 1631) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.encoder_attn.out_proj.bias with (Unnamed Layer* 1634) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1491 with (Unnamed Layer* 1640) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1494 with (Unnamed Layer* 1644) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.encoder_attn_layer_norm.weight with (Unnamed Layer* 1649) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.encoder_attn_layer_norm.bias with (Unnamed Layer* 1652) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2965 with (Unnamed Layer* 1655) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.fc1.bias with (Unnamed Layer* 1658) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1503 with (Unnamed Layer* 1661) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1506 with (Unnamed Layer* 1665) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1509 with (Unnamed Layer* 1669) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2966 with (Unnamed Layer* 1672) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.fc2.bias with (Unnamed Layer* 1675) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1517 with (Unnamed Layer* 1681) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1520 with (Unnamed Layer* 1685) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.final_layer_norm.weight with (Unnamed Layer* 1690) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.0.final_layer_norm.bias with (Unnamed Layer* 1693) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2967 with (Unnamed Layer* 1702) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.self_attn.q_proj.bias with (Unnamed Layer* 1705) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1535 with (Unnamed Layer* 1708) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2968 with (Unnamed Layer* 1711) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.self_attn.k_proj.bias with (Unnamed Layer* 1714) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2972 with (Unnamed Layer* 1724) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.self_attn.v_proj.bias with (Unnamed Layer* 1727) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2988 with (Unnamed Layer* 1806) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.self_attn.out_proj.bias with (Unnamed Layer* 1809) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1638 with (Unnamed Layer* 1815) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1641 with (Unnamed Layer* 1819) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.self_attn_layer_norm.weight with (Unnamed Layer* 1824) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.self_attn_layer_norm.bias with (Unnamed Layer* 1827) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2989 with (Unnamed Layer* 1836) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.encoder_attn.q_proj.bias with (Unnamed Layer* 1839) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1656 with (Unnamed Layer* 1842) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2990 with (Unnamed Layer* 1845) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.encoder_attn.k_proj.bias with (Unnamed Layer* 1848) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2994 with (Unnamed Layer* 1858) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.encoder_attn.v_proj.bias with (Unnamed Layer* 1861) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3009 with (Unnamed Layer* 1923) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.encoder_attn.out_proj.bias with (Unnamed Layer* 1926) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1741 with (Unnamed Layer* 1932) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1744 with (Unnamed Layer* 1936) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.encoder_attn_layer_norm.weight with (Unnamed Layer* 1941) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.encoder_attn_layer_norm.bias with (Unnamed Layer* 1944) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3010 with (Unnamed Layer* 1947) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.fc1.bias with (Unnamed Layer* 1950) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1753 with (Unnamed Layer* 1953) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1756 with (Unnamed Layer* 1957) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1759 with (Unnamed Layer* 1961) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3011 with (Unnamed Layer* 1964) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.fc2.bias with (Unnamed Layer* 1967) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1767 with (Unnamed Layer* 1973) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1770 with (Unnamed Layer* 1977) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.final_layer_norm.weight with (Unnamed Layer* 1982) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.1.final_layer_norm.bias with (Unnamed Layer* 1985) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3012 with (Unnamed Layer* 1994) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.self_attn.q_proj.bias with (Unnamed Layer* 1997) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1785 with (Unnamed Layer* 2000) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3013 with (Unnamed Layer* 2003) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.self_attn.k_proj.bias with (Unnamed Layer* 2006) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3017 with (Unnamed Layer* 2016) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.self_attn.v_proj.bias with (Unnamed Layer* 2019) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3033 with (Unnamed Layer* 2098) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.self_attn.out_proj.bias with (Unnamed Layer* 2101) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1888 with (Unnamed Layer* 2107) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1891 with (Unnamed Layer* 2111) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.self_attn_layer_norm.weight with (Unnamed Layer* 2116) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.self_attn_layer_norm.bias with (Unnamed Layer* 2119) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3034 with (Unnamed Layer* 2128) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.encoder_attn.q_proj.bias with (Unnamed Layer* 2131) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1906 with (Unnamed Layer* 2134) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3035 with (Unnamed Layer* 2137) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.encoder_attn.k_proj.bias with (Unnamed Layer* 2140) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3039 with (Unnamed Layer* 2150) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.encoder_attn.v_proj.bias with (Unnamed Layer* 2153) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3054 with (Unnamed Layer* 2215) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.encoder_attn.out_proj.bias with (Unnamed Layer* 2218) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1991 with (Unnamed Layer* 2224) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 1994 with (Unnamed Layer* 2228) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.encoder_attn_layer_norm.weight with (Unnamed Layer* 2233) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.encoder_attn_layer_norm.bias with (Unnamed Layer* 2236) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3055 with (Unnamed Layer* 2239) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.fc1.bias with (Unnamed Layer* 2242) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2003 with (Unnamed Layer* 2245) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2006 with (Unnamed Layer* 2249) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2009 with (Unnamed Layer* 2253) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3056 with (Unnamed Layer* 2256) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.fc2.bias with (Unnamed Layer* 2259) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2017 with (Unnamed Layer* 2265) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2020 with (Unnamed Layer* 2269) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.final_layer_norm.weight with (Unnamed Layer* 2274) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.2.final_layer_norm.bias with (Unnamed Layer* 2277) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3057 with (Unnamed Layer* 2286) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.self_attn.q_proj.bias with (Unnamed Layer* 2289) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2035 with (Unnamed Layer* 2292) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3058 with (Unnamed Layer* 2295) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.self_attn.k_proj.bias with (Unnamed Layer* 2298) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3062 with (Unnamed Layer* 2308) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.self_attn.v_proj.bias with (Unnamed Layer* 2311) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3078 with (Unnamed Layer* 2390) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.self_attn.out_proj.bias with (Unnamed Layer* 2393) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2138 with (Unnamed Layer* 2399) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2141 with (Unnamed Layer* 2403) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.self_attn_layer_norm.weight with (Unnamed Layer* 2408) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.self_attn_layer_norm.bias with (Unnamed Layer* 2411) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3079 with (Unnamed Layer* 2420) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.encoder_attn.q_proj.bias with (Unnamed Layer* 2423) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2156 with (Unnamed Layer* 2426) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3080 with (Unnamed Layer* 2429) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.encoder_attn.k_proj.bias with (Unnamed Layer* 2432) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3084 with (Unnamed Layer* 2442) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.encoder_attn.v_proj.bias with (Unnamed Layer* 2445) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3099 with (Unnamed Layer* 2507) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.encoder_attn.out_proj.bias with (Unnamed Layer* 2510) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2241 with (Unnamed Layer* 2516) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2244 with (Unnamed Layer* 2520) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.encoder_attn_layer_norm.weight with (Unnamed Layer* 2525) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.encoder_attn_layer_norm.bias with (Unnamed Layer* 2528) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3100 with (Unnamed Layer* 2531) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.fc1.bias with (Unnamed Layer* 2534) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2253 with (Unnamed Layer* 2537) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2256 with (Unnamed Layer* 2541) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2259 with (Unnamed Layer* 2545) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3101 with (Unnamed Layer* 2548) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.fc2.bias with (Unnamed Layer* 2551) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2267 with (Unnamed Layer* 2557) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2270 with (Unnamed Layer* 2561) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.final_layer_norm.weight with (Unnamed Layer* 2566) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.3.final_layer_norm.bias with (Unnamed Layer* 2569) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3102 with (Unnamed Layer* 2578) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.self_attn.q_proj.bias with (Unnamed Layer* 2581) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2285 with (Unnamed Layer* 2584) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3103 with (Unnamed Layer* 2587) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.self_attn.k_proj.bias with (Unnamed Layer* 2590) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3107 with (Unnamed Layer* 2600) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.self_attn.v_proj.bias with (Unnamed Layer* 2603) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3123 with (Unnamed Layer* 2682) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.self_attn.out_proj.bias with (Unnamed Layer* 2685) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2388 with (Unnamed Layer* 2691) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2391 with (Unnamed Layer* 2695) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.self_attn_layer_norm.weight with (Unnamed Layer* 2700) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.self_attn_layer_norm.bias with (Unnamed Layer* 2703) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3124 with (Unnamed Layer* 2712) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.encoder_attn.q_proj.bias with (Unnamed Layer* 2715) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2406 with (Unnamed Layer* 2718) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3125 with (Unnamed Layer* 2721) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.encoder_attn.k_proj.bias with (Unnamed Layer* 2724) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3129 with (Unnamed Layer* 2734) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.encoder_attn.v_proj.bias with (Unnamed Layer* 2737) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3144 with (Unnamed Layer* 2799) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.encoder_attn.out_proj.bias with (Unnamed Layer* 2802) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2491 with (Unnamed Layer* 2808) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2494 with (Unnamed Layer* 2812) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.encoder_attn_layer_norm.weight with (Unnamed Layer* 2817) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.encoder_attn_layer_norm.bias with (Unnamed Layer* 2820) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3145 with (Unnamed Layer* 2823) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.fc1.bias with (Unnamed Layer* 2826) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2503 with (Unnamed Layer* 2829) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2506 with (Unnamed Layer* 2833) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2509 with (Unnamed Layer* 2837) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3146 with (Unnamed Layer* 2840) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.fc2.bias with (Unnamed Layer* 2843) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2517 with (Unnamed Layer* 2849) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2520 with (Unnamed Layer* 2853) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.final_layer_norm.weight with (Unnamed Layer* 2858) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.4.final_layer_norm.bias with (Unnamed Layer* 2861) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3147 with (Unnamed Layer* 2870) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.self_attn.q_proj.bias with (Unnamed Layer* 2873) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2535 with (Unnamed Layer* 2876) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3148 with (Unnamed Layer* 2879) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.self_attn.k_proj.bias with (Unnamed Layer* 2882) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3152 with (Unnamed Layer* 2892) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.self_attn.v_proj.bias with (Unnamed Layer* 2895) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3168 with (Unnamed Layer* 2974) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.self_attn.out_proj.bias with (Unnamed Layer* 2977) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2638 with (Unnamed Layer* 2983) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2641 with (Unnamed Layer* 2987) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.self_attn_layer_norm.weight with (Unnamed Layer* 2992) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.self_attn_layer_norm.bias with (Unnamed Layer* 2995) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3169 with (Unnamed Layer* 3004) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.encoder_attn.q_proj.bias with (Unnamed Layer* 3007) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 2656 with (Unnamed Layer* 3010) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3170 with (Unnamed Layer* 3013) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.encoder_attn.k_proj.bias with (Unnamed Layer* 3016) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing 3174 with (Unnamed Layer* 3026) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.encoder_attn.v_proj.bias with (Unnamed Layer* 3029) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleErasure [01/12/2022-09:33:06] [V] [TRT] Removing Reshape_124 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_161 with Transpose_162 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_167 with Transpose_168 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_174 with Transpose_175 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_181 with Transpose_185 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_192 with Transpose_193 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleErasure [01/12/2022-09:33:06] [V] [TRT] Removing Reshape_689 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_250 with Transpose_251 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_256 with Transpose_257 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_263 with Transpose_264 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_270 with Transpose_274 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_281 with Transpose_282 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Unsqueeze_723 with Unsqueeze_724 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_774 with Transpose_775 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_780 with Transpose_781 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_787 with Transpose_788 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_794 with Transpose_801 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_815 with (Unnamed Layer* 1496) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_821 with Transpose_822 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_339 with Transpose_340 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_345 with Transpose_346 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_352 with Transpose_353 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_359 with Transpose_363 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_868 with Transpose_869 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_370 with Transpose_371 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_428 with Transpose_429 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_434 with Transpose_435 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_441 with Transpose_442 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_448 with Transpose_452 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_459 with Transpose_460 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_517 with Transpose_518 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_523 with Transpose_524 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_530 with Transpose_531 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_537 with Transpose_541 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_548 with Transpose_549 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_606 with Transpose_607 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_612 with Transpose_613 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_619 with Transpose_620 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_626 with Transpose_630 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_637 with Transpose_638 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_855 with Transpose_856 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_861 with Transpose_862 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_875 with Transpose_879 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_886 with Transpose_887 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_944 with Transpose_945 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_950 with Transpose_951 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_957 with Transpose_958 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_964 with Transpose_971 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_985 with (Unnamed Layer* 1788) [Shuffle] [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_991 with Transpose_992 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1025 with Transpose_1026 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1031 with Transpose_1032 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1038 with Transpose_1039 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1045 with Transpose_1049 [01/12/2022-09:33:06] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:06] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1056 with Transpose_1057 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1114 with Transpose_1115 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1120 with Transpose_1121 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1127 with Transpose_1128 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1134 with Transpose_1141 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1155 with (Unnamed Layer* 2080) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1161 with Transpose_1162 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1195 with Transpose_1196 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1201 with Transpose_1202 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1208 with Transpose_1209 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1215 with Transpose_1219 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1226 with Transpose_1227 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1284 with Transpose_1285 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1290 with Transpose_1291 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1297 with Transpose_1298 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1304 with Transpose_1311 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1325 with (Unnamed Layer* 2372) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1331 with Transpose_1332 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1365 with Transpose_1366 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1371 with Transpose_1372 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1378 with Transpose_1379 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1385 with Transpose_1389 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1396 with Transpose_1397 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1454 with Transpose_1455 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1460 with Transpose_1461 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1467 with Transpose_1468 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1474 with Transpose_1481 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1495 with (Unnamed Layer* 2664) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1501 with Transpose_1502 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1535 with Transpose_1536 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1541 with Transpose_1542 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1548 with Transpose_1549 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1555 with Transpose_1559 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1566 with Transpose_1567 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1624 with Transpose_1625 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1630 with Transpose_1631 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1637 with Transpose_1638 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1644 with Transpose_1651 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1665 with (Unnamed Layer* 2956) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1671 with Transpose_1672 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1705 with Transpose_1706 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1711 with Transpose_1712 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1718 with Transpose_1719 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1725 with Transpose_1729 [01/12/2022-09:33:07] [V] [TRT] Running: ShuffleShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_1736 with Transpose_1737 [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 3189 with (Unnamed Layer* 3091) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.encoder_attn.out_proj.bias with (Unnamed Layer* 3094) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2741 with (Unnamed Layer* 3100) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2744 with (Unnamed Layer* 3104) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.encoder_attn_layer_norm.weight with (Unnamed Layer* 3109) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.encoder_attn_layer_norm.bias with (Unnamed Layer* 3112) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 3190 with (Unnamed Layer* 3115) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.fc1.bias with (Unnamed Layer* 3118) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2753 with (Unnamed Layer* 3121) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2756 with (Unnamed Layer* 3125) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2759 with (Unnamed Layer* 3129) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 3191 with (Unnamed Layer* 3132) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.fc2.bias with (Unnamed Layer* 3135) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2767 with (Unnamed Layer* 3141) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing 2770 with (Unnamed Layer* 3145) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.final_layer_norm.weight with (Unnamed Layer* 3150) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Running: ConstShuffleFusion [01/12/2022-09:33:07] [V] [TRT] ConstShuffleFusion: Fusing decoder.layers.5.final_layer_norm.bias with (Unnamed Layer* 3153) [Shuffle] [01/12/2022-09:33:07] [V] [TRT] Found MatMul_153 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_157 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_163 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_186 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_187 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_188 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_242 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_246 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_252 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_275 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_276 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_277 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_766 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_770 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_776 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_802 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_816 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_817 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_331 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_335 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_341 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_364 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_365 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_366 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_420 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_424 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_430 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_453 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_454 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_455 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_509 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_513 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_519 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_542 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_543 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_544 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_598 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_602 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_608 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_631 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_632 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_633 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_936 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_940 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_946 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_972 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_986 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_987 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1106 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1110 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1116 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1142 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_1156 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1157 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1276 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1280 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1286 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1312 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_1326 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1327 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1446 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1450 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1456 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1482 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_1496 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1497 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1616 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1620 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1626 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1652 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found Softmax_1666 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found MatMul_1667 to be part of self-attention pattern. [01/12/2022-09:33:07] [V] [TRT] Found and reassigned Myelin backends for Self-Attention nodes [01/12/2022-09:33:07] [V] [TRT] After Myelin optimization: 11 layers [01/12/2022-09:33:07] [V] [TRT] Applying ScaleNodes fusions. [01/12/2022-09:33:07] [V] [TRT] After scale fusion: 11 layers [01/12/2022-09:33:07] [V] [TRT] After vertical fusions: 11 layers [01/12/2022-09:33:07] [V] [TRT] After dupe layer removal: 11 layers [01/12/2022-09:33:07] [V] [TRT] After final dead-layer removal: 11 layers [01/12/2022-09:33:07] [V] [TRT] After tensor merging: 11 layers [01/12/2022-09:33:07] [V] [TRT] Eliminating slice Slice_14by retargeting 274 from 274 to input_ids [01/12/2022-09:33:07] [V] [TRT] Replacing slice Slice_40 with copy from 295 to 300 [01/12/2022-09:33:07] [V] [TRT] After concat removal: 10 layers [01/12/2022-09:33:07] [V] [TRT] Graph construction and optimization completed in 1.58675 seconds. [01/12/2022-09:33:08] [V] [TRT] Using cublasLt as a tactic source [01/12/2022-09:33:08] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +508, GPU +224, now: CPU 1531, GPU 7110 (MiB) [01/12/2022-09:33:08] [V] [TRT] Using cuDNN as a tactic source [01/12/2022-09:33:08] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +115, GPU +52, now: CPU 1646, GPU 7162 (MiB) [01/12/2022-09:33:08] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [01/12/2022-09:33:08] [V] [TRT] Constructing optimization profile number 0 [1/1]. [01/12/2022-09:33:08] [V] [TRT] Reserving memory for activation tensors. Host: 0 bytes Device: 40896512 bytes [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning Reformat: Int32(1) -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Slice_40 (Reformat) [01/12/2022-09:33:08] [V] [TRT] Tactic: 1002 Time: 0.006632 [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.005008 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005008 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Reformat Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing reformatting costs [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(), Int32(), Int32(), Int32() *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: [HostToDeviceCopy] (ShapeHostToDevice) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.009852 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.009852 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: ShapeHostToDevice Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: Int32((# 1 (SHAPE input_ids)),1) -> Int32((# 1 (RESHAPE 16 (* E0 (MIN 1 E0)) | 16 E0 zeroIsPlaceholder)),1) where E0=(+ (# 1 (SHAPE input_ids)) -1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Expand_21 (Slice) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.005112 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005112 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: Int32((# 1 E1),1) -> Int32((# 1 (RESHAPE 16 (# 1 E1) | 16 E0 zeroIsPlaceholder)),1) where E0=(+ (# 1 (SHAPE input_ids)) -1) E1=(RESHAPE 16 (* E0 (MIN 1 E0)) | 16 E0 zeroIsPlaceholder) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Reshape_68 (Shuffle) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.005104 [01/12/2022-09:33:08] [V] [TRT] Tactic: 1 Time: 0.00594 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.005104 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Range_706 (Fill) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.019444 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.019444 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Range_744 (Fill) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.019492 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.019492 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Range_82 (Fill) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.019424 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.019424 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Range_35 (Fill) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.019396 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.019396 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Range_28 (Fill) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.019116 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.019116 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: -> Int32(1) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: Range_131 (Fill) [01/12/2022-09:33:08] [V] [TRT] Tactic: 0 Time: 0.019524 [01/12/2022-09:33:08] [V] [TRT] Fastest Tactic: 0 Time: 0.019524 [01/12/2022-09:33:08] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0 [01/12/2022-09:33:08] [V] [TRT] =============== Computing costs for [01/12/2022-09:33:08] [V] [TRT] *************** Autotuning format combination: Int32(1), Int32(1), Int32(1), Int32(1), Int32(1), Int32((# 1 (SHAPE input_ids)),1), Int32((# 1 (RESHAPE 16 (# 1 (RESHAPE 16 (* E0 (MIN 1 E0)) | 16 E0 zeroIsPlaceholder)) | 16 E0 zeroIsPlaceholder)),1), Int32(1), Int32(), Int32(), Int32(), Int32() -> Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,768,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,E1,64,1), Float(E2,768,1) where E0=(+ (# 1 (SHAPE input_ids)) -1) E1=(* 64 (# 1 (SHAPE input_ids))) E2=(* 768 (# 1 (SHAPE input_ids))) *************** [01/12/2022-09:33:08] [V] [TRT] --------------- Timing Runner: {ForeignNode[(Unnamed Layer* 1306) [Shuffle]_output[Constant]...Add_1779]} (Myelin)