&&&& RUNNING TensorRT.trtexec [TensorRT v8204] # /data/wangsenhao/tensorRT/TensorRT-8.2.4.2/bin/trtexec --onnx=encoder.onnx --minShapes=speech:1x1x80,speech_lengths:1 --optShapes=speech:4x2x80,speech_lengths:4 --maxShapes=speech:16x1x28x28,speech_lengths:16 --workspace=1024 --saveEngine=encoder.plan --shapes=speech:4x2x80,speech_lengths:4 --verbose [05/10/2022-20:07:01] [I] === Model Options === [05/10/2022-20:07:01] [I] Format: ONNX [05/10/2022-20:07:01] [I] Model: encoder.onnx [05/10/2022-20:07:01] [I] Output: [05/10/2022-20:07:01] [I] === Build Options === [05/10/2022-20:07:01] [I] Max batch: explicit batch [05/10/2022-20:07:01] [I] Workspace: 1024 MiB [05/10/2022-20:07:01] [I] minTiming: 1 [05/10/2022-20:07:01] [I] avgTiming: 8 [05/10/2022-20:07:01] [I] Precision: FP32 [05/10/2022-20:07:01] [I] Calibration: [05/10/2022-20:07:01] [I] Refit: Disabled [05/10/2022-20:07:01] [I] Sparsity: Disabled [05/10/2022-20:07:01] [I] Safe mode: Disabled [05/10/2022-20:07:01] [I] DirectIO mode: Disabled [05/10/2022-20:07:01] [I] Restricted mode: Disabled [05/10/2022-20:07:01] [I] Save engine: encoder.plan [05/10/2022-20:07:01] [I] Load engine: [05/10/2022-20:07:01] [I] Profiling verbosity: 0 [05/10/2022-20:07:01] [I] Tactic sources: Using default tactic sources [05/10/2022-20:07:01] [I] timingCacheMode: local [05/10/2022-20:07:01] [I] timingCacheFile: [05/10/2022-20:07:01] [I] Input(s)s format: fp32:CHW [05/10/2022-20:07:01] [I] Output(s)s format: fp32:CHW [05/10/2022-20:07:01] [I] Input build shape: speech_lengths=1+4+16 [05/10/2022-20:07:01] [I] Input build shape: speech=1x1x80+4x2x80+16x1x28x28 [05/10/2022-20:07:01] [I] Input calibration shapes: model [05/10/2022-20:07:01] [I] === System Options === [05/10/2022-20:07:01] [I] Device: 0 [05/10/2022-20:07:01] [I] DLACore: [05/10/2022-20:07:01] [I] Plugins: [05/10/2022-20:07:01] [I] === Inference Options === [05/10/2022-20:07:01] [I] Batch: Explicit [05/10/2022-20:07:01] [I] Input inference shape: speech_lengths=4 [05/10/2022-20:07:01] [I] Input inference shape: speech=4x2x80 [05/10/2022-20:07:01] [I] Iterations: 10 [05/10/2022-20:07:01] [I] Duration: 3s (+ 200ms warm up) [05/10/2022-20:07:01] [I] Sleep time: 0ms [05/10/2022-20:07:01] [I] Idle time: 0ms [05/10/2022-20:07:01] [I] Streams: 1 [05/10/2022-20:07:01] [I] ExposeDMA: Disabled [05/10/2022-20:07:01] [I] Data transfers: Enabled [05/10/2022-20:07:01] [I] Spin-wait: Disabled [05/10/2022-20:07:01] [I] Multithreading: Disabled [05/10/2022-20:07:01] [I] CUDA Graph: Disabled [05/10/2022-20:07:01] [I] Separate profiling: Disabled [05/10/2022-20:07:01] [I] Time Deserialize: Disabled [05/10/2022-20:07:01] [I] Time Refit: Disabled [05/10/2022-20:07:01] [I] Skip inference: Disabled [05/10/2022-20:07:01] [I] Inputs: [05/10/2022-20:07:01] [I] === Reporting Options === [05/10/2022-20:07:01] [I] Verbose: Enabled [05/10/2022-20:07:01] [I] Averages: 10 inferences [05/10/2022-20:07:01] [I] Percentile: 99 [05/10/2022-20:07:01] [I] Dump refittable layers:Disabled [05/10/2022-20:07:01] [I] Dump output: Disabled [05/10/2022-20:07:01] [I] Profile: Disabled [05/10/2022-20:07:01] [I] Export timing to JSON file: [05/10/2022-20:07:01] [I] Export output to JSON file: [05/10/2022-20:07:01] [I] Export profile to JSON file: [05/10/2022-20:07:01] [I] [05/10/2022-20:07:01] [I] === Device Information === [05/10/2022-20:07:01] [I] Selected Device: Tesla V100-SXM2-32GB [05/10/2022-20:07:01] [I] Compute Capability: 7.0 [05/10/2022-20:07:01] [I] SMs: 80 [05/10/2022-20:07:01] [I] Compute Clock Rate: 1.53 GHz [05/10/2022-20:07:01] [I] Device Global Memory: 32510 MiB [05/10/2022-20:07:01] [I] Shared Memory per SM: 96 KiB [05/10/2022-20:07:01] [I] Memory Bus Width: 4096 bits (ECC enabled) [05/10/2022-20:07:01] [I] Memory Clock Rate: 0.877 GHz [05/10/2022-20:07:01] [I] [05/10/2022-20:07:01] [I] TensorRT version: 8.2.4 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::Region_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::ScatterND version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::CropAndResize version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::EfficientNMS_TFTRT_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::Proposal version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::Split version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1 [05/10/2022-20:07:01] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1 [05/10/2022-20:07:02] [I] [TRT] [MemUsageChange] Init CUDA: CPU +237, GPU +0, now: CPU 240, GPU 494 (MiB) [05/10/2022-20:07:02] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 240 MiB, GPU 494 MiB [05/10/2022-20:07:02] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 308 MiB, GPU 516 MiB [05/10/2022-20:07:02] [I] Start parsing network model [05/10/2022-20:07:02] [I] [TRT] ---------------------------------------------------------------- [05/10/2022-20:07:02] [I] [TRT] Input filename: encoder.onnx [05/10/2022-20:07:02] [I] [TRT] ONNX IR version: 0.0.7 [05/10/2022-20:07:02] [I] [TRT] Opset version: 13 [05/10/2022-20:07:02] [I] [TRT] Producer name: pytorch [05/10/2022-20:07:02] [I] [TRT] Producer version: 1.10 [05/10/2022-20:07:02] [I] [TRT] Domain: [05/10/2022-20:07:02] [I] [TRT] Model version: 0 [05/10/2022-20:07:02] [I] [TRT] Doc string: [05/10/2022-20:07:02] [I] [TRT] ---------------------------------------------------------------- [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::ScatterND version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TFTRT_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::Proposal version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::Split version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1 [05/10/2022-20:07:02] [V] [TRT] Adding network input: speech with dtype: float32, dimensions: (-1, -1, 80) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: speech for ONNX tensor: speech [05/10/2022-20:07:02] [V] [TRT] Adding network input: speech_lengths with dtype: int32, dimensions: (-1) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: speech_lengths for ONNX tensor: speech_lengths [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.global_cmvn.mean [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.global_cmvn.istd [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.embed.conv.0.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.embed.conv.0.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.embed.conv.2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.embed.conv.2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.embed.out.0.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.after_norm.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.after_norm.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.0.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.1.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.2.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.3.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.4.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.5.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.6.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.7.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.8.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.9.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.10.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_final.weight [05/10/2022-20:07:02] [V] [TRT] Importing initializer: encoder.encoders.11.norm_final.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: ctc.ctc_lo.bias [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3161 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3162 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3164 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3165 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3167 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3168 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3170 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3171 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3173 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3174 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3176 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3177 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3179 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3180 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3182 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3183 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3185 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3186 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3188 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3189 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3191 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3192 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3194 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3195 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3196 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3197 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3198 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3199 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3200 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3201 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3202 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3203 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3204 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3205 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3206 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3207 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3208 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3209 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3210 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3211 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3212 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3213 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3214 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3215 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3216 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3217 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3218 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3219 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3220 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3221 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3222 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3223 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3224 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3225 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3226 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3227 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3228 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3229 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3230 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3231 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3232 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3233 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3234 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3235 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3236 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3237 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3238 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3239 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3240 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3241 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3242 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3243 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3244 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3245 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3246 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3247 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3248 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3249 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3250 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3251 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3252 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3253 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3254 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3255 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3256 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3257 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3258 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3259 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3260 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3261 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3262 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3263 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3264 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3265 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3266 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3267 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3268 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3269 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3270 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3271 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3272 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3273 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3274 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3275 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3276 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3277 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3278 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3279 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3280 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3281 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3282 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3283 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3284 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3285 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3286 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3287 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3288 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3289 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3290 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3291 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3292 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3293 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3294 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3295 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3296 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3297 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3298 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3299 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3300 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3301 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3302 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3303 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3304 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3305 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3306 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3307 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3308 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3309 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3310 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3311 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3312 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3313 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3314 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3315 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3316 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3317 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3318 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3319 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3320 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3321 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3322 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3323 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3324 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3325 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3326 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3327 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3328 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3329 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3330 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3331 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3332 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3333 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3334 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3335 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3336 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3337 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3338 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3339 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3340 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3341 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3342 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3343 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3344 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3345 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3346 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3347 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3348 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3349 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3350 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3351 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3352 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3353 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3354 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3355 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3356 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3357 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3358 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3359 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3360 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3361 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3362 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3363 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3364 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3365 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3366 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3367 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3368 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3369 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3370 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3371 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3372 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3373 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3374 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3375 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3376 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3377 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3378 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3379 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3380 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3381 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3382 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3383 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3384 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3385 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3386 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3387 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3388 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3389 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3390 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3391 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3392 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3393 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3394 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3395 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3396 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3397 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3398 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3399 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3400 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3401 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3402 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3403 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3404 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3405 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3406 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3407 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3408 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3409 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3410 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3411 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3412 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3413 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3414 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3415 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3416 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3417 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3418 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3419 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3420 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3421 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3422 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3423 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3424 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3425 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3426 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3427 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3428 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3429 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3430 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3431 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3432 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3433 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3434 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3435 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3436 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3437 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3438 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3439 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3440 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3441 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3442 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3443 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3444 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3445 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3446 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3447 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3448 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3449 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3450 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3451 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3452 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3453 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3454 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3455 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3456 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3457 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3458 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3459 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3460 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3461 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3462 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3463 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3464 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3465 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3466 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3467 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3468 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3469 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3470 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3471 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3472 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3473 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3474 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3475 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3476 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3477 [05/10/2022-20:07:02] [V] [TRT] Importing initializer: 3478 [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_0 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: speech [05/10/2022-20:07:02] [V] [TRT] Shape_0 [Shape] inputs: [speech -> (-1, -1, 80)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_0 for ONNX node: Shape_0 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518 [05/10/2022-20:07:02] [V] [TRT] Shape_0 [Shape] outputs: [518 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_1 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_1 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_1 [Constant] outputs: [519 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_2 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 518 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 519 [05/10/2022-20:07:02] [V] [TRT] Gather_2 [Gather] inputs: [518 -> (3)[INT32]], [519 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 519 for ONNX node: 519 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_2 for ONNX node: Gather_2 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520 [05/10/2022-20:07:02] [V] [TRT] Gather_2 [Gather] outputs: [520 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_3 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: speech_lengths [05/10/2022-20:07:02] [V] [TRT] Shape_3 [Shape] inputs: [speech_lengths -> (-1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_3 for ONNX node: Shape_3 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 521 for ONNX tensor: 521 [05/10/2022-20:07:02] [V] [TRT] Shape_3 [Shape] outputs: [521 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_4 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_4 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_4 [Constant] outputs: [522 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_5 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 521 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 522 [05/10/2022-20:07:02] [V] [TRT] Gather_5 [Gather] inputs: [521 -> (1)[INT32]], [522 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 522 for ONNX node: 522 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_5 for ONNX node: Gather_5 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 523 for ONNX tensor: 523 [05/10/2022-20:07:02] [V] [TRT] Gather_5 [Gather] outputs: [523 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_6 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 520 [05/10/2022-20:07:02] [V] [TRT] Cast_6 [Cast] inputs: [520 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_6 for ONNX node: Cast_6 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 527 for ONNX tensor: 527 [05/10/2022-20:07:02] [V] [TRT] Cast_6 [Cast] outputs: [527 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Range_7 [Range] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3196 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 527 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3197 [05/10/2022-20:07:02] [V] [TRT] Range_7 [Range] inputs: [3196 -> ()[INT32]], [527 -> ()[INT32]], [3197 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Range_7 for ONNX node: Range_7 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 529 for ONNX tensor: 529 [05/10/2022-20:07:02] [V] [TRT] Range_7 [Range] outputs: [529 -> (-1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_8 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_8 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_8 [Constant] outputs: [530 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_9 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 529 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 530 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_9 [Unsqueeze] inputs: [529 -> (-1)[INT32]], [530 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_9 for ONNX node: Unsqueeze_9 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_9 [Unsqueeze] outputs: [531 -> (1, -1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_10 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_10 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_10 [Constant] outputs: [532 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_11 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 523 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 532 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_11 [Unsqueeze] inputs: [523 -> ()[INT32]], [532 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_11 for ONNX node: Unsqueeze_11 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 533 for ONNX tensor: 533 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_11 [Unsqueeze] outputs: [533 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_12 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_12 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_12 [Constant] outputs: [534 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_13 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 520 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 534 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_13 [Unsqueeze] inputs: [520 -> ()[INT32]], [534 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_13 for ONNX node: Unsqueeze_13 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_13 [Unsqueeze] outputs: [535 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_14 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 533 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 535 [05/10/2022-20:07:02] [V] [TRT] Concat_14 [Concat] inputs: [533 -> (1)[INT32]], [535 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_14 for ONNX node: Concat_14 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 536 for ONNX tensor: 536 [05/10/2022-20:07:02] [V] [TRT] Concat_14 [Concat] outputs: [536 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_15 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_15 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_15 [Constant] outputs: [537 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_16 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 536 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 537 [05/10/2022-20:07:02] [V] [TRT] Reshape_16 [Reshape] inputs: [536 -> (2)[INT32]], [537 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_16 for ONNX node: Reshape_16 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 538 for ONNX tensor: 538 [05/10/2022-20:07:02] [V] [TRT] Reshape_16 [Reshape] outputs: [538 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_17 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 538 [05/10/2022-20:07:02] [V] [TRT] Shape_17 [Shape] inputs: [538 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_17 for ONNX node: Shape_17 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 539 for ONNX tensor: 539 [05/10/2022-20:07:02] [V] [TRT] Shape_17 [Shape] outputs: [539 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ConstantOfShape_18 [ConstantOfShape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 539 [05/10/2022-20:07:02] [V] [TRT] ConstantOfShape_18 [ConstantOfShape] inputs: [539 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ConstantOfShape_18 for ONNX node: ConstantOfShape_18 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540 [05/10/2022-20:07:02] [V] [TRT] ConstantOfShape_18 [ConstantOfShape] outputs: [540 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_19 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_19 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_19 [Constant] outputs: [541 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_20 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 540 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 541 [05/10/2022-20:07:02] [V] [TRT] Mul_20 [Mul] inputs: [540 -> (2)[INT32]], [541 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 541 for ONNX node: 541 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_20 for ONNX node: Mul_20 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 542 for ONNX tensor: 542 [05/10/2022-20:07:02] [V] [TRT] Mul_20 [Mul] outputs: [542 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Equal_21 [Equal] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 538 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 542 [05/10/2022-20:07:02] [V] [TRT] Equal_21 [Equal] inputs: [538 -> (2)[INT32]], [542 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Equal_21 for ONNX node: Equal_21 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 543 for ONNX tensor: 543 [05/10/2022-20:07:02] [V] [TRT] Equal_21 [Equal] outputs: [543 -> (2)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Where_22 [Where] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 543 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 540 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 538 [05/10/2022-20:07:02] [V] [TRT] Where_22 [Where] inputs: [543 -> (2)[BOOL]], [540 -> (2)[INT32]], [538 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Where_22 for ONNX node: Where_22 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 544 for ONNX tensor: 544 [05/10/2022-20:07:02] [V] [TRT] Where_22 [Where] outputs: [544 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Expand_23 [Expand] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 531 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 544 [05/10/2022-20:07:02] [V] [TRT] Expand_23 [Expand] inputs: [531 -> (1, -1)[INT32]], [544 -> (2)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Expand_23 for ONNX node: Expand_23 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 545 for ONNX tensor: 545 [05/10/2022-20:07:02] [V] [TRT] Expand_23 [Expand] outputs: [545 -> (-1, -1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_24 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_24 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_24 [Constant] outputs: [546 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_25 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: speech_lengths [05/10/2022-20:07:02] [V] [TRT] Searching for input: 546 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_25 [Unsqueeze] inputs: [speech_lengths -> (-1)[INT32]], [546 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (_,), unsqueezing to: (_, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_25 for ONNX node: Unsqueeze_25 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 547 for ONNX tensor: 547 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_25 [Unsqueeze] outputs: [547 -> (-1, 1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_26 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 547 [05/10/2022-20:07:02] [V] [TRT] Cast_26 [Cast] inputs: [547 -> (-1, 1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_26 for ONNX node: Cast_26 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 548 for ONNX tensor: 548 [05/10/2022-20:07:02] [V] [TRT] Cast_26 [Cast] outputs: [548 -> (-1, 1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: GreaterOrEqual_27 [GreaterOrEqual] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 545 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 548 [05/10/2022-20:07:02] [V] [TRT] GreaterOrEqual_27 [GreaterOrEqual] inputs: [545 -> (-1, -1)[INT32]], [548 -> (-1, 1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: GreaterOrEqual_27 for ONNX node: GreaterOrEqual_27 [05/10/2022-20:07:02] [V] [TRT] Registering layer: GreaterOrEqual_27_0 for ONNX node: GreaterOrEqual_27 [05/10/2022-20:07:02] [V] [TRT] Registering layer: GreaterOrEqual_27_1 for ONNX node: GreaterOrEqual_27 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 549 for ONNX tensor: 549 [05/10/2022-20:07:02] [V] [TRT] GreaterOrEqual_27 [GreaterOrEqual] outputs: [549 -> (-1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_28 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_28 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_28 [Constant] outputs: [550 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_29 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 549 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 550 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_29 [Unsqueeze] inputs: [549 -> (-1, -1)[BOOL]], [550 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, _), unsqueezing to: (_, _, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_29 for ONNX node: Unsqueeze_29 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 551 for ONNX tensor: 551 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_29 [Unsqueeze] outputs: [551 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Not_30 [Not] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 551 [05/10/2022-20:07:02] [V] [TRT] Not_30 [Not] inputs: [551 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Not_30 for ONNX node: Not_30 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552 [05/10/2022-20:07:02] [V] [TRT] Not_30 [Not] outputs: [552 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sub_31 [Sub] [05/10/2022-20:07:02] [V] [TRT] Searching for input: speech [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.global_cmvn.mean [05/10/2022-20:07:02] [V] [TRT] Sub_31 [Sub] inputs: [speech -> (-1, -1, 80)[FLOAT]], [encoder.global_cmvn.mean -> (80)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.global_cmvn.mean for ONNX node: encoder.global_cmvn.mean [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sub_31 for ONNX node: Sub_31 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553 [05/10/2022-20:07:02] [V] [TRT] Sub_31 [Sub] outputs: [553 -> (-1, -1, 80)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_32 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 553 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.global_cmvn.istd [05/10/2022-20:07:02] [V] [TRT] Mul_32 [Mul] inputs: [553 -> (-1, -1, 80)[FLOAT]], [encoder.global_cmvn.istd -> (80)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.global_cmvn.istd for ONNX node: encoder.global_cmvn.istd [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_32 for ONNX node: Mul_32 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 554 for ONNX tensor: 554 [05/10/2022-20:07:02] [V] [TRT] Mul_32 [Mul] outputs: [554 -> (-1, -1, 80)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_33 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_33 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_33 [Constant] outputs: [555 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_34 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 554 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 555 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_34 [Unsqueeze] inputs: [554 -> (-1, -1, 80)[FLOAT]], [555 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, _, 80), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_34 for ONNX node: Unsqueeze_34 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 556 for ONNX tensor: 556 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_34 [Unsqueeze] outputs: [556 -> (-1, 1, -1, 80)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Conv_35 [Conv] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 556 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.embed.conv.0.weight [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.embed.conv.0.bias [05/10/2022-20:07:02] [V] [TRT] Conv_35 [Conv] inputs: [556 -> (-1, 1, -1, 80)[FLOAT]], [encoder.embed.conv.0.weight -> (256, 1, 3, 3)[FLOAT]], [encoder.embed.conv.0.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Convolution input dimensions: (-1, 1, -1, 80) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Conv_35 for ONNX node: Conv_35 [05/10/2022-20:07:02] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:02] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 39) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 557 for ONNX tensor: 557 [05/10/2022-20:07:02] [V] [TRT] Conv_35 [Conv] outputs: [557 -> (-1, 256, -1, 39)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Relu_36 [Relu] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 557 [05/10/2022-20:07:02] [V] [TRT] Relu_36 [Relu] inputs: [557 -> (-1, 256, -1, 39)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Relu_36 for ONNX node: Relu_36 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 558 for ONNX tensor: 558 [05/10/2022-20:07:02] [V] [TRT] Relu_36 [Relu] outputs: [558 -> (-1, 256, -1, 39)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Conv_37 [Conv] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 558 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.embed.conv.2.weight [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.embed.conv.2.bias [05/10/2022-20:07:02] [V] [TRT] Conv_37 [Conv] inputs: [558 -> (-1, 256, -1, 39)[FLOAT]], [encoder.embed.conv.2.weight -> (256, 256, 3, 3)[FLOAT]], [encoder.embed.conv.2.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Convolution input dimensions: (-1, 256, -1, 39) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Conv_37 for ONNX node: Conv_37 [05/10/2022-20:07:02] [V] [TRT] Using kernel: (3, 3), strides: (2, 2), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:02] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 19) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 559 for ONNX tensor: 559 [05/10/2022-20:07:02] [V] [TRT] Conv_37 [Conv] outputs: [559 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Relu_38 [Relu] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 559 [05/10/2022-20:07:02] [V] [TRT] Relu_38 [Relu] inputs: [559 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Relu_38 for ONNX node: Relu_38 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 560 for ONNX tensor: 560 [05/10/2022-20:07:02] [V] [TRT] Relu_38 [Relu] outputs: [560 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_39 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 560 [05/10/2022-20:07:02] [V] [TRT] Shape_39 [Shape] inputs: [560 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_39 for ONNX node: Shape_39 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 561 for ONNX tensor: 561 [05/10/2022-20:07:02] [V] [TRT] Shape_39 [Shape] outputs: [561 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_40 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_40 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_40 [Constant] outputs: [562 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_41 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 561 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 562 [05/10/2022-20:07:02] [V] [TRT] Gather_41 [Gather] inputs: [561 -> (4)[INT32]], [562 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 562 for ONNX node: 562 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_41 for ONNX node: Gather_41 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 563 for ONNX tensor: 563 [05/10/2022-20:07:02] [V] [TRT] Gather_41 [Gather] outputs: [563 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_42 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 560 [05/10/2022-20:07:02] [V] [TRT] Shape_42 [Shape] inputs: [560 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_42 for ONNX node: Shape_42 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 564 for ONNX tensor: 564 [05/10/2022-20:07:02] [V] [TRT] Shape_42 [Shape] outputs: [564 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_43 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_43 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_43 [Constant] outputs: [565 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_44 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 564 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 565 [05/10/2022-20:07:02] [V] [TRT] Gather_44 [Gather] inputs: [564 -> (4)[INT32]], [565 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 565 for ONNX node: 565 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_44 for ONNX node: Gather_44 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 566 for ONNX tensor: 566 [05/10/2022-20:07:02] [V] [TRT] Gather_44 [Gather] outputs: [566 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_45 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 560 [05/10/2022-20:07:02] [V] [TRT] Shape_45 [Shape] inputs: [560 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_45 for ONNX node: Shape_45 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 567 for ONNX tensor: 567 [05/10/2022-20:07:02] [V] [TRT] Shape_45 [Shape] outputs: [567 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_46 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_46 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_46 [Constant] outputs: [568 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_47 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 567 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 568 [05/10/2022-20:07:02] [V] [TRT] Gather_47 [Gather] inputs: [567 -> (4)[INT32]], [568 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 568 for ONNX node: 568 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_47 for ONNX node: Gather_47 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569 [05/10/2022-20:07:02] [V] [TRT] Gather_47 [Gather] outputs: [569 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_48 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 560 [05/10/2022-20:07:02] [V] [TRT] Shape_48 [Shape] inputs: [560 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_48 for ONNX node: Shape_48 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570 [05/10/2022-20:07:02] [V] [TRT] Shape_48 [Shape] outputs: [570 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_49 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_49 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_49 [Constant] outputs: [571 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_50 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 570 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 571 [05/10/2022-20:07:02] [V] [TRT] Gather_50 [Gather] inputs: [570 -> (4)[INT32]], [571 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 571 for ONNX node: 571 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_50 for ONNX node: Gather_50 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 572 for ONNX tensor: 572 [05/10/2022-20:07:02] [V] [TRT] Gather_50 [Gather] outputs: [572 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_51 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 560 [05/10/2022-20:07:02] [V] [TRT] Transpose_51 [Transpose] inputs: [560 -> (-1, 256, -1, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_51 for ONNX node: Transpose_51 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 573 for ONNX tensor: 573 [05/10/2022-20:07:02] [V] [TRT] Transpose_51 [Transpose] outputs: [573 -> (-1, -1, 256, 19)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_52 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 566 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 572 [05/10/2022-20:07:02] [V] [TRT] Mul_52 [Mul] inputs: [566 -> ()[INT32]], [572 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_52 for ONNX node: Mul_52 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 574 for ONNX tensor: 574 [05/10/2022-20:07:02] [V] [TRT] Mul_52 [Mul] outputs: [574 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_53 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_53 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_53 [Constant] outputs: [575 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_54 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 563 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 575 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_54 [Unsqueeze] inputs: [563 -> ()[INT32]], [575 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_54 for ONNX node: Unsqueeze_54 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 576 for ONNX tensor: 576 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_54 [Unsqueeze] outputs: [576 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_55 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_55 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_55 [Constant] outputs: [577 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_56 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 569 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 577 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_56 [Unsqueeze] inputs: [569 -> ()[INT32]], [577 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_56 for ONNX node: Unsqueeze_56 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 578 for ONNX tensor: 578 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_56 [Unsqueeze] outputs: [578 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_57 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_57 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_57 [Constant] outputs: [579 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_58 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 574 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 579 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_58 [Unsqueeze] inputs: [574 -> ()[INT32]], [579 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_58 for ONNX node: Unsqueeze_58 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 580 for ONNX tensor: 580 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_58 [Unsqueeze] outputs: [580 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_59 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 576 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 578 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 580 [05/10/2022-20:07:02] [V] [TRT] Concat_59 [Concat] inputs: [576 -> (1)[INT32]], [578 -> (1)[INT32]], [580 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_59 for ONNX node: Concat_59 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 581 for ONNX tensor: 581 [05/10/2022-20:07:02] [V] [TRT] Concat_59 [Concat] outputs: [581 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_60 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 573 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 581 [05/10/2022-20:07:02] [V] [TRT] Reshape_60 [Reshape] inputs: [573 -> (-1, -1, 256, 19)[FLOAT]], [581 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_60 for ONNX node: Reshape_60 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 582 for ONNX tensor: 582 [05/10/2022-20:07:02] [V] [TRT] Reshape_60 [Reshape] outputs: [582 -> (-1, -1, 4864)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_61 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 582 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3198 [05/10/2022-20:07:02] [V] [TRT] MatMul_61 [MatMul] inputs: [582 -> (-1, -1, 4864)[FLOAT]], [3198 -> (4864, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3198 for ONNX node: 3198 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_61 for ONNX node: MatMul_61 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 584 for ONNX tensor: 584 [05/10/2022-20:07:02] [V] [TRT] MatMul_61 [MatMul] outputs: [584 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_62 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.embed.out.0.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 584 [05/10/2022-20:07:02] [V] [TRT] Add_62 [Add] inputs: [encoder.embed.out.0.bias -> (256)[FLOAT]], [584 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.embed.out.0.bias for ONNX node: encoder.embed.out.0.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_62 for ONNX node: Add_62 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 585 for ONNX tensor: 585 [05/10/2022-20:07:02] [V] [TRT] Add_62 [Add] outputs: [585 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_63 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_63 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_63 [Constant] outputs: [586 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_64 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 585 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 586 [05/10/2022-20:07:02] [V] [TRT] Mul_64 [Mul] inputs: [585 -> (-1, -1, 256)[FLOAT]], [586 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 586 for ONNX node: 586 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_64 for ONNX node: Mul_64 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587 [05/10/2022-20:07:02] [V] [TRT] Mul_64 [Mul] outputs: [587 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_65 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 587 [05/10/2022-20:07:02] [V] [TRT] Shape_65 [Shape] inputs: [587 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_65 for ONNX node: Shape_65 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 588 for ONNX tensor: 588 [05/10/2022-20:07:02] [V] [TRT] Shape_65 [Shape] outputs: [588 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_66 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_66 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_66 [Constant] outputs: [589 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_67 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 588 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 589 [05/10/2022-20:07:02] [V] [TRT] Gather_67 [Gather] inputs: [588 -> (3)[INT32]], [589 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 589 for ONNX node: 589 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_67 for ONNX node: Gather_67 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590 [05/10/2022-20:07:02] [V] [TRT] Gather_67 [Gather] outputs: [590 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_68 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_68 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_68 [Constant] outputs: [591 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_69 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 590 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 591 [05/10/2022-20:07:02] [V] [TRT] Add_69 [Add] inputs: [590 -> ()[INT32]], [591 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 591 for ONNX node: 591 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_69 for ONNX node: Add_69 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 592 for ONNX tensor: 592 [05/10/2022-20:07:02] [V] [TRT] Add_69 [Add] outputs: [592 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_70 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_70 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_70 [Constant] outputs: [593 -> (1, 5000, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_71 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_71 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_71 [Constant] outputs: [598 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_72 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 592 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 598 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_72 [Unsqueeze] inputs: [592 -> ()[INT32]], [598 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_72 for ONNX node: Unsqueeze_72 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 599 for ONNX tensor: 599 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_72 [Unsqueeze] outputs: [599 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_73 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_73 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_73 [Constant] outputs: [602 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Slice_74 [Slice] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 593 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3199 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 599 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3200 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 602 [05/10/2022-20:07:02] [V] [TRT] Slice_74 [Slice] inputs: [593 -> (1, 5000, 256)[FLOAT]], [3199 -> (1)[INT32]], [599 -> (1)[INT32]], [3200 -> (1)[INT32]], [602 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 593 for ONNX node: 593 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Slice_74 for ONNX node: Slice_74 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 603 for ONNX tensor: 603 [05/10/2022-20:07:02] [V] [TRT] Slice_74 [Slice] outputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_75 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_75 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_75 [Constant] outputs: [604 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_76 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_76 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_76 [Constant] outputs: [605 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_77 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_77 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_77 [Constant] outputs: [606 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_78 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_78 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_78 [Constant] outputs: [607 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Slice_79 [Slice] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 552 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 605 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 606 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 604 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 607 [05/10/2022-20:07:02] [V] [TRT] Slice_79 [Slice] inputs: [552 -> (-1, 1, -1)[BOOL]], [605 -> (1)[INT32]], [606 -> (1)[INT32]], [604 -> (1)[INT32]], [607 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Slice_79 for ONNX node: Slice_79 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608 [05/10/2022-20:07:02] [V] [TRT] Slice_79 [Slice] outputs: [608 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_80 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_80 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_80 [Constant] outputs: [609 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_81 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_81 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_81 [Constant] outputs: [610 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_82 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_82 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_82 [Constant] outputs: [611 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_83 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_83 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_83 [Constant] outputs: [612 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Slice_84 [Slice] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 608 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 610 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 611 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 609 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 612 [05/10/2022-20:07:02] [V] [TRT] Slice_84 [Slice] inputs: [608 -> (-1, 1, -1)[BOOL]], [610 -> (1)[INT32]], [611 -> (1)[INT32]], [609 -> (1)[INT32]], [612 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Slice_84 for ONNX node: Slice_84 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613 [05/10/2022-20:07:02] [V] [TRT] Slice_84 [Slice] outputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_85 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 587 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_85 [ReduceMean] inputs: [587 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_85 for ONNX node: ReduceMean_85 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 614 for ONNX tensor: 614 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_85 [ReduceMean] outputs: [614 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sub_86 [Sub] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 587 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 614 [05/10/2022-20:07:02] [V] [TRT] Sub_86 [Sub] inputs: [587 -> (-1, -1, 256)[FLOAT]], [614 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sub_86 for ONNX node: Sub_86 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615 [05/10/2022-20:07:02] [V] [TRT] Sub_86 [Sub] outputs: [615 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_87 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_87 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_87 [Constant] outputs: [616 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Pow_88 [Pow] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 615 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 616 [05/10/2022-20:07:02] [V] [TRT] Pow_88 [Pow] inputs: [615 -> (-1, -1, 256)[FLOAT]], [616 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 616 for ONNX node: 616 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Pow_88 for ONNX node: Pow_88 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 617 for ONNX tensor: 617 [05/10/2022-20:07:02] [V] [TRT] Pow_88 [Pow] outputs: [617 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_89 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 617 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_89 [ReduceMean] inputs: [617 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_89 for ONNX node: ReduceMean_89 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 618 for ONNX tensor: 618 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_89 [ReduceMean] outputs: [618 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_90 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_90 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_90 [Constant] outputs: [619 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_91 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 618 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 619 [05/10/2022-20:07:02] [V] [TRT] Add_91 [Add] inputs: [618 -> (-1, -1, 1)[FLOAT]], [619 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 619 for ONNX node: 619 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_91 for ONNX node: Add_91 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 620 for ONNX tensor: 620 [05/10/2022-20:07:02] [V] [TRT] Add_91 [Add] outputs: [620 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sqrt_92 [Sqrt] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 620 [05/10/2022-20:07:02] [V] [TRT] Sqrt_92 [Sqrt] inputs: [620 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sqrt_92 for ONNX node: Sqrt_92 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 621 for ONNX tensor: 621 [05/10/2022-20:07:02] [V] [TRT] Sqrt_92 [Sqrt] outputs: [621 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Div_93 [Div] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 615 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 621 [05/10/2022-20:07:02] [V] [TRT] Div_93 [Div] inputs: [615 -> (-1, -1, 256)[FLOAT]], [621 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Div_93 for ONNX node: Div_93 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 622 for ONNX tensor: 622 [05/10/2022-20:07:02] [V] [TRT] Div_93 [Div] outputs: [622 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_94 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 622 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Mul_94 [Mul] inputs: [622 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_ff_macaron.weight for ONNX node: encoder.encoders.0.norm_ff_macaron.weight [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_94 for ONNX node: Mul_94 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 623 for ONNX tensor: 623 [05/10/2022-20:07:02] [V] [TRT] Mul_94 [Mul] outputs: [623 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_95 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 623 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Add_95 [Add] inputs: [623 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_ff_macaron.bias for ONNX node: encoder.encoders.0.norm_ff_macaron.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_95 for ONNX node: Add_95 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 624 for ONNX tensor: 624 [05/10/2022-20:07:02] [V] [TRT] Add_95 [Add] outputs: [624 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_96 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 624 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3201 [05/10/2022-20:07:02] [V] [TRT] MatMul_96 [MatMul] inputs: [624 -> (-1, -1, 256)[FLOAT]], [3201 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3201 for ONNX node: 3201 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_96 for ONNX node: MatMul_96 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 626 for ONNX tensor: 626 [05/10/2022-20:07:02] [V] [TRT] MatMul_96 [MatMul] outputs: [626 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_97 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 626 [05/10/2022-20:07:02] [V] [TRT] Add_97 [Add] inputs: [encoder.encoders.0.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [626 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.0.feed_forward_macaron.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_97 for ONNX node: Add_97 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 627 for ONNX tensor: 627 [05/10/2022-20:07:02] [V] [TRT] Add_97 [Add] outputs: [627 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sigmoid_98 [Sigmoid] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 627 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_98 [Sigmoid] inputs: [627 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sigmoid_98 for ONNX node: Sigmoid_98 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_98 [Sigmoid] outputs: [628 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_99 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 627 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 628 [05/10/2022-20:07:02] [V] [TRT] Mul_99 [Mul] inputs: [627 -> (-1, -1, 2048)[FLOAT]], [628 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_99 for ONNX node: Mul_99 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629 [05/10/2022-20:07:02] [V] [TRT] Mul_99 [Mul] outputs: [629 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_100 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 629 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3202 [05/10/2022-20:07:02] [V] [TRT] MatMul_100 [MatMul] inputs: [629 -> (-1, -1, 2048)[FLOAT]], [3202 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3202 for ONNX node: 3202 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_100 for ONNX node: MatMul_100 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 631 for ONNX tensor: 631 [05/10/2022-20:07:02] [V] [TRT] MatMul_100 [MatMul] outputs: [631 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_101 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 631 [05/10/2022-20:07:02] [V] [TRT] Add_101 [Add] inputs: [encoder.encoders.0.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [631 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.0.feed_forward_macaron.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_101 for ONNX node: Add_101 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 632 for ONNX tensor: 632 [05/10/2022-20:07:02] [V] [TRT] Add_101 [Add] outputs: [632 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_102 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_102 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_102 [Constant] outputs: [633 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_103 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 632 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 633 [05/10/2022-20:07:02] [V] [TRT] Mul_103 [Mul] inputs: [632 -> (-1, -1, 256)[FLOAT]], [633 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 633 for ONNX node: 633 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_103 for ONNX node: Mul_103 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 634 for ONNX tensor: 634 [05/10/2022-20:07:02] [V] [TRT] Mul_103 [Mul] outputs: [634 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_104 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 587 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 634 [05/10/2022-20:07:02] [V] [TRT] Add_104 [Add] inputs: [587 -> (-1, -1, 256)[FLOAT]], [634 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_104 for ONNX node: Add_104 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 635 for ONNX tensor: 635 [05/10/2022-20:07:02] [V] [TRT] Add_104 [Add] outputs: [635 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_105 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 635 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_105 [ReduceMean] inputs: [635 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_105 for ONNX node: ReduceMean_105 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 636 for ONNX tensor: 636 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_105 [ReduceMean] outputs: [636 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sub_106 [Sub] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 635 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 636 [05/10/2022-20:07:02] [V] [TRT] Sub_106 [Sub] inputs: [635 -> (-1, -1, 256)[FLOAT]], [636 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sub_106 for ONNX node: Sub_106 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637 [05/10/2022-20:07:02] [V] [TRT] Sub_106 [Sub] outputs: [637 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_107 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_107 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_107 [Constant] outputs: [638 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Pow_108 [Pow] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 637 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 638 [05/10/2022-20:07:02] [V] [TRT] Pow_108 [Pow] inputs: [637 -> (-1, -1, 256)[FLOAT]], [638 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 638 for ONNX node: 638 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Pow_108 for ONNX node: Pow_108 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 639 for ONNX tensor: 639 [05/10/2022-20:07:02] [V] [TRT] Pow_108 [Pow] outputs: [639 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_109 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 639 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_109 [ReduceMean] inputs: [639 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_109 for ONNX node: ReduceMean_109 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_109 [ReduceMean] outputs: [640 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_110 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_110 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_110 [Constant] outputs: [641 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_111 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 640 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 641 [05/10/2022-20:07:02] [V] [TRT] Add_111 [Add] inputs: [640 -> (-1, -1, 1)[FLOAT]], [641 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 641 for ONNX node: 641 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_111 for ONNX node: Add_111 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642 [05/10/2022-20:07:02] [V] [TRT] Add_111 [Add] outputs: [642 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sqrt_112 [Sqrt] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 642 [05/10/2022-20:07:02] [V] [TRT] Sqrt_112 [Sqrt] inputs: [642 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sqrt_112 for ONNX node: Sqrt_112 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643 [05/10/2022-20:07:02] [V] [TRT] Sqrt_112 [Sqrt] outputs: [643 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Div_113 [Div] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 637 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 643 [05/10/2022-20:07:02] [V] [TRT] Div_113 [Div] inputs: [637 -> (-1, -1, 256)[FLOAT]], [643 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Div_113 for ONNX node: Div_113 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 644 for ONNX tensor: 644 [05/10/2022-20:07:02] [V] [TRT] Div_113 [Div] outputs: [644 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_114 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 644 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Mul_114 [Mul] inputs: [644 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_mha.weight for ONNX node: encoder.encoders.0.norm_mha.weight [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_114 for ONNX node: Mul_114 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 645 for ONNX tensor: 645 [05/10/2022-20:07:02] [V] [TRT] Mul_114 [Mul] outputs: [645 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_115 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 645 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Add_115 [Add] inputs: [645 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_mha.bias for ONNX node: encoder.encoders.0.norm_mha.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_115 for ONNX node: Add_115 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646 [05/10/2022-20:07:02] [V] [TRT] Add_115 [Add] outputs: [646 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_116 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 646 [05/10/2022-20:07:02] [V] [TRT] Shape_116 [Shape] inputs: [646 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_116 for ONNX node: Shape_116 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 647 for ONNX tensor: 647 [05/10/2022-20:07:02] [V] [TRT] Shape_116 [Shape] outputs: [647 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_117 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_117 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_117 [Constant] outputs: [648 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_118 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 647 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 648 [05/10/2022-20:07:02] [V] [TRT] Gather_118 [Gather] inputs: [647 -> (3)[INT32]], [648 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 648 for ONNX node: 648 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_118 for ONNX node: Gather_118 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 649 for ONNX tensor: 649 [05/10/2022-20:07:02] [V] [TRT] Gather_118 [Gather] outputs: [649 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_119 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 646 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3203 [05/10/2022-20:07:02] [V] [TRT] MatMul_119 [MatMul] inputs: [646 -> (-1, -1, 256)[FLOAT]], [3203 -> (256, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3203 for ONNX node: 3203 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_119 for ONNX node: MatMul_119 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 651 for ONNX tensor: 651 [05/10/2022-20:07:02] [V] [TRT] MatMul_119 [MatMul] outputs: [651 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_120 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 651 [05/10/2022-20:07:02] [V] [TRT] Add_120 [Add] inputs: [encoder.encoders.0.self_attn.linear_q.bias -> (256)[FLOAT]], [651 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.self_attn.linear_q.bias for ONNX node: encoder.encoders.0.self_attn.linear_q.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_120 for ONNX node: Add_120 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 652 for ONNX tensor: 652 [05/10/2022-20:07:02] [V] [TRT] Add_120 [Add] outputs: [652 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_121 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_121 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_121 [Constant] outputs: [656 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_122 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 649 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 656 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_122 [Unsqueeze] inputs: [649 -> ()[INT32]], [656 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_122 for ONNX node: Unsqueeze_122 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_122 [Unsqueeze] outputs: [657 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_123 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 657 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3204 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3205 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3206 [05/10/2022-20:07:02] [V] [TRT] Concat_123 [Concat] inputs: [657 -> (1)[INT32]], [3204 -> (1)[INT32]], [3205 -> (1)[INT32]], [3206 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3204 for ONNX node: 3204 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3205 for ONNX node: 3205 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3206 for ONNX node: 3206 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_123 for ONNX node: Concat_123 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 664 for ONNX tensor: 664 [05/10/2022-20:07:02] [V] [TRT] Concat_123 [Concat] outputs: [664 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_124 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 652 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 664 [05/10/2022-20:07:02] [V] [TRT] Reshape_124 [Reshape] inputs: [652 -> (-1, -1, 256)[FLOAT]], [664 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_124 for ONNX node: Reshape_124 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 665 for ONNX tensor: 665 [05/10/2022-20:07:02] [V] [TRT] Reshape_124 [Reshape] outputs: [665 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_125 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 646 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3207 [05/10/2022-20:07:02] [V] [TRT] MatMul_125 [MatMul] inputs: [646 -> (-1, -1, 256)[FLOAT]], [3207 -> (256, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3207 for ONNX node: 3207 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_125 for ONNX node: MatMul_125 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 667 for ONNX tensor: 667 [05/10/2022-20:07:02] [V] [TRT] MatMul_125 [MatMul] outputs: [667 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_126 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 667 [05/10/2022-20:07:02] [V] [TRT] Add_126 [Add] inputs: [encoder.encoders.0.self_attn.linear_k.bias -> (256)[FLOAT]], [667 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.self_attn.linear_k.bias for ONNX node: encoder.encoders.0.self_attn.linear_k.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_126 for ONNX node: Add_126 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 668 for ONNX tensor: 668 [05/10/2022-20:07:02] [V] [TRT] Add_126 [Add] outputs: [668 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_127 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_127 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_127 [Constant] outputs: [672 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_128 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 649 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 672 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_128 [Unsqueeze] inputs: [649 -> ()[INT32]], [672 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_128 for ONNX node: Unsqueeze_128 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 673 for ONNX tensor: 673 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_128 [Unsqueeze] outputs: [673 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_129 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 673 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3208 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3209 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3210 [05/10/2022-20:07:02] [V] [TRT] Concat_129 [Concat] inputs: [673 -> (1)[INT32]], [3208 -> (1)[INT32]], [3209 -> (1)[INT32]], [3210 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3208 for ONNX node: 3208 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3209 for ONNX node: 3209 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3210 for ONNX node: 3210 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_129 for ONNX node: Concat_129 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 680 for ONNX tensor: 680 [05/10/2022-20:07:02] [V] [TRT] Concat_129 [Concat] outputs: [680 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_130 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 668 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 680 [05/10/2022-20:07:02] [V] [TRT] Reshape_130 [Reshape] inputs: [668 -> (-1, -1, 256)[FLOAT]], [680 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_130 for ONNX node: Reshape_130 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 681 for ONNX tensor: 681 [05/10/2022-20:07:02] [V] [TRT] Reshape_130 [Reshape] outputs: [681 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_131 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 646 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3211 [05/10/2022-20:07:02] [V] [TRT] MatMul_131 [MatMul] inputs: [646 -> (-1, -1, 256)[FLOAT]], [3211 -> (256, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3211 for ONNX node: 3211 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_131 for ONNX node: MatMul_131 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 683 for ONNX tensor: 683 [05/10/2022-20:07:02] [V] [TRT] MatMul_131 [MatMul] outputs: [683 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_132 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 683 [05/10/2022-20:07:02] [V] [TRT] Add_132 [Add] inputs: [encoder.encoders.0.self_attn.linear_v.bias -> (256)[FLOAT]], [683 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.self_attn.linear_v.bias for ONNX node: encoder.encoders.0.self_attn.linear_v.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_132 for ONNX node: Add_132 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 684 for ONNX tensor: 684 [05/10/2022-20:07:02] [V] [TRT] Add_132 [Add] outputs: [684 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_133 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_133 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_133 [Constant] outputs: [688 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_134 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 649 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 688 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_134 [Unsqueeze] inputs: [649 -> ()[INT32]], [688 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_134 for ONNX node: Unsqueeze_134 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 689 for ONNX tensor: 689 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_134 [Unsqueeze] outputs: [689 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_135 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 689 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3212 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3213 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3214 [05/10/2022-20:07:02] [V] [TRT] Concat_135 [Concat] inputs: [689 -> (1)[INT32]], [3212 -> (1)[INT32]], [3213 -> (1)[INT32]], [3214 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3212 for ONNX node: 3212 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3213 for ONNX node: 3213 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3214 for ONNX node: 3214 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_135 for ONNX node: Concat_135 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 696 for ONNX tensor: 696 [05/10/2022-20:07:02] [V] [TRT] Concat_135 [Concat] outputs: [696 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_136 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 684 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 696 [05/10/2022-20:07:02] [V] [TRT] Reshape_136 [Reshape] inputs: [684 -> (-1, -1, 256)[FLOAT]], [696 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_136 for ONNX node: Reshape_136 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 697 for ONNX tensor: 697 [05/10/2022-20:07:02] [V] [TRT] Reshape_136 [Reshape] outputs: [697 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_137 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 697 [05/10/2022-20:07:02] [V] [TRT] Transpose_137 [Transpose] inputs: [697 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_137 for ONNX node: Transpose_137 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 698 for ONNX tensor: 698 [05/10/2022-20:07:02] [V] [TRT] Transpose_137 [Transpose] outputs: [698 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_138 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:02] [V] [TRT] Shape_138 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_138 for ONNX node: Shape_138 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 699 for ONNX tensor: 699 [05/10/2022-20:07:02] [V] [TRT] Shape_138 [Shape] outputs: [699 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_139 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_139 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_139 [Constant] outputs: [700 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_140 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 699 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 700 [05/10/2022-20:07:02] [V] [TRT] Gather_140 [Gather] inputs: [699 -> (3)[INT32]], [700 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 700 for ONNX node: 700 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_140 for ONNX node: Gather_140 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 701 for ONNX tensor: 701 [05/10/2022-20:07:02] [V] [TRT] Gather_140 [Gather] outputs: [701 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_141 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3215 [05/10/2022-20:07:02] [V] [TRT] MatMul_141 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3215 -> (256, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3215 for ONNX node: 3215 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_141 for ONNX node: MatMul_141 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 703 for ONNX tensor: 703 [05/10/2022-20:07:02] [V] [TRT] MatMul_141 [MatMul] outputs: [703 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_142 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_142 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_142 [Constant] outputs: [707 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_143 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 701 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 707 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_143 [Unsqueeze] inputs: [701 -> ()[INT32]], [707 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_143 for ONNX node: Unsqueeze_143 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 708 for ONNX tensor: 708 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_143 [Unsqueeze] outputs: [708 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_144 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 708 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3216 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3217 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3218 [05/10/2022-20:07:02] [V] [TRT] Concat_144 [Concat] inputs: [708 -> (1)[INT32]], [3216 -> (1)[INT32]], [3217 -> (1)[INT32]], [3218 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3216 for ONNX node: 3216 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3217 for ONNX node: 3217 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3218 for ONNX node: 3218 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_144 for ONNX node: Concat_144 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 715 for ONNX tensor: 715 [05/10/2022-20:07:02] [V] [TRT] Concat_144 [Concat] outputs: [715 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_145 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 703 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 715 [05/10/2022-20:07:02] [V] [TRT] Reshape_145 [Reshape] inputs: [703 -> (1, -1, 256)[FLOAT]], [715 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_145 for ONNX node: Reshape_145 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 716 for ONNX tensor: 716 [05/10/2022-20:07:02] [V] [TRT] Reshape_145 [Reshape] outputs: [716 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_146 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 665 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Add_146 [Add] inputs: [665 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.0.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.self_attn.pos_bias_u for ONNX node: encoder.encoders.0.self_attn.pos_bias_u [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_146 for ONNX node: Add_146 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 717 for ONNX tensor: 717 [05/10/2022-20:07:02] [V] [TRT] Add_146 [Add] outputs: [717 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_147 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 717 [05/10/2022-20:07:02] [V] [TRT] Transpose_147 [Transpose] inputs: [717 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_147 for ONNX node: Transpose_147 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 718 for ONNX tensor: 718 [05/10/2022-20:07:02] [V] [TRT] Transpose_147 [Transpose] outputs: [718 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_148 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 665 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Add_148 [Add] inputs: [665 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.0.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.self_attn.pos_bias_v for ONNX node: encoder.encoders.0.self_attn.pos_bias_v [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_148 for ONNX node: Add_148 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 719 for ONNX tensor: 719 [05/10/2022-20:07:02] [V] [TRT] Add_148 [Add] outputs: [719 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_149 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 719 [05/10/2022-20:07:02] [V] [TRT] Transpose_149 [Transpose] inputs: [719 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_149 for ONNX node: Transpose_149 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 720 for ONNX tensor: 720 [05/10/2022-20:07:02] [V] [TRT] Transpose_149 [Transpose] outputs: [720 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_150 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 681 [05/10/2022-20:07:02] [V] [TRT] Transpose_150 [Transpose] inputs: [681 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_150 for ONNX node: Transpose_150 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 721 for ONNX tensor: 721 [05/10/2022-20:07:02] [V] [TRT] Transpose_150 [Transpose] outputs: [721 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_151 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 718 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 721 [05/10/2022-20:07:02] [V] [TRT] MatMul_151 [MatMul] inputs: [718 -> (-1, 4, -1, 64)[FLOAT]], [721 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_151 for ONNX node: MatMul_151 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 722 for ONNX tensor: 722 [05/10/2022-20:07:02] [V] [TRT] MatMul_151 [MatMul] outputs: [722 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_152 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 716 [05/10/2022-20:07:02] [V] [TRT] Transpose_152 [Transpose] inputs: [716 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_152 for ONNX node: Transpose_152 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 723 for ONNX tensor: 723 [05/10/2022-20:07:02] [V] [TRT] Transpose_152 [Transpose] outputs: [723 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_153 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 720 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 723 [05/10/2022-20:07:02] [V] [TRT] MatMul_153 [MatMul] inputs: [720 -> (-1, 4, -1, 64)[FLOAT]], [723 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_153 for ONNX node: MatMul_153 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724 [05/10/2022-20:07:02] [V] [TRT] MatMul_153 [MatMul] outputs: [724 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_154 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 722 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 724 [05/10/2022-20:07:02] [V] [TRT] Add_154 [Add] inputs: [722 -> (-1, 4, -1, -1)[FLOAT]], [724 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_154 for ONNX node: Add_154 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 725 for ONNX tensor: 725 [05/10/2022-20:07:02] [V] [TRT] Add_154 [Add] outputs: [725 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_155 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_155 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_155 [Constant] outputs: [726 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Div_156 [Div] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 725 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 726 [05/10/2022-20:07:02] [V] [TRT] Div_156 [Div] inputs: [725 -> (-1, 4, -1, -1)[FLOAT]], [726 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 726 for ONNX node: 726 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Div_156 for ONNX node: Div_156 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 727 for ONNX tensor: 727 [05/10/2022-20:07:02] [V] [TRT] Div_156 [Div] outputs: [727 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Shape_157 [Shape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 698 [05/10/2022-20:07:02] [V] [TRT] Shape_157 [Shape] inputs: [698 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Shape_157 for ONNX node: Shape_157 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 728 for ONNX tensor: 728 [05/10/2022-20:07:02] [V] [TRT] Shape_157 [Shape] outputs: [728 -> (4)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_158 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_158 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_158 [Constant] outputs: [729 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Gather_159 [Gather] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 728 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 729 [05/10/2022-20:07:02] [V] [TRT] Gather_159 [Gather] inputs: [728 -> (4)[INT32]], [729 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 729 for ONNX node: 729 [05/10/2022-20:07:02] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Gather_159 for ONNX node: Gather_159 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 730 for ONNX tensor: 730 [05/10/2022-20:07:02] [V] [TRT] Gather_159 [Gather] outputs: [730 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_160 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_160 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_160 [Constant] outputs: [731 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_161 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 731 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_161 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [731 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_161 for ONNX node: Unsqueeze_161 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 732 for ONNX tensor: 732 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_161 [Unsqueeze] outputs: [732 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_162 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 732 [05/10/2022-20:07:02] [V] [TRT] Cast_162 [Cast] inputs: [732 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_162 for ONNX node: Cast_162 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733 [05/10/2022-20:07:02] [V] [TRT] Cast_162 [Cast] outputs: [733 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_163 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_163 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_163 [Constant] outputs: [734 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Equal_164 [Equal] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 733 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 734 [05/10/2022-20:07:02] [V] [TRT] Equal_164 [Equal] inputs: [733 -> (-1, 1, 1, -1)[INT32]], [734 -> ()[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 734 for ONNX node: 734 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Equal_164 for ONNX node: Equal_164 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 735 for ONNX tensor: 735 [05/10/2022-20:07:02] [V] [TRT] Equal_164 [Equal] outputs: [735 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_165 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 735 [05/10/2022-20:07:02] [V] [TRT] Cast_165 [Cast] inputs: [735 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: bool [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_165 for ONNX node: Cast_165 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 736 for ONNX tensor: 736 [05/10/2022-20:07:02] [V] [TRT] Cast_165 [Cast] outputs: [736 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_166 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_166 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_166 [Constant] outputs: [737 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Where_167 [Where] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 736 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 737 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 727 [05/10/2022-20:07:02] [V] [TRT] Where_167 [Where] inputs: [736 -> (-1, 1, 1, -1)[BOOL]], [737 -> ()[FLOAT]], [727 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 737 for ONNX node: 737 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Where_167 for ONNX node: Where_167 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 738 for ONNX tensor: 738 [05/10/2022-20:07:02] [V] [TRT] Where_167 [Where] outputs: [738 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Softmax_168 [Softmax] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 738 [05/10/2022-20:07:02] [V] [TRT] Softmax_168 [Softmax] inputs: [738 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Softmax_168 for ONNX node: Softmax_168 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739 [05/10/2022-20:07:02] [V] [TRT] Softmax_168 [Softmax] outputs: [739 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_169 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 735 [05/10/2022-20:07:02] [V] [TRT] Cast_169 [Cast] inputs: [735 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: bool [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_169 for ONNX node: Cast_169 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 740 for ONNX tensor: 740 [05/10/2022-20:07:02] [V] [TRT] Cast_169 [Cast] outputs: [740 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_170 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_170 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_170 [Constant] outputs: [741 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Where_171 [Where] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 740 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 741 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 739 [05/10/2022-20:07:02] [V] [TRT] Where_171 [Where] inputs: [740 -> (-1, 1, 1, -1)[BOOL]], [741 -> ()[FLOAT]], [739 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 741 for ONNX node: 741 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Where_171 for ONNX node: Where_171 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742 [05/10/2022-20:07:02] [V] [TRT] Where_171 [Where] outputs: [742 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_172 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 742 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 698 [05/10/2022-20:07:02] [V] [TRT] MatMul_172 [MatMul] inputs: [742 -> (-1, 4, -1, -1)[FLOAT]], [698 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_172 for ONNX node: MatMul_172 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743 [05/10/2022-20:07:02] [V] [TRT] MatMul_172 [MatMul] outputs: [743 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_173 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 743 [05/10/2022-20:07:02] [V] [TRT] Transpose_173 [Transpose] inputs: [743 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_173 for ONNX node: Transpose_173 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744 [05/10/2022-20:07:02] [V] [TRT] Transpose_173 [Transpose] outputs: [744 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_174 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_174 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_174 [Constant] outputs: [747 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Unsqueeze_175 [Unsqueeze] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 730 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 747 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_175 [Unsqueeze] inputs: [730 -> ()[INT32]], [747 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Unsqueeze_175 for ONNX node: Unsqueeze_175 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 748 for ONNX tensor: 748 [05/10/2022-20:07:02] [V] [TRT] Unsqueeze_175 [Unsqueeze] outputs: [748 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Concat_176 [Concat] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 748 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3219 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3220 [05/10/2022-20:07:02] [V] [TRT] Concat_176 [Concat] inputs: [748 -> (1)[INT32]], [3219 -> (1)[INT32]], [3220 -> (1)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3219 for ONNX node: 3219 [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3220 for ONNX node: 3220 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Concat_176 for ONNX node: Concat_176 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 753 for ONNX tensor: 753 [05/10/2022-20:07:02] [V] [TRT] Concat_176 [Concat] outputs: [753 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Reshape_177 [Reshape] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 744 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 753 [05/10/2022-20:07:02] [V] [TRT] Reshape_177 [Reshape] inputs: [744 -> (-1, -1, 4, 64)[FLOAT]], [753 -> (3)[INT32]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Reshape_177 for ONNX node: Reshape_177 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 754 for ONNX tensor: 754 [05/10/2022-20:07:02] [V] [TRT] Reshape_177 [Reshape] outputs: [754 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_178 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 754 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3221 [05/10/2022-20:07:02] [V] [TRT] MatMul_178 [MatMul] inputs: [754 -> (-1, -1, 256)[FLOAT]], [3221 -> (256, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3221 for ONNX node: 3221 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_178 for ONNX node: MatMul_178 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 756 for ONNX tensor: 756 [05/10/2022-20:07:02] [V] [TRT] MatMul_178 [MatMul] outputs: [756 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_179 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 756 [05/10/2022-20:07:02] [V] [TRT] Add_179 [Add] inputs: [encoder.encoders.0.self_attn.linear_out.bias -> (256)[FLOAT]], [756 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.self_attn.linear_out.bias for ONNX node: encoder.encoders.0.self_attn.linear_out.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_179 for ONNX node: Add_179 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 757 for ONNX tensor: 757 [05/10/2022-20:07:02] [V] [TRT] Add_179 [Add] outputs: [757 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_180 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 635 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 757 [05/10/2022-20:07:02] [V] [TRT] Add_180 [Add] inputs: [635 -> (-1, -1, 256)[FLOAT]], [757 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_180 for ONNX node: Add_180 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 758 for ONNX tensor: 758 [05/10/2022-20:07:02] [V] [TRT] Add_180 [Add] outputs: [758 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_181 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 758 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_181 [ReduceMean] inputs: [758 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_181 for ONNX node: ReduceMean_181 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 759 for ONNX tensor: 759 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_181 [ReduceMean] outputs: [759 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sub_182 [Sub] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 758 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 759 [05/10/2022-20:07:02] [V] [TRT] Sub_182 [Sub] inputs: [758 -> (-1, -1, 256)[FLOAT]], [759 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sub_182 for ONNX node: Sub_182 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760 [05/10/2022-20:07:02] [V] [TRT] Sub_182 [Sub] outputs: [760 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_183 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_183 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_183 [Constant] outputs: [761 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Pow_184 [Pow] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 760 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 761 [05/10/2022-20:07:02] [V] [TRT] Pow_184 [Pow] inputs: [760 -> (-1, -1, 256)[FLOAT]], [761 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 761 for ONNX node: 761 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Pow_184 for ONNX node: Pow_184 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762 [05/10/2022-20:07:02] [V] [TRT] Pow_184 [Pow] outputs: [762 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_185 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 762 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_185 [ReduceMean] inputs: [762 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_185 for ONNX node: ReduceMean_185 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_185 [ReduceMean] outputs: [763 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_186 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_186 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_186 [Constant] outputs: [764 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_187 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 763 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 764 [05/10/2022-20:07:02] [V] [TRT] Add_187 [Add] inputs: [763 -> (-1, -1, 1)[FLOAT]], [764 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 764 for ONNX node: 764 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_187 for ONNX node: Add_187 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 765 for ONNX tensor: 765 [05/10/2022-20:07:02] [V] [TRT] Add_187 [Add] outputs: [765 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sqrt_188 [Sqrt] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 765 [05/10/2022-20:07:02] [V] [TRT] Sqrt_188 [Sqrt] inputs: [765 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sqrt_188 for ONNX node: Sqrt_188 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766 [05/10/2022-20:07:02] [V] [TRT] Sqrt_188 [Sqrt] outputs: [766 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Div_189 [Div] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 760 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 766 [05/10/2022-20:07:02] [V] [TRT] Div_189 [Div] inputs: [760 -> (-1, -1, 256)[FLOAT]], [766 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Div_189 for ONNX node: Div_189 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 767 for ONNX tensor: 767 [05/10/2022-20:07:02] [V] [TRT] Div_189 [Div] outputs: [767 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_190 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 767 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Mul_190 [Mul] inputs: [767 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_conv.weight for ONNX node: encoder.encoders.0.norm_conv.weight [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_190 for ONNX node: Mul_190 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 768 for ONNX tensor: 768 [05/10/2022-20:07:02] [V] [TRT] Mul_190 [Mul] outputs: [768 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_191 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 768 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Add_191 [Add] inputs: [768 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_conv.bias for ONNX node: encoder.encoders.0.norm_conv.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_191 for ONNX node: Add_191 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769 [05/10/2022-20:07:02] [V] [TRT] Add_191 [Add] outputs: [769 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_192 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 769 [05/10/2022-20:07:02] [V] [TRT] Transpose_192 [Transpose] inputs: [769 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_192 for ONNX node: Transpose_192 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 770 for ONNX tensor: 770 [05/10/2022-20:07:02] [V] [TRT] Transpose_192 [Transpose] outputs: [770 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Not_193 [Not] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:02] [V] [TRT] Not_193 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Not_193 for ONNX node: Not_193 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771 [05/10/2022-20:07:02] [V] [TRT] Not_193 [Not] outputs: [771 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_194 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 771 [05/10/2022-20:07:02] [V] [TRT] Cast_194 [Cast] inputs: [771 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: bool [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_194 for ONNX node: Cast_194 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 772 for ONNX tensor: 772 [05/10/2022-20:07:02] [V] [TRT] Cast_194 [Cast] outputs: [772 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_195 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_195 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_195 [Constant] outputs: [773 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Where_196 [Where] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 772 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 773 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 770 [05/10/2022-20:07:02] [V] [TRT] Where_196 [Where] inputs: [772 -> (-1, 1, -1)[BOOL]], [773 -> ()[FLOAT]], [770 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 773 for ONNX node: 773 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Where_196 for ONNX node: Where_196 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 774 for ONNX tensor: 774 [05/10/2022-20:07:02] [V] [TRT] Where_196 [Where] outputs: [774 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Conv_197 [Conv] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 774 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.conv_module.pointwise_conv1.weight [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.conv_module.pointwise_conv1.bias [05/10/2022-20:07:02] [V] [TRT] Conv_197 [Conv] inputs: [774 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.0.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.0.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Conv_197 for ONNX node: Conv_197 [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:02] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 775 for ONNX tensor: 775 [05/10/2022-20:07:02] [V] [TRT] Conv_197 [Conv] outputs: [775 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Split_198 [Split] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 775 [05/10/2022-20:07:02] [V] [TRT] Split_198 [Split] inputs: [775 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Split_198 for ONNX node: Split_198 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Split_198_2 for ONNX node: Split_198 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 776 for ONNX tensor: 776 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 777 for ONNX tensor: 777 [05/10/2022-20:07:02] [V] [TRT] Split_198 [Split] outputs: [776 -> (-1, 256, -1)[FLOAT]], [777 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sigmoid_199 [Sigmoid] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 777 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_199 [Sigmoid] inputs: [777 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sigmoid_199 for ONNX node: Sigmoid_199 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 778 for ONNX tensor: 778 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_199 [Sigmoid] outputs: [778 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_200 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 776 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 778 [05/10/2022-20:07:02] [V] [TRT] Mul_200 [Mul] inputs: [776 -> (-1, 256, -1)[FLOAT]], [778 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_200 for ONNX node: Mul_200 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 779 for ONNX tensor: 779 [05/10/2022-20:07:02] [V] [TRT] Mul_200 [Mul] outputs: [779 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Conv_201 [Conv] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 779 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3161 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3162 [05/10/2022-20:07:02] [V] [TRT] Conv_201 [Conv] inputs: [779 -> (-1, 256, -1)[FLOAT]], [3161 -> (256, 1, 15)[FLOAT]], [3162 -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Conv_201 for ONNX node: Conv_201 [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:02] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:02] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 3160 for ONNX tensor: 3160 [05/10/2022-20:07:02] [V] [TRT] Conv_201 [Conv] outputs: [3160 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sigmoid_202 [Sigmoid] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3160 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_202 [Sigmoid] inputs: [3160 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sigmoid_202 for ONNX node: Sigmoid_202 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 782 for ONNX tensor: 782 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_202 [Sigmoid] outputs: [782 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_203 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3160 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 782 [05/10/2022-20:07:02] [V] [TRT] Mul_203 [Mul] inputs: [3160 -> (-1, 256, -1)[FLOAT]], [782 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_203 for ONNX node: Mul_203 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 783 for ONNX tensor: 783 [05/10/2022-20:07:02] [V] [TRT] Mul_203 [Mul] outputs: [783 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Not_204 [Not] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:02] [V] [TRT] Not_204 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Not_204 for ONNX node: Not_204 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 784 for ONNX tensor: 784 [05/10/2022-20:07:02] [V] [TRT] Not_204 [Not] outputs: [784 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Conv_205 [Conv] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 783 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.conv_module.pointwise_conv2.weight [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.conv_module.pointwise_conv2.bias [05/10/2022-20:07:02] [V] [TRT] Conv_205 [Conv] inputs: [783 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.0.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.0.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:02] [V] [TRT] Registering layer: Conv_205 for ONNX node: Conv_205 [05/10/2022-20:07:02] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:02] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:02] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 785 for ONNX tensor: 785 [05/10/2022-20:07:02] [V] [TRT] Conv_205 [Conv] outputs: [785 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Cast_206 [Cast] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 784 [05/10/2022-20:07:02] [V] [TRT] Cast_206 [Cast] inputs: [784 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Casting to type: bool [05/10/2022-20:07:02] [V] [TRT] Registering layer: Cast_206 for ONNX node: Cast_206 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786 [05/10/2022-20:07:02] [V] [TRT] Cast_206 [Cast] outputs: [786 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_207 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_207 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_207 [Constant] outputs: [787 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Where_208 [Where] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 786 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 787 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 785 [05/10/2022-20:07:02] [V] [TRT] Where_208 [Where] inputs: [786 -> (-1, 1, -1)[BOOL]], [787 -> ()[FLOAT]], [785 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 787 for ONNX node: 787 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Where_208 for ONNX node: Where_208 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 788 for ONNX tensor: 788 [05/10/2022-20:07:02] [V] [TRT] Where_208 [Where] outputs: [788 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Transpose_209 [Transpose] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 788 [05/10/2022-20:07:02] [V] [TRT] Transpose_209 [Transpose] inputs: [788 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Transpose_209 for ONNX node: Transpose_209 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 789 for ONNX tensor: 789 [05/10/2022-20:07:02] [V] [TRT] Transpose_209 [Transpose] outputs: [789 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_210 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 758 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 789 [05/10/2022-20:07:02] [V] [TRT] Add_210 [Add] inputs: [758 -> (-1, -1, 256)[FLOAT]], [789 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_210 for ONNX node: Add_210 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 790 for ONNX tensor: 790 [05/10/2022-20:07:02] [V] [TRT] Add_210 [Add] outputs: [790 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_211 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 790 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_211 [ReduceMean] inputs: [790 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_211 for ONNX node: ReduceMean_211 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 791 for ONNX tensor: 791 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_211 [ReduceMean] outputs: [791 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sub_212 [Sub] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 790 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 791 [05/10/2022-20:07:02] [V] [TRT] Sub_212 [Sub] inputs: [790 -> (-1, -1, 256)[FLOAT]], [791 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sub_212 for ONNX node: Sub_212 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 792 for ONNX tensor: 792 [05/10/2022-20:07:02] [V] [TRT] Sub_212 [Sub] outputs: [792 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_213 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_213 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_213 [Constant] outputs: [793 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Pow_214 [Pow] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 792 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 793 [05/10/2022-20:07:02] [V] [TRT] Pow_214 [Pow] inputs: [792 -> (-1, -1, 256)[FLOAT]], [793 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 793 for ONNX node: 793 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Pow_214 for ONNX node: Pow_214 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 794 for ONNX tensor: 794 [05/10/2022-20:07:02] [V] [TRT] Pow_214 [Pow] outputs: [794 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_215 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 794 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_215 [ReduceMean] inputs: [794 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_215 for ONNX node: ReduceMean_215 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_215 [ReduceMean] outputs: [795 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_216 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_216 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_216 [Constant] outputs: [796 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_217 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 795 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 796 [05/10/2022-20:07:02] [V] [TRT] Add_217 [Add] inputs: [795 -> (-1, -1, 1)[FLOAT]], [796 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 796 for ONNX node: 796 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_217 for ONNX node: Add_217 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 797 for ONNX tensor: 797 [05/10/2022-20:07:02] [V] [TRT] Add_217 [Add] outputs: [797 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sqrt_218 [Sqrt] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 797 [05/10/2022-20:07:02] [V] [TRT] Sqrt_218 [Sqrt] inputs: [797 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sqrt_218 for ONNX node: Sqrt_218 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 798 for ONNX tensor: 798 [05/10/2022-20:07:02] [V] [TRT] Sqrt_218 [Sqrt] outputs: [798 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Div_219 [Div] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 792 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 798 [05/10/2022-20:07:02] [V] [TRT] Div_219 [Div] inputs: [792 -> (-1, -1, 256)[FLOAT]], [798 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Div_219 for ONNX node: Div_219 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 799 for ONNX tensor: 799 [05/10/2022-20:07:02] [V] [TRT] Div_219 [Div] outputs: [799 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_220 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 799 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Mul_220 [Mul] inputs: [799 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_ff.weight for ONNX node: encoder.encoders.0.norm_ff.weight [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_220 for ONNX node: Mul_220 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 800 for ONNX tensor: 800 [05/10/2022-20:07:02] [V] [TRT] Mul_220 [Mul] outputs: [800 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_221 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 800 [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Add_221 [Add] inputs: [800 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.norm_ff.bias for ONNX node: encoder.encoders.0.norm_ff.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_221 for ONNX node: Add_221 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 801 for ONNX tensor: 801 [05/10/2022-20:07:02] [V] [TRT] Add_221 [Add] outputs: [801 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_222 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 801 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3222 [05/10/2022-20:07:02] [V] [TRT] MatMul_222 [MatMul] inputs: [801 -> (-1, -1, 256)[FLOAT]], [3222 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3222 for ONNX node: 3222 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_222 for ONNX node: MatMul_222 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 803 for ONNX tensor: 803 [05/10/2022-20:07:02] [V] [TRT] MatMul_222 [MatMul] outputs: [803 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_223 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 803 [05/10/2022-20:07:02] [V] [TRT] Add_223 [Add] inputs: [encoder.encoders.0.feed_forward.w_1.bias -> (2048)[FLOAT]], [803 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.feed_forward.w_1.bias for ONNX node: encoder.encoders.0.feed_forward.w_1.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_223 for ONNX node: Add_223 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 804 for ONNX tensor: 804 [05/10/2022-20:07:02] [V] [TRT] Add_223 [Add] outputs: [804 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sigmoid_224 [Sigmoid] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 804 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_224 [Sigmoid] inputs: [804 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sigmoid_224 for ONNX node: Sigmoid_224 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 805 for ONNX tensor: 805 [05/10/2022-20:07:02] [V] [TRT] Sigmoid_224 [Sigmoid] outputs: [805 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_225 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 804 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 805 [05/10/2022-20:07:02] [V] [TRT] Mul_225 [Mul] inputs: [804 -> (-1, -1, 2048)[FLOAT]], [805 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_225 for ONNX node: Mul_225 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 806 for ONNX tensor: 806 [05/10/2022-20:07:02] [V] [TRT] Mul_225 [Mul] outputs: [806 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: MatMul_226 [MatMul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 806 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 3223 [05/10/2022-20:07:02] [V] [TRT] MatMul_226 [MatMul] inputs: [806 -> (-1, -1, 2048)[FLOAT]], [3223 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 3223 for ONNX node: 3223 [05/10/2022-20:07:02] [V] [TRT] Registering layer: MatMul_226 for ONNX node: MatMul_226 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 808 for ONNX tensor: 808 [05/10/2022-20:07:02] [V] [TRT] MatMul_226 [MatMul] outputs: [808 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_227 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: encoder.encoders.0.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Searching for input: 808 [05/10/2022-20:07:02] [V] [TRT] Add_227 [Add] inputs: [encoder.encoders.0.feed_forward.w_2.bias -> (256)[FLOAT]], [808 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: encoder.encoders.0.feed_forward.w_2.bias for ONNX node: encoder.encoders.0.feed_forward.w_2.bias [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_227 for ONNX node: Add_227 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 809 for ONNX tensor: 809 [05/10/2022-20:07:02] [V] [TRT] Add_227 [Add] outputs: [809 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Constant_228 [Constant] [05/10/2022-20:07:02] [V] [TRT] Constant_228 [Constant] inputs: [05/10/2022-20:07:02] [V] [TRT] Constant_228 [Constant] outputs: [810 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Mul_229 [Mul] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 809 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 810 [05/10/2022-20:07:02] [V] [TRT] Mul_229 [Mul] inputs: [809 -> (-1, -1, 256)[FLOAT]], [810 -> ()[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: 810 for ONNX node: 810 [05/10/2022-20:07:02] [V] [TRT] Registering layer: Mul_229 for ONNX node: Mul_229 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 811 for ONNX tensor: 811 [05/10/2022-20:07:02] [V] [TRT] Mul_229 [Mul] outputs: [811 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Add_230 [Add] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 790 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 811 [05/10/2022-20:07:02] [V] [TRT] Add_230 [Add] inputs: [790 -> (-1, -1, 256)[FLOAT]], [811 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Add_230 for ONNX node: Add_230 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 812 for ONNX tensor: 812 [05/10/2022-20:07:02] [V] [TRT] Add_230 [Add] outputs: [812 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: ReduceMean_231 [ReduceMean] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 812 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_231 [ReduceMean] inputs: [812 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: ReduceMean_231 for ONNX node: ReduceMean_231 [05/10/2022-20:07:02] [V] [TRT] Registering tensor: 813 for ONNX tensor: 813 [05/10/2022-20:07:02] [V] [TRT] ReduceMean_231 [ReduceMean] outputs: [813 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Parsing node: Sub_232 [Sub] [05/10/2022-20:07:02] [V] [TRT] Searching for input: 812 [05/10/2022-20:07:02] [V] [TRT] Searching for input: 813 [05/10/2022-20:07:02] [V] [TRT] Sub_232 [Sub] inputs: [812 -> (-1, -1, 256)[FLOAT]], [813 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:02] [V] [TRT] Registering layer: Sub_232 for ONNX node: Sub_232 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 814 for ONNX tensor: 814 [05/10/2022-20:07:03] [V] [TRT] Sub_232 [Sub] outputs: [814 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_233 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_233 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_233 [Constant] outputs: [815 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_234 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 814 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 815 [05/10/2022-20:07:03] [V] [TRT] Pow_234 [Pow] inputs: [814 -> (-1, -1, 256)[FLOAT]], [815 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 815 for ONNX node: 815 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_234 for ONNX node: Pow_234 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 816 for ONNX tensor: 816 [05/10/2022-20:07:03] [V] [TRT] Pow_234 [Pow] outputs: [816 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_235 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 816 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_235 [ReduceMean] inputs: [816 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_235 for ONNX node: ReduceMean_235 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 817 for ONNX tensor: 817 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_235 [ReduceMean] outputs: [817 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_236 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_236 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_236 [Constant] outputs: [818 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_237 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 817 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 818 [05/10/2022-20:07:03] [V] [TRT] Add_237 [Add] inputs: [817 -> (-1, -1, 1)[FLOAT]], [818 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 818 for ONNX node: 818 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_237 for ONNX node: Add_237 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 819 for ONNX tensor: 819 [05/10/2022-20:07:03] [V] [TRT] Add_237 [Add] outputs: [819 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_238 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 819 [05/10/2022-20:07:03] [V] [TRT] Sqrt_238 [Sqrt] inputs: [819 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_238 for ONNX node: Sqrt_238 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 820 for ONNX tensor: 820 [05/10/2022-20:07:03] [V] [TRT] Sqrt_238 [Sqrt] outputs: [820 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_239 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 814 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 820 [05/10/2022-20:07:03] [V] [TRT] Div_239 [Div] inputs: [814 -> (-1, -1, 256)[FLOAT]], [820 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_239 for ONNX node: Div_239 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 821 for ONNX tensor: 821 [05/10/2022-20:07:03] [V] [TRT] Div_239 [Div] outputs: [821 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_240 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 821 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.0.norm_final.weight [05/10/2022-20:07:03] [V] [TRT] Mul_240 [Mul] inputs: [821 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.0.norm_final.weight for ONNX node: encoder.encoders.0.norm_final.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_240 for ONNX node: Mul_240 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 822 for ONNX tensor: 822 [05/10/2022-20:07:03] [V] [TRT] Mul_240 [Mul] outputs: [822 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_241 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 822 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.0.norm_final.bias [05/10/2022-20:07:03] [V] [TRT] Add_241 [Add] inputs: [822 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.0.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.0.norm_final.bias for ONNX node: encoder.encoders.0.norm_final.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_241 for ONNX node: Add_241 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823 [05/10/2022-20:07:03] [V] [TRT] Add_241 [Add] outputs: [823 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_242 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 823 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_242 [ReduceMean] inputs: [823 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_242 for ONNX node: ReduceMean_242 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 824 for ONNX tensor: 824 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_242 [ReduceMean] outputs: [824 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_243 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 823 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 824 [05/10/2022-20:07:03] [V] [TRT] Sub_243 [Sub] inputs: [823 -> (-1, -1, 256)[FLOAT]], [824 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_243 for ONNX node: Sub_243 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 825 for ONNX tensor: 825 [05/10/2022-20:07:03] [V] [TRT] Sub_243 [Sub] outputs: [825 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_244 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_244 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_244 [Constant] outputs: [826 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_245 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 825 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 826 [05/10/2022-20:07:03] [V] [TRT] Pow_245 [Pow] inputs: [825 -> (-1, -1, 256)[FLOAT]], [826 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 826 for ONNX node: 826 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_245 for ONNX node: Pow_245 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 827 for ONNX tensor: 827 [05/10/2022-20:07:03] [V] [TRT] Pow_245 [Pow] outputs: [827 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_246 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 827 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_246 [ReduceMean] inputs: [827 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_246 for ONNX node: ReduceMean_246 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 828 for ONNX tensor: 828 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_246 [ReduceMean] outputs: [828 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_247 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_247 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_247 [Constant] outputs: [829 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_248 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 828 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 829 [05/10/2022-20:07:03] [V] [TRT] Add_248 [Add] inputs: [828 -> (-1, -1, 1)[FLOAT]], [829 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 829 for ONNX node: 829 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_248 for ONNX node: Add_248 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 830 for ONNX tensor: 830 [05/10/2022-20:07:03] [V] [TRT] Add_248 [Add] outputs: [830 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_249 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 830 [05/10/2022-20:07:03] [V] [TRT] Sqrt_249 [Sqrt] inputs: [830 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_249 for ONNX node: Sqrt_249 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 831 for ONNX tensor: 831 [05/10/2022-20:07:03] [V] [TRT] Sqrt_249 [Sqrt] outputs: [831 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_250 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 825 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 831 [05/10/2022-20:07:03] [V] [TRT] Div_250 [Div] inputs: [825 -> (-1, -1, 256)[FLOAT]], [831 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_250 for ONNX node: Div_250 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 832 for ONNX tensor: 832 [05/10/2022-20:07:03] [V] [TRT] Div_250 [Div] outputs: [832 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_251 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 832 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_ff_macaron.weight [05/10/2022-20:07:03] [V] [TRT] Mul_251 [Mul] inputs: [832 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_ff_macaron.weight for ONNX node: encoder.encoders.1.norm_ff_macaron.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_251 for ONNX node: Mul_251 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 833 for ONNX tensor: 833 [05/10/2022-20:07:03] [V] [TRT] Mul_251 [Mul] outputs: [833 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_252 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 833 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_ff_macaron.bias [05/10/2022-20:07:03] [V] [TRT] Add_252 [Add] inputs: [833 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_ff_macaron.bias for ONNX node: encoder.encoders.1.norm_ff_macaron.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_252 for ONNX node: Add_252 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 834 for ONNX tensor: 834 [05/10/2022-20:07:03] [V] [TRT] Add_252 [Add] outputs: [834 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_253 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 834 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3224 [05/10/2022-20:07:03] [V] [TRT] MatMul_253 [MatMul] inputs: [834 -> (-1, -1, 256)[FLOAT]], [3224 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3224 for ONNX node: 3224 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_253 for ONNX node: MatMul_253 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 836 for ONNX tensor: 836 [05/10/2022-20:07:03] [V] [TRT] MatMul_253 [MatMul] outputs: [836 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_254 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.feed_forward_macaron.w_1.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 836 [05/10/2022-20:07:03] [V] [TRT] Add_254 [Add] inputs: [encoder.encoders.1.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [836 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.1.feed_forward_macaron.w_1.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_254 for ONNX node: Add_254 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 837 for ONNX tensor: 837 [05/10/2022-20:07:03] [V] [TRT] Add_254 [Add] outputs: [837 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sigmoid_255 [Sigmoid] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 837 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_255 [Sigmoid] inputs: [837 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sigmoid_255 for ONNX node: Sigmoid_255 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 838 for ONNX tensor: 838 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_255 [Sigmoid] outputs: [838 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_256 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 837 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 838 [05/10/2022-20:07:03] [V] [TRT] Mul_256 [Mul] inputs: [837 -> (-1, -1, 2048)[FLOAT]], [838 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_256 for ONNX node: Mul_256 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 839 for ONNX tensor: 839 [05/10/2022-20:07:03] [V] [TRT] Mul_256 [Mul] outputs: [839 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_257 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 839 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3225 [05/10/2022-20:07:03] [V] [TRT] MatMul_257 [MatMul] inputs: [839 -> (-1, -1, 2048)[FLOAT]], [3225 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3225 for ONNX node: 3225 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_257 for ONNX node: MatMul_257 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 841 for ONNX tensor: 841 [05/10/2022-20:07:03] [V] [TRT] MatMul_257 [MatMul] outputs: [841 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_258 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.feed_forward_macaron.w_2.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 841 [05/10/2022-20:07:03] [V] [TRT] Add_258 [Add] inputs: [encoder.encoders.1.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [841 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.1.feed_forward_macaron.w_2.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_258 for ONNX node: Add_258 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 842 for ONNX tensor: 842 [05/10/2022-20:07:03] [V] [TRT] Add_258 [Add] outputs: [842 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_259 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_259 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_259 [Constant] outputs: [843 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_260 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 842 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 843 [05/10/2022-20:07:03] [V] [TRT] Mul_260 [Mul] inputs: [842 -> (-1, -1, 256)[FLOAT]], [843 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 843 for ONNX node: 843 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_260 for ONNX node: Mul_260 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 844 for ONNX tensor: 844 [05/10/2022-20:07:03] [V] [TRT] Mul_260 [Mul] outputs: [844 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_261 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 823 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 844 [05/10/2022-20:07:03] [V] [TRT] Add_261 [Add] inputs: [823 -> (-1, -1, 256)[FLOAT]], [844 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_261 for ONNX node: Add_261 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 845 for ONNX tensor: 845 [05/10/2022-20:07:03] [V] [TRT] Add_261 [Add] outputs: [845 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_262 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 845 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_262 [ReduceMean] inputs: [845 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_262 for ONNX node: ReduceMean_262 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 846 for ONNX tensor: 846 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_262 [ReduceMean] outputs: [846 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_263 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 845 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 846 [05/10/2022-20:07:03] [V] [TRT] Sub_263 [Sub] inputs: [845 -> (-1, -1, 256)[FLOAT]], [846 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_263 for ONNX node: Sub_263 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 847 for ONNX tensor: 847 [05/10/2022-20:07:03] [V] [TRT] Sub_263 [Sub] outputs: [847 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_264 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_264 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_264 [Constant] outputs: [848 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_265 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 847 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 848 [05/10/2022-20:07:03] [V] [TRT] Pow_265 [Pow] inputs: [847 -> (-1, -1, 256)[FLOAT]], [848 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 848 for ONNX node: 848 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_265 for ONNX node: Pow_265 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 849 for ONNX tensor: 849 [05/10/2022-20:07:03] [V] [TRT] Pow_265 [Pow] outputs: [849 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_266 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 849 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_266 [ReduceMean] inputs: [849 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_266 for ONNX node: ReduceMean_266 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 850 for ONNX tensor: 850 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_266 [ReduceMean] outputs: [850 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_267 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_267 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_267 [Constant] outputs: [851 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_268 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 850 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 851 [05/10/2022-20:07:03] [V] [TRT] Add_268 [Add] inputs: [850 -> (-1, -1, 1)[FLOAT]], [851 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 851 for ONNX node: 851 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_268 for ONNX node: Add_268 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 852 for ONNX tensor: 852 [05/10/2022-20:07:03] [V] [TRT] Add_268 [Add] outputs: [852 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_269 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 852 [05/10/2022-20:07:03] [V] [TRT] Sqrt_269 [Sqrt] inputs: [852 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_269 for ONNX node: Sqrt_269 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 853 for ONNX tensor: 853 [05/10/2022-20:07:03] [V] [TRT] Sqrt_269 [Sqrt] outputs: [853 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_270 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 847 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 853 [05/10/2022-20:07:03] [V] [TRT] Div_270 [Div] inputs: [847 -> (-1, -1, 256)[FLOAT]], [853 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_270 for ONNX node: Div_270 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 854 for ONNX tensor: 854 [05/10/2022-20:07:03] [V] [TRT] Div_270 [Div] outputs: [854 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_271 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 854 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_mha.weight [05/10/2022-20:07:03] [V] [TRT] Mul_271 [Mul] inputs: [854 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_mha.weight for ONNX node: encoder.encoders.1.norm_mha.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_271 for ONNX node: Mul_271 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 855 for ONNX tensor: 855 [05/10/2022-20:07:03] [V] [TRT] Mul_271 [Mul] outputs: [855 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_272 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 855 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_mha.bias [05/10/2022-20:07:03] [V] [TRT] Add_272 [Add] inputs: [855 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_mha.bias for ONNX node: encoder.encoders.1.norm_mha.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_272 for ONNX node: Add_272 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 856 for ONNX tensor: 856 [05/10/2022-20:07:03] [V] [TRT] Add_272 [Add] outputs: [856 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Shape_273 [Shape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 856 [05/10/2022-20:07:03] [V] [TRT] Shape_273 [Shape] inputs: [856 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Shape_273 for ONNX node: Shape_273 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 857 for ONNX tensor: 857 [05/10/2022-20:07:03] [V] [TRT] Shape_273 [Shape] outputs: [857 -> (3)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_274 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_274 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_274 [Constant] outputs: [858 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Gather_275 [Gather] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 857 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 858 [05/10/2022-20:07:03] [V] [TRT] Gather_275 [Gather] inputs: [857 -> (3)[INT32]], [858 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 858 for ONNX node: 858 [05/10/2022-20:07:03] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Gather_275 for ONNX node: Gather_275 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 859 for ONNX tensor: 859 [05/10/2022-20:07:03] [V] [TRT] Gather_275 [Gather] outputs: [859 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_276 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 856 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3226 [05/10/2022-20:07:03] [V] [TRT] MatMul_276 [MatMul] inputs: [856 -> (-1, -1, 256)[FLOAT]], [3226 -> (256, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3226 for ONNX node: 3226 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_276 for ONNX node: MatMul_276 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 861 for ONNX tensor: 861 [05/10/2022-20:07:03] [V] [TRT] MatMul_276 [MatMul] outputs: [861 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_277 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.self_attn.linear_q.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 861 [05/10/2022-20:07:03] [V] [TRT] Add_277 [Add] inputs: [encoder.encoders.1.self_attn.linear_q.bias -> (256)[FLOAT]], [861 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.self_attn.linear_q.bias for ONNX node: encoder.encoders.1.self_attn.linear_q.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_277 for ONNX node: Add_277 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 862 for ONNX tensor: 862 [05/10/2022-20:07:03] [V] [TRT] Add_277 [Add] outputs: [862 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_278 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_278 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_278 [Constant] outputs: [866 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_279 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 859 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 866 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_279 [Unsqueeze] inputs: [859 -> ()[INT32]], [866 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_279 for ONNX node: Unsqueeze_279 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 867 for ONNX tensor: 867 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_279 [Unsqueeze] outputs: [867 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Concat_280 [Concat] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 867 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3227 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3228 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3229 [05/10/2022-20:07:03] [V] [TRT] Concat_280 [Concat] inputs: [867 -> (1)[INT32]], [3227 -> (1)[INT32]], [3228 -> (1)[INT32]], [3229 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3227 for ONNX node: 3227 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3228 for ONNX node: 3228 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3229 for ONNX node: 3229 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Concat_280 for ONNX node: Concat_280 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874 [05/10/2022-20:07:03] [V] [TRT] Concat_280 [Concat] outputs: [874 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Reshape_281 [Reshape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 862 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 874 [05/10/2022-20:07:03] [V] [TRT] Reshape_281 [Reshape] inputs: [862 -> (-1, -1, 256)[FLOAT]], [874 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Reshape_281 for ONNX node: Reshape_281 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 875 for ONNX tensor: 875 [05/10/2022-20:07:03] [V] [TRT] Reshape_281 [Reshape] outputs: [875 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_282 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 856 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3230 [05/10/2022-20:07:03] [V] [TRT] MatMul_282 [MatMul] inputs: [856 -> (-1, -1, 256)[FLOAT]], [3230 -> (256, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3230 for ONNX node: 3230 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_282 for ONNX node: MatMul_282 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 877 for ONNX tensor: 877 [05/10/2022-20:07:03] [V] [TRT] MatMul_282 [MatMul] outputs: [877 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_283 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.self_attn.linear_k.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 877 [05/10/2022-20:07:03] [V] [TRT] Add_283 [Add] inputs: [encoder.encoders.1.self_attn.linear_k.bias -> (256)[FLOAT]], [877 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.self_attn.linear_k.bias for ONNX node: encoder.encoders.1.self_attn.linear_k.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_283 for ONNX node: Add_283 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 878 for ONNX tensor: 878 [05/10/2022-20:07:03] [V] [TRT] Add_283 [Add] outputs: [878 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_284 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_284 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_284 [Constant] outputs: [882 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_285 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 859 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 882 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_285 [Unsqueeze] inputs: [859 -> ()[INT32]], [882 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_285 for ONNX node: Unsqueeze_285 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_285 [Unsqueeze] outputs: [883 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Concat_286 [Concat] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 883 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3231 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3232 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3233 [05/10/2022-20:07:03] [V] [TRT] Concat_286 [Concat] inputs: [883 -> (1)[INT32]], [3231 -> (1)[INT32]], [3232 -> (1)[INT32]], [3233 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3231 for ONNX node: 3231 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3232 for ONNX node: 3232 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3233 for ONNX node: 3233 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Concat_286 for ONNX node: Concat_286 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 890 for ONNX tensor: 890 [05/10/2022-20:07:03] [V] [TRT] Concat_286 [Concat] outputs: [890 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Reshape_287 [Reshape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 878 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 890 [05/10/2022-20:07:03] [V] [TRT] Reshape_287 [Reshape] inputs: [878 -> (-1, -1, 256)[FLOAT]], [890 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Reshape_287 for ONNX node: Reshape_287 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 891 for ONNX tensor: 891 [05/10/2022-20:07:03] [V] [TRT] Reshape_287 [Reshape] outputs: [891 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_288 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 856 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3234 [05/10/2022-20:07:03] [V] [TRT] MatMul_288 [MatMul] inputs: [856 -> (-1, -1, 256)[FLOAT]], [3234 -> (256, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3234 for ONNX node: 3234 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_288 for ONNX node: MatMul_288 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 893 for ONNX tensor: 893 [05/10/2022-20:07:03] [V] [TRT] MatMul_288 [MatMul] outputs: [893 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_289 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.self_attn.linear_v.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 893 [05/10/2022-20:07:03] [V] [TRT] Add_289 [Add] inputs: [encoder.encoders.1.self_attn.linear_v.bias -> (256)[FLOAT]], [893 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.self_attn.linear_v.bias for ONNX node: encoder.encoders.1.self_attn.linear_v.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_289 for ONNX node: Add_289 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 894 for ONNX tensor: 894 [05/10/2022-20:07:03] [V] [TRT] Add_289 [Add] outputs: [894 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_290 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_290 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_290 [Constant] outputs: [898 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_291 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 859 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 898 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_291 [Unsqueeze] inputs: [859 -> ()[INT32]], [898 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_291 for ONNX node: Unsqueeze_291 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 899 for ONNX tensor: 899 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_291 [Unsqueeze] outputs: [899 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Concat_292 [Concat] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 899 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3235 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3236 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3237 [05/10/2022-20:07:03] [V] [TRT] Concat_292 [Concat] inputs: [899 -> (1)[INT32]], [3235 -> (1)[INT32]], [3236 -> (1)[INT32]], [3237 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3235 for ONNX node: 3235 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3236 for ONNX node: 3236 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3237 for ONNX node: 3237 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Concat_292 for ONNX node: Concat_292 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 906 for ONNX tensor: 906 [05/10/2022-20:07:03] [V] [TRT] Concat_292 [Concat] outputs: [906 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Reshape_293 [Reshape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 894 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 906 [05/10/2022-20:07:03] [V] [TRT] Reshape_293 [Reshape] inputs: [894 -> (-1, -1, 256)[FLOAT]], [906 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Reshape_293 for ONNX node: Reshape_293 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907 [05/10/2022-20:07:03] [V] [TRT] Reshape_293 [Reshape] outputs: [907 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_294 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 907 [05/10/2022-20:07:03] [V] [TRT] Transpose_294 [Transpose] inputs: [907 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_294 for ONNX node: Transpose_294 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 908 for ONNX tensor: 908 [05/10/2022-20:07:03] [V] [TRT] Transpose_294 [Transpose] outputs: [908 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Shape_295 [Shape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:03] [V] [TRT] Shape_295 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Shape_295 for ONNX node: Shape_295 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 909 for ONNX tensor: 909 [05/10/2022-20:07:03] [V] [TRT] Shape_295 [Shape] outputs: [909 -> (3)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_296 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_296 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_296 [Constant] outputs: [910 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Gather_297 [Gather] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 909 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 910 [05/10/2022-20:07:03] [V] [TRT] Gather_297 [Gather] inputs: [909 -> (3)[INT32]], [910 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 910 for ONNX node: 910 [05/10/2022-20:07:03] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Gather_297 for ONNX node: Gather_297 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 911 for ONNX tensor: 911 [05/10/2022-20:07:03] [V] [TRT] Gather_297 [Gather] outputs: [911 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_298 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3238 [05/10/2022-20:07:03] [V] [TRT] MatMul_298 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3238 -> (256, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3238 for ONNX node: 3238 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_298 for ONNX node: MatMul_298 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 913 for ONNX tensor: 913 [05/10/2022-20:07:03] [V] [TRT] MatMul_298 [MatMul] outputs: [913 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_299 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_299 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_299 [Constant] outputs: [917 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_300 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 911 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 917 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_300 [Unsqueeze] inputs: [911 -> ()[INT32]], [917 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_300 for ONNX node: Unsqueeze_300 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 918 for ONNX tensor: 918 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_300 [Unsqueeze] outputs: [918 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Concat_301 [Concat] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 918 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3239 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3240 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3241 [05/10/2022-20:07:03] [V] [TRT] Concat_301 [Concat] inputs: [918 -> (1)[INT32]], [3239 -> (1)[INT32]], [3240 -> (1)[INT32]], [3241 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3239 for ONNX node: 3239 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3240 for ONNX node: 3240 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3241 for ONNX node: 3241 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Concat_301 for ONNX node: Concat_301 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 925 for ONNX tensor: 925 [05/10/2022-20:07:03] [V] [TRT] Concat_301 [Concat] outputs: [925 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Reshape_302 [Reshape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 913 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 925 [05/10/2022-20:07:03] [V] [TRT] Reshape_302 [Reshape] inputs: [913 -> (1, -1, 256)[FLOAT]], [925 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Reshape_302 for ONNX node: Reshape_302 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 926 for ONNX tensor: 926 [05/10/2022-20:07:03] [V] [TRT] Reshape_302 [Reshape] outputs: [926 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_303 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 875 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.self_attn.pos_bias_u [05/10/2022-20:07:03] [V] [TRT] Add_303 [Add] inputs: [875 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.1.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.self_attn.pos_bias_u for ONNX node: encoder.encoders.1.self_attn.pos_bias_u [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_303 for ONNX node: Add_303 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927 [05/10/2022-20:07:03] [V] [TRT] Add_303 [Add] outputs: [927 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_304 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 927 [05/10/2022-20:07:03] [V] [TRT] Transpose_304 [Transpose] inputs: [927 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_304 for ONNX node: Transpose_304 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 928 for ONNX tensor: 928 [05/10/2022-20:07:03] [V] [TRT] Transpose_304 [Transpose] outputs: [928 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_305 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 875 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.self_attn.pos_bias_v [05/10/2022-20:07:03] [V] [TRT] Add_305 [Add] inputs: [875 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.1.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.self_attn.pos_bias_v for ONNX node: encoder.encoders.1.self_attn.pos_bias_v [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_305 for ONNX node: Add_305 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 929 for ONNX tensor: 929 [05/10/2022-20:07:03] [V] [TRT] Add_305 [Add] outputs: [929 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_306 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 929 [05/10/2022-20:07:03] [V] [TRT] Transpose_306 [Transpose] inputs: [929 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_306 for ONNX node: Transpose_306 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 930 for ONNX tensor: 930 [05/10/2022-20:07:03] [V] [TRT] Transpose_306 [Transpose] outputs: [930 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_307 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 891 [05/10/2022-20:07:03] [V] [TRT] Transpose_307 [Transpose] inputs: [891 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_307 for ONNX node: Transpose_307 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 931 for ONNX tensor: 931 [05/10/2022-20:07:03] [V] [TRT] Transpose_307 [Transpose] outputs: [931 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_308 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 928 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 931 [05/10/2022-20:07:03] [V] [TRT] MatMul_308 [MatMul] inputs: [928 -> (-1, 4, -1, 64)[FLOAT]], [931 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_308 for ONNX node: MatMul_308 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 932 for ONNX tensor: 932 [05/10/2022-20:07:03] [V] [TRT] MatMul_308 [MatMul] outputs: [932 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_309 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 926 [05/10/2022-20:07:03] [V] [TRT] Transpose_309 [Transpose] inputs: [926 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_309 for ONNX node: Transpose_309 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 933 for ONNX tensor: 933 [05/10/2022-20:07:03] [V] [TRT] Transpose_309 [Transpose] outputs: [933 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_310 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 930 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 933 [05/10/2022-20:07:03] [V] [TRT] MatMul_310 [MatMul] inputs: [930 -> (-1, 4, -1, 64)[FLOAT]], [933 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_310 for ONNX node: MatMul_310 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 934 for ONNX tensor: 934 [05/10/2022-20:07:03] [V] [TRT] MatMul_310 [MatMul] outputs: [934 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_311 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 932 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 934 [05/10/2022-20:07:03] [V] [TRT] Add_311 [Add] inputs: [932 -> (-1, 4, -1, -1)[FLOAT]], [934 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_311 for ONNX node: Add_311 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 935 for ONNX tensor: 935 [05/10/2022-20:07:03] [V] [TRT] Add_311 [Add] outputs: [935 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_312 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_312 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_312 [Constant] outputs: [936 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_313 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 935 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 936 [05/10/2022-20:07:03] [V] [TRT] Div_313 [Div] inputs: [935 -> (-1, 4, -1, -1)[FLOAT]], [936 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 936 for ONNX node: 936 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_313 for ONNX node: Div_313 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 937 for ONNX tensor: 937 [05/10/2022-20:07:03] [V] [TRT] Div_313 [Div] outputs: [937 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Shape_314 [Shape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 908 [05/10/2022-20:07:03] [V] [TRT] Shape_314 [Shape] inputs: [908 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Shape_314 for ONNX node: Shape_314 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 938 for ONNX tensor: 938 [05/10/2022-20:07:03] [V] [TRT] Shape_314 [Shape] outputs: [938 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_315 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_315 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_315 [Constant] outputs: [939 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Gather_316 [Gather] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 938 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 939 [05/10/2022-20:07:03] [V] [TRT] Gather_316 [Gather] inputs: [938 -> (4)[INT32]], [939 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 939 for ONNX node: 939 [05/10/2022-20:07:03] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Gather_316 for ONNX node: Gather_316 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 940 for ONNX tensor: 940 [05/10/2022-20:07:03] [V] [TRT] Gather_316 [Gather] outputs: [940 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_317 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_317 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_317 [Constant] outputs: [941 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_318 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 941 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_318 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [941 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_318 for ONNX node: Unsqueeze_318 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 942 for ONNX tensor: 942 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_318 [Unsqueeze] outputs: [942 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Cast_319 [Cast] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 942 [05/10/2022-20:07:03] [V] [TRT] Cast_319 [Cast] inputs: [942 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Cast_319 for ONNX node: Cast_319 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 943 for ONNX tensor: 943 [05/10/2022-20:07:03] [V] [TRT] Cast_319 [Cast] outputs: [943 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_320 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_320 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_320 [Constant] outputs: [944 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Equal_321 [Equal] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 943 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 944 [05/10/2022-20:07:03] [V] [TRT] Equal_321 [Equal] inputs: [943 -> (-1, 1, 1, -1)[INT32]], [944 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 944 for ONNX node: 944 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Equal_321 for ONNX node: Equal_321 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 945 for ONNX tensor: 945 [05/10/2022-20:07:03] [V] [TRT] Equal_321 [Equal] outputs: [945 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Cast_322 [Cast] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 945 [05/10/2022-20:07:03] [V] [TRT] Cast_322 [Cast] inputs: [945 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Casting to type: bool [05/10/2022-20:07:03] [V] [TRT] Registering layer: Cast_322 for ONNX node: Cast_322 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 946 for ONNX tensor: 946 [05/10/2022-20:07:03] [V] [TRT] Cast_322 [Cast] outputs: [946 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_323 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_323 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_323 [Constant] outputs: [947 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Where_324 [Where] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 946 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 947 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 937 [05/10/2022-20:07:03] [V] [TRT] Where_324 [Where] inputs: [946 -> (-1, 1, 1, -1)[BOOL]], [947 -> ()[FLOAT]], [937 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 947 for ONNX node: 947 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Where_324 for ONNX node: Where_324 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 948 for ONNX tensor: 948 [05/10/2022-20:07:03] [V] [TRT] Where_324 [Where] outputs: [948 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Softmax_325 [Softmax] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 948 [05/10/2022-20:07:03] [V] [TRT] Softmax_325 [Softmax] inputs: [948 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Softmax_325 for ONNX node: Softmax_325 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 949 for ONNX tensor: 949 [05/10/2022-20:07:03] [V] [TRT] Softmax_325 [Softmax] outputs: [949 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Cast_326 [Cast] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 945 [05/10/2022-20:07:03] [V] [TRT] Cast_326 [Cast] inputs: [945 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Casting to type: bool [05/10/2022-20:07:03] [V] [TRT] Registering layer: Cast_326 for ONNX node: Cast_326 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 950 for ONNX tensor: 950 [05/10/2022-20:07:03] [V] [TRT] Cast_326 [Cast] outputs: [950 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_327 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_327 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_327 [Constant] outputs: [951 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Where_328 [Where] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 950 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 951 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 949 [05/10/2022-20:07:03] [V] [TRT] Where_328 [Where] inputs: [950 -> (-1, 1, 1, -1)[BOOL]], [951 -> ()[FLOAT]], [949 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 951 for ONNX node: 951 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Where_328 for ONNX node: Where_328 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 952 for ONNX tensor: 952 [05/10/2022-20:07:03] [V] [TRT] Where_328 [Where] outputs: [952 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_329 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 952 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 908 [05/10/2022-20:07:03] [V] [TRT] MatMul_329 [MatMul] inputs: [952 -> (-1, 4, -1, -1)[FLOAT]], [908 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_329 for ONNX node: MatMul_329 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 953 for ONNX tensor: 953 [05/10/2022-20:07:03] [V] [TRT] MatMul_329 [MatMul] outputs: [953 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_330 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 953 [05/10/2022-20:07:03] [V] [TRT] Transpose_330 [Transpose] inputs: [953 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_330 for ONNX node: Transpose_330 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 954 for ONNX tensor: 954 [05/10/2022-20:07:03] [V] [TRT] Transpose_330 [Transpose] outputs: [954 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_331 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_331 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_331 [Constant] outputs: [957 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_332 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 940 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 957 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_332 [Unsqueeze] inputs: [940 -> ()[INT32]], [957 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_332 for ONNX node: Unsqueeze_332 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 958 for ONNX tensor: 958 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_332 [Unsqueeze] outputs: [958 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Concat_333 [Concat] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 958 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3242 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3243 [05/10/2022-20:07:03] [V] [TRT] Concat_333 [Concat] inputs: [958 -> (1)[INT32]], [3242 -> (1)[INT32]], [3243 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3242 for ONNX node: 3242 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3243 for ONNX node: 3243 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Concat_333 for ONNX node: Concat_333 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 963 for ONNX tensor: 963 [05/10/2022-20:07:03] [V] [TRT] Concat_333 [Concat] outputs: [963 -> (3)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Reshape_334 [Reshape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 954 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 963 [05/10/2022-20:07:03] [V] [TRT] Reshape_334 [Reshape] inputs: [954 -> (-1, -1, 4, 64)[FLOAT]], [963 -> (3)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Reshape_334 for ONNX node: Reshape_334 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 964 for ONNX tensor: 964 [05/10/2022-20:07:03] [V] [TRT] Reshape_334 [Reshape] outputs: [964 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_335 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 964 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3244 [05/10/2022-20:07:03] [V] [TRT] MatMul_335 [MatMul] inputs: [964 -> (-1, -1, 256)[FLOAT]], [3244 -> (256, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3244 for ONNX node: 3244 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_335 for ONNX node: MatMul_335 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 966 for ONNX tensor: 966 [05/10/2022-20:07:03] [V] [TRT] MatMul_335 [MatMul] outputs: [966 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_336 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.self_attn.linear_out.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 966 [05/10/2022-20:07:03] [V] [TRT] Add_336 [Add] inputs: [encoder.encoders.1.self_attn.linear_out.bias -> (256)[FLOAT]], [966 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.self_attn.linear_out.bias for ONNX node: encoder.encoders.1.self_attn.linear_out.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_336 for ONNX node: Add_336 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 967 for ONNX tensor: 967 [05/10/2022-20:07:03] [V] [TRT] Add_336 [Add] outputs: [967 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_337 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 845 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 967 [05/10/2022-20:07:03] [V] [TRT] Add_337 [Add] inputs: [845 -> (-1, -1, 256)[FLOAT]], [967 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_337 for ONNX node: Add_337 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 968 for ONNX tensor: 968 [05/10/2022-20:07:03] [V] [TRT] Add_337 [Add] outputs: [968 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_338 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 968 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_338 [ReduceMean] inputs: [968 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_338 for ONNX node: ReduceMean_338 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 969 for ONNX tensor: 969 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_338 [ReduceMean] outputs: [969 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_339 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 968 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 969 [05/10/2022-20:07:03] [V] [TRT] Sub_339 [Sub] inputs: [968 -> (-1, -1, 256)[FLOAT]], [969 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_339 for ONNX node: Sub_339 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 970 for ONNX tensor: 970 [05/10/2022-20:07:03] [V] [TRT] Sub_339 [Sub] outputs: [970 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_340 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_340 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_340 [Constant] outputs: [971 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_341 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 970 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 971 [05/10/2022-20:07:03] [V] [TRT] Pow_341 [Pow] inputs: [970 -> (-1, -1, 256)[FLOAT]], [971 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 971 for ONNX node: 971 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_341 for ONNX node: Pow_341 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 972 for ONNX tensor: 972 [05/10/2022-20:07:03] [V] [TRT] Pow_341 [Pow] outputs: [972 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_342 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 972 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_342 [ReduceMean] inputs: [972 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_342 for ONNX node: ReduceMean_342 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 973 for ONNX tensor: 973 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_342 [ReduceMean] outputs: [973 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_343 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_343 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_343 [Constant] outputs: [974 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_344 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 973 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 974 [05/10/2022-20:07:03] [V] [TRT] Add_344 [Add] inputs: [973 -> (-1, -1, 1)[FLOAT]], [974 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 974 for ONNX node: 974 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_344 for ONNX node: Add_344 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 975 for ONNX tensor: 975 [05/10/2022-20:07:03] [V] [TRT] Add_344 [Add] outputs: [975 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_345 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 975 [05/10/2022-20:07:03] [V] [TRT] Sqrt_345 [Sqrt] inputs: [975 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_345 for ONNX node: Sqrt_345 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 976 for ONNX tensor: 976 [05/10/2022-20:07:03] [V] [TRT] Sqrt_345 [Sqrt] outputs: [976 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_346 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 970 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 976 [05/10/2022-20:07:03] [V] [TRT] Div_346 [Div] inputs: [970 -> (-1, -1, 256)[FLOAT]], [976 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_346 for ONNX node: Div_346 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 977 for ONNX tensor: 977 [05/10/2022-20:07:03] [V] [TRT] Div_346 [Div] outputs: [977 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_347 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 977 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_conv.weight [05/10/2022-20:07:03] [V] [TRT] Mul_347 [Mul] inputs: [977 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_conv.weight for ONNX node: encoder.encoders.1.norm_conv.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_347 for ONNX node: Mul_347 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 978 for ONNX tensor: 978 [05/10/2022-20:07:03] [V] [TRT] Mul_347 [Mul] outputs: [978 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_348 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 978 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_conv.bias [05/10/2022-20:07:03] [V] [TRT] Add_348 [Add] inputs: [978 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_conv.bias for ONNX node: encoder.encoders.1.norm_conv.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_348 for ONNX node: Add_348 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 979 for ONNX tensor: 979 [05/10/2022-20:07:03] [V] [TRT] Add_348 [Add] outputs: [979 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_349 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 979 [05/10/2022-20:07:03] [V] [TRT] Transpose_349 [Transpose] inputs: [979 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_349 for ONNX node: Transpose_349 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 980 for ONNX tensor: 980 [05/10/2022-20:07:03] [V] [TRT] Transpose_349 [Transpose] outputs: [980 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Not_350 [Not] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:03] [V] [TRT] Not_350 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Not_350 for ONNX node: Not_350 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 981 for ONNX tensor: 981 [05/10/2022-20:07:03] [V] [TRT] Not_350 [Not] outputs: [981 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Cast_351 [Cast] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 981 [05/10/2022-20:07:03] [V] [TRT] Cast_351 [Cast] inputs: [981 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Casting to type: bool [05/10/2022-20:07:03] [V] [TRT] Registering layer: Cast_351 for ONNX node: Cast_351 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 982 for ONNX tensor: 982 [05/10/2022-20:07:03] [V] [TRT] Cast_351 [Cast] outputs: [982 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_352 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_352 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_352 [Constant] outputs: [983 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Where_353 [Where] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 982 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 983 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 980 [05/10/2022-20:07:03] [V] [TRT] Where_353 [Where] inputs: [982 -> (-1, 1, -1)[BOOL]], [983 -> ()[FLOAT]], [980 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 983 for ONNX node: 983 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Where_353 for ONNX node: Where_353 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 984 for ONNX tensor: 984 [05/10/2022-20:07:03] [V] [TRT] Where_353 [Where] outputs: [984 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Conv_354 [Conv] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 984 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.conv_module.pointwise_conv1.weight [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.conv_module.pointwise_conv1.bias [05/10/2022-20:07:03] [V] [TRT] Conv_354 [Conv] inputs: [984 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.1.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.1.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Conv_354 for ONNX node: Conv_354 [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:03] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:03] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 985 for ONNX tensor: 985 [05/10/2022-20:07:03] [V] [TRT] Conv_354 [Conv] outputs: [985 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Split_355 [Split] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 985 [05/10/2022-20:07:03] [V] [TRT] Split_355 [Split] inputs: [985 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Split_355 for ONNX node: Split_355 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Split_355_3 for ONNX node: Split_355 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 986 for ONNX tensor: 986 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 987 for ONNX tensor: 987 [05/10/2022-20:07:03] [V] [TRT] Split_355 [Split] outputs: [986 -> (-1, 256, -1)[FLOAT]], [987 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sigmoid_356 [Sigmoid] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 987 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_356 [Sigmoid] inputs: [987 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sigmoid_356 for ONNX node: Sigmoid_356 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 988 for ONNX tensor: 988 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_356 [Sigmoid] outputs: [988 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_357 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 986 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 988 [05/10/2022-20:07:03] [V] [TRT] Mul_357 [Mul] inputs: [986 -> (-1, 256, -1)[FLOAT]], [988 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_357 for ONNX node: Mul_357 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 989 for ONNX tensor: 989 [05/10/2022-20:07:03] [V] [TRT] Mul_357 [Mul] outputs: [989 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Conv_358 [Conv] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 989 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3164 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3165 [05/10/2022-20:07:03] [V] [TRT] Conv_358 [Conv] inputs: [989 -> (-1, 256, -1)[FLOAT]], [3164 -> (256, 1, 15)[FLOAT]], [3165 -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Conv_358 for ONNX node: Conv_358 [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:03] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:03] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 3163 for ONNX tensor: 3163 [05/10/2022-20:07:03] [V] [TRT] Conv_358 [Conv] outputs: [3163 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sigmoid_359 [Sigmoid] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3163 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_359 [Sigmoid] inputs: [3163 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sigmoid_359 for ONNX node: Sigmoid_359 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 992 for ONNX tensor: 992 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_359 [Sigmoid] outputs: [992 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_360 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3163 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 992 [05/10/2022-20:07:03] [V] [TRT] Mul_360 [Mul] inputs: [3163 -> (-1, 256, -1)[FLOAT]], [992 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_360 for ONNX node: Mul_360 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 993 for ONNX tensor: 993 [05/10/2022-20:07:03] [V] [TRT] Mul_360 [Mul] outputs: [993 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Not_361 [Not] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:03] [V] [TRT] Not_361 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Not_361 for ONNX node: Not_361 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 994 for ONNX tensor: 994 [05/10/2022-20:07:03] [V] [TRT] Not_361 [Not] outputs: [994 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Conv_362 [Conv] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 993 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.conv_module.pointwise_conv2.weight [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.conv_module.pointwise_conv2.bias [05/10/2022-20:07:03] [V] [TRT] Conv_362 [Conv] inputs: [993 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.1.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.1.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Conv_362 for ONNX node: Conv_362 [05/10/2022-20:07:03] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:03] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:03] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 995 for ONNX tensor: 995 [05/10/2022-20:07:03] [V] [TRT] Conv_362 [Conv] outputs: [995 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Cast_363 [Cast] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 994 [05/10/2022-20:07:03] [V] [TRT] Cast_363 [Cast] inputs: [994 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Casting to type: bool [05/10/2022-20:07:03] [V] [TRT] Registering layer: Cast_363 for ONNX node: Cast_363 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 996 for ONNX tensor: 996 [05/10/2022-20:07:03] [V] [TRT] Cast_363 [Cast] outputs: [996 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_364 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_364 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_364 [Constant] outputs: [997 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Where_365 [Where] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 996 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 997 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 995 [05/10/2022-20:07:03] [V] [TRT] Where_365 [Where] inputs: [996 -> (-1, 1, -1)[BOOL]], [997 -> ()[FLOAT]], [995 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 997 for ONNX node: 997 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Where_365 for ONNX node: Where_365 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 998 for ONNX tensor: 998 [05/10/2022-20:07:03] [V] [TRT] Where_365 [Where] outputs: [998 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Transpose_366 [Transpose] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 998 [05/10/2022-20:07:03] [V] [TRT] Transpose_366 [Transpose] inputs: [998 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Transpose_366 for ONNX node: Transpose_366 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 999 for ONNX tensor: 999 [05/10/2022-20:07:03] [V] [TRT] Transpose_366 [Transpose] outputs: [999 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_367 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 968 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 999 [05/10/2022-20:07:03] [V] [TRT] Add_367 [Add] inputs: [968 -> (-1, -1, 256)[FLOAT]], [999 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_367 for ONNX node: Add_367 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1000 for ONNX tensor: 1000 [05/10/2022-20:07:03] [V] [TRT] Add_367 [Add] outputs: [1000 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_368 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1000 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_368 [ReduceMean] inputs: [1000 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_368 for ONNX node: ReduceMean_368 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1001 for ONNX tensor: 1001 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_368 [ReduceMean] outputs: [1001 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_369 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1000 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1001 [05/10/2022-20:07:03] [V] [TRT] Sub_369 [Sub] inputs: [1000 -> (-1, -1, 256)[FLOAT]], [1001 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_369 for ONNX node: Sub_369 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1002 for ONNX tensor: 1002 [05/10/2022-20:07:03] [V] [TRT] Sub_369 [Sub] outputs: [1002 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_370 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_370 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_370 [Constant] outputs: [1003 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_371 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1002 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1003 [05/10/2022-20:07:03] [V] [TRT] Pow_371 [Pow] inputs: [1002 -> (-1, -1, 256)[FLOAT]], [1003 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1003 for ONNX node: 1003 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_371 for ONNX node: Pow_371 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1004 for ONNX tensor: 1004 [05/10/2022-20:07:03] [V] [TRT] Pow_371 [Pow] outputs: [1004 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_372 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1004 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_372 [ReduceMean] inputs: [1004 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_372 for ONNX node: ReduceMean_372 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1005 for ONNX tensor: 1005 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_372 [ReduceMean] outputs: [1005 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_373 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_373 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_373 [Constant] outputs: [1006 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_374 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1005 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1006 [05/10/2022-20:07:03] [V] [TRT] Add_374 [Add] inputs: [1005 -> (-1, -1, 1)[FLOAT]], [1006 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1006 for ONNX node: 1006 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_374 for ONNX node: Add_374 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1007 for ONNX tensor: 1007 [05/10/2022-20:07:03] [V] [TRT] Add_374 [Add] outputs: [1007 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_375 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1007 [05/10/2022-20:07:03] [V] [TRT] Sqrt_375 [Sqrt] inputs: [1007 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_375 for ONNX node: Sqrt_375 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1008 for ONNX tensor: 1008 [05/10/2022-20:07:03] [V] [TRT] Sqrt_375 [Sqrt] outputs: [1008 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_376 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1002 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1008 [05/10/2022-20:07:03] [V] [TRT] Div_376 [Div] inputs: [1002 -> (-1, -1, 256)[FLOAT]], [1008 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_376 for ONNX node: Div_376 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1009 for ONNX tensor: 1009 [05/10/2022-20:07:03] [V] [TRT] Div_376 [Div] outputs: [1009 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_377 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1009 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_ff.weight [05/10/2022-20:07:03] [V] [TRT] Mul_377 [Mul] inputs: [1009 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_ff.weight for ONNX node: encoder.encoders.1.norm_ff.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_377 for ONNX node: Mul_377 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1010 for ONNX tensor: 1010 [05/10/2022-20:07:03] [V] [TRT] Mul_377 [Mul] outputs: [1010 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_378 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1010 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_ff.bias [05/10/2022-20:07:03] [V] [TRT] Add_378 [Add] inputs: [1010 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_ff.bias for ONNX node: encoder.encoders.1.norm_ff.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_378 for ONNX node: Add_378 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1011 for ONNX tensor: 1011 [05/10/2022-20:07:03] [V] [TRT] Add_378 [Add] outputs: [1011 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_379 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1011 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3245 [05/10/2022-20:07:03] [V] [TRT] MatMul_379 [MatMul] inputs: [1011 -> (-1, -1, 256)[FLOAT]], [3245 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3245 for ONNX node: 3245 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_379 for ONNX node: MatMul_379 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1013 for ONNX tensor: 1013 [05/10/2022-20:07:03] [V] [TRT] MatMul_379 [MatMul] outputs: [1013 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_380 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.feed_forward.w_1.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1013 [05/10/2022-20:07:03] [V] [TRT] Add_380 [Add] inputs: [encoder.encoders.1.feed_forward.w_1.bias -> (2048)[FLOAT]], [1013 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.feed_forward.w_1.bias for ONNX node: encoder.encoders.1.feed_forward.w_1.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_380 for ONNX node: Add_380 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1014 for ONNX tensor: 1014 [05/10/2022-20:07:03] [V] [TRT] Add_380 [Add] outputs: [1014 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sigmoid_381 [Sigmoid] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1014 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_381 [Sigmoid] inputs: [1014 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sigmoid_381 for ONNX node: Sigmoid_381 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1015 for ONNX tensor: 1015 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_381 [Sigmoid] outputs: [1015 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_382 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1014 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1015 [05/10/2022-20:07:03] [V] [TRT] Mul_382 [Mul] inputs: [1014 -> (-1, -1, 2048)[FLOAT]], [1015 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_382 for ONNX node: Mul_382 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1016 for ONNX tensor: 1016 [05/10/2022-20:07:03] [V] [TRT] Mul_382 [Mul] outputs: [1016 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_383 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1016 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3246 [05/10/2022-20:07:03] [V] [TRT] MatMul_383 [MatMul] inputs: [1016 -> (-1, -1, 2048)[FLOAT]], [3246 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3246 for ONNX node: 3246 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_383 for ONNX node: MatMul_383 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1018 for ONNX tensor: 1018 [05/10/2022-20:07:03] [V] [TRT] MatMul_383 [MatMul] outputs: [1018 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_384 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.feed_forward.w_2.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1018 [05/10/2022-20:07:03] [V] [TRT] Add_384 [Add] inputs: [encoder.encoders.1.feed_forward.w_2.bias -> (256)[FLOAT]], [1018 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.feed_forward.w_2.bias for ONNX node: encoder.encoders.1.feed_forward.w_2.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_384 for ONNX node: Add_384 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1019 for ONNX tensor: 1019 [05/10/2022-20:07:03] [V] [TRT] Add_384 [Add] outputs: [1019 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_385 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_385 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_385 [Constant] outputs: [1020 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_386 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1019 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1020 [05/10/2022-20:07:03] [V] [TRT] Mul_386 [Mul] inputs: [1019 -> (-1, -1, 256)[FLOAT]], [1020 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1020 for ONNX node: 1020 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_386 for ONNX node: Mul_386 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1021 for ONNX tensor: 1021 [05/10/2022-20:07:03] [V] [TRT] Mul_386 [Mul] outputs: [1021 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_387 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1000 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1021 [05/10/2022-20:07:03] [V] [TRT] Add_387 [Add] inputs: [1000 -> (-1, -1, 256)[FLOAT]], [1021 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_387 for ONNX node: Add_387 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1022 for ONNX tensor: 1022 [05/10/2022-20:07:03] [V] [TRT] Add_387 [Add] outputs: [1022 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_388 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1022 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_388 [ReduceMean] inputs: [1022 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_388 for ONNX node: ReduceMean_388 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1023 for ONNX tensor: 1023 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_388 [ReduceMean] outputs: [1023 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_389 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1022 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1023 [05/10/2022-20:07:03] [V] [TRT] Sub_389 [Sub] inputs: [1022 -> (-1, -1, 256)[FLOAT]], [1023 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_389 for ONNX node: Sub_389 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1024 for ONNX tensor: 1024 [05/10/2022-20:07:03] [V] [TRT] Sub_389 [Sub] outputs: [1024 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_390 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_390 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_390 [Constant] outputs: [1025 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_391 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1024 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1025 [05/10/2022-20:07:03] [V] [TRT] Pow_391 [Pow] inputs: [1024 -> (-1, -1, 256)[FLOAT]], [1025 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1025 for ONNX node: 1025 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_391 for ONNX node: Pow_391 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1026 for ONNX tensor: 1026 [05/10/2022-20:07:03] [V] [TRT] Pow_391 [Pow] outputs: [1026 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_392 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1026 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_392 [ReduceMean] inputs: [1026 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_392 for ONNX node: ReduceMean_392 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1027 for ONNX tensor: 1027 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_392 [ReduceMean] outputs: [1027 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_393 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_393 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_393 [Constant] outputs: [1028 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_394 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1027 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1028 [05/10/2022-20:07:03] [V] [TRT] Add_394 [Add] inputs: [1027 -> (-1, -1, 1)[FLOAT]], [1028 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1028 for ONNX node: 1028 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_394 for ONNX node: Add_394 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1029 for ONNX tensor: 1029 [05/10/2022-20:07:03] [V] [TRT] Add_394 [Add] outputs: [1029 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_395 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1029 [05/10/2022-20:07:03] [V] [TRT] Sqrt_395 [Sqrt] inputs: [1029 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_395 for ONNX node: Sqrt_395 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1030 for ONNX tensor: 1030 [05/10/2022-20:07:03] [V] [TRT] Sqrt_395 [Sqrt] outputs: [1030 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_396 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1024 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1030 [05/10/2022-20:07:03] [V] [TRT] Div_396 [Div] inputs: [1024 -> (-1, -1, 256)[FLOAT]], [1030 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_396 for ONNX node: Div_396 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1031 for ONNX tensor: 1031 [05/10/2022-20:07:03] [V] [TRT] Div_396 [Div] outputs: [1031 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_397 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1031 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_final.weight [05/10/2022-20:07:03] [V] [TRT] Mul_397 [Mul] inputs: [1031 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_final.weight for ONNX node: encoder.encoders.1.norm_final.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_397 for ONNX node: Mul_397 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1032 for ONNX tensor: 1032 [05/10/2022-20:07:03] [V] [TRT] Mul_397 [Mul] outputs: [1032 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_398 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1032 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.1.norm_final.bias [05/10/2022-20:07:03] [V] [TRT] Add_398 [Add] inputs: [1032 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.1.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.1.norm_final.bias for ONNX node: encoder.encoders.1.norm_final.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_398 for ONNX node: Add_398 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1033 for ONNX tensor: 1033 [05/10/2022-20:07:03] [V] [TRT] Add_398 [Add] outputs: [1033 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_399 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1033 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_399 [ReduceMean] inputs: [1033 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_399 for ONNX node: ReduceMean_399 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1034 for ONNX tensor: 1034 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_399 [ReduceMean] outputs: [1034 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_400 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1033 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1034 [05/10/2022-20:07:03] [V] [TRT] Sub_400 [Sub] inputs: [1033 -> (-1, -1, 256)[FLOAT]], [1034 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_400 for ONNX node: Sub_400 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1035 for ONNX tensor: 1035 [05/10/2022-20:07:03] [V] [TRT] Sub_400 [Sub] outputs: [1035 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_401 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_401 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_401 [Constant] outputs: [1036 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_402 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1035 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1036 [05/10/2022-20:07:03] [V] [TRT] Pow_402 [Pow] inputs: [1035 -> (-1, -1, 256)[FLOAT]], [1036 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1036 for ONNX node: 1036 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_402 for ONNX node: Pow_402 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1037 for ONNX tensor: 1037 [05/10/2022-20:07:03] [V] [TRT] Pow_402 [Pow] outputs: [1037 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_403 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1037 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_403 [ReduceMean] inputs: [1037 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_403 for ONNX node: ReduceMean_403 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1038 for ONNX tensor: 1038 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_403 [ReduceMean] outputs: [1038 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_404 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_404 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_404 [Constant] outputs: [1039 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_405 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1038 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1039 [05/10/2022-20:07:03] [V] [TRT] Add_405 [Add] inputs: [1038 -> (-1, -1, 1)[FLOAT]], [1039 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1039 for ONNX node: 1039 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_405 for ONNX node: Add_405 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1040 for ONNX tensor: 1040 [05/10/2022-20:07:03] [V] [TRT] Add_405 [Add] outputs: [1040 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_406 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1040 [05/10/2022-20:07:03] [V] [TRT] Sqrt_406 [Sqrt] inputs: [1040 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_406 for ONNX node: Sqrt_406 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1041 for ONNX tensor: 1041 [05/10/2022-20:07:03] [V] [TRT] Sqrt_406 [Sqrt] outputs: [1041 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_407 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1035 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1041 [05/10/2022-20:07:03] [V] [TRT] Div_407 [Div] inputs: [1035 -> (-1, -1, 256)[FLOAT]], [1041 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_407 for ONNX node: Div_407 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1042 for ONNX tensor: 1042 [05/10/2022-20:07:03] [V] [TRT] Div_407 [Div] outputs: [1042 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_408 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1042 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.norm_ff_macaron.weight [05/10/2022-20:07:03] [V] [TRT] Mul_408 [Mul] inputs: [1042 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.norm_ff_macaron.weight for ONNX node: encoder.encoders.2.norm_ff_macaron.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_408 for ONNX node: Mul_408 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1043 for ONNX tensor: 1043 [05/10/2022-20:07:03] [V] [TRT] Mul_408 [Mul] outputs: [1043 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_409 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1043 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.norm_ff_macaron.bias [05/10/2022-20:07:03] [V] [TRT] Add_409 [Add] inputs: [1043 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.norm_ff_macaron.bias for ONNX node: encoder.encoders.2.norm_ff_macaron.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_409 for ONNX node: Add_409 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1044 for ONNX tensor: 1044 [05/10/2022-20:07:03] [V] [TRT] Add_409 [Add] outputs: [1044 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_410 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1044 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3247 [05/10/2022-20:07:03] [V] [TRT] MatMul_410 [MatMul] inputs: [1044 -> (-1, -1, 256)[FLOAT]], [3247 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3247 for ONNX node: 3247 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_410 for ONNX node: MatMul_410 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1046 for ONNX tensor: 1046 [05/10/2022-20:07:03] [V] [TRT] MatMul_410 [MatMul] outputs: [1046 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_411 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.feed_forward_macaron.w_1.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1046 [05/10/2022-20:07:03] [V] [TRT] Add_411 [Add] inputs: [encoder.encoders.2.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [1046 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.2.feed_forward_macaron.w_1.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_411 for ONNX node: Add_411 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1047 for ONNX tensor: 1047 [05/10/2022-20:07:03] [V] [TRT] Add_411 [Add] outputs: [1047 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sigmoid_412 [Sigmoid] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1047 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_412 [Sigmoid] inputs: [1047 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sigmoid_412 for ONNX node: Sigmoid_412 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1048 for ONNX tensor: 1048 [05/10/2022-20:07:03] [V] [TRT] Sigmoid_412 [Sigmoid] outputs: [1048 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_413 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1047 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1048 [05/10/2022-20:07:03] [V] [TRT] Mul_413 [Mul] inputs: [1047 -> (-1, -1, 2048)[FLOAT]], [1048 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_413 for ONNX node: Mul_413 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1049 for ONNX tensor: 1049 [05/10/2022-20:07:03] [V] [TRT] Mul_413 [Mul] outputs: [1049 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_414 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1049 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3248 [05/10/2022-20:07:03] [V] [TRT] MatMul_414 [MatMul] inputs: [1049 -> (-1, -1, 2048)[FLOAT]], [3248 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3248 for ONNX node: 3248 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_414 for ONNX node: MatMul_414 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1051 for ONNX tensor: 1051 [05/10/2022-20:07:03] [V] [TRT] MatMul_414 [MatMul] outputs: [1051 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_415 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.feed_forward_macaron.w_2.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1051 [05/10/2022-20:07:03] [V] [TRT] Add_415 [Add] inputs: [encoder.encoders.2.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [1051 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.2.feed_forward_macaron.w_2.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_415 for ONNX node: Add_415 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1052 for ONNX tensor: 1052 [05/10/2022-20:07:03] [V] [TRT] Add_415 [Add] outputs: [1052 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_416 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_416 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_416 [Constant] outputs: [1053 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_417 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1052 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1053 [05/10/2022-20:07:03] [V] [TRT] Mul_417 [Mul] inputs: [1052 -> (-1, -1, 256)[FLOAT]], [1053 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1053 for ONNX node: 1053 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_417 for ONNX node: Mul_417 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1054 for ONNX tensor: 1054 [05/10/2022-20:07:03] [V] [TRT] Mul_417 [Mul] outputs: [1054 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_418 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1033 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1054 [05/10/2022-20:07:03] [V] [TRT] Add_418 [Add] inputs: [1033 -> (-1, -1, 256)[FLOAT]], [1054 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_418 for ONNX node: Add_418 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1055 for ONNX tensor: 1055 [05/10/2022-20:07:03] [V] [TRT] Add_418 [Add] outputs: [1055 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_419 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1055 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_419 [ReduceMean] inputs: [1055 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_419 for ONNX node: ReduceMean_419 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1056 for ONNX tensor: 1056 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_419 [ReduceMean] outputs: [1056 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sub_420 [Sub] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1055 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1056 [05/10/2022-20:07:03] [V] [TRT] Sub_420 [Sub] inputs: [1055 -> (-1, -1, 256)[FLOAT]], [1056 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sub_420 for ONNX node: Sub_420 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1057 for ONNX tensor: 1057 [05/10/2022-20:07:03] [V] [TRT] Sub_420 [Sub] outputs: [1057 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_421 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_421 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_421 [Constant] outputs: [1058 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Pow_422 [Pow] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1057 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1058 [05/10/2022-20:07:03] [V] [TRT] Pow_422 [Pow] inputs: [1057 -> (-1, -1, 256)[FLOAT]], [1058 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1058 for ONNX node: 1058 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Pow_422 for ONNX node: Pow_422 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1059 for ONNX tensor: 1059 [05/10/2022-20:07:03] [V] [TRT] Pow_422 [Pow] outputs: [1059 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: ReduceMean_423 [ReduceMean] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1059 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_423 [ReduceMean] inputs: [1059 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: ReduceMean_423 for ONNX node: ReduceMean_423 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1060 for ONNX tensor: 1060 [05/10/2022-20:07:03] [V] [TRT] ReduceMean_423 [ReduceMean] outputs: [1060 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_424 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_424 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_424 [Constant] outputs: [1061 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_425 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1060 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1061 [05/10/2022-20:07:03] [V] [TRT] Add_425 [Add] inputs: [1060 -> (-1, -1, 1)[FLOAT]], [1061 -> ()[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1061 for ONNX node: 1061 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_425 for ONNX node: Add_425 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1062 for ONNX tensor: 1062 [05/10/2022-20:07:03] [V] [TRT] Add_425 [Add] outputs: [1062 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Sqrt_426 [Sqrt] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1062 [05/10/2022-20:07:03] [V] [TRT] Sqrt_426 [Sqrt] inputs: [1062 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Sqrt_426 for ONNX node: Sqrt_426 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1063 for ONNX tensor: 1063 [05/10/2022-20:07:03] [V] [TRT] Sqrt_426 [Sqrt] outputs: [1063 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Div_427 [Div] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1057 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1063 [05/10/2022-20:07:03] [V] [TRT] Div_427 [Div] inputs: [1057 -> (-1, -1, 256)[FLOAT]], [1063 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Div_427 for ONNX node: Div_427 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1064 for ONNX tensor: 1064 [05/10/2022-20:07:03] [V] [TRT] Div_427 [Div] outputs: [1064 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Mul_428 [Mul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1064 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.norm_mha.weight [05/10/2022-20:07:03] [V] [TRT] Mul_428 [Mul] inputs: [1064 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.norm_mha.weight for ONNX node: encoder.encoders.2.norm_mha.weight [05/10/2022-20:07:03] [V] [TRT] Registering layer: Mul_428 for ONNX node: Mul_428 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1065 for ONNX tensor: 1065 [05/10/2022-20:07:03] [V] [TRT] Mul_428 [Mul] outputs: [1065 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_429 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1065 [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.norm_mha.bias [05/10/2022-20:07:03] [V] [TRT] Add_429 [Add] inputs: [1065 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.norm_mha.bias for ONNX node: encoder.encoders.2.norm_mha.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_429 for ONNX node: Add_429 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1066 for ONNX tensor: 1066 [05/10/2022-20:07:03] [V] [TRT] Add_429 [Add] outputs: [1066 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Shape_430 [Shape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1066 [05/10/2022-20:07:03] [V] [TRT] Shape_430 [Shape] inputs: [1066 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Shape_430 for ONNX node: Shape_430 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1067 for ONNX tensor: 1067 [05/10/2022-20:07:03] [V] [TRT] Shape_430 [Shape] outputs: [1067 -> (3)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_431 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_431 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_431 [Constant] outputs: [1068 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Gather_432 [Gather] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1067 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1068 [05/10/2022-20:07:03] [V] [TRT] Gather_432 [Gather] inputs: [1067 -> (3)[INT32]], [1068 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 1068 for ONNX node: 1068 [05/10/2022-20:07:03] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Gather_432 for ONNX node: Gather_432 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1069 for ONNX tensor: 1069 [05/10/2022-20:07:03] [V] [TRT] Gather_432 [Gather] outputs: [1069 -> ()[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: MatMul_433 [MatMul] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1066 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3249 [05/10/2022-20:07:03] [V] [TRT] MatMul_433 [MatMul] inputs: [1066 -> (-1, -1, 256)[FLOAT]], [3249 -> (256, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3249 for ONNX node: 3249 [05/10/2022-20:07:03] [V] [TRT] Registering layer: MatMul_433 for ONNX node: MatMul_433 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1071 for ONNX tensor: 1071 [05/10/2022-20:07:03] [V] [TRT] MatMul_433 [MatMul] outputs: [1071 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Add_434 [Add] [05/10/2022-20:07:03] [V] [TRT] Searching for input: encoder.encoders.2.self_attn.linear_q.bias [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1071 [05/10/2022-20:07:03] [V] [TRT] Add_434 [Add] inputs: [encoder.encoders.2.self_attn.linear_q.bias -> (256)[FLOAT]], [1071 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: encoder.encoders.2.self_attn.linear_q.bias for ONNX node: encoder.encoders.2.self_attn.linear_q.bias [05/10/2022-20:07:03] [V] [TRT] Registering layer: Add_434 for ONNX node: Add_434 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1072 for ONNX tensor: 1072 [05/10/2022-20:07:03] [V] [TRT] Add_434 [Add] outputs: [1072 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Constant_435 [Constant] [05/10/2022-20:07:03] [V] [TRT] Constant_435 [Constant] inputs: [05/10/2022-20:07:03] [V] [TRT] Constant_435 [Constant] outputs: [1076 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Unsqueeze_436 [Unsqueeze] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1069 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1076 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_436 [Unsqueeze] inputs: [1069 -> ()[INT32]], [1076 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:03] [V] [TRT] Registering layer: Unsqueeze_436 for ONNX node: Unsqueeze_436 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1077 for ONNX tensor: 1077 [05/10/2022-20:07:03] [V] [TRT] Unsqueeze_436 [Unsqueeze] outputs: [1077 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Concat_437 [Concat] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1077 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3250 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3251 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 3252 [05/10/2022-20:07:03] [V] [TRT] Concat_437 [Concat] inputs: [1077 -> (1)[INT32]], [3250 -> (1)[INT32]], [3251 -> (1)[INT32]], [3252 -> (1)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3250 for ONNX node: 3250 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3251 for ONNX node: 3251 [05/10/2022-20:07:03] [V] [TRT] Registering layer: 3252 for ONNX node: 3252 [05/10/2022-20:07:03] [V] [TRT] Registering layer: Concat_437 for ONNX node: Concat_437 [05/10/2022-20:07:03] [V] [TRT] Registering tensor: 1084 for ONNX tensor: 1084 [05/10/2022-20:07:03] [V] [TRT] Concat_437 [Concat] outputs: [1084 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Parsing node: Reshape_438 [Reshape] [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1072 [05/10/2022-20:07:03] [V] [TRT] Searching for input: 1084 [05/10/2022-20:07:03] [V] [TRT] Reshape_438 [Reshape] inputs: [1072 -> (-1, -1, 256)[FLOAT]], [1084 -> (4)[INT32]], [05/10/2022-20:07:03] [V] [TRT] Registering layer: Reshape_438 for ONNX node: Reshape_438 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1085 for ONNX tensor: 1085 [05/10/2022-20:07:04] [V] [TRT] Reshape_438 [Reshape] outputs: [1085 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_439 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1066 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3253 [05/10/2022-20:07:04] [V] [TRT] MatMul_439 [MatMul] inputs: [1066 -> (-1, -1, 256)[FLOAT]], [3253 -> (256, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3253 for ONNX node: 3253 [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_439 for ONNX node: MatMul_439 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1087 for ONNX tensor: 1087 [05/10/2022-20:07:04] [V] [TRT] MatMul_439 [MatMul] outputs: [1087 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_440 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.self_attn.linear_k.bias [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1087 [05/10/2022-20:07:04] [V] [TRT] Add_440 [Add] inputs: [encoder.encoders.2.self_attn.linear_k.bias -> (256)[FLOAT]], [1087 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.self_attn.linear_k.bias for ONNX node: encoder.encoders.2.self_attn.linear_k.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_440 for ONNX node: Add_440 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1088 for ONNX tensor: 1088 [05/10/2022-20:07:04] [V] [TRT] Add_440 [Add] outputs: [1088 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_441 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_441 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_441 [Constant] outputs: [1092 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Unsqueeze_442 [Unsqueeze] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1069 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1092 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_442 [Unsqueeze] inputs: [1069 -> ()[INT32]], [1092 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Unsqueeze_442 for ONNX node: Unsqueeze_442 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1093 for ONNX tensor: 1093 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_442 [Unsqueeze] outputs: [1093 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Concat_443 [Concat] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1093 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3254 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3255 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3256 [05/10/2022-20:07:04] [V] [TRT] Concat_443 [Concat] inputs: [1093 -> (1)[INT32]], [3254 -> (1)[INT32]], [3255 -> (1)[INT32]], [3256 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3254 for ONNX node: 3254 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3255 for ONNX node: 3255 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3256 for ONNX node: 3256 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Concat_443 for ONNX node: Concat_443 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1100 for ONNX tensor: 1100 [05/10/2022-20:07:04] [V] [TRT] Concat_443 [Concat] outputs: [1100 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Reshape_444 [Reshape] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1088 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1100 [05/10/2022-20:07:04] [V] [TRT] Reshape_444 [Reshape] inputs: [1088 -> (-1, -1, 256)[FLOAT]], [1100 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Reshape_444 for ONNX node: Reshape_444 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1101 for ONNX tensor: 1101 [05/10/2022-20:07:04] [V] [TRT] Reshape_444 [Reshape] outputs: [1101 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_445 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1066 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3257 [05/10/2022-20:07:04] [V] [TRT] MatMul_445 [MatMul] inputs: [1066 -> (-1, -1, 256)[FLOAT]], [3257 -> (256, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3257 for ONNX node: 3257 [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_445 for ONNX node: MatMul_445 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1103 for ONNX tensor: 1103 [05/10/2022-20:07:04] [V] [TRT] MatMul_445 [MatMul] outputs: [1103 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_446 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.self_attn.linear_v.bias [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1103 [05/10/2022-20:07:04] [V] [TRT] Add_446 [Add] inputs: [encoder.encoders.2.self_attn.linear_v.bias -> (256)[FLOAT]], [1103 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.self_attn.linear_v.bias for ONNX node: encoder.encoders.2.self_attn.linear_v.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_446 for ONNX node: Add_446 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1104 for ONNX tensor: 1104 [05/10/2022-20:07:04] [V] [TRT] Add_446 [Add] outputs: [1104 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_447 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_447 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_447 [Constant] outputs: [1108 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Unsqueeze_448 [Unsqueeze] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1069 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1108 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_448 [Unsqueeze] inputs: [1069 -> ()[INT32]], [1108 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Unsqueeze_448 for ONNX node: Unsqueeze_448 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1109 for ONNX tensor: 1109 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_448 [Unsqueeze] outputs: [1109 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Concat_449 [Concat] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1109 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3258 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3259 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3260 [05/10/2022-20:07:04] [V] [TRT] Concat_449 [Concat] inputs: [1109 -> (1)[INT32]], [3258 -> (1)[INT32]], [3259 -> (1)[INT32]], [3260 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3258 for ONNX node: 3258 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3259 for ONNX node: 3259 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3260 for ONNX node: 3260 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Concat_449 for ONNX node: Concat_449 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1116 for ONNX tensor: 1116 [05/10/2022-20:07:04] [V] [TRT] Concat_449 [Concat] outputs: [1116 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Reshape_450 [Reshape] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1104 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1116 [05/10/2022-20:07:04] [V] [TRT] Reshape_450 [Reshape] inputs: [1104 -> (-1, -1, 256)[FLOAT]], [1116 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Reshape_450 for ONNX node: Reshape_450 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1117 for ONNX tensor: 1117 [05/10/2022-20:07:04] [V] [TRT] Reshape_450 [Reshape] outputs: [1117 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_451 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1117 [05/10/2022-20:07:04] [V] [TRT] Transpose_451 [Transpose] inputs: [1117 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_451 for ONNX node: Transpose_451 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1118 for ONNX tensor: 1118 [05/10/2022-20:07:04] [V] [TRT] Transpose_451 [Transpose] outputs: [1118 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Shape_452 [Shape] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:04] [V] [TRT] Shape_452 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Shape_452 for ONNX node: Shape_452 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1119 for ONNX tensor: 1119 [05/10/2022-20:07:04] [V] [TRT] Shape_452 [Shape] outputs: [1119 -> (3)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_453 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_453 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_453 [Constant] outputs: [1120 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Gather_454 [Gather] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1119 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1120 [05/10/2022-20:07:04] [V] [TRT] Gather_454 [Gather] inputs: [1119 -> (3)[INT32]], [1120 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1120 for ONNX node: 1120 [05/10/2022-20:07:04] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Gather_454 for ONNX node: Gather_454 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1121 for ONNX tensor: 1121 [05/10/2022-20:07:04] [V] [TRT] Gather_454 [Gather] outputs: [1121 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_455 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3261 [05/10/2022-20:07:04] [V] [TRT] MatMul_455 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3261 -> (256, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3261 for ONNX node: 3261 [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_455 for ONNX node: MatMul_455 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1123 for ONNX tensor: 1123 [05/10/2022-20:07:04] [V] [TRT] MatMul_455 [MatMul] outputs: [1123 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_456 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_456 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_456 [Constant] outputs: [1127 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Unsqueeze_457 [Unsqueeze] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1121 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1127 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_457 [Unsqueeze] inputs: [1121 -> ()[INT32]], [1127 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Unsqueeze_457 for ONNX node: Unsqueeze_457 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1128 for ONNX tensor: 1128 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_457 [Unsqueeze] outputs: [1128 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Concat_458 [Concat] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1128 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3262 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3263 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3264 [05/10/2022-20:07:04] [V] [TRT] Concat_458 [Concat] inputs: [1128 -> (1)[INT32]], [3262 -> (1)[INT32]], [3263 -> (1)[INT32]], [3264 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3262 for ONNX node: 3262 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3263 for ONNX node: 3263 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3264 for ONNX node: 3264 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Concat_458 for ONNX node: Concat_458 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1135 for ONNX tensor: 1135 [05/10/2022-20:07:04] [V] [TRT] Concat_458 [Concat] outputs: [1135 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Reshape_459 [Reshape] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1123 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1135 [05/10/2022-20:07:04] [V] [TRT] Reshape_459 [Reshape] inputs: [1123 -> (1, -1, 256)[FLOAT]], [1135 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Reshape_459 for ONNX node: Reshape_459 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1136 for ONNX tensor: 1136 [05/10/2022-20:07:04] [V] [TRT] Reshape_459 [Reshape] outputs: [1136 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_460 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1085 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.self_attn.pos_bias_u [05/10/2022-20:07:04] [V] [TRT] Add_460 [Add] inputs: [1085 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.2.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.self_attn.pos_bias_u for ONNX node: encoder.encoders.2.self_attn.pos_bias_u [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_460 for ONNX node: Add_460 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1137 for ONNX tensor: 1137 [05/10/2022-20:07:04] [V] [TRT] Add_460 [Add] outputs: [1137 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_461 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1137 [05/10/2022-20:07:04] [V] [TRT] Transpose_461 [Transpose] inputs: [1137 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_461 for ONNX node: Transpose_461 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1138 for ONNX tensor: 1138 [05/10/2022-20:07:04] [V] [TRT] Transpose_461 [Transpose] outputs: [1138 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_462 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1085 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.self_attn.pos_bias_v [05/10/2022-20:07:04] [V] [TRT] Add_462 [Add] inputs: [1085 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.2.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.self_attn.pos_bias_v for ONNX node: encoder.encoders.2.self_attn.pos_bias_v [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_462 for ONNX node: Add_462 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1139 for ONNX tensor: 1139 [05/10/2022-20:07:04] [V] [TRT] Add_462 [Add] outputs: [1139 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_463 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1139 [05/10/2022-20:07:04] [V] [TRT] Transpose_463 [Transpose] inputs: [1139 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_463 for ONNX node: Transpose_463 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1140 for ONNX tensor: 1140 [05/10/2022-20:07:04] [V] [TRT] Transpose_463 [Transpose] outputs: [1140 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_464 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1101 [05/10/2022-20:07:04] [V] [TRT] Transpose_464 [Transpose] inputs: [1101 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_464 for ONNX node: Transpose_464 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1141 for ONNX tensor: 1141 [05/10/2022-20:07:04] [V] [TRT] Transpose_464 [Transpose] outputs: [1141 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_465 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1138 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1141 [05/10/2022-20:07:04] [V] [TRT] MatMul_465 [MatMul] inputs: [1138 -> (-1, 4, -1, 64)[FLOAT]], [1141 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_465 for ONNX node: MatMul_465 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1142 for ONNX tensor: 1142 [05/10/2022-20:07:04] [V] [TRT] MatMul_465 [MatMul] outputs: [1142 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_466 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1136 [05/10/2022-20:07:04] [V] [TRT] Transpose_466 [Transpose] inputs: [1136 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_466 for ONNX node: Transpose_466 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1143 for ONNX tensor: 1143 [05/10/2022-20:07:04] [V] [TRT] Transpose_466 [Transpose] outputs: [1143 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_467 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1140 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1143 [05/10/2022-20:07:04] [V] [TRT] MatMul_467 [MatMul] inputs: [1140 -> (-1, 4, -1, 64)[FLOAT]], [1143 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_467 for ONNX node: MatMul_467 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1144 for ONNX tensor: 1144 [05/10/2022-20:07:04] [V] [TRT] MatMul_467 [MatMul] outputs: [1144 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_468 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1142 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1144 [05/10/2022-20:07:04] [V] [TRT] Add_468 [Add] inputs: [1142 -> (-1, 4, -1, -1)[FLOAT]], [1144 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_468 for ONNX node: Add_468 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1145 for ONNX tensor: 1145 [05/10/2022-20:07:04] [V] [TRT] Add_468 [Add] outputs: [1145 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_469 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_469 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_469 [Constant] outputs: [1146 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Div_470 [Div] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1145 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1146 [05/10/2022-20:07:04] [V] [TRT] Div_470 [Div] inputs: [1145 -> (-1, 4, -1, -1)[FLOAT]], [1146 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1146 for ONNX node: 1146 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Div_470 for ONNX node: Div_470 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1147 for ONNX tensor: 1147 [05/10/2022-20:07:04] [V] [TRT] Div_470 [Div] outputs: [1147 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Shape_471 [Shape] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1118 [05/10/2022-20:07:04] [V] [TRT] Shape_471 [Shape] inputs: [1118 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Shape_471 for ONNX node: Shape_471 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1148 for ONNX tensor: 1148 [05/10/2022-20:07:04] [V] [TRT] Shape_471 [Shape] outputs: [1148 -> (4)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_472 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_472 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_472 [Constant] outputs: [1149 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Gather_473 [Gather] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1148 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1149 [05/10/2022-20:07:04] [V] [TRT] Gather_473 [Gather] inputs: [1148 -> (4)[INT32]], [1149 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1149 for ONNX node: 1149 [05/10/2022-20:07:04] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Gather_473 for ONNX node: Gather_473 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1150 for ONNX tensor: 1150 [05/10/2022-20:07:04] [V] [TRT] Gather_473 [Gather] outputs: [1150 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_474 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_474 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_474 [Constant] outputs: [1151 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Unsqueeze_475 [Unsqueeze] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1151 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_475 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [1151 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Unsqueeze_475 for ONNX node: Unsqueeze_475 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1152 for ONNX tensor: 1152 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_475 [Unsqueeze] outputs: [1152 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Cast_476 [Cast] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1152 [05/10/2022-20:07:04] [V] [TRT] Cast_476 [Cast] inputs: [1152 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Cast_476 for ONNX node: Cast_476 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1153 for ONNX tensor: 1153 [05/10/2022-20:07:04] [V] [TRT] Cast_476 [Cast] outputs: [1153 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_477 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_477 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_477 [Constant] outputs: [1154 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Equal_478 [Equal] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1153 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1154 [05/10/2022-20:07:04] [V] [TRT] Equal_478 [Equal] inputs: [1153 -> (-1, 1, 1, -1)[INT32]], [1154 -> ()[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1154 for ONNX node: 1154 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Equal_478 for ONNX node: Equal_478 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1155 for ONNX tensor: 1155 [05/10/2022-20:07:04] [V] [TRT] Equal_478 [Equal] outputs: [1155 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Cast_479 [Cast] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1155 [05/10/2022-20:07:04] [V] [TRT] Cast_479 [Cast] inputs: [1155 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Casting to type: bool [05/10/2022-20:07:04] [V] [TRT] Registering layer: Cast_479 for ONNX node: Cast_479 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1156 for ONNX tensor: 1156 [05/10/2022-20:07:04] [V] [TRT] Cast_479 [Cast] outputs: [1156 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_480 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_480 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_480 [Constant] outputs: [1157 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Where_481 [Where] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1156 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1157 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1147 [05/10/2022-20:07:04] [V] [TRT] Where_481 [Where] inputs: [1156 -> (-1, 1, 1, -1)[BOOL]], [1157 -> ()[FLOAT]], [1147 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1157 for ONNX node: 1157 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Where_481 for ONNX node: Where_481 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1158 for ONNX tensor: 1158 [05/10/2022-20:07:04] [V] [TRT] Where_481 [Where] outputs: [1158 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Softmax_482 [Softmax] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1158 [05/10/2022-20:07:04] [V] [TRT] Softmax_482 [Softmax] inputs: [1158 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Softmax_482 for ONNX node: Softmax_482 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1159 for ONNX tensor: 1159 [05/10/2022-20:07:04] [V] [TRT] Softmax_482 [Softmax] outputs: [1159 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Cast_483 [Cast] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1155 [05/10/2022-20:07:04] [V] [TRT] Cast_483 [Cast] inputs: [1155 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Casting to type: bool [05/10/2022-20:07:04] [V] [TRT] Registering layer: Cast_483 for ONNX node: Cast_483 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1160 for ONNX tensor: 1160 [05/10/2022-20:07:04] [V] [TRT] Cast_483 [Cast] outputs: [1160 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_484 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_484 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_484 [Constant] outputs: [1161 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Where_485 [Where] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1160 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1161 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1159 [05/10/2022-20:07:04] [V] [TRT] Where_485 [Where] inputs: [1160 -> (-1, 1, 1, -1)[BOOL]], [1161 -> ()[FLOAT]], [1159 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1161 for ONNX node: 1161 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Where_485 for ONNX node: Where_485 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1162 for ONNX tensor: 1162 [05/10/2022-20:07:04] [V] [TRT] Where_485 [Where] outputs: [1162 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_486 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1162 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1118 [05/10/2022-20:07:04] [V] [TRT] MatMul_486 [MatMul] inputs: [1162 -> (-1, 4, -1, -1)[FLOAT]], [1118 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_486 for ONNX node: MatMul_486 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1163 for ONNX tensor: 1163 [05/10/2022-20:07:04] [V] [TRT] MatMul_486 [MatMul] outputs: [1163 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_487 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1163 [05/10/2022-20:07:04] [V] [TRT] Transpose_487 [Transpose] inputs: [1163 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_487 for ONNX node: Transpose_487 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1164 for ONNX tensor: 1164 [05/10/2022-20:07:04] [V] [TRT] Transpose_487 [Transpose] outputs: [1164 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_488 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_488 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_488 [Constant] outputs: [1167 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Unsqueeze_489 [Unsqueeze] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1150 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1167 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_489 [Unsqueeze] inputs: [1150 -> ()[INT32]], [1167 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Unsqueeze_489 for ONNX node: Unsqueeze_489 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1168 for ONNX tensor: 1168 [05/10/2022-20:07:04] [V] [TRT] Unsqueeze_489 [Unsqueeze] outputs: [1168 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Concat_490 [Concat] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1168 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3265 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3266 [05/10/2022-20:07:04] [V] [TRT] Concat_490 [Concat] inputs: [1168 -> (1)[INT32]], [3265 -> (1)[INT32]], [3266 -> (1)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3265 for ONNX node: 3265 [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3266 for ONNX node: 3266 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Concat_490 for ONNX node: Concat_490 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1173 for ONNX tensor: 1173 [05/10/2022-20:07:04] [V] [TRT] Concat_490 [Concat] outputs: [1173 -> (3)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Reshape_491 [Reshape] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1164 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1173 [05/10/2022-20:07:04] [V] [TRT] Reshape_491 [Reshape] inputs: [1164 -> (-1, -1, 4, 64)[FLOAT]], [1173 -> (3)[INT32]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Reshape_491 for ONNX node: Reshape_491 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1174 for ONNX tensor: 1174 [05/10/2022-20:07:04] [V] [TRT] Reshape_491 [Reshape] outputs: [1174 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_492 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1174 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3267 [05/10/2022-20:07:04] [V] [TRT] MatMul_492 [MatMul] inputs: [1174 -> (-1, -1, 256)[FLOAT]], [3267 -> (256, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3267 for ONNX node: 3267 [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_492 for ONNX node: MatMul_492 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1176 for ONNX tensor: 1176 [05/10/2022-20:07:04] [V] [TRT] MatMul_492 [MatMul] outputs: [1176 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_493 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.self_attn.linear_out.bias [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1176 [05/10/2022-20:07:04] [V] [TRT] Add_493 [Add] inputs: [encoder.encoders.2.self_attn.linear_out.bias -> (256)[FLOAT]], [1176 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.self_attn.linear_out.bias for ONNX node: encoder.encoders.2.self_attn.linear_out.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_493 for ONNX node: Add_493 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1177 for ONNX tensor: 1177 [05/10/2022-20:07:04] [V] [TRT] Add_493 [Add] outputs: [1177 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_494 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1055 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1177 [05/10/2022-20:07:04] [V] [TRT] Add_494 [Add] inputs: [1055 -> (-1, -1, 256)[FLOAT]], [1177 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_494 for ONNX node: Add_494 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1178 for ONNX tensor: 1178 [05/10/2022-20:07:04] [V] [TRT] Add_494 [Add] outputs: [1178 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_495 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1178 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_495 [ReduceMean] inputs: [1178 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_495 for ONNX node: ReduceMean_495 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1179 for ONNX tensor: 1179 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_495 [ReduceMean] outputs: [1179 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sub_496 [Sub] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1178 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1179 [05/10/2022-20:07:04] [V] [TRT] Sub_496 [Sub] inputs: [1178 -> (-1, -1, 256)[FLOAT]], [1179 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sub_496 for ONNX node: Sub_496 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1180 for ONNX tensor: 1180 [05/10/2022-20:07:04] [V] [TRT] Sub_496 [Sub] outputs: [1180 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_497 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_497 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_497 [Constant] outputs: [1181 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Pow_498 [Pow] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1180 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1181 [05/10/2022-20:07:04] [V] [TRT] Pow_498 [Pow] inputs: [1180 -> (-1, -1, 256)[FLOAT]], [1181 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1181 for ONNX node: 1181 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Pow_498 for ONNX node: Pow_498 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1182 for ONNX tensor: 1182 [05/10/2022-20:07:04] [V] [TRT] Pow_498 [Pow] outputs: [1182 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_499 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1182 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_499 [ReduceMean] inputs: [1182 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_499 for ONNX node: ReduceMean_499 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1183 for ONNX tensor: 1183 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_499 [ReduceMean] outputs: [1183 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_500 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_500 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_500 [Constant] outputs: [1184 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_501 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1183 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1184 [05/10/2022-20:07:04] [V] [TRT] Add_501 [Add] inputs: [1183 -> (-1, -1, 1)[FLOAT]], [1184 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1184 for ONNX node: 1184 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_501 for ONNX node: Add_501 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1185 for ONNX tensor: 1185 [05/10/2022-20:07:04] [V] [TRT] Add_501 [Add] outputs: [1185 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sqrt_502 [Sqrt] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1185 [05/10/2022-20:07:04] [V] [TRT] Sqrt_502 [Sqrt] inputs: [1185 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sqrt_502 for ONNX node: Sqrt_502 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1186 for ONNX tensor: 1186 [05/10/2022-20:07:04] [V] [TRT] Sqrt_502 [Sqrt] outputs: [1186 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Div_503 [Div] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1180 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1186 [05/10/2022-20:07:04] [V] [TRT] Div_503 [Div] inputs: [1180 -> (-1, -1, 256)[FLOAT]], [1186 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Div_503 for ONNX node: Div_503 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1187 for ONNX tensor: 1187 [05/10/2022-20:07:04] [V] [TRT] Div_503 [Div] outputs: [1187 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_504 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1187 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.norm_conv.weight [05/10/2022-20:07:04] [V] [TRT] Mul_504 [Mul] inputs: [1187 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.norm_conv.weight for ONNX node: encoder.encoders.2.norm_conv.weight [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_504 for ONNX node: Mul_504 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1188 for ONNX tensor: 1188 [05/10/2022-20:07:04] [V] [TRT] Mul_504 [Mul] outputs: [1188 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_505 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1188 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.norm_conv.bias [05/10/2022-20:07:04] [V] [TRT] Add_505 [Add] inputs: [1188 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.norm_conv.bias for ONNX node: encoder.encoders.2.norm_conv.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_505 for ONNX node: Add_505 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1189 for ONNX tensor: 1189 [05/10/2022-20:07:04] [V] [TRT] Add_505 [Add] outputs: [1189 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_506 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1189 [05/10/2022-20:07:04] [V] [TRT] Transpose_506 [Transpose] inputs: [1189 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_506 for ONNX node: Transpose_506 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1190 for ONNX tensor: 1190 [05/10/2022-20:07:04] [V] [TRT] Transpose_506 [Transpose] outputs: [1190 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Not_507 [Not] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:04] [V] [TRT] Not_507 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Not_507 for ONNX node: Not_507 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1191 for ONNX tensor: 1191 [05/10/2022-20:07:04] [V] [TRT] Not_507 [Not] outputs: [1191 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Cast_508 [Cast] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1191 [05/10/2022-20:07:04] [V] [TRT] Cast_508 [Cast] inputs: [1191 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Casting to type: bool [05/10/2022-20:07:04] [V] [TRT] Registering layer: Cast_508 for ONNX node: Cast_508 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1192 for ONNX tensor: 1192 [05/10/2022-20:07:04] [V] [TRT] Cast_508 [Cast] outputs: [1192 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_509 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_509 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_509 [Constant] outputs: [1193 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Where_510 [Where] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1192 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1193 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1190 [05/10/2022-20:07:04] [V] [TRT] Where_510 [Where] inputs: [1192 -> (-1, 1, -1)[BOOL]], [1193 -> ()[FLOAT]], [1190 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1193 for ONNX node: 1193 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Where_510 for ONNX node: Where_510 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1194 for ONNX tensor: 1194 [05/10/2022-20:07:04] [V] [TRT] Where_510 [Where] outputs: [1194 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Conv_511 [Conv] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1194 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.conv_module.pointwise_conv1.weight [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.conv_module.pointwise_conv1.bias [05/10/2022-20:07:04] [V] [TRT] Conv_511 [Conv] inputs: [1194 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.2.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.2.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Conv_511 for ONNX node: Conv_511 [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:04] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:04] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1195 for ONNX tensor: 1195 [05/10/2022-20:07:04] [V] [TRT] Conv_511 [Conv] outputs: [1195 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Split_512 [Split] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1195 [05/10/2022-20:07:04] [V] [TRT] Split_512 [Split] inputs: [1195 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Split_512 for ONNX node: Split_512 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Split_512_4 for ONNX node: Split_512 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1196 for ONNX tensor: 1196 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1197 for ONNX tensor: 1197 [05/10/2022-20:07:04] [V] [TRT] Split_512 [Split] outputs: [1196 -> (-1, 256, -1)[FLOAT]], [1197 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sigmoid_513 [Sigmoid] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1197 [05/10/2022-20:07:04] [V] [TRT] Sigmoid_513 [Sigmoid] inputs: [1197 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sigmoid_513 for ONNX node: Sigmoid_513 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1198 for ONNX tensor: 1198 [05/10/2022-20:07:04] [V] [TRT] Sigmoid_513 [Sigmoid] outputs: [1198 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_514 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1196 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1198 [05/10/2022-20:07:04] [V] [TRT] Mul_514 [Mul] inputs: [1196 -> (-1, 256, -1)[FLOAT]], [1198 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_514 for ONNX node: Mul_514 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1199 for ONNX tensor: 1199 [05/10/2022-20:07:04] [V] [TRT] Mul_514 [Mul] outputs: [1199 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Conv_515 [Conv] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1199 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3167 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3168 [05/10/2022-20:07:04] [V] [TRT] Conv_515 [Conv] inputs: [1199 -> (-1, 256, -1)[FLOAT]], [3167 -> (256, 1, 15)[FLOAT]], [3168 -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Conv_515 for ONNX node: Conv_515 [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:04] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:04] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 3166 for ONNX tensor: 3166 [05/10/2022-20:07:04] [V] [TRT] Conv_515 [Conv] outputs: [3166 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sigmoid_516 [Sigmoid] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3166 [05/10/2022-20:07:04] [V] [TRT] Sigmoid_516 [Sigmoid] inputs: [3166 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sigmoid_516 for ONNX node: Sigmoid_516 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1202 for ONNX tensor: 1202 [05/10/2022-20:07:04] [V] [TRT] Sigmoid_516 [Sigmoid] outputs: [1202 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_517 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3166 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1202 [05/10/2022-20:07:04] [V] [TRT] Mul_517 [Mul] inputs: [3166 -> (-1, 256, -1)[FLOAT]], [1202 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_517 for ONNX node: Mul_517 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1203 for ONNX tensor: 1203 [05/10/2022-20:07:04] [V] [TRT] Mul_517 [Mul] outputs: [1203 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Not_518 [Not] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:04] [V] [TRT] Not_518 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Not_518 for ONNX node: Not_518 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1204 for ONNX tensor: 1204 [05/10/2022-20:07:04] [V] [TRT] Not_518 [Not] outputs: [1204 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Conv_519 [Conv] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1203 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.conv_module.pointwise_conv2.weight [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.conv_module.pointwise_conv2.bias [05/10/2022-20:07:04] [V] [TRT] Conv_519 [Conv] inputs: [1203 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.2.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.2.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:04] [V] [TRT] Registering layer: Conv_519 for ONNX node: Conv_519 [05/10/2022-20:07:04] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:04] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:04] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1205 for ONNX tensor: 1205 [05/10/2022-20:07:04] [V] [TRT] Conv_519 [Conv] outputs: [1205 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Cast_520 [Cast] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1204 [05/10/2022-20:07:04] [V] [TRT] Cast_520 [Cast] inputs: [1204 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Casting to type: bool [05/10/2022-20:07:04] [V] [TRT] Registering layer: Cast_520 for ONNX node: Cast_520 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1206 for ONNX tensor: 1206 [05/10/2022-20:07:04] [V] [TRT] Cast_520 [Cast] outputs: [1206 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_521 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_521 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_521 [Constant] outputs: [1207 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Where_522 [Where] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1206 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1207 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1205 [05/10/2022-20:07:04] [V] [TRT] Where_522 [Where] inputs: [1206 -> (-1, 1, -1)[BOOL]], [1207 -> ()[FLOAT]], [1205 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1207 for ONNX node: 1207 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Where_522 for ONNX node: Where_522 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1208 for ONNX tensor: 1208 [05/10/2022-20:07:04] [V] [TRT] Where_522 [Where] outputs: [1208 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Transpose_523 [Transpose] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1208 [05/10/2022-20:07:04] [V] [TRT] Transpose_523 [Transpose] inputs: [1208 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Transpose_523 for ONNX node: Transpose_523 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1209 for ONNX tensor: 1209 [05/10/2022-20:07:04] [V] [TRT] Transpose_523 [Transpose] outputs: [1209 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_524 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1178 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1209 [05/10/2022-20:07:04] [V] [TRT] Add_524 [Add] inputs: [1178 -> (-1, -1, 256)[FLOAT]], [1209 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_524 for ONNX node: Add_524 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1210 for ONNX tensor: 1210 [05/10/2022-20:07:04] [V] [TRT] Add_524 [Add] outputs: [1210 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_525 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1210 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_525 [ReduceMean] inputs: [1210 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_525 for ONNX node: ReduceMean_525 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1211 for ONNX tensor: 1211 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_525 [ReduceMean] outputs: [1211 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sub_526 [Sub] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1210 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1211 [05/10/2022-20:07:04] [V] [TRT] Sub_526 [Sub] inputs: [1210 -> (-1, -1, 256)[FLOAT]], [1211 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sub_526 for ONNX node: Sub_526 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1212 for ONNX tensor: 1212 [05/10/2022-20:07:04] [V] [TRT] Sub_526 [Sub] outputs: [1212 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_527 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_527 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_527 [Constant] outputs: [1213 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Pow_528 [Pow] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1212 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1213 [05/10/2022-20:07:04] [V] [TRT] Pow_528 [Pow] inputs: [1212 -> (-1, -1, 256)[FLOAT]], [1213 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1213 for ONNX node: 1213 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Pow_528 for ONNX node: Pow_528 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1214 for ONNX tensor: 1214 [05/10/2022-20:07:04] [V] [TRT] Pow_528 [Pow] outputs: [1214 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_529 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1214 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_529 [ReduceMean] inputs: [1214 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_529 for ONNX node: ReduceMean_529 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1215 for ONNX tensor: 1215 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_529 [ReduceMean] outputs: [1215 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_530 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_530 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_530 [Constant] outputs: [1216 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_531 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1215 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1216 [05/10/2022-20:07:04] [V] [TRT] Add_531 [Add] inputs: [1215 -> (-1, -1, 1)[FLOAT]], [1216 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1216 for ONNX node: 1216 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_531 for ONNX node: Add_531 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1217 for ONNX tensor: 1217 [05/10/2022-20:07:04] [V] [TRT] Add_531 [Add] outputs: [1217 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sqrt_532 [Sqrt] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1217 [05/10/2022-20:07:04] [V] [TRT] Sqrt_532 [Sqrt] inputs: [1217 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sqrt_532 for ONNX node: Sqrt_532 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1218 for ONNX tensor: 1218 [05/10/2022-20:07:04] [V] [TRT] Sqrt_532 [Sqrt] outputs: [1218 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Div_533 [Div] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1212 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1218 [05/10/2022-20:07:04] [V] [TRT] Div_533 [Div] inputs: [1212 -> (-1, -1, 256)[FLOAT]], [1218 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Div_533 for ONNX node: Div_533 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1219 for ONNX tensor: 1219 [05/10/2022-20:07:04] [V] [TRT] Div_533 [Div] outputs: [1219 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_534 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1219 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.norm_ff.weight [05/10/2022-20:07:04] [V] [TRT] Mul_534 [Mul] inputs: [1219 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.norm_ff.weight for ONNX node: encoder.encoders.2.norm_ff.weight [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_534 for ONNX node: Mul_534 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1220 for ONNX tensor: 1220 [05/10/2022-20:07:04] [V] [TRT] Mul_534 [Mul] outputs: [1220 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_535 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1220 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.norm_ff.bias [05/10/2022-20:07:04] [V] [TRT] Add_535 [Add] inputs: [1220 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.norm_ff.bias for ONNX node: encoder.encoders.2.norm_ff.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_535 for ONNX node: Add_535 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1221 for ONNX tensor: 1221 [05/10/2022-20:07:04] [V] [TRT] Add_535 [Add] outputs: [1221 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_536 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1221 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3268 [05/10/2022-20:07:04] [V] [TRT] MatMul_536 [MatMul] inputs: [1221 -> (-1, -1, 256)[FLOAT]], [3268 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3268 for ONNX node: 3268 [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_536 for ONNX node: MatMul_536 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1223 for ONNX tensor: 1223 [05/10/2022-20:07:04] [V] [TRT] MatMul_536 [MatMul] outputs: [1223 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_537 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.feed_forward.w_1.bias [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1223 [05/10/2022-20:07:04] [V] [TRT] Add_537 [Add] inputs: [encoder.encoders.2.feed_forward.w_1.bias -> (2048)[FLOAT]], [1223 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.feed_forward.w_1.bias for ONNX node: encoder.encoders.2.feed_forward.w_1.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_537 for ONNX node: Add_537 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1224 for ONNX tensor: 1224 [05/10/2022-20:07:04] [V] [TRT] Add_537 [Add] outputs: [1224 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sigmoid_538 [Sigmoid] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1224 [05/10/2022-20:07:04] [V] [TRT] Sigmoid_538 [Sigmoid] inputs: [1224 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sigmoid_538 for ONNX node: Sigmoid_538 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1225 for ONNX tensor: 1225 [05/10/2022-20:07:04] [V] [TRT] Sigmoid_538 [Sigmoid] outputs: [1225 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_539 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1224 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1225 [05/10/2022-20:07:04] [V] [TRT] Mul_539 [Mul] inputs: [1224 -> (-1, -1, 2048)[FLOAT]], [1225 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_539 for ONNX node: Mul_539 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1226 for ONNX tensor: 1226 [05/10/2022-20:07:04] [V] [TRT] Mul_539 [Mul] outputs: [1226 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: MatMul_540 [MatMul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1226 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 3269 [05/10/2022-20:07:04] [V] [TRT] MatMul_540 [MatMul] inputs: [1226 -> (-1, -1, 2048)[FLOAT]], [3269 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 3269 for ONNX node: 3269 [05/10/2022-20:07:04] [V] [TRT] Registering layer: MatMul_540 for ONNX node: MatMul_540 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1228 for ONNX tensor: 1228 [05/10/2022-20:07:04] [V] [TRT] MatMul_540 [MatMul] outputs: [1228 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_541 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.feed_forward.w_2.bias [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1228 [05/10/2022-20:07:04] [V] [TRT] Add_541 [Add] inputs: [encoder.encoders.2.feed_forward.w_2.bias -> (256)[FLOAT]], [1228 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.feed_forward.w_2.bias for ONNX node: encoder.encoders.2.feed_forward.w_2.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_541 for ONNX node: Add_541 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1229 for ONNX tensor: 1229 [05/10/2022-20:07:04] [V] [TRT] Add_541 [Add] outputs: [1229 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_542 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_542 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_542 [Constant] outputs: [1230 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_543 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1229 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1230 [05/10/2022-20:07:04] [V] [TRT] Mul_543 [Mul] inputs: [1229 -> (-1, -1, 256)[FLOAT]], [1230 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1230 for ONNX node: 1230 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_543 for ONNX node: Mul_543 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1231 for ONNX tensor: 1231 [05/10/2022-20:07:04] [V] [TRT] Mul_543 [Mul] outputs: [1231 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_544 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1210 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1231 [05/10/2022-20:07:04] [V] [TRT] Add_544 [Add] inputs: [1210 -> (-1, -1, 256)[FLOAT]], [1231 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_544 for ONNX node: Add_544 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1232 for ONNX tensor: 1232 [05/10/2022-20:07:04] [V] [TRT] Add_544 [Add] outputs: [1232 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_545 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1232 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_545 [ReduceMean] inputs: [1232 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_545 for ONNX node: ReduceMean_545 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1233 for ONNX tensor: 1233 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_545 [ReduceMean] outputs: [1233 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sub_546 [Sub] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1232 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1233 [05/10/2022-20:07:04] [V] [TRT] Sub_546 [Sub] inputs: [1232 -> (-1, -1, 256)[FLOAT]], [1233 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sub_546 for ONNX node: Sub_546 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1234 for ONNX tensor: 1234 [05/10/2022-20:07:04] [V] [TRT] Sub_546 [Sub] outputs: [1234 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_547 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_547 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_547 [Constant] outputs: [1235 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Pow_548 [Pow] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1234 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1235 [05/10/2022-20:07:04] [V] [TRT] Pow_548 [Pow] inputs: [1234 -> (-1, -1, 256)[FLOAT]], [1235 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1235 for ONNX node: 1235 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Pow_548 for ONNX node: Pow_548 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1236 for ONNX tensor: 1236 [05/10/2022-20:07:04] [V] [TRT] Pow_548 [Pow] outputs: [1236 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_549 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1236 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_549 [ReduceMean] inputs: [1236 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_549 for ONNX node: ReduceMean_549 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1237 for ONNX tensor: 1237 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_549 [ReduceMean] outputs: [1237 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_550 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_550 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_550 [Constant] outputs: [1238 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_551 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1237 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1238 [05/10/2022-20:07:04] [V] [TRT] Add_551 [Add] inputs: [1237 -> (-1, -1, 1)[FLOAT]], [1238 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1238 for ONNX node: 1238 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_551 for ONNX node: Add_551 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1239 for ONNX tensor: 1239 [05/10/2022-20:07:04] [V] [TRT] Add_551 [Add] outputs: [1239 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sqrt_552 [Sqrt] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1239 [05/10/2022-20:07:04] [V] [TRT] Sqrt_552 [Sqrt] inputs: [1239 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sqrt_552 for ONNX node: Sqrt_552 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1240 for ONNX tensor: 1240 [05/10/2022-20:07:04] [V] [TRT] Sqrt_552 [Sqrt] outputs: [1240 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Div_553 [Div] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1234 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1240 [05/10/2022-20:07:04] [V] [TRT] Div_553 [Div] inputs: [1234 -> (-1, -1, 256)[FLOAT]], [1240 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Div_553 for ONNX node: Div_553 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1241 for ONNX tensor: 1241 [05/10/2022-20:07:04] [V] [TRT] Div_553 [Div] outputs: [1241 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Mul_554 [Mul] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1241 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.norm_final.weight [05/10/2022-20:07:04] [V] [TRT] Mul_554 [Mul] inputs: [1241 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.norm_final.weight for ONNX node: encoder.encoders.2.norm_final.weight [05/10/2022-20:07:04] [V] [TRT] Registering layer: Mul_554 for ONNX node: Mul_554 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1242 for ONNX tensor: 1242 [05/10/2022-20:07:04] [V] [TRT] Mul_554 [Mul] outputs: [1242 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_555 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1242 [05/10/2022-20:07:04] [V] [TRT] Searching for input: encoder.encoders.2.norm_final.bias [05/10/2022-20:07:04] [V] [TRT] Add_555 [Add] inputs: [1242 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.2.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: encoder.encoders.2.norm_final.bias for ONNX node: encoder.encoders.2.norm_final.bias [05/10/2022-20:07:04] [V] [TRT] Registering layer: Add_555 for ONNX node: Add_555 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1243 for ONNX tensor: 1243 [05/10/2022-20:07:04] [V] [TRT] Add_555 [Add] outputs: [1243 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_556 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1243 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_556 [ReduceMean] inputs: [1243 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_556 for ONNX node: ReduceMean_556 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1244 for ONNX tensor: 1244 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_556 [ReduceMean] outputs: [1244 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Sub_557 [Sub] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1243 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1244 [05/10/2022-20:07:04] [V] [TRT] Sub_557 [Sub] inputs: [1243 -> (-1, -1, 256)[FLOAT]], [1244 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: Sub_557 for ONNX node: Sub_557 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1245 for ONNX tensor: 1245 [05/10/2022-20:07:04] [V] [TRT] Sub_557 [Sub] outputs: [1245 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_558 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_558 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_558 [Constant] outputs: [1246 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Pow_559 [Pow] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1245 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1246 [05/10/2022-20:07:04] [V] [TRT] Pow_559 [Pow] inputs: [1245 -> (-1, -1, 256)[FLOAT]], [1246 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1246 for ONNX node: 1246 [05/10/2022-20:07:04] [V] [TRT] Registering layer: Pow_559 for ONNX node: Pow_559 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1247 for ONNX tensor: 1247 [05/10/2022-20:07:04] [V] [TRT] Pow_559 [Pow] outputs: [1247 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: ReduceMean_560 [ReduceMean] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1247 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_560 [ReduceMean] inputs: [1247 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: ReduceMean_560 for ONNX node: ReduceMean_560 [05/10/2022-20:07:04] [V] [TRT] Registering tensor: 1248 for ONNX tensor: 1248 [05/10/2022-20:07:04] [V] [TRT] ReduceMean_560 [ReduceMean] outputs: [1248 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Constant_561 [Constant] [05/10/2022-20:07:04] [V] [TRT] Constant_561 [Constant] inputs: [05/10/2022-20:07:04] [V] [TRT] Constant_561 [Constant] outputs: [1249 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Parsing node: Add_562 [Add] [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1248 [05/10/2022-20:07:04] [V] [TRT] Searching for input: 1249 [05/10/2022-20:07:04] [V] [TRT] Add_562 [Add] inputs: [1248 -> (-1, -1, 1)[FLOAT]], [1249 -> ()[FLOAT]], [05/10/2022-20:07:04] [V] [TRT] Registering layer: 1249 for ONNX node: 1249 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_562 for ONNX node: Add_562 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1250 for ONNX tensor: 1250 [05/10/2022-20:07:05] [V] [TRT] Add_562 [Add] outputs: [1250 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Sqrt_563 [Sqrt] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1250 [05/10/2022-20:07:05] [V] [TRT] Sqrt_563 [Sqrt] inputs: [1250 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Sqrt_563 for ONNX node: Sqrt_563 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1251 for ONNX tensor: 1251 [05/10/2022-20:07:05] [V] [TRT] Sqrt_563 [Sqrt] outputs: [1251 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Div_564 [Div] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1245 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1251 [05/10/2022-20:07:05] [V] [TRT] Div_564 [Div] inputs: [1245 -> (-1, -1, 256)[FLOAT]], [1251 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Div_564 for ONNX node: Div_564 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1252 for ONNX tensor: 1252 [05/10/2022-20:07:05] [V] [TRT] Div_564 [Div] outputs: [1252 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Mul_565 [Mul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1252 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.norm_ff_macaron.weight [05/10/2022-20:07:05] [V] [TRT] Mul_565 [Mul] inputs: [1252 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.norm_ff_macaron.weight for ONNX node: encoder.encoders.3.norm_ff_macaron.weight [05/10/2022-20:07:05] [V] [TRT] Registering layer: Mul_565 for ONNX node: Mul_565 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1253 for ONNX tensor: 1253 [05/10/2022-20:07:05] [V] [TRT] Mul_565 [Mul] outputs: [1253 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_566 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1253 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.norm_ff_macaron.bias [05/10/2022-20:07:05] [V] [TRT] Add_566 [Add] inputs: [1253 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.norm_ff_macaron.bias for ONNX node: encoder.encoders.3.norm_ff_macaron.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_566 for ONNX node: Add_566 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1254 for ONNX tensor: 1254 [05/10/2022-20:07:05] [V] [TRT] Add_566 [Add] outputs: [1254 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_567 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1254 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3270 [05/10/2022-20:07:05] [V] [TRT] MatMul_567 [MatMul] inputs: [1254 -> (-1, -1, 256)[FLOAT]], [3270 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3270 for ONNX node: 3270 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_567 for ONNX node: MatMul_567 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1256 for ONNX tensor: 1256 [05/10/2022-20:07:05] [V] [TRT] MatMul_567 [MatMul] outputs: [1256 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_568 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.feed_forward_macaron.w_1.bias [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1256 [05/10/2022-20:07:05] [V] [TRT] Add_568 [Add] inputs: [encoder.encoders.3.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [1256 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.3.feed_forward_macaron.w_1.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_568 for ONNX node: Add_568 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1257 for ONNX tensor: 1257 [05/10/2022-20:07:05] [V] [TRT] Add_568 [Add] outputs: [1257 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Sigmoid_569 [Sigmoid] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1257 [05/10/2022-20:07:05] [V] [TRT] Sigmoid_569 [Sigmoid] inputs: [1257 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Sigmoid_569 for ONNX node: Sigmoid_569 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1258 for ONNX tensor: 1258 [05/10/2022-20:07:05] [V] [TRT] Sigmoid_569 [Sigmoid] outputs: [1258 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Mul_570 [Mul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1257 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1258 [05/10/2022-20:07:05] [V] [TRT] Mul_570 [Mul] inputs: [1257 -> (-1, -1, 2048)[FLOAT]], [1258 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Mul_570 for ONNX node: Mul_570 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1259 for ONNX tensor: 1259 [05/10/2022-20:07:05] [V] [TRT] Mul_570 [Mul] outputs: [1259 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_571 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1259 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3271 [05/10/2022-20:07:05] [V] [TRT] MatMul_571 [MatMul] inputs: [1259 -> (-1, -1, 2048)[FLOAT]], [3271 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3271 for ONNX node: 3271 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_571 for ONNX node: MatMul_571 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1261 for ONNX tensor: 1261 [05/10/2022-20:07:05] [V] [TRT] MatMul_571 [MatMul] outputs: [1261 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_572 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.feed_forward_macaron.w_2.bias [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1261 [05/10/2022-20:07:05] [V] [TRT] Add_572 [Add] inputs: [encoder.encoders.3.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [1261 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.3.feed_forward_macaron.w_2.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_572 for ONNX node: Add_572 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1262 for ONNX tensor: 1262 [05/10/2022-20:07:05] [V] [TRT] Add_572 [Add] outputs: [1262 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_573 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_573 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_573 [Constant] outputs: [1263 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Mul_574 [Mul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1262 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1263 [05/10/2022-20:07:05] [V] [TRT] Mul_574 [Mul] inputs: [1262 -> (-1, -1, 256)[FLOAT]], [1263 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1263 for ONNX node: 1263 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Mul_574 for ONNX node: Mul_574 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1264 for ONNX tensor: 1264 [05/10/2022-20:07:05] [V] [TRT] Mul_574 [Mul] outputs: [1264 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_575 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1243 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1264 [05/10/2022-20:07:05] [V] [TRT] Add_575 [Add] inputs: [1243 -> (-1, -1, 256)[FLOAT]], [1264 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_575 for ONNX node: Add_575 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1265 for ONNX tensor: 1265 [05/10/2022-20:07:05] [V] [TRT] Add_575 [Add] outputs: [1265 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: ReduceMean_576 [ReduceMean] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1265 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_576 [ReduceMean] inputs: [1265 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: ReduceMean_576 for ONNX node: ReduceMean_576 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1266 for ONNX tensor: 1266 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_576 [ReduceMean] outputs: [1266 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Sub_577 [Sub] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1265 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1266 [05/10/2022-20:07:05] [V] [TRT] Sub_577 [Sub] inputs: [1265 -> (-1, -1, 256)[FLOAT]], [1266 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Sub_577 for ONNX node: Sub_577 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1267 for ONNX tensor: 1267 [05/10/2022-20:07:05] [V] [TRT] Sub_577 [Sub] outputs: [1267 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_578 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_578 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_578 [Constant] outputs: [1268 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Pow_579 [Pow] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1267 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1268 [05/10/2022-20:07:05] [V] [TRT] Pow_579 [Pow] inputs: [1267 -> (-1, -1, 256)[FLOAT]], [1268 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1268 for ONNX node: 1268 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Pow_579 for ONNX node: Pow_579 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1269 for ONNX tensor: 1269 [05/10/2022-20:07:05] [V] [TRT] Pow_579 [Pow] outputs: [1269 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: ReduceMean_580 [ReduceMean] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1269 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_580 [ReduceMean] inputs: [1269 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: ReduceMean_580 for ONNX node: ReduceMean_580 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1270 for ONNX tensor: 1270 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_580 [ReduceMean] outputs: [1270 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_581 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_581 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_581 [Constant] outputs: [1271 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_582 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1270 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1271 [05/10/2022-20:07:05] [V] [TRT] Add_582 [Add] inputs: [1270 -> (-1, -1, 1)[FLOAT]], [1271 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1271 for ONNX node: 1271 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_582 for ONNX node: Add_582 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1272 for ONNX tensor: 1272 [05/10/2022-20:07:05] [V] [TRT] Add_582 [Add] outputs: [1272 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Sqrt_583 [Sqrt] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1272 [05/10/2022-20:07:05] [V] [TRT] Sqrt_583 [Sqrt] inputs: [1272 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Sqrt_583 for ONNX node: Sqrt_583 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1273 for ONNX tensor: 1273 [05/10/2022-20:07:05] [V] [TRT] Sqrt_583 [Sqrt] outputs: [1273 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Div_584 [Div] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1267 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1273 [05/10/2022-20:07:05] [V] [TRT] Div_584 [Div] inputs: [1267 -> (-1, -1, 256)[FLOAT]], [1273 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Div_584 for ONNX node: Div_584 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1274 for ONNX tensor: 1274 [05/10/2022-20:07:05] [V] [TRT] Div_584 [Div] outputs: [1274 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Mul_585 [Mul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1274 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.norm_mha.weight [05/10/2022-20:07:05] [V] [TRT] Mul_585 [Mul] inputs: [1274 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.norm_mha.weight for ONNX node: encoder.encoders.3.norm_mha.weight [05/10/2022-20:07:05] [V] [TRT] Registering layer: Mul_585 for ONNX node: Mul_585 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1275 for ONNX tensor: 1275 [05/10/2022-20:07:05] [V] [TRT] Mul_585 [Mul] outputs: [1275 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_586 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1275 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.norm_mha.bias [05/10/2022-20:07:05] [V] [TRT] Add_586 [Add] inputs: [1275 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.norm_mha.bias for ONNX node: encoder.encoders.3.norm_mha.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_586 for ONNX node: Add_586 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1276 for ONNX tensor: 1276 [05/10/2022-20:07:05] [V] [TRT] Add_586 [Add] outputs: [1276 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Shape_587 [Shape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1276 [05/10/2022-20:07:05] [V] [TRT] Shape_587 [Shape] inputs: [1276 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Shape_587 for ONNX node: Shape_587 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1277 for ONNX tensor: 1277 [05/10/2022-20:07:05] [V] [TRT] Shape_587 [Shape] outputs: [1277 -> (3)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_588 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_588 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_588 [Constant] outputs: [1278 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Gather_589 [Gather] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1277 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1278 [05/10/2022-20:07:05] [V] [TRT] Gather_589 [Gather] inputs: [1277 -> (3)[INT32]], [1278 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1278 for ONNX node: 1278 [05/10/2022-20:07:05] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Gather_589 for ONNX node: Gather_589 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1279 for ONNX tensor: 1279 [05/10/2022-20:07:05] [V] [TRT] Gather_589 [Gather] outputs: [1279 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_590 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1276 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3272 [05/10/2022-20:07:05] [V] [TRT] MatMul_590 [MatMul] inputs: [1276 -> (-1, -1, 256)[FLOAT]], [3272 -> (256, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3272 for ONNX node: 3272 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_590 for ONNX node: MatMul_590 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1281 for ONNX tensor: 1281 [05/10/2022-20:07:05] [V] [TRT] MatMul_590 [MatMul] outputs: [1281 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_591 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.self_attn.linear_q.bias [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1281 [05/10/2022-20:07:05] [V] [TRT] Add_591 [Add] inputs: [encoder.encoders.3.self_attn.linear_q.bias -> (256)[FLOAT]], [1281 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.self_attn.linear_q.bias for ONNX node: encoder.encoders.3.self_attn.linear_q.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_591 for ONNX node: Add_591 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1282 for ONNX tensor: 1282 [05/10/2022-20:07:05] [V] [TRT] Add_591 [Add] outputs: [1282 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_592 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_592 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_592 [Constant] outputs: [1286 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Unsqueeze_593 [Unsqueeze] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1279 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1286 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_593 [Unsqueeze] inputs: [1279 -> ()[INT32]], [1286 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:05] [V] [TRT] Registering layer: Unsqueeze_593 for ONNX node: Unsqueeze_593 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1287 for ONNX tensor: 1287 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_593 [Unsqueeze] outputs: [1287 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Concat_594 [Concat] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1287 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3273 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3274 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3275 [05/10/2022-20:07:05] [V] [TRT] Concat_594 [Concat] inputs: [1287 -> (1)[INT32]], [3273 -> (1)[INT32]], [3274 -> (1)[INT32]], [3275 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3273 for ONNX node: 3273 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3274 for ONNX node: 3274 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3275 for ONNX node: 3275 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Concat_594 for ONNX node: Concat_594 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1294 for ONNX tensor: 1294 [05/10/2022-20:07:05] [V] [TRT] Concat_594 [Concat] outputs: [1294 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Reshape_595 [Reshape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1282 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1294 [05/10/2022-20:07:05] [V] [TRT] Reshape_595 [Reshape] inputs: [1282 -> (-1, -1, 256)[FLOAT]], [1294 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Reshape_595 for ONNX node: Reshape_595 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1295 for ONNX tensor: 1295 [05/10/2022-20:07:05] [V] [TRT] Reshape_595 [Reshape] outputs: [1295 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_596 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1276 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3276 [05/10/2022-20:07:05] [V] [TRT] MatMul_596 [MatMul] inputs: [1276 -> (-1, -1, 256)[FLOAT]], [3276 -> (256, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3276 for ONNX node: 3276 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_596 for ONNX node: MatMul_596 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1297 for ONNX tensor: 1297 [05/10/2022-20:07:05] [V] [TRT] MatMul_596 [MatMul] outputs: [1297 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_597 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.self_attn.linear_k.bias [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1297 [05/10/2022-20:07:05] [V] [TRT] Add_597 [Add] inputs: [encoder.encoders.3.self_attn.linear_k.bias -> (256)[FLOAT]], [1297 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.self_attn.linear_k.bias for ONNX node: encoder.encoders.3.self_attn.linear_k.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_597 for ONNX node: Add_597 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1298 for ONNX tensor: 1298 [05/10/2022-20:07:05] [V] [TRT] Add_597 [Add] outputs: [1298 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_598 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_598 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_598 [Constant] outputs: [1302 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Unsqueeze_599 [Unsqueeze] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1279 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1302 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_599 [Unsqueeze] inputs: [1279 -> ()[INT32]], [1302 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:05] [V] [TRT] Registering layer: Unsqueeze_599 for ONNX node: Unsqueeze_599 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1303 for ONNX tensor: 1303 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_599 [Unsqueeze] outputs: [1303 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Concat_600 [Concat] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1303 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3277 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3278 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3279 [05/10/2022-20:07:05] [V] [TRT] Concat_600 [Concat] inputs: [1303 -> (1)[INT32]], [3277 -> (1)[INT32]], [3278 -> (1)[INT32]], [3279 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3277 for ONNX node: 3277 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3278 for ONNX node: 3278 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3279 for ONNX node: 3279 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Concat_600 for ONNX node: Concat_600 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1310 for ONNX tensor: 1310 [05/10/2022-20:07:05] [V] [TRT] Concat_600 [Concat] outputs: [1310 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Reshape_601 [Reshape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1298 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1310 [05/10/2022-20:07:05] [V] [TRT] Reshape_601 [Reshape] inputs: [1298 -> (-1, -1, 256)[FLOAT]], [1310 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Reshape_601 for ONNX node: Reshape_601 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1311 for ONNX tensor: 1311 [05/10/2022-20:07:05] [V] [TRT] Reshape_601 [Reshape] outputs: [1311 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_602 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1276 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3280 [05/10/2022-20:07:05] [V] [TRT] MatMul_602 [MatMul] inputs: [1276 -> (-1, -1, 256)[FLOAT]], [3280 -> (256, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3280 for ONNX node: 3280 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_602 for ONNX node: MatMul_602 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1313 for ONNX tensor: 1313 [05/10/2022-20:07:05] [V] [TRT] MatMul_602 [MatMul] outputs: [1313 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_603 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.self_attn.linear_v.bias [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1313 [05/10/2022-20:07:05] [V] [TRT] Add_603 [Add] inputs: [encoder.encoders.3.self_attn.linear_v.bias -> (256)[FLOAT]], [1313 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.self_attn.linear_v.bias for ONNX node: encoder.encoders.3.self_attn.linear_v.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_603 for ONNX node: Add_603 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1314 for ONNX tensor: 1314 [05/10/2022-20:07:05] [V] [TRT] Add_603 [Add] outputs: [1314 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_604 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_604 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_604 [Constant] outputs: [1318 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Unsqueeze_605 [Unsqueeze] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1279 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1318 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_605 [Unsqueeze] inputs: [1279 -> ()[INT32]], [1318 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:05] [V] [TRT] Registering layer: Unsqueeze_605 for ONNX node: Unsqueeze_605 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1319 for ONNX tensor: 1319 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_605 [Unsqueeze] outputs: [1319 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Concat_606 [Concat] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1319 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3281 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3282 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3283 [05/10/2022-20:07:05] [V] [TRT] Concat_606 [Concat] inputs: [1319 -> (1)[INT32]], [3281 -> (1)[INT32]], [3282 -> (1)[INT32]], [3283 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3281 for ONNX node: 3281 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3282 for ONNX node: 3282 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3283 for ONNX node: 3283 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Concat_606 for ONNX node: Concat_606 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1326 for ONNX tensor: 1326 [05/10/2022-20:07:05] [V] [TRT] Concat_606 [Concat] outputs: [1326 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Reshape_607 [Reshape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1314 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1326 [05/10/2022-20:07:05] [V] [TRT] Reshape_607 [Reshape] inputs: [1314 -> (-1, -1, 256)[FLOAT]], [1326 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Reshape_607 for ONNX node: Reshape_607 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1327 for ONNX tensor: 1327 [05/10/2022-20:07:05] [V] [TRT] Reshape_607 [Reshape] outputs: [1327 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_608 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1327 [05/10/2022-20:07:05] [V] [TRT] Transpose_608 [Transpose] inputs: [1327 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_608 for ONNX node: Transpose_608 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1328 for ONNX tensor: 1328 [05/10/2022-20:07:05] [V] [TRT] Transpose_608 [Transpose] outputs: [1328 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Shape_609 [Shape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:05] [V] [TRT] Shape_609 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Shape_609 for ONNX node: Shape_609 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1329 for ONNX tensor: 1329 [05/10/2022-20:07:05] [V] [TRT] Shape_609 [Shape] outputs: [1329 -> (3)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_610 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_610 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_610 [Constant] outputs: [1330 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Gather_611 [Gather] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1329 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1330 [05/10/2022-20:07:05] [V] [TRT] Gather_611 [Gather] inputs: [1329 -> (3)[INT32]], [1330 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1330 for ONNX node: 1330 [05/10/2022-20:07:05] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Gather_611 for ONNX node: Gather_611 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1331 for ONNX tensor: 1331 [05/10/2022-20:07:05] [V] [TRT] Gather_611 [Gather] outputs: [1331 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_612 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3284 [05/10/2022-20:07:05] [V] [TRT] MatMul_612 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3284 -> (256, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3284 for ONNX node: 3284 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_612 for ONNX node: MatMul_612 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1333 for ONNX tensor: 1333 [05/10/2022-20:07:05] [V] [TRT] MatMul_612 [MatMul] outputs: [1333 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_613 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_613 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_613 [Constant] outputs: [1337 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Unsqueeze_614 [Unsqueeze] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1331 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1337 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_614 [Unsqueeze] inputs: [1331 -> ()[INT32]], [1337 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:05] [V] [TRT] Registering layer: Unsqueeze_614 for ONNX node: Unsqueeze_614 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1338 for ONNX tensor: 1338 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_614 [Unsqueeze] outputs: [1338 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Concat_615 [Concat] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1338 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3285 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3286 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3287 [05/10/2022-20:07:05] [V] [TRT] Concat_615 [Concat] inputs: [1338 -> (1)[INT32]], [3285 -> (1)[INT32]], [3286 -> (1)[INT32]], [3287 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3285 for ONNX node: 3285 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3286 for ONNX node: 3286 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3287 for ONNX node: 3287 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Concat_615 for ONNX node: Concat_615 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1345 for ONNX tensor: 1345 [05/10/2022-20:07:05] [V] [TRT] Concat_615 [Concat] outputs: [1345 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Reshape_616 [Reshape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1333 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1345 [05/10/2022-20:07:05] [V] [TRT] Reshape_616 [Reshape] inputs: [1333 -> (1, -1, 256)[FLOAT]], [1345 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Reshape_616 for ONNX node: Reshape_616 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1346 for ONNX tensor: 1346 [05/10/2022-20:07:05] [V] [TRT] Reshape_616 [Reshape] outputs: [1346 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_617 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1295 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.self_attn.pos_bias_u [05/10/2022-20:07:05] [V] [TRT] Add_617 [Add] inputs: [1295 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.3.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.self_attn.pos_bias_u for ONNX node: encoder.encoders.3.self_attn.pos_bias_u [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_617 for ONNX node: Add_617 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1347 for ONNX tensor: 1347 [05/10/2022-20:07:05] [V] [TRT] Add_617 [Add] outputs: [1347 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_618 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1347 [05/10/2022-20:07:05] [V] [TRT] Transpose_618 [Transpose] inputs: [1347 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_618 for ONNX node: Transpose_618 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1348 for ONNX tensor: 1348 [05/10/2022-20:07:05] [V] [TRT] Transpose_618 [Transpose] outputs: [1348 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_619 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1295 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.self_attn.pos_bias_v [05/10/2022-20:07:05] [V] [TRT] Add_619 [Add] inputs: [1295 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.3.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.self_attn.pos_bias_v for ONNX node: encoder.encoders.3.self_attn.pos_bias_v [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_619 for ONNX node: Add_619 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1349 for ONNX tensor: 1349 [05/10/2022-20:07:05] [V] [TRT] Add_619 [Add] outputs: [1349 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_620 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1349 [05/10/2022-20:07:05] [V] [TRT] Transpose_620 [Transpose] inputs: [1349 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_620 for ONNX node: Transpose_620 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1350 for ONNX tensor: 1350 [05/10/2022-20:07:05] [V] [TRT] Transpose_620 [Transpose] outputs: [1350 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_621 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1311 [05/10/2022-20:07:05] [V] [TRT] Transpose_621 [Transpose] inputs: [1311 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_621 for ONNX node: Transpose_621 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1351 for ONNX tensor: 1351 [05/10/2022-20:07:05] [V] [TRT] Transpose_621 [Transpose] outputs: [1351 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_622 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1348 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1351 [05/10/2022-20:07:05] [V] [TRT] MatMul_622 [MatMul] inputs: [1348 -> (-1, 4, -1, 64)[FLOAT]], [1351 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_622 for ONNX node: MatMul_622 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1352 for ONNX tensor: 1352 [05/10/2022-20:07:05] [V] [TRT] MatMul_622 [MatMul] outputs: [1352 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_623 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1346 [05/10/2022-20:07:05] [V] [TRT] Transpose_623 [Transpose] inputs: [1346 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_623 for ONNX node: Transpose_623 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1353 for ONNX tensor: 1353 [05/10/2022-20:07:05] [V] [TRT] Transpose_623 [Transpose] outputs: [1353 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_624 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1350 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1353 [05/10/2022-20:07:05] [V] [TRT] MatMul_624 [MatMul] inputs: [1350 -> (-1, 4, -1, 64)[FLOAT]], [1353 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_624 for ONNX node: MatMul_624 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1354 for ONNX tensor: 1354 [05/10/2022-20:07:05] [V] [TRT] MatMul_624 [MatMul] outputs: [1354 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_625 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1352 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1354 [05/10/2022-20:07:05] [V] [TRT] Add_625 [Add] inputs: [1352 -> (-1, 4, -1, -1)[FLOAT]], [1354 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_625 for ONNX node: Add_625 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1355 for ONNX tensor: 1355 [05/10/2022-20:07:05] [V] [TRT] Add_625 [Add] outputs: [1355 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_626 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_626 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_626 [Constant] outputs: [1356 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Div_627 [Div] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1355 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1356 [05/10/2022-20:07:05] [V] [TRT] Div_627 [Div] inputs: [1355 -> (-1, 4, -1, -1)[FLOAT]], [1356 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1356 for ONNX node: 1356 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Div_627 for ONNX node: Div_627 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1357 for ONNX tensor: 1357 [05/10/2022-20:07:05] [V] [TRT] Div_627 [Div] outputs: [1357 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Shape_628 [Shape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1328 [05/10/2022-20:07:05] [V] [TRT] Shape_628 [Shape] inputs: [1328 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Shape_628 for ONNX node: Shape_628 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1358 for ONNX tensor: 1358 [05/10/2022-20:07:05] [V] [TRT] Shape_628 [Shape] outputs: [1358 -> (4)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_629 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_629 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_629 [Constant] outputs: [1359 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Gather_630 [Gather] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1358 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1359 [05/10/2022-20:07:05] [V] [TRT] Gather_630 [Gather] inputs: [1358 -> (4)[INT32]], [1359 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1359 for ONNX node: 1359 [05/10/2022-20:07:05] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Gather_630 for ONNX node: Gather_630 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1360 for ONNX tensor: 1360 [05/10/2022-20:07:05] [V] [TRT] Gather_630 [Gather] outputs: [1360 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_631 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_631 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_631 [Constant] outputs: [1361 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Unsqueeze_632 [Unsqueeze] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1361 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_632 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [1361 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:05] [V] [TRT] Registering layer: Unsqueeze_632 for ONNX node: Unsqueeze_632 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1362 for ONNX tensor: 1362 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_632 [Unsqueeze] outputs: [1362 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Cast_633 [Cast] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1362 [05/10/2022-20:07:05] [V] [TRT] Cast_633 [Cast] inputs: [1362 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Cast_633 for ONNX node: Cast_633 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1363 for ONNX tensor: 1363 [05/10/2022-20:07:05] [V] [TRT] Cast_633 [Cast] outputs: [1363 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_634 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_634 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_634 [Constant] outputs: [1364 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Equal_635 [Equal] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1363 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1364 [05/10/2022-20:07:05] [V] [TRT] Equal_635 [Equal] inputs: [1363 -> (-1, 1, 1, -1)[INT32]], [1364 -> ()[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1364 for ONNX node: 1364 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Equal_635 for ONNX node: Equal_635 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1365 for ONNX tensor: 1365 [05/10/2022-20:07:05] [V] [TRT] Equal_635 [Equal] outputs: [1365 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Cast_636 [Cast] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1365 [05/10/2022-20:07:05] [V] [TRT] Cast_636 [Cast] inputs: [1365 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Casting to type: bool [05/10/2022-20:07:05] [V] [TRT] Registering layer: Cast_636 for ONNX node: Cast_636 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1366 for ONNX tensor: 1366 [05/10/2022-20:07:05] [V] [TRT] Cast_636 [Cast] outputs: [1366 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_637 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_637 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_637 [Constant] outputs: [1367 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Where_638 [Where] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1366 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1367 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1357 [05/10/2022-20:07:05] [V] [TRT] Where_638 [Where] inputs: [1366 -> (-1, 1, 1, -1)[BOOL]], [1367 -> ()[FLOAT]], [1357 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1367 for ONNX node: 1367 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Where_638 for ONNX node: Where_638 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1368 for ONNX tensor: 1368 [05/10/2022-20:07:05] [V] [TRT] Where_638 [Where] outputs: [1368 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Softmax_639 [Softmax] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1368 [05/10/2022-20:07:05] [V] [TRT] Softmax_639 [Softmax] inputs: [1368 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Softmax_639 for ONNX node: Softmax_639 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1369 for ONNX tensor: 1369 [05/10/2022-20:07:05] [V] [TRT] Softmax_639 [Softmax] outputs: [1369 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Cast_640 [Cast] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1365 [05/10/2022-20:07:05] [V] [TRT] Cast_640 [Cast] inputs: [1365 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Casting to type: bool [05/10/2022-20:07:05] [V] [TRT] Registering layer: Cast_640 for ONNX node: Cast_640 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1370 for ONNX tensor: 1370 [05/10/2022-20:07:05] [V] [TRT] Cast_640 [Cast] outputs: [1370 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_641 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_641 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_641 [Constant] outputs: [1371 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Where_642 [Where] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1370 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1371 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1369 [05/10/2022-20:07:05] [V] [TRT] Where_642 [Where] inputs: [1370 -> (-1, 1, 1, -1)[BOOL]], [1371 -> ()[FLOAT]], [1369 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1371 for ONNX node: 1371 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Where_642 for ONNX node: Where_642 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1372 for ONNX tensor: 1372 [05/10/2022-20:07:05] [V] [TRT] Where_642 [Where] outputs: [1372 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_643 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1372 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1328 [05/10/2022-20:07:05] [V] [TRT] MatMul_643 [MatMul] inputs: [1372 -> (-1, 4, -1, -1)[FLOAT]], [1328 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_643 for ONNX node: MatMul_643 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1373 for ONNX tensor: 1373 [05/10/2022-20:07:05] [V] [TRT] MatMul_643 [MatMul] outputs: [1373 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_644 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1373 [05/10/2022-20:07:05] [V] [TRT] Transpose_644 [Transpose] inputs: [1373 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_644 for ONNX node: Transpose_644 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1374 for ONNX tensor: 1374 [05/10/2022-20:07:05] [V] [TRT] Transpose_644 [Transpose] outputs: [1374 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_645 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_645 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_645 [Constant] outputs: [1377 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Unsqueeze_646 [Unsqueeze] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1360 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1377 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_646 [Unsqueeze] inputs: [1360 -> ()[INT32]], [1377 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:05] [V] [TRT] Registering layer: Unsqueeze_646 for ONNX node: Unsqueeze_646 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1378 for ONNX tensor: 1378 [05/10/2022-20:07:05] [V] [TRT] Unsqueeze_646 [Unsqueeze] outputs: [1378 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Concat_647 [Concat] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1378 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3288 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3289 [05/10/2022-20:07:05] [V] [TRT] Concat_647 [Concat] inputs: [1378 -> (1)[INT32]], [3288 -> (1)[INT32]], [3289 -> (1)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3288 for ONNX node: 3288 [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3289 for ONNX node: 3289 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Concat_647 for ONNX node: Concat_647 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1383 for ONNX tensor: 1383 [05/10/2022-20:07:05] [V] [TRT] Concat_647 [Concat] outputs: [1383 -> (3)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Reshape_648 [Reshape] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1374 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1383 [05/10/2022-20:07:05] [V] [TRT] Reshape_648 [Reshape] inputs: [1374 -> (-1, -1, 4, 64)[FLOAT]], [1383 -> (3)[INT32]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Reshape_648 for ONNX node: Reshape_648 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1384 for ONNX tensor: 1384 [05/10/2022-20:07:05] [V] [TRT] Reshape_648 [Reshape] outputs: [1384 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: MatMul_649 [MatMul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1384 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 3290 [05/10/2022-20:07:05] [V] [TRT] MatMul_649 [MatMul] inputs: [1384 -> (-1, -1, 256)[FLOAT]], [3290 -> (256, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 3290 for ONNX node: 3290 [05/10/2022-20:07:05] [V] [TRT] Registering layer: MatMul_649 for ONNX node: MatMul_649 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1386 for ONNX tensor: 1386 [05/10/2022-20:07:05] [V] [TRT] MatMul_649 [MatMul] outputs: [1386 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_650 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.self_attn.linear_out.bias [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1386 [05/10/2022-20:07:05] [V] [TRT] Add_650 [Add] inputs: [encoder.encoders.3.self_attn.linear_out.bias -> (256)[FLOAT]], [1386 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.self_attn.linear_out.bias for ONNX node: encoder.encoders.3.self_attn.linear_out.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_650 for ONNX node: Add_650 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1387 for ONNX tensor: 1387 [05/10/2022-20:07:05] [V] [TRT] Add_650 [Add] outputs: [1387 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_651 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1265 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1387 [05/10/2022-20:07:05] [V] [TRT] Add_651 [Add] inputs: [1265 -> (-1, -1, 256)[FLOAT]], [1387 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_651 for ONNX node: Add_651 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1388 for ONNX tensor: 1388 [05/10/2022-20:07:05] [V] [TRT] Add_651 [Add] outputs: [1388 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: ReduceMean_652 [ReduceMean] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1388 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_652 [ReduceMean] inputs: [1388 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: ReduceMean_652 for ONNX node: ReduceMean_652 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1389 for ONNX tensor: 1389 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_652 [ReduceMean] outputs: [1389 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Sub_653 [Sub] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1388 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1389 [05/10/2022-20:07:05] [V] [TRT] Sub_653 [Sub] inputs: [1388 -> (-1, -1, 256)[FLOAT]], [1389 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Sub_653 for ONNX node: Sub_653 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1390 for ONNX tensor: 1390 [05/10/2022-20:07:05] [V] [TRT] Sub_653 [Sub] outputs: [1390 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_654 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_654 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_654 [Constant] outputs: [1391 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Pow_655 [Pow] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1390 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1391 [05/10/2022-20:07:05] [V] [TRT] Pow_655 [Pow] inputs: [1390 -> (-1, -1, 256)[FLOAT]], [1391 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1391 for ONNX node: 1391 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Pow_655 for ONNX node: Pow_655 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1392 for ONNX tensor: 1392 [05/10/2022-20:07:05] [V] [TRT] Pow_655 [Pow] outputs: [1392 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: ReduceMean_656 [ReduceMean] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1392 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_656 [ReduceMean] inputs: [1392 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: ReduceMean_656 for ONNX node: ReduceMean_656 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1393 for ONNX tensor: 1393 [05/10/2022-20:07:05] [V] [TRT] ReduceMean_656 [ReduceMean] outputs: [1393 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Constant_657 [Constant] [05/10/2022-20:07:05] [V] [TRT] Constant_657 [Constant] inputs: [05/10/2022-20:07:05] [V] [TRT] Constant_657 [Constant] outputs: [1394 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_658 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1393 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1394 [05/10/2022-20:07:05] [V] [TRT] Add_658 [Add] inputs: [1393 -> (-1, -1, 1)[FLOAT]], [1394 -> ()[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: 1394 for ONNX node: 1394 [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_658 for ONNX node: Add_658 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1395 for ONNX tensor: 1395 [05/10/2022-20:07:05] [V] [TRT] Add_658 [Add] outputs: [1395 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Sqrt_659 [Sqrt] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1395 [05/10/2022-20:07:05] [V] [TRT] Sqrt_659 [Sqrt] inputs: [1395 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Sqrt_659 for ONNX node: Sqrt_659 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1396 for ONNX tensor: 1396 [05/10/2022-20:07:05] [V] [TRT] Sqrt_659 [Sqrt] outputs: [1396 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Div_660 [Div] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1390 [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1396 [05/10/2022-20:07:05] [V] [TRT] Div_660 [Div] inputs: [1390 -> (-1, -1, 256)[FLOAT]], [1396 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Div_660 for ONNX node: Div_660 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1397 for ONNX tensor: 1397 [05/10/2022-20:07:05] [V] [TRT] Div_660 [Div] outputs: [1397 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Mul_661 [Mul] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1397 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.norm_conv.weight [05/10/2022-20:07:05] [V] [TRT] Mul_661 [Mul] inputs: [1397 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.norm_conv.weight for ONNX node: encoder.encoders.3.norm_conv.weight [05/10/2022-20:07:05] [V] [TRT] Registering layer: Mul_661 for ONNX node: Mul_661 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1398 for ONNX tensor: 1398 [05/10/2022-20:07:05] [V] [TRT] Mul_661 [Mul] outputs: [1398 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Add_662 [Add] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1398 [05/10/2022-20:07:05] [V] [TRT] Searching for input: encoder.encoders.3.norm_conv.bias [05/10/2022-20:07:05] [V] [TRT] Add_662 [Add] inputs: [1398 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: encoder.encoders.3.norm_conv.bias for ONNX node: encoder.encoders.3.norm_conv.bias [05/10/2022-20:07:05] [V] [TRT] Registering layer: Add_662 for ONNX node: Add_662 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1399 for ONNX tensor: 1399 [05/10/2022-20:07:05] [V] [TRT] Add_662 [Add] outputs: [1399 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Transpose_663 [Transpose] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1399 [05/10/2022-20:07:05] [V] [TRT] Transpose_663 [Transpose] inputs: [1399 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Transpose_663 for ONNX node: Transpose_663 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1400 for ONNX tensor: 1400 [05/10/2022-20:07:05] [V] [TRT] Transpose_663 [Transpose] outputs: [1400 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Not_664 [Not] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:05] [V] [TRT] Not_664 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Registering layer: Not_664 for ONNX node: Not_664 [05/10/2022-20:07:05] [V] [TRT] Registering tensor: 1401 for ONNX tensor: 1401 [05/10/2022-20:07:05] [V] [TRT] Not_664 [Not] outputs: [1401 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Parsing node: Cast_665 [Cast] [05/10/2022-20:07:05] [V] [TRT] Searching for input: 1401 [05/10/2022-20:07:05] [V] [TRT] Cast_665 [Cast] inputs: [1401 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:05] [V] [TRT] Casting to type: bool [05/10/2022-20:07:06] [V] [TRT] Registering layer: Cast_665 for ONNX node: Cast_665 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1402 for ONNX tensor: 1402 [05/10/2022-20:07:06] [V] [TRT] Cast_665 [Cast] outputs: [1402 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_666 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_666 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_666 [Constant] outputs: [1403 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Where_667 [Where] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1402 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1403 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1400 [05/10/2022-20:07:06] [V] [TRT] Where_667 [Where] inputs: [1402 -> (-1, 1, -1)[BOOL]], [1403 -> ()[FLOAT]], [1400 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1403 for ONNX node: 1403 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Where_667 for ONNX node: Where_667 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1404 for ONNX tensor: 1404 [05/10/2022-20:07:06] [V] [TRT] Where_667 [Where] outputs: [1404 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Conv_668 [Conv] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1404 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.conv_module.pointwise_conv1.weight [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.conv_module.pointwise_conv1.bias [05/10/2022-20:07:06] [V] [TRT] Conv_668 [Conv] inputs: [1404 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.3.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.3.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:06] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:06] [V] [TRT] Registering layer: Conv_668 for ONNX node: Conv_668 [05/10/2022-20:07:06] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:06] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:06] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1405 for ONNX tensor: 1405 [05/10/2022-20:07:06] [V] [TRT] Conv_668 [Conv] outputs: [1405 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Split_669 [Split] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1405 [05/10/2022-20:07:06] [V] [TRT] Split_669 [Split] inputs: [1405 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Split_669 for ONNX node: Split_669 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Split_669_5 for ONNX node: Split_669 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1406 for ONNX tensor: 1406 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1407 for ONNX tensor: 1407 [05/10/2022-20:07:06] [V] [TRT] Split_669 [Split] outputs: [1406 -> (-1, 256, -1)[FLOAT]], [1407 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sigmoid_670 [Sigmoid] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1407 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_670 [Sigmoid] inputs: [1407 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sigmoid_670 for ONNX node: Sigmoid_670 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1408 for ONNX tensor: 1408 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_670 [Sigmoid] outputs: [1408 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_671 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1406 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1408 [05/10/2022-20:07:06] [V] [TRT] Mul_671 [Mul] inputs: [1406 -> (-1, 256, -1)[FLOAT]], [1408 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_671 for ONNX node: Mul_671 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1409 for ONNX tensor: 1409 [05/10/2022-20:07:06] [V] [TRT] Mul_671 [Mul] outputs: [1409 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Conv_672 [Conv] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1409 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3170 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3171 [05/10/2022-20:07:06] [V] [TRT] Conv_672 [Conv] inputs: [1409 -> (-1, 256, -1)[FLOAT]], [3170 -> (256, 1, 15)[FLOAT]], [3171 -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:06] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:06] [V] [TRT] Registering layer: Conv_672 for ONNX node: Conv_672 [05/10/2022-20:07:06] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:06] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:06] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 3169 for ONNX tensor: 3169 [05/10/2022-20:07:06] [V] [TRT] Conv_672 [Conv] outputs: [3169 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sigmoid_673 [Sigmoid] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3169 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_673 [Sigmoid] inputs: [3169 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sigmoid_673 for ONNX node: Sigmoid_673 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1412 for ONNX tensor: 1412 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_673 [Sigmoid] outputs: [1412 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_674 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3169 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1412 [05/10/2022-20:07:06] [V] [TRT] Mul_674 [Mul] inputs: [3169 -> (-1, 256, -1)[FLOAT]], [1412 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_674 for ONNX node: Mul_674 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1413 for ONNX tensor: 1413 [05/10/2022-20:07:06] [V] [TRT] Mul_674 [Mul] outputs: [1413 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Not_675 [Not] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:06] [V] [TRT] Not_675 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Not_675 for ONNX node: Not_675 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1414 for ONNX tensor: 1414 [05/10/2022-20:07:06] [V] [TRT] Not_675 [Not] outputs: [1414 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Conv_676 [Conv] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1413 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.conv_module.pointwise_conv2.weight [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.conv_module.pointwise_conv2.bias [05/10/2022-20:07:06] [V] [TRT] Conv_676 [Conv] inputs: [1413 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.3.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.3.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:06] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:06] [V] [TRT] Registering layer: Conv_676 for ONNX node: Conv_676 [05/10/2022-20:07:06] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:06] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:06] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1415 for ONNX tensor: 1415 [05/10/2022-20:07:06] [V] [TRT] Conv_676 [Conv] outputs: [1415 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Cast_677 [Cast] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1414 [05/10/2022-20:07:06] [V] [TRT] Cast_677 [Cast] inputs: [1414 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:06] [V] [TRT] Casting to type: bool [05/10/2022-20:07:06] [V] [TRT] Registering layer: Cast_677 for ONNX node: Cast_677 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1416 for ONNX tensor: 1416 [05/10/2022-20:07:06] [V] [TRT] Cast_677 [Cast] outputs: [1416 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_678 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_678 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_678 [Constant] outputs: [1417 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Where_679 [Where] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1416 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1417 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1415 [05/10/2022-20:07:06] [V] [TRT] Where_679 [Where] inputs: [1416 -> (-1, 1, -1)[BOOL]], [1417 -> ()[FLOAT]], [1415 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1417 for ONNX node: 1417 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Where_679 for ONNX node: Where_679 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1418 for ONNX tensor: 1418 [05/10/2022-20:07:06] [V] [TRT] Where_679 [Where] outputs: [1418 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Transpose_680 [Transpose] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1418 [05/10/2022-20:07:06] [V] [TRT] Transpose_680 [Transpose] inputs: [1418 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Transpose_680 for ONNX node: Transpose_680 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1419 for ONNX tensor: 1419 [05/10/2022-20:07:06] [V] [TRT] Transpose_680 [Transpose] outputs: [1419 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_681 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1388 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1419 [05/10/2022-20:07:06] [V] [TRT] Add_681 [Add] inputs: [1388 -> (-1, -1, 256)[FLOAT]], [1419 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_681 for ONNX node: Add_681 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1420 for ONNX tensor: 1420 [05/10/2022-20:07:06] [V] [TRT] Add_681 [Add] outputs: [1420 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_682 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1420 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_682 [ReduceMean] inputs: [1420 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_682 for ONNX node: ReduceMean_682 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1421 for ONNX tensor: 1421 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_682 [ReduceMean] outputs: [1421 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sub_683 [Sub] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1420 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1421 [05/10/2022-20:07:06] [V] [TRT] Sub_683 [Sub] inputs: [1420 -> (-1, -1, 256)[FLOAT]], [1421 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sub_683 for ONNX node: Sub_683 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1422 for ONNX tensor: 1422 [05/10/2022-20:07:06] [V] [TRT] Sub_683 [Sub] outputs: [1422 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_684 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_684 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_684 [Constant] outputs: [1423 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Pow_685 [Pow] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1422 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1423 [05/10/2022-20:07:06] [V] [TRT] Pow_685 [Pow] inputs: [1422 -> (-1, -1, 256)[FLOAT]], [1423 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1423 for ONNX node: 1423 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Pow_685 for ONNX node: Pow_685 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1424 for ONNX tensor: 1424 [05/10/2022-20:07:06] [V] [TRT] Pow_685 [Pow] outputs: [1424 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_686 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1424 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_686 [ReduceMean] inputs: [1424 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_686 for ONNX node: ReduceMean_686 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1425 for ONNX tensor: 1425 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_686 [ReduceMean] outputs: [1425 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_687 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_687 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_687 [Constant] outputs: [1426 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_688 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1425 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1426 [05/10/2022-20:07:06] [V] [TRT] Add_688 [Add] inputs: [1425 -> (-1, -1, 1)[FLOAT]], [1426 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1426 for ONNX node: 1426 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_688 for ONNX node: Add_688 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1427 for ONNX tensor: 1427 [05/10/2022-20:07:06] [V] [TRT] Add_688 [Add] outputs: [1427 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sqrt_689 [Sqrt] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1427 [05/10/2022-20:07:06] [V] [TRT] Sqrt_689 [Sqrt] inputs: [1427 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sqrt_689 for ONNX node: Sqrt_689 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1428 for ONNX tensor: 1428 [05/10/2022-20:07:06] [V] [TRT] Sqrt_689 [Sqrt] outputs: [1428 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Div_690 [Div] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1422 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1428 [05/10/2022-20:07:06] [V] [TRT] Div_690 [Div] inputs: [1422 -> (-1, -1, 256)[FLOAT]], [1428 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Div_690 for ONNX node: Div_690 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1429 for ONNX tensor: 1429 [05/10/2022-20:07:06] [V] [TRT] Div_690 [Div] outputs: [1429 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_691 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1429 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.norm_ff.weight [05/10/2022-20:07:06] [V] [TRT] Mul_691 [Mul] inputs: [1429 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.3.norm_ff.weight for ONNX node: encoder.encoders.3.norm_ff.weight [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_691 for ONNX node: Mul_691 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1430 for ONNX tensor: 1430 [05/10/2022-20:07:06] [V] [TRT] Mul_691 [Mul] outputs: [1430 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_692 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1430 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.norm_ff.bias [05/10/2022-20:07:06] [V] [TRT] Add_692 [Add] inputs: [1430 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.3.norm_ff.bias for ONNX node: encoder.encoders.3.norm_ff.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_692 for ONNX node: Add_692 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1431 for ONNX tensor: 1431 [05/10/2022-20:07:06] [V] [TRT] Add_692 [Add] outputs: [1431 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: MatMul_693 [MatMul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1431 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3291 [05/10/2022-20:07:06] [V] [TRT] MatMul_693 [MatMul] inputs: [1431 -> (-1, -1, 256)[FLOAT]], [3291 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 3291 for ONNX node: 3291 [05/10/2022-20:07:06] [V] [TRT] Registering layer: MatMul_693 for ONNX node: MatMul_693 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1433 for ONNX tensor: 1433 [05/10/2022-20:07:06] [V] [TRT] MatMul_693 [MatMul] outputs: [1433 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_694 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.feed_forward.w_1.bias [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1433 [05/10/2022-20:07:06] [V] [TRT] Add_694 [Add] inputs: [encoder.encoders.3.feed_forward.w_1.bias -> (2048)[FLOAT]], [1433 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.3.feed_forward.w_1.bias for ONNX node: encoder.encoders.3.feed_forward.w_1.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_694 for ONNX node: Add_694 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1434 for ONNX tensor: 1434 [05/10/2022-20:07:06] [V] [TRT] Add_694 [Add] outputs: [1434 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sigmoid_695 [Sigmoid] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1434 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_695 [Sigmoid] inputs: [1434 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sigmoid_695 for ONNX node: Sigmoid_695 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1435 for ONNX tensor: 1435 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_695 [Sigmoid] outputs: [1435 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_696 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1434 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1435 [05/10/2022-20:07:06] [V] [TRT] Mul_696 [Mul] inputs: [1434 -> (-1, -1, 2048)[FLOAT]], [1435 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_696 for ONNX node: Mul_696 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1436 for ONNX tensor: 1436 [05/10/2022-20:07:06] [V] [TRT] Mul_696 [Mul] outputs: [1436 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: MatMul_697 [MatMul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1436 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3292 [05/10/2022-20:07:06] [V] [TRT] MatMul_697 [MatMul] inputs: [1436 -> (-1, -1, 2048)[FLOAT]], [3292 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 3292 for ONNX node: 3292 [05/10/2022-20:07:06] [V] [TRT] Registering layer: MatMul_697 for ONNX node: MatMul_697 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1438 for ONNX tensor: 1438 [05/10/2022-20:07:06] [V] [TRT] MatMul_697 [MatMul] outputs: [1438 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_698 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.feed_forward.w_2.bias [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1438 [05/10/2022-20:07:06] [V] [TRT] Add_698 [Add] inputs: [encoder.encoders.3.feed_forward.w_2.bias -> (256)[FLOAT]], [1438 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.3.feed_forward.w_2.bias for ONNX node: encoder.encoders.3.feed_forward.w_2.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_698 for ONNX node: Add_698 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1439 for ONNX tensor: 1439 [05/10/2022-20:07:06] [V] [TRT] Add_698 [Add] outputs: [1439 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_699 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_699 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_699 [Constant] outputs: [1440 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_700 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1439 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1440 [05/10/2022-20:07:06] [V] [TRT] Mul_700 [Mul] inputs: [1439 -> (-1, -1, 256)[FLOAT]], [1440 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1440 for ONNX node: 1440 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_700 for ONNX node: Mul_700 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1441 for ONNX tensor: 1441 [05/10/2022-20:07:06] [V] [TRT] Mul_700 [Mul] outputs: [1441 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_701 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1420 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1441 [05/10/2022-20:07:06] [V] [TRT] Add_701 [Add] inputs: [1420 -> (-1, -1, 256)[FLOAT]], [1441 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_701 for ONNX node: Add_701 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1442 for ONNX tensor: 1442 [05/10/2022-20:07:06] [V] [TRT] Add_701 [Add] outputs: [1442 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_702 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1442 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_702 [ReduceMean] inputs: [1442 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_702 for ONNX node: ReduceMean_702 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1443 for ONNX tensor: 1443 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_702 [ReduceMean] outputs: [1443 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sub_703 [Sub] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1442 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1443 [05/10/2022-20:07:06] [V] [TRT] Sub_703 [Sub] inputs: [1442 -> (-1, -1, 256)[FLOAT]], [1443 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sub_703 for ONNX node: Sub_703 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1444 for ONNX tensor: 1444 [05/10/2022-20:07:06] [V] [TRT] Sub_703 [Sub] outputs: [1444 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_704 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_704 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_704 [Constant] outputs: [1445 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Pow_705 [Pow] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1444 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1445 [05/10/2022-20:07:06] [V] [TRT] Pow_705 [Pow] inputs: [1444 -> (-1, -1, 256)[FLOAT]], [1445 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1445 for ONNX node: 1445 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Pow_705 for ONNX node: Pow_705 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1446 for ONNX tensor: 1446 [05/10/2022-20:07:06] [V] [TRT] Pow_705 [Pow] outputs: [1446 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_706 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1446 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_706 [ReduceMean] inputs: [1446 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_706 for ONNX node: ReduceMean_706 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1447 for ONNX tensor: 1447 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_706 [ReduceMean] outputs: [1447 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_707 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_707 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_707 [Constant] outputs: [1448 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_708 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1447 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1448 [05/10/2022-20:07:06] [V] [TRT] Add_708 [Add] inputs: [1447 -> (-1, -1, 1)[FLOAT]], [1448 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1448 for ONNX node: 1448 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_708 for ONNX node: Add_708 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1449 for ONNX tensor: 1449 [05/10/2022-20:07:06] [V] [TRT] Add_708 [Add] outputs: [1449 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sqrt_709 [Sqrt] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1449 [05/10/2022-20:07:06] [V] [TRT] Sqrt_709 [Sqrt] inputs: [1449 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sqrt_709 for ONNX node: Sqrt_709 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1450 for ONNX tensor: 1450 [05/10/2022-20:07:06] [V] [TRT] Sqrt_709 [Sqrt] outputs: [1450 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Div_710 [Div] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1444 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1450 [05/10/2022-20:07:06] [V] [TRT] Div_710 [Div] inputs: [1444 -> (-1, -1, 256)[FLOAT]], [1450 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Div_710 for ONNX node: Div_710 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1451 for ONNX tensor: 1451 [05/10/2022-20:07:06] [V] [TRT] Div_710 [Div] outputs: [1451 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_711 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1451 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.norm_final.weight [05/10/2022-20:07:06] [V] [TRT] Mul_711 [Mul] inputs: [1451 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.3.norm_final.weight for ONNX node: encoder.encoders.3.norm_final.weight [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_711 for ONNX node: Mul_711 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1452 for ONNX tensor: 1452 [05/10/2022-20:07:06] [V] [TRT] Mul_711 [Mul] outputs: [1452 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_712 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1452 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.3.norm_final.bias [05/10/2022-20:07:06] [V] [TRT] Add_712 [Add] inputs: [1452 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.3.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.3.norm_final.bias for ONNX node: encoder.encoders.3.norm_final.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_712 for ONNX node: Add_712 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1453 for ONNX tensor: 1453 [05/10/2022-20:07:06] [V] [TRT] Add_712 [Add] outputs: [1453 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_713 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1453 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_713 [ReduceMean] inputs: [1453 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_713 for ONNX node: ReduceMean_713 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1454 for ONNX tensor: 1454 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_713 [ReduceMean] outputs: [1454 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sub_714 [Sub] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1453 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1454 [05/10/2022-20:07:06] [V] [TRT] Sub_714 [Sub] inputs: [1453 -> (-1, -1, 256)[FLOAT]], [1454 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sub_714 for ONNX node: Sub_714 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1455 for ONNX tensor: 1455 [05/10/2022-20:07:06] [V] [TRT] Sub_714 [Sub] outputs: [1455 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_715 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_715 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_715 [Constant] outputs: [1456 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Pow_716 [Pow] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1455 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1456 [05/10/2022-20:07:06] [V] [TRT] Pow_716 [Pow] inputs: [1455 -> (-1, -1, 256)[FLOAT]], [1456 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1456 for ONNX node: 1456 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Pow_716 for ONNX node: Pow_716 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1457 for ONNX tensor: 1457 [05/10/2022-20:07:06] [V] [TRT] Pow_716 [Pow] outputs: [1457 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_717 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1457 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_717 [ReduceMean] inputs: [1457 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_717 for ONNX node: ReduceMean_717 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1458 for ONNX tensor: 1458 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_717 [ReduceMean] outputs: [1458 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_718 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_718 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_718 [Constant] outputs: [1459 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_719 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1458 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1459 [05/10/2022-20:07:06] [V] [TRT] Add_719 [Add] inputs: [1458 -> (-1, -1, 1)[FLOAT]], [1459 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1459 for ONNX node: 1459 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_719 for ONNX node: Add_719 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1460 for ONNX tensor: 1460 [05/10/2022-20:07:06] [V] [TRT] Add_719 [Add] outputs: [1460 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sqrt_720 [Sqrt] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1460 [05/10/2022-20:07:06] [V] [TRT] Sqrt_720 [Sqrt] inputs: [1460 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sqrt_720 for ONNX node: Sqrt_720 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1461 for ONNX tensor: 1461 [05/10/2022-20:07:06] [V] [TRT] Sqrt_720 [Sqrt] outputs: [1461 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Div_721 [Div] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1455 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1461 [05/10/2022-20:07:06] [V] [TRT] Div_721 [Div] inputs: [1455 -> (-1, -1, 256)[FLOAT]], [1461 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Div_721 for ONNX node: Div_721 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1462 for ONNX tensor: 1462 [05/10/2022-20:07:06] [V] [TRT] Div_721 [Div] outputs: [1462 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_722 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1462 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.4.norm_ff_macaron.weight [05/10/2022-20:07:06] [V] [TRT] Mul_722 [Mul] inputs: [1462 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.4.norm_ff_macaron.weight for ONNX node: encoder.encoders.4.norm_ff_macaron.weight [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_722 for ONNX node: Mul_722 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1463 for ONNX tensor: 1463 [05/10/2022-20:07:06] [V] [TRT] Mul_722 [Mul] outputs: [1463 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_723 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1463 [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.4.norm_ff_macaron.bias [05/10/2022-20:07:06] [V] [TRT] Add_723 [Add] inputs: [1463 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.4.norm_ff_macaron.bias for ONNX node: encoder.encoders.4.norm_ff_macaron.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_723 for ONNX node: Add_723 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1464 for ONNX tensor: 1464 [05/10/2022-20:07:06] [V] [TRT] Add_723 [Add] outputs: [1464 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: MatMul_724 [MatMul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1464 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3293 [05/10/2022-20:07:06] [V] [TRT] MatMul_724 [MatMul] inputs: [1464 -> (-1, -1, 256)[FLOAT]], [3293 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 3293 for ONNX node: 3293 [05/10/2022-20:07:06] [V] [TRT] Registering layer: MatMul_724 for ONNX node: MatMul_724 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1466 for ONNX tensor: 1466 [05/10/2022-20:07:06] [V] [TRT] MatMul_724 [MatMul] outputs: [1466 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_725 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.4.feed_forward_macaron.w_1.bias [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1466 [05/10/2022-20:07:06] [V] [TRT] Add_725 [Add] inputs: [encoder.encoders.4.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [1466 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.4.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.4.feed_forward_macaron.w_1.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_725 for ONNX node: Add_725 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1467 for ONNX tensor: 1467 [05/10/2022-20:07:06] [V] [TRT] Add_725 [Add] outputs: [1467 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sigmoid_726 [Sigmoid] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1467 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_726 [Sigmoid] inputs: [1467 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sigmoid_726 for ONNX node: Sigmoid_726 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1468 for ONNX tensor: 1468 [05/10/2022-20:07:06] [V] [TRT] Sigmoid_726 [Sigmoid] outputs: [1468 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_727 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1467 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1468 [05/10/2022-20:07:06] [V] [TRT] Mul_727 [Mul] inputs: [1467 -> (-1, -1, 2048)[FLOAT]], [1468 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_727 for ONNX node: Mul_727 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1469 for ONNX tensor: 1469 [05/10/2022-20:07:06] [V] [TRT] Mul_727 [Mul] outputs: [1469 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: MatMul_728 [MatMul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1469 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 3294 [05/10/2022-20:07:06] [V] [TRT] MatMul_728 [MatMul] inputs: [1469 -> (-1, -1, 2048)[FLOAT]], [3294 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 3294 for ONNX node: 3294 [05/10/2022-20:07:06] [V] [TRT] Registering layer: MatMul_728 for ONNX node: MatMul_728 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1471 for ONNX tensor: 1471 [05/10/2022-20:07:06] [V] [TRT] MatMul_728 [MatMul] outputs: [1471 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_729 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: encoder.encoders.4.feed_forward_macaron.w_2.bias [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1471 [05/10/2022-20:07:06] [V] [TRT] Add_729 [Add] inputs: [encoder.encoders.4.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [1471 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: encoder.encoders.4.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.4.feed_forward_macaron.w_2.bias [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_729 for ONNX node: Add_729 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1472 for ONNX tensor: 1472 [05/10/2022-20:07:06] [V] [TRT] Add_729 [Add] outputs: [1472 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_730 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_730 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_730 [Constant] outputs: [1473 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Mul_731 [Mul] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1472 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1473 [05/10/2022-20:07:06] [V] [TRT] Mul_731 [Mul] inputs: [1472 -> (-1, -1, 256)[FLOAT]], [1473 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1473 for ONNX node: 1473 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Mul_731 for ONNX node: Mul_731 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1474 for ONNX tensor: 1474 [05/10/2022-20:07:06] [V] [TRT] Mul_731 [Mul] outputs: [1474 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Add_732 [Add] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1453 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1474 [05/10/2022-20:07:06] [V] [TRT] Add_732 [Add] inputs: [1453 -> (-1, -1, 256)[FLOAT]], [1474 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Add_732 for ONNX node: Add_732 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1475 for ONNX tensor: 1475 [05/10/2022-20:07:06] [V] [TRT] Add_732 [Add] outputs: [1475 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_733 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1475 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_733 [ReduceMean] inputs: [1475 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_733 for ONNX node: ReduceMean_733 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1476 for ONNX tensor: 1476 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_733 [ReduceMean] outputs: [1476 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Sub_734 [Sub] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1475 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1476 [05/10/2022-20:07:06] [V] [TRT] Sub_734 [Sub] inputs: [1475 -> (-1, -1, 256)[FLOAT]], [1476 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: Sub_734 for ONNX node: Sub_734 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1477 for ONNX tensor: 1477 [05/10/2022-20:07:06] [V] [TRT] Sub_734 [Sub] outputs: [1477 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Constant_735 [Constant] [05/10/2022-20:07:06] [V] [TRT] Constant_735 [Constant] inputs: [05/10/2022-20:07:06] [V] [TRT] Constant_735 [Constant] outputs: [1478 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: Pow_736 [Pow] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1477 [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1478 [05/10/2022-20:07:06] [V] [TRT] Pow_736 [Pow] inputs: [1477 -> (-1, -1, 256)[FLOAT]], [1478 -> ()[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: 1478 for ONNX node: 1478 [05/10/2022-20:07:06] [V] [TRT] Registering layer: Pow_736 for ONNX node: Pow_736 [05/10/2022-20:07:06] [V] [TRT] Registering tensor: 1479 for ONNX tensor: 1479 [05/10/2022-20:07:06] [V] [TRT] Pow_736 [Pow] outputs: [1479 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Parsing node: ReduceMean_737 [ReduceMean] [05/10/2022-20:07:06] [V] [TRT] Searching for input: 1479 [05/10/2022-20:07:06] [V] [TRT] ReduceMean_737 [ReduceMean] inputs: [1479 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:06] [V] [TRT] Registering layer: ReduceMean_737 for ONNX node: ReduceMean_737 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1480 for ONNX tensor: 1480 [05/10/2022-20:07:07] [V] [TRT] ReduceMean_737 [ReduceMean] outputs: [1480 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_738 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_738 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_738 [Constant] outputs: [1481 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_739 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1480 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1481 [05/10/2022-20:07:07] [V] [TRT] Add_739 [Add] inputs: [1480 -> (-1, -1, 1)[FLOAT]], [1481 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1481 for ONNX node: 1481 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_739 for ONNX node: Add_739 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1482 for ONNX tensor: 1482 [05/10/2022-20:07:07] [V] [TRT] Add_739 [Add] outputs: [1482 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Sqrt_740 [Sqrt] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1482 [05/10/2022-20:07:07] [V] [TRT] Sqrt_740 [Sqrt] inputs: [1482 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Sqrt_740 for ONNX node: Sqrt_740 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1483 for ONNX tensor: 1483 [05/10/2022-20:07:07] [V] [TRT] Sqrt_740 [Sqrt] outputs: [1483 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Div_741 [Div] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1477 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1483 [05/10/2022-20:07:07] [V] [TRT] Div_741 [Div] inputs: [1477 -> (-1, -1, 256)[FLOAT]], [1483 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Div_741 for ONNX node: Div_741 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1484 for ONNX tensor: 1484 [05/10/2022-20:07:07] [V] [TRT] Div_741 [Div] outputs: [1484 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Mul_742 [Mul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1484 [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.norm_mha.weight [05/10/2022-20:07:07] [V] [TRT] Mul_742 [Mul] inputs: [1484 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.norm_mha.weight for ONNX node: encoder.encoders.4.norm_mha.weight [05/10/2022-20:07:07] [V] [TRT] Registering layer: Mul_742 for ONNX node: Mul_742 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1485 for ONNX tensor: 1485 [05/10/2022-20:07:07] [V] [TRT] Mul_742 [Mul] outputs: [1485 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_743 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1485 [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.norm_mha.bias [05/10/2022-20:07:07] [V] [TRT] Add_743 [Add] inputs: [1485 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.norm_mha.bias for ONNX node: encoder.encoders.4.norm_mha.bias [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_743 for ONNX node: Add_743 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1486 for ONNX tensor: 1486 [05/10/2022-20:07:07] [V] [TRT] Add_743 [Add] outputs: [1486 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Shape_744 [Shape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1486 [05/10/2022-20:07:07] [V] [TRT] Shape_744 [Shape] inputs: [1486 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Shape_744 for ONNX node: Shape_744 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1487 for ONNX tensor: 1487 [05/10/2022-20:07:07] [V] [TRT] Shape_744 [Shape] outputs: [1487 -> (3)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_745 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_745 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_745 [Constant] outputs: [1488 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Gather_746 [Gather] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1487 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1488 [05/10/2022-20:07:07] [V] [TRT] Gather_746 [Gather] inputs: [1487 -> (3)[INT32]], [1488 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1488 for ONNX node: 1488 [05/10/2022-20:07:07] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Gather_746 for ONNX node: Gather_746 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1489 for ONNX tensor: 1489 [05/10/2022-20:07:07] [V] [TRT] Gather_746 [Gather] outputs: [1489 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_747 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1486 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3295 [05/10/2022-20:07:07] [V] [TRT] MatMul_747 [MatMul] inputs: [1486 -> (-1, -1, 256)[FLOAT]], [3295 -> (256, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3295 for ONNX node: 3295 [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_747 for ONNX node: MatMul_747 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1491 for ONNX tensor: 1491 [05/10/2022-20:07:07] [V] [TRT] MatMul_747 [MatMul] outputs: [1491 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_748 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.self_attn.linear_q.bias [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1491 [05/10/2022-20:07:07] [V] [TRT] Add_748 [Add] inputs: [encoder.encoders.4.self_attn.linear_q.bias -> (256)[FLOAT]], [1491 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.self_attn.linear_q.bias for ONNX node: encoder.encoders.4.self_attn.linear_q.bias [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_748 for ONNX node: Add_748 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1492 for ONNX tensor: 1492 [05/10/2022-20:07:07] [V] [TRT] Add_748 [Add] outputs: [1492 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_749 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_749 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_749 [Constant] outputs: [1496 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Unsqueeze_750 [Unsqueeze] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1489 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1496 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_750 [Unsqueeze] inputs: [1489 -> ()[INT32]], [1496 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:07] [V] [TRT] Registering layer: Unsqueeze_750 for ONNX node: Unsqueeze_750 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1497 for ONNX tensor: 1497 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_750 [Unsqueeze] outputs: [1497 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Concat_751 [Concat] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1497 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3296 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3297 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3298 [05/10/2022-20:07:07] [V] [TRT] Concat_751 [Concat] inputs: [1497 -> (1)[INT32]], [3296 -> (1)[INT32]], [3297 -> (1)[INT32]], [3298 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3296 for ONNX node: 3296 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3297 for ONNX node: 3297 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3298 for ONNX node: 3298 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Concat_751 for ONNX node: Concat_751 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1504 for ONNX tensor: 1504 [05/10/2022-20:07:07] [V] [TRT] Concat_751 [Concat] outputs: [1504 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Reshape_752 [Reshape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1492 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1504 [05/10/2022-20:07:07] [V] [TRT] Reshape_752 [Reshape] inputs: [1492 -> (-1, -1, 256)[FLOAT]], [1504 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Reshape_752 for ONNX node: Reshape_752 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1505 for ONNX tensor: 1505 [05/10/2022-20:07:07] [V] [TRT] Reshape_752 [Reshape] outputs: [1505 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_753 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1486 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3299 [05/10/2022-20:07:07] [V] [TRT] MatMul_753 [MatMul] inputs: [1486 -> (-1, -1, 256)[FLOAT]], [3299 -> (256, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3299 for ONNX node: 3299 [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_753 for ONNX node: MatMul_753 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1507 for ONNX tensor: 1507 [05/10/2022-20:07:07] [V] [TRT] MatMul_753 [MatMul] outputs: [1507 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_754 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.self_attn.linear_k.bias [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1507 [05/10/2022-20:07:07] [V] [TRT] Add_754 [Add] inputs: [encoder.encoders.4.self_attn.linear_k.bias -> (256)[FLOAT]], [1507 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.self_attn.linear_k.bias for ONNX node: encoder.encoders.4.self_attn.linear_k.bias [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_754 for ONNX node: Add_754 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1508 for ONNX tensor: 1508 [05/10/2022-20:07:07] [V] [TRT] Add_754 [Add] outputs: [1508 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_755 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_755 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_755 [Constant] outputs: [1512 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Unsqueeze_756 [Unsqueeze] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1489 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1512 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_756 [Unsqueeze] inputs: [1489 -> ()[INT32]], [1512 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:07] [V] [TRT] Registering layer: Unsqueeze_756 for ONNX node: Unsqueeze_756 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1513 for ONNX tensor: 1513 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_756 [Unsqueeze] outputs: [1513 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Concat_757 [Concat] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1513 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3300 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3301 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3302 [05/10/2022-20:07:07] [V] [TRT] Concat_757 [Concat] inputs: [1513 -> (1)[INT32]], [3300 -> (1)[INT32]], [3301 -> (1)[INT32]], [3302 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3300 for ONNX node: 3300 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3301 for ONNX node: 3301 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3302 for ONNX node: 3302 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Concat_757 for ONNX node: Concat_757 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1520 for ONNX tensor: 1520 [05/10/2022-20:07:07] [V] [TRT] Concat_757 [Concat] outputs: [1520 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Reshape_758 [Reshape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1508 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1520 [05/10/2022-20:07:07] [V] [TRT] Reshape_758 [Reshape] inputs: [1508 -> (-1, -1, 256)[FLOAT]], [1520 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Reshape_758 for ONNX node: Reshape_758 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1521 for ONNX tensor: 1521 [05/10/2022-20:07:07] [V] [TRT] Reshape_758 [Reshape] outputs: [1521 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_759 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1486 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3303 [05/10/2022-20:07:07] [V] [TRT] MatMul_759 [MatMul] inputs: [1486 -> (-1, -1, 256)[FLOAT]], [3303 -> (256, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3303 for ONNX node: 3303 [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_759 for ONNX node: MatMul_759 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1523 for ONNX tensor: 1523 [05/10/2022-20:07:07] [V] [TRT] MatMul_759 [MatMul] outputs: [1523 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_760 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.self_attn.linear_v.bias [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1523 [05/10/2022-20:07:07] [V] [TRT] Add_760 [Add] inputs: [encoder.encoders.4.self_attn.linear_v.bias -> (256)[FLOAT]], [1523 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.self_attn.linear_v.bias for ONNX node: encoder.encoders.4.self_attn.linear_v.bias [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_760 for ONNX node: Add_760 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1524 for ONNX tensor: 1524 [05/10/2022-20:07:07] [V] [TRT] Add_760 [Add] outputs: [1524 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_761 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_761 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_761 [Constant] outputs: [1528 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Unsqueeze_762 [Unsqueeze] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1489 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1528 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_762 [Unsqueeze] inputs: [1489 -> ()[INT32]], [1528 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:07] [V] [TRT] Registering layer: Unsqueeze_762 for ONNX node: Unsqueeze_762 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1529 for ONNX tensor: 1529 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_762 [Unsqueeze] outputs: [1529 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Concat_763 [Concat] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1529 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3304 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3305 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3306 [05/10/2022-20:07:07] [V] [TRT] Concat_763 [Concat] inputs: [1529 -> (1)[INT32]], [3304 -> (1)[INT32]], [3305 -> (1)[INT32]], [3306 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3304 for ONNX node: 3304 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3305 for ONNX node: 3305 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3306 for ONNX node: 3306 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Concat_763 for ONNX node: Concat_763 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1536 for ONNX tensor: 1536 [05/10/2022-20:07:07] [V] [TRT] Concat_763 [Concat] outputs: [1536 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Reshape_764 [Reshape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1524 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1536 [05/10/2022-20:07:07] [V] [TRT] Reshape_764 [Reshape] inputs: [1524 -> (-1, -1, 256)[FLOAT]], [1536 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Reshape_764 for ONNX node: Reshape_764 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1537 for ONNX tensor: 1537 [05/10/2022-20:07:07] [V] [TRT] Reshape_764 [Reshape] outputs: [1537 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Transpose_765 [Transpose] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1537 [05/10/2022-20:07:07] [V] [TRT] Transpose_765 [Transpose] inputs: [1537 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Transpose_765 for ONNX node: Transpose_765 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1538 for ONNX tensor: 1538 [05/10/2022-20:07:07] [V] [TRT] Transpose_765 [Transpose] outputs: [1538 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Shape_766 [Shape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:07] [V] [TRT] Shape_766 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Shape_766 for ONNX node: Shape_766 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1539 for ONNX tensor: 1539 [05/10/2022-20:07:07] [V] [TRT] Shape_766 [Shape] outputs: [1539 -> (3)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_767 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_767 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_767 [Constant] outputs: [1540 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Gather_768 [Gather] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1539 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1540 [05/10/2022-20:07:07] [V] [TRT] Gather_768 [Gather] inputs: [1539 -> (3)[INT32]], [1540 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1540 for ONNX node: 1540 [05/10/2022-20:07:07] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Gather_768 for ONNX node: Gather_768 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1541 for ONNX tensor: 1541 [05/10/2022-20:07:07] [V] [TRT] Gather_768 [Gather] outputs: [1541 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_769 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3307 [05/10/2022-20:07:07] [V] [TRT] MatMul_769 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3307 -> (256, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3307 for ONNX node: 3307 [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_769 for ONNX node: MatMul_769 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1543 for ONNX tensor: 1543 [05/10/2022-20:07:07] [V] [TRT] MatMul_769 [MatMul] outputs: [1543 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_770 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_770 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_770 [Constant] outputs: [1547 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Unsqueeze_771 [Unsqueeze] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1541 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1547 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_771 [Unsqueeze] inputs: [1541 -> ()[INT32]], [1547 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:07] [V] [TRT] Registering layer: Unsqueeze_771 for ONNX node: Unsqueeze_771 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1548 for ONNX tensor: 1548 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_771 [Unsqueeze] outputs: [1548 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Concat_772 [Concat] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1548 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3308 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3309 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3310 [05/10/2022-20:07:07] [V] [TRT] Concat_772 [Concat] inputs: [1548 -> (1)[INT32]], [3308 -> (1)[INT32]], [3309 -> (1)[INT32]], [3310 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3308 for ONNX node: 3308 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3309 for ONNX node: 3309 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3310 for ONNX node: 3310 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Concat_772 for ONNX node: Concat_772 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1555 for ONNX tensor: 1555 [05/10/2022-20:07:07] [V] [TRT] Concat_772 [Concat] outputs: [1555 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Reshape_773 [Reshape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1543 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1555 [05/10/2022-20:07:07] [V] [TRT] Reshape_773 [Reshape] inputs: [1543 -> (1, -1, 256)[FLOAT]], [1555 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Reshape_773 for ONNX node: Reshape_773 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1556 for ONNX tensor: 1556 [05/10/2022-20:07:07] [V] [TRT] Reshape_773 [Reshape] outputs: [1556 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_774 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1505 [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.self_attn.pos_bias_u [05/10/2022-20:07:07] [V] [TRT] Add_774 [Add] inputs: [1505 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.4.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.self_attn.pos_bias_u for ONNX node: encoder.encoders.4.self_attn.pos_bias_u [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_774 for ONNX node: Add_774 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1557 for ONNX tensor: 1557 [05/10/2022-20:07:07] [V] [TRT] Add_774 [Add] outputs: [1557 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Transpose_775 [Transpose] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1557 [05/10/2022-20:07:07] [V] [TRT] Transpose_775 [Transpose] inputs: [1557 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Transpose_775 for ONNX node: Transpose_775 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1558 for ONNX tensor: 1558 [05/10/2022-20:07:07] [V] [TRT] Transpose_775 [Transpose] outputs: [1558 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_776 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1505 [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.self_attn.pos_bias_v [05/10/2022-20:07:07] [V] [TRT] Add_776 [Add] inputs: [1505 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.4.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.self_attn.pos_bias_v for ONNX node: encoder.encoders.4.self_attn.pos_bias_v [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_776 for ONNX node: Add_776 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1559 for ONNX tensor: 1559 [05/10/2022-20:07:07] [V] [TRT] Add_776 [Add] outputs: [1559 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Transpose_777 [Transpose] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1559 [05/10/2022-20:07:07] [V] [TRT] Transpose_777 [Transpose] inputs: [1559 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Transpose_777 for ONNX node: Transpose_777 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1560 for ONNX tensor: 1560 [05/10/2022-20:07:07] [V] [TRT] Transpose_777 [Transpose] outputs: [1560 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Transpose_778 [Transpose] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1521 [05/10/2022-20:07:07] [V] [TRT] Transpose_778 [Transpose] inputs: [1521 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Transpose_778 for ONNX node: Transpose_778 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1561 for ONNX tensor: 1561 [05/10/2022-20:07:07] [V] [TRT] Transpose_778 [Transpose] outputs: [1561 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_779 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1558 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1561 [05/10/2022-20:07:07] [V] [TRT] MatMul_779 [MatMul] inputs: [1558 -> (-1, 4, -1, 64)[FLOAT]], [1561 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_779 for ONNX node: MatMul_779 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1562 for ONNX tensor: 1562 [05/10/2022-20:07:07] [V] [TRT] MatMul_779 [MatMul] outputs: [1562 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Transpose_780 [Transpose] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1556 [05/10/2022-20:07:07] [V] [TRT] Transpose_780 [Transpose] inputs: [1556 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Transpose_780 for ONNX node: Transpose_780 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1563 for ONNX tensor: 1563 [05/10/2022-20:07:07] [V] [TRT] Transpose_780 [Transpose] outputs: [1563 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_781 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1560 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1563 [05/10/2022-20:07:07] [V] [TRT] MatMul_781 [MatMul] inputs: [1560 -> (-1, 4, -1, 64)[FLOAT]], [1563 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_781 for ONNX node: MatMul_781 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1564 for ONNX tensor: 1564 [05/10/2022-20:07:07] [V] [TRT] MatMul_781 [MatMul] outputs: [1564 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_782 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1562 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1564 [05/10/2022-20:07:07] [V] [TRT] Add_782 [Add] inputs: [1562 -> (-1, 4, -1, -1)[FLOAT]], [1564 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_782 for ONNX node: Add_782 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1565 for ONNX tensor: 1565 [05/10/2022-20:07:07] [V] [TRT] Add_782 [Add] outputs: [1565 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_783 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_783 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_783 [Constant] outputs: [1566 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Div_784 [Div] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1565 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1566 [05/10/2022-20:07:07] [V] [TRT] Div_784 [Div] inputs: [1565 -> (-1, 4, -1, -1)[FLOAT]], [1566 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1566 for ONNX node: 1566 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Div_784 for ONNX node: Div_784 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1567 for ONNX tensor: 1567 [05/10/2022-20:07:07] [V] [TRT] Div_784 [Div] outputs: [1567 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Shape_785 [Shape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1538 [05/10/2022-20:07:07] [V] [TRT] Shape_785 [Shape] inputs: [1538 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Shape_785 for ONNX node: Shape_785 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1568 for ONNX tensor: 1568 [05/10/2022-20:07:07] [V] [TRT] Shape_785 [Shape] outputs: [1568 -> (4)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_786 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_786 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_786 [Constant] outputs: [1569 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Gather_787 [Gather] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1568 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1569 [05/10/2022-20:07:07] [V] [TRT] Gather_787 [Gather] inputs: [1568 -> (4)[INT32]], [1569 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1569 for ONNX node: 1569 [05/10/2022-20:07:07] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Gather_787 for ONNX node: Gather_787 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1570 for ONNX tensor: 1570 [05/10/2022-20:07:07] [V] [TRT] Gather_787 [Gather] outputs: [1570 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_788 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_788 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_788 [Constant] outputs: [1571 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Unsqueeze_789 [Unsqueeze] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1571 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_789 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [1571 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:07] [V] [TRT] Registering layer: Unsqueeze_789 for ONNX node: Unsqueeze_789 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1572 for ONNX tensor: 1572 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_789 [Unsqueeze] outputs: [1572 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Cast_790 [Cast] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1572 [05/10/2022-20:07:07] [V] [TRT] Cast_790 [Cast] inputs: [1572 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Cast_790 for ONNX node: Cast_790 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1573 for ONNX tensor: 1573 [05/10/2022-20:07:07] [V] [TRT] Cast_790 [Cast] outputs: [1573 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_791 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_791 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_791 [Constant] outputs: [1574 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Equal_792 [Equal] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1573 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1574 [05/10/2022-20:07:07] [V] [TRT] Equal_792 [Equal] inputs: [1573 -> (-1, 1, 1, -1)[INT32]], [1574 -> ()[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1574 for ONNX node: 1574 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Equal_792 for ONNX node: Equal_792 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1575 for ONNX tensor: 1575 [05/10/2022-20:07:07] [V] [TRT] Equal_792 [Equal] outputs: [1575 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Cast_793 [Cast] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1575 [05/10/2022-20:07:07] [V] [TRT] Cast_793 [Cast] inputs: [1575 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Casting to type: bool [05/10/2022-20:07:07] [V] [TRT] Registering layer: Cast_793 for ONNX node: Cast_793 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1576 for ONNX tensor: 1576 [05/10/2022-20:07:07] [V] [TRT] Cast_793 [Cast] outputs: [1576 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_794 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_794 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_794 [Constant] outputs: [1577 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Where_795 [Where] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1576 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1577 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1567 [05/10/2022-20:07:07] [V] [TRT] Where_795 [Where] inputs: [1576 -> (-1, 1, 1, -1)[BOOL]], [1577 -> ()[FLOAT]], [1567 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1577 for ONNX node: 1577 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Where_795 for ONNX node: Where_795 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1578 for ONNX tensor: 1578 [05/10/2022-20:07:07] [V] [TRT] Where_795 [Where] outputs: [1578 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Softmax_796 [Softmax] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1578 [05/10/2022-20:07:07] [V] [TRT] Softmax_796 [Softmax] inputs: [1578 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Softmax_796 for ONNX node: Softmax_796 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1579 for ONNX tensor: 1579 [05/10/2022-20:07:07] [V] [TRT] Softmax_796 [Softmax] outputs: [1579 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Cast_797 [Cast] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1575 [05/10/2022-20:07:07] [V] [TRT] Cast_797 [Cast] inputs: [1575 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Casting to type: bool [05/10/2022-20:07:07] [V] [TRT] Registering layer: Cast_797 for ONNX node: Cast_797 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1580 for ONNX tensor: 1580 [05/10/2022-20:07:07] [V] [TRT] Cast_797 [Cast] outputs: [1580 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_798 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_798 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_798 [Constant] outputs: [1581 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Where_799 [Where] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1580 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1581 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1579 [05/10/2022-20:07:07] [V] [TRT] Where_799 [Where] inputs: [1580 -> (-1, 1, 1, -1)[BOOL]], [1581 -> ()[FLOAT]], [1579 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1581 for ONNX node: 1581 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Where_799 for ONNX node: Where_799 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1582 for ONNX tensor: 1582 [05/10/2022-20:07:07] [V] [TRT] Where_799 [Where] outputs: [1582 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_800 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1582 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1538 [05/10/2022-20:07:07] [V] [TRT] MatMul_800 [MatMul] inputs: [1582 -> (-1, 4, -1, -1)[FLOAT]], [1538 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_800 for ONNX node: MatMul_800 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1583 for ONNX tensor: 1583 [05/10/2022-20:07:07] [V] [TRT] MatMul_800 [MatMul] outputs: [1583 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Transpose_801 [Transpose] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1583 [05/10/2022-20:07:07] [V] [TRT] Transpose_801 [Transpose] inputs: [1583 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Transpose_801 for ONNX node: Transpose_801 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1584 for ONNX tensor: 1584 [05/10/2022-20:07:07] [V] [TRT] Transpose_801 [Transpose] outputs: [1584 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_802 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_802 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_802 [Constant] outputs: [1587 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Unsqueeze_803 [Unsqueeze] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1570 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1587 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_803 [Unsqueeze] inputs: [1570 -> ()[INT32]], [1587 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:07] [V] [TRT] Registering layer: Unsqueeze_803 for ONNX node: Unsqueeze_803 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1588 for ONNX tensor: 1588 [05/10/2022-20:07:07] [V] [TRT] Unsqueeze_803 [Unsqueeze] outputs: [1588 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Concat_804 [Concat] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1588 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3311 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3312 [05/10/2022-20:07:07] [V] [TRT] Concat_804 [Concat] inputs: [1588 -> (1)[INT32]], [3311 -> (1)[INT32]], [3312 -> (1)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3311 for ONNX node: 3311 [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3312 for ONNX node: 3312 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Concat_804 for ONNX node: Concat_804 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1593 for ONNX tensor: 1593 [05/10/2022-20:07:07] [V] [TRT] Concat_804 [Concat] outputs: [1593 -> (3)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Reshape_805 [Reshape] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1584 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1593 [05/10/2022-20:07:07] [V] [TRT] Reshape_805 [Reshape] inputs: [1584 -> (-1, -1, 4, 64)[FLOAT]], [1593 -> (3)[INT32]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Reshape_805 for ONNX node: Reshape_805 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1594 for ONNX tensor: 1594 [05/10/2022-20:07:07] [V] [TRT] Reshape_805 [Reshape] outputs: [1594 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: MatMul_806 [MatMul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1594 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 3313 [05/10/2022-20:07:07] [V] [TRT] MatMul_806 [MatMul] inputs: [1594 -> (-1, -1, 256)[FLOAT]], [3313 -> (256, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 3313 for ONNX node: 3313 [05/10/2022-20:07:07] [V] [TRT] Registering layer: MatMul_806 for ONNX node: MatMul_806 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1596 for ONNX tensor: 1596 [05/10/2022-20:07:07] [V] [TRT] MatMul_806 [MatMul] outputs: [1596 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_807 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.self_attn.linear_out.bias [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1596 [05/10/2022-20:07:07] [V] [TRT] Add_807 [Add] inputs: [encoder.encoders.4.self_attn.linear_out.bias -> (256)[FLOAT]], [1596 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.self_attn.linear_out.bias for ONNX node: encoder.encoders.4.self_attn.linear_out.bias [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_807 for ONNX node: Add_807 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1597 for ONNX tensor: 1597 [05/10/2022-20:07:07] [V] [TRT] Add_807 [Add] outputs: [1597 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_808 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1475 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1597 [05/10/2022-20:07:07] [V] [TRT] Add_808 [Add] inputs: [1475 -> (-1, -1, 256)[FLOAT]], [1597 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_808 for ONNX node: Add_808 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1598 for ONNX tensor: 1598 [05/10/2022-20:07:07] [V] [TRT] Add_808 [Add] outputs: [1598 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: ReduceMean_809 [ReduceMean] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1598 [05/10/2022-20:07:07] [V] [TRT] ReduceMean_809 [ReduceMean] inputs: [1598 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: ReduceMean_809 for ONNX node: ReduceMean_809 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1599 for ONNX tensor: 1599 [05/10/2022-20:07:07] [V] [TRT] ReduceMean_809 [ReduceMean] outputs: [1599 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Sub_810 [Sub] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1598 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1599 [05/10/2022-20:07:07] [V] [TRT] Sub_810 [Sub] inputs: [1598 -> (-1, -1, 256)[FLOAT]], [1599 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Sub_810 for ONNX node: Sub_810 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1600 for ONNX tensor: 1600 [05/10/2022-20:07:07] [V] [TRT] Sub_810 [Sub] outputs: [1600 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_811 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_811 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_811 [Constant] outputs: [1601 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Pow_812 [Pow] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1600 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1601 [05/10/2022-20:07:07] [V] [TRT] Pow_812 [Pow] inputs: [1600 -> (-1, -1, 256)[FLOAT]], [1601 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1601 for ONNX node: 1601 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Pow_812 for ONNX node: Pow_812 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1602 for ONNX tensor: 1602 [05/10/2022-20:07:07] [V] [TRT] Pow_812 [Pow] outputs: [1602 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: ReduceMean_813 [ReduceMean] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1602 [05/10/2022-20:07:07] [V] [TRT] ReduceMean_813 [ReduceMean] inputs: [1602 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: ReduceMean_813 for ONNX node: ReduceMean_813 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1603 for ONNX tensor: 1603 [05/10/2022-20:07:07] [V] [TRT] ReduceMean_813 [ReduceMean] outputs: [1603 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Constant_814 [Constant] [05/10/2022-20:07:07] [V] [TRT] Constant_814 [Constant] inputs: [05/10/2022-20:07:07] [V] [TRT] Constant_814 [Constant] outputs: [1604 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Add_815 [Add] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1603 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1604 [05/10/2022-20:07:07] [V] [TRT] Add_815 [Add] inputs: [1603 -> (-1, -1, 1)[FLOAT]], [1604 -> ()[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: 1604 for ONNX node: 1604 [05/10/2022-20:07:07] [V] [TRT] Registering layer: Add_815 for ONNX node: Add_815 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1605 for ONNX tensor: 1605 [05/10/2022-20:07:07] [V] [TRT] Add_815 [Add] outputs: [1605 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Sqrt_816 [Sqrt] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1605 [05/10/2022-20:07:07] [V] [TRT] Sqrt_816 [Sqrt] inputs: [1605 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Sqrt_816 for ONNX node: Sqrt_816 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1606 for ONNX tensor: 1606 [05/10/2022-20:07:07] [V] [TRT] Sqrt_816 [Sqrt] outputs: [1606 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Div_817 [Div] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1600 [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1606 [05/10/2022-20:07:07] [V] [TRT] Div_817 [Div] inputs: [1600 -> (-1, -1, 256)[FLOAT]], [1606 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: Div_817 for ONNX node: Div_817 [05/10/2022-20:07:07] [V] [TRT] Registering tensor: 1607 for ONNX tensor: 1607 [05/10/2022-20:07:07] [V] [TRT] Div_817 [Div] outputs: [1607 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Parsing node: Mul_818 [Mul] [05/10/2022-20:07:07] [V] [TRT] Searching for input: 1607 [05/10/2022-20:07:07] [V] [TRT] Searching for input: encoder.encoders.4.norm_conv.weight [05/10/2022-20:07:07] [V] [TRT] Mul_818 [Mul] inputs: [1607 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:07] [V] [TRT] Registering layer: encoder.encoders.4.norm_conv.weight for ONNX node: encoder.encoders.4.norm_conv.weight [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_818 for ONNX node: Mul_818 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1608 for ONNX tensor: 1608 [05/10/2022-20:07:08] [V] [TRT] Mul_818 [Mul] outputs: [1608 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_819 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1608 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.norm_conv.bias [05/10/2022-20:07:08] [V] [TRT] Add_819 [Add] inputs: [1608 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.norm_conv.bias for ONNX node: encoder.encoders.4.norm_conv.bias [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_819 for ONNX node: Add_819 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1609 for ONNX tensor: 1609 [05/10/2022-20:07:08] [V] [TRT] Add_819 [Add] outputs: [1609 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Transpose_820 [Transpose] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1609 [05/10/2022-20:07:08] [V] [TRT] Transpose_820 [Transpose] inputs: [1609 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Transpose_820 for ONNX node: Transpose_820 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1610 for ONNX tensor: 1610 [05/10/2022-20:07:08] [V] [TRT] Transpose_820 [Transpose] outputs: [1610 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Not_821 [Not] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:08] [V] [TRT] Not_821 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Not_821 for ONNX node: Not_821 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1611 for ONNX tensor: 1611 [05/10/2022-20:07:08] [V] [TRT] Not_821 [Not] outputs: [1611 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Cast_822 [Cast] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1611 [05/10/2022-20:07:08] [V] [TRT] Cast_822 [Cast] inputs: [1611 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Casting to type: bool [05/10/2022-20:07:08] [V] [TRT] Registering layer: Cast_822 for ONNX node: Cast_822 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1612 for ONNX tensor: 1612 [05/10/2022-20:07:08] [V] [TRT] Cast_822 [Cast] outputs: [1612 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_823 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_823 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_823 [Constant] outputs: [1613 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Where_824 [Where] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1612 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1613 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1610 [05/10/2022-20:07:08] [V] [TRT] Where_824 [Where] inputs: [1612 -> (-1, 1, -1)[BOOL]], [1613 -> ()[FLOAT]], [1610 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1613 for ONNX node: 1613 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Where_824 for ONNX node: Where_824 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1614 for ONNX tensor: 1614 [05/10/2022-20:07:08] [V] [TRT] Where_824 [Where] outputs: [1614 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Conv_825 [Conv] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1614 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.conv_module.pointwise_conv1.weight [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.conv_module.pointwise_conv1.bias [05/10/2022-20:07:08] [V] [TRT] Conv_825 [Conv] inputs: [1614 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.4.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.4.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:08] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:08] [V] [TRT] Registering layer: Conv_825 for ONNX node: Conv_825 [05/10/2022-20:07:08] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:08] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:08] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1615 for ONNX tensor: 1615 [05/10/2022-20:07:08] [V] [TRT] Conv_825 [Conv] outputs: [1615 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Split_826 [Split] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1615 [05/10/2022-20:07:08] [V] [TRT] Split_826 [Split] inputs: [1615 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Split_826 for ONNX node: Split_826 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Split_826_6 for ONNX node: Split_826 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1616 for ONNX tensor: 1616 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1617 for ONNX tensor: 1617 [05/10/2022-20:07:08] [V] [TRT] Split_826 [Split] outputs: [1616 -> (-1, 256, -1)[FLOAT]], [1617 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sigmoid_827 [Sigmoid] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1617 [05/10/2022-20:07:08] [V] [TRT] Sigmoid_827 [Sigmoid] inputs: [1617 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sigmoid_827 for ONNX node: Sigmoid_827 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1618 for ONNX tensor: 1618 [05/10/2022-20:07:08] [V] [TRT] Sigmoid_827 [Sigmoid] outputs: [1618 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Mul_828 [Mul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1616 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1618 [05/10/2022-20:07:08] [V] [TRT] Mul_828 [Mul] inputs: [1616 -> (-1, 256, -1)[FLOAT]], [1618 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_828 for ONNX node: Mul_828 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1619 for ONNX tensor: 1619 [05/10/2022-20:07:08] [V] [TRT] Mul_828 [Mul] outputs: [1619 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Conv_829 [Conv] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1619 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 3173 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 3174 [05/10/2022-20:07:08] [V] [TRT] Conv_829 [Conv] inputs: [1619 -> (-1, 256, -1)[FLOAT]], [3173 -> (256, 1, 15)[FLOAT]], [3174 -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:08] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:08] [V] [TRT] Registering layer: Conv_829 for ONNX node: Conv_829 [05/10/2022-20:07:08] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:08] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:08] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 3172 for ONNX tensor: 3172 [05/10/2022-20:07:08] [V] [TRT] Conv_829 [Conv] outputs: [3172 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sigmoid_830 [Sigmoid] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 3172 [05/10/2022-20:07:08] [V] [TRT] Sigmoid_830 [Sigmoid] inputs: [3172 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sigmoid_830 for ONNX node: Sigmoid_830 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1622 for ONNX tensor: 1622 [05/10/2022-20:07:08] [V] [TRT] Sigmoid_830 [Sigmoid] outputs: [1622 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Mul_831 [Mul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 3172 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1622 [05/10/2022-20:07:08] [V] [TRT] Mul_831 [Mul] inputs: [3172 -> (-1, 256, -1)[FLOAT]], [1622 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_831 for ONNX node: Mul_831 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1623 for ONNX tensor: 1623 [05/10/2022-20:07:08] [V] [TRT] Mul_831 [Mul] outputs: [1623 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Not_832 [Not] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:08] [V] [TRT] Not_832 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Not_832 for ONNX node: Not_832 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1624 for ONNX tensor: 1624 [05/10/2022-20:07:08] [V] [TRT] Not_832 [Not] outputs: [1624 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Conv_833 [Conv] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1623 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.conv_module.pointwise_conv2.weight [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.conv_module.pointwise_conv2.bias [05/10/2022-20:07:08] [V] [TRT] Conv_833 [Conv] inputs: [1623 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.4.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.4.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:08] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:08] [V] [TRT] Registering layer: Conv_833 for ONNX node: Conv_833 [05/10/2022-20:07:08] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:08] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:08] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1625 for ONNX tensor: 1625 [05/10/2022-20:07:08] [V] [TRT] Conv_833 [Conv] outputs: [1625 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Cast_834 [Cast] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1624 [05/10/2022-20:07:08] [V] [TRT] Cast_834 [Cast] inputs: [1624 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Casting to type: bool [05/10/2022-20:07:08] [V] [TRT] Registering layer: Cast_834 for ONNX node: Cast_834 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1626 for ONNX tensor: 1626 [05/10/2022-20:07:08] [V] [TRT] Cast_834 [Cast] outputs: [1626 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_835 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_835 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_835 [Constant] outputs: [1627 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Where_836 [Where] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1626 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1627 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1625 [05/10/2022-20:07:08] [V] [TRT] Where_836 [Where] inputs: [1626 -> (-1, 1, -1)[BOOL]], [1627 -> ()[FLOAT]], [1625 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1627 for ONNX node: 1627 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Where_836 for ONNX node: Where_836 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1628 for ONNX tensor: 1628 [05/10/2022-20:07:08] [V] [TRT] Where_836 [Where] outputs: [1628 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Transpose_837 [Transpose] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1628 [05/10/2022-20:07:08] [V] [TRT] Transpose_837 [Transpose] inputs: [1628 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Transpose_837 for ONNX node: Transpose_837 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1629 for ONNX tensor: 1629 [05/10/2022-20:07:08] [V] [TRT] Transpose_837 [Transpose] outputs: [1629 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_838 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1598 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1629 [05/10/2022-20:07:08] [V] [TRT] Add_838 [Add] inputs: [1598 -> (-1, -1, 256)[FLOAT]], [1629 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_838 for ONNX node: Add_838 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1630 for ONNX tensor: 1630 [05/10/2022-20:07:08] [V] [TRT] Add_838 [Add] outputs: [1630 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: ReduceMean_839 [ReduceMean] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1630 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_839 [ReduceMean] inputs: [1630 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: ReduceMean_839 for ONNX node: ReduceMean_839 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1631 for ONNX tensor: 1631 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_839 [ReduceMean] outputs: [1631 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sub_840 [Sub] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1630 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1631 [05/10/2022-20:07:08] [V] [TRT] Sub_840 [Sub] inputs: [1630 -> (-1, -1, 256)[FLOAT]], [1631 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sub_840 for ONNX node: Sub_840 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1632 for ONNX tensor: 1632 [05/10/2022-20:07:08] [V] [TRT] Sub_840 [Sub] outputs: [1632 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_841 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_841 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_841 [Constant] outputs: [1633 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Pow_842 [Pow] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1632 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1633 [05/10/2022-20:07:08] [V] [TRT] Pow_842 [Pow] inputs: [1632 -> (-1, -1, 256)[FLOAT]], [1633 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1633 for ONNX node: 1633 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Pow_842 for ONNX node: Pow_842 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1634 for ONNX tensor: 1634 [05/10/2022-20:07:08] [V] [TRT] Pow_842 [Pow] outputs: [1634 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: ReduceMean_843 [ReduceMean] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1634 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_843 [ReduceMean] inputs: [1634 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: ReduceMean_843 for ONNX node: ReduceMean_843 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1635 for ONNX tensor: 1635 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_843 [ReduceMean] outputs: [1635 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_844 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_844 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_844 [Constant] outputs: [1636 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_845 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1635 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1636 [05/10/2022-20:07:08] [V] [TRT] Add_845 [Add] inputs: [1635 -> (-1, -1, 1)[FLOAT]], [1636 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1636 for ONNX node: 1636 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_845 for ONNX node: Add_845 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1637 for ONNX tensor: 1637 [05/10/2022-20:07:08] [V] [TRT] Add_845 [Add] outputs: [1637 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sqrt_846 [Sqrt] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1637 [05/10/2022-20:07:08] [V] [TRT] Sqrt_846 [Sqrt] inputs: [1637 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sqrt_846 for ONNX node: Sqrt_846 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1638 for ONNX tensor: 1638 [05/10/2022-20:07:08] [V] [TRT] Sqrt_846 [Sqrt] outputs: [1638 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Div_847 [Div] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1632 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1638 [05/10/2022-20:07:08] [V] [TRT] Div_847 [Div] inputs: [1632 -> (-1, -1, 256)[FLOAT]], [1638 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Div_847 for ONNX node: Div_847 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1639 for ONNX tensor: 1639 [05/10/2022-20:07:08] [V] [TRT] Div_847 [Div] outputs: [1639 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Mul_848 [Mul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1639 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.norm_ff.weight [05/10/2022-20:07:08] [V] [TRT] Mul_848 [Mul] inputs: [1639 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.norm_ff.weight for ONNX node: encoder.encoders.4.norm_ff.weight [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_848 for ONNX node: Mul_848 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1640 for ONNX tensor: 1640 [05/10/2022-20:07:08] [V] [TRT] Mul_848 [Mul] outputs: [1640 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_849 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1640 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.norm_ff.bias [05/10/2022-20:07:08] [V] [TRT] Add_849 [Add] inputs: [1640 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.norm_ff.bias for ONNX node: encoder.encoders.4.norm_ff.bias [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_849 for ONNX node: Add_849 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1641 for ONNX tensor: 1641 [05/10/2022-20:07:08] [V] [TRT] Add_849 [Add] outputs: [1641 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: MatMul_850 [MatMul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1641 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 3314 [05/10/2022-20:07:08] [V] [TRT] MatMul_850 [MatMul] inputs: [1641 -> (-1, -1, 256)[FLOAT]], [3314 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 3314 for ONNX node: 3314 [05/10/2022-20:07:08] [V] [TRT] Registering layer: MatMul_850 for ONNX node: MatMul_850 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1643 for ONNX tensor: 1643 [05/10/2022-20:07:08] [V] [TRT] MatMul_850 [MatMul] outputs: [1643 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_851 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.feed_forward.w_1.bias [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1643 [05/10/2022-20:07:08] [V] [TRT] Add_851 [Add] inputs: [encoder.encoders.4.feed_forward.w_1.bias -> (2048)[FLOAT]], [1643 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.feed_forward.w_1.bias for ONNX node: encoder.encoders.4.feed_forward.w_1.bias [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_851 for ONNX node: Add_851 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1644 for ONNX tensor: 1644 [05/10/2022-20:07:08] [V] [TRT] Add_851 [Add] outputs: [1644 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sigmoid_852 [Sigmoid] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1644 [05/10/2022-20:07:08] [V] [TRT] Sigmoid_852 [Sigmoid] inputs: [1644 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sigmoid_852 for ONNX node: Sigmoid_852 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1645 for ONNX tensor: 1645 [05/10/2022-20:07:08] [V] [TRT] Sigmoid_852 [Sigmoid] outputs: [1645 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Mul_853 [Mul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1644 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1645 [05/10/2022-20:07:08] [V] [TRT] Mul_853 [Mul] inputs: [1644 -> (-1, -1, 2048)[FLOAT]], [1645 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_853 for ONNX node: Mul_853 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1646 for ONNX tensor: 1646 [05/10/2022-20:07:08] [V] [TRT] Mul_853 [Mul] outputs: [1646 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: MatMul_854 [MatMul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1646 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 3315 [05/10/2022-20:07:08] [V] [TRT] MatMul_854 [MatMul] inputs: [1646 -> (-1, -1, 2048)[FLOAT]], [3315 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 3315 for ONNX node: 3315 [05/10/2022-20:07:08] [V] [TRT] Registering layer: MatMul_854 for ONNX node: MatMul_854 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1648 for ONNX tensor: 1648 [05/10/2022-20:07:08] [V] [TRT] MatMul_854 [MatMul] outputs: [1648 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_855 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.feed_forward.w_2.bias [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1648 [05/10/2022-20:07:08] [V] [TRT] Add_855 [Add] inputs: [encoder.encoders.4.feed_forward.w_2.bias -> (256)[FLOAT]], [1648 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.feed_forward.w_2.bias for ONNX node: encoder.encoders.4.feed_forward.w_2.bias [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_855 for ONNX node: Add_855 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1649 for ONNX tensor: 1649 [05/10/2022-20:07:08] [V] [TRT] Add_855 [Add] outputs: [1649 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_856 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_856 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_856 [Constant] outputs: [1650 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Mul_857 [Mul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1649 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1650 [05/10/2022-20:07:08] [V] [TRT] Mul_857 [Mul] inputs: [1649 -> (-1, -1, 256)[FLOAT]], [1650 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1650 for ONNX node: 1650 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_857 for ONNX node: Mul_857 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1651 for ONNX tensor: 1651 [05/10/2022-20:07:08] [V] [TRT] Mul_857 [Mul] outputs: [1651 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_858 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1630 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1651 [05/10/2022-20:07:08] [V] [TRT] Add_858 [Add] inputs: [1630 -> (-1, -1, 256)[FLOAT]], [1651 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_858 for ONNX node: Add_858 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1652 for ONNX tensor: 1652 [05/10/2022-20:07:08] [V] [TRT] Add_858 [Add] outputs: [1652 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: ReduceMean_859 [ReduceMean] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1652 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_859 [ReduceMean] inputs: [1652 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: ReduceMean_859 for ONNX node: ReduceMean_859 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1653 for ONNX tensor: 1653 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_859 [ReduceMean] outputs: [1653 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sub_860 [Sub] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1652 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1653 [05/10/2022-20:07:08] [V] [TRT] Sub_860 [Sub] inputs: [1652 -> (-1, -1, 256)[FLOAT]], [1653 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sub_860 for ONNX node: Sub_860 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1654 for ONNX tensor: 1654 [05/10/2022-20:07:08] [V] [TRT] Sub_860 [Sub] outputs: [1654 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_861 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_861 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_861 [Constant] outputs: [1655 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Pow_862 [Pow] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1654 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1655 [05/10/2022-20:07:08] [V] [TRT] Pow_862 [Pow] inputs: [1654 -> (-1, -1, 256)[FLOAT]], [1655 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1655 for ONNX node: 1655 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Pow_862 for ONNX node: Pow_862 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1656 for ONNX tensor: 1656 [05/10/2022-20:07:08] [V] [TRT] Pow_862 [Pow] outputs: [1656 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: ReduceMean_863 [ReduceMean] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1656 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_863 [ReduceMean] inputs: [1656 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: ReduceMean_863 for ONNX node: ReduceMean_863 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1657 for ONNX tensor: 1657 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_863 [ReduceMean] outputs: [1657 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_864 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_864 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_864 [Constant] outputs: [1658 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_865 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1657 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1658 [05/10/2022-20:07:08] [V] [TRT] Add_865 [Add] inputs: [1657 -> (-1, -1, 1)[FLOAT]], [1658 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1658 for ONNX node: 1658 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_865 for ONNX node: Add_865 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1659 for ONNX tensor: 1659 [05/10/2022-20:07:08] [V] [TRT] Add_865 [Add] outputs: [1659 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sqrt_866 [Sqrt] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1659 [05/10/2022-20:07:08] [V] [TRT] Sqrt_866 [Sqrt] inputs: [1659 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sqrt_866 for ONNX node: Sqrt_866 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1660 for ONNX tensor: 1660 [05/10/2022-20:07:08] [V] [TRT] Sqrt_866 [Sqrt] outputs: [1660 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Div_867 [Div] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1654 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1660 [05/10/2022-20:07:08] [V] [TRT] Div_867 [Div] inputs: [1654 -> (-1, -1, 256)[FLOAT]], [1660 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Div_867 for ONNX node: Div_867 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1661 for ONNX tensor: 1661 [05/10/2022-20:07:08] [V] [TRT] Div_867 [Div] outputs: [1661 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Mul_868 [Mul] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1661 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.norm_final.weight [05/10/2022-20:07:08] [V] [TRT] Mul_868 [Mul] inputs: [1661 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.norm_final.weight for ONNX node: encoder.encoders.4.norm_final.weight [05/10/2022-20:07:08] [V] [TRT] Registering layer: Mul_868 for ONNX node: Mul_868 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1662 for ONNX tensor: 1662 [05/10/2022-20:07:08] [V] [TRT] Mul_868 [Mul] outputs: [1662 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_869 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1662 [05/10/2022-20:07:08] [V] [TRT] Searching for input: encoder.encoders.4.norm_final.bias [05/10/2022-20:07:08] [V] [TRT] Add_869 [Add] inputs: [1662 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.4.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: encoder.encoders.4.norm_final.bias for ONNX node: encoder.encoders.4.norm_final.bias [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_869 for ONNX node: Add_869 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1663 for ONNX tensor: 1663 [05/10/2022-20:07:08] [V] [TRT] Add_869 [Add] outputs: [1663 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: ReduceMean_870 [ReduceMean] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1663 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_870 [ReduceMean] inputs: [1663 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: ReduceMean_870 for ONNX node: ReduceMean_870 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1664 for ONNX tensor: 1664 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_870 [ReduceMean] outputs: [1664 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Sub_871 [Sub] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1663 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1664 [05/10/2022-20:07:08] [V] [TRT] Sub_871 [Sub] inputs: [1663 -> (-1, -1, 256)[FLOAT]], [1664 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: Sub_871 for ONNX node: Sub_871 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1665 for ONNX tensor: 1665 [05/10/2022-20:07:08] [V] [TRT] Sub_871 [Sub] outputs: [1665 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_872 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_872 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_872 [Constant] outputs: [1666 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Pow_873 [Pow] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1665 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1666 [05/10/2022-20:07:08] [V] [TRT] Pow_873 [Pow] inputs: [1665 -> (-1, -1, 256)[FLOAT]], [1666 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1666 for ONNX node: 1666 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Pow_873 for ONNX node: Pow_873 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1667 for ONNX tensor: 1667 [05/10/2022-20:07:08] [V] [TRT] Pow_873 [Pow] outputs: [1667 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: ReduceMean_874 [ReduceMean] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1667 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_874 [ReduceMean] inputs: [1667 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: ReduceMean_874 for ONNX node: ReduceMean_874 [05/10/2022-20:07:08] [V] [TRT] Registering tensor: 1668 for ONNX tensor: 1668 [05/10/2022-20:07:08] [V] [TRT] ReduceMean_874 [ReduceMean] outputs: [1668 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Constant_875 [Constant] [05/10/2022-20:07:08] [V] [TRT] Constant_875 [Constant] inputs: [05/10/2022-20:07:08] [V] [TRT] Constant_875 [Constant] outputs: [1669 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Parsing node: Add_876 [Add] [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1668 [05/10/2022-20:07:08] [V] [TRT] Searching for input: 1669 [05/10/2022-20:07:08] [V] [TRT] Add_876 [Add] inputs: [1668 -> (-1, -1, 1)[FLOAT]], [1669 -> ()[FLOAT]], [05/10/2022-20:07:08] [V] [TRT] Registering layer: 1669 for ONNX node: 1669 [05/10/2022-20:07:08] [V] [TRT] Registering layer: Add_876 for ONNX node: Add_876 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1670 for ONNX tensor: 1670 [05/10/2022-20:07:09] [V] [TRT] Add_876 [Add] outputs: [1670 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Sqrt_877 [Sqrt] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1670 [05/10/2022-20:07:09] [V] [TRT] Sqrt_877 [Sqrt] inputs: [1670 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Sqrt_877 for ONNX node: Sqrt_877 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1671 for ONNX tensor: 1671 [05/10/2022-20:07:09] [V] [TRT] Sqrt_877 [Sqrt] outputs: [1671 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Div_878 [Div] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1665 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1671 [05/10/2022-20:07:09] [V] [TRT] Div_878 [Div] inputs: [1665 -> (-1, -1, 256)[FLOAT]], [1671 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Div_878 for ONNX node: Div_878 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1672 for ONNX tensor: 1672 [05/10/2022-20:07:09] [V] [TRT] Div_878 [Div] outputs: [1672 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Mul_879 [Mul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1672 [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.norm_ff_macaron.weight [05/10/2022-20:07:09] [V] [TRT] Mul_879 [Mul] inputs: [1672 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.norm_ff_macaron.weight for ONNX node: encoder.encoders.5.norm_ff_macaron.weight [05/10/2022-20:07:09] [V] [TRT] Registering layer: Mul_879 for ONNX node: Mul_879 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1673 for ONNX tensor: 1673 [05/10/2022-20:07:09] [V] [TRT] Mul_879 [Mul] outputs: [1673 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_880 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1673 [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.norm_ff_macaron.bias [05/10/2022-20:07:09] [V] [TRT] Add_880 [Add] inputs: [1673 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.norm_ff_macaron.bias for ONNX node: encoder.encoders.5.norm_ff_macaron.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_880 for ONNX node: Add_880 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1674 for ONNX tensor: 1674 [05/10/2022-20:07:09] [V] [TRT] Add_880 [Add] outputs: [1674 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_881 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1674 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3316 [05/10/2022-20:07:09] [V] [TRT] MatMul_881 [MatMul] inputs: [1674 -> (-1, -1, 256)[FLOAT]], [3316 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3316 for ONNX node: 3316 [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_881 for ONNX node: MatMul_881 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1676 for ONNX tensor: 1676 [05/10/2022-20:07:09] [V] [TRT] MatMul_881 [MatMul] outputs: [1676 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_882 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.feed_forward_macaron.w_1.bias [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1676 [05/10/2022-20:07:09] [V] [TRT] Add_882 [Add] inputs: [encoder.encoders.5.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [1676 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.5.feed_forward_macaron.w_1.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_882 for ONNX node: Add_882 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1677 for ONNX tensor: 1677 [05/10/2022-20:07:09] [V] [TRT] Add_882 [Add] outputs: [1677 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Sigmoid_883 [Sigmoid] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1677 [05/10/2022-20:07:09] [V] [TRT] Sigmoid_883 [Sigmoid] inputs: [1677 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Sigmoid_883 for ONNX node: Sigmoid_883 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1678 for ONNX tensor: 1678 [05/10/2022-20:07:09] [V] [TRT] Sigmoid_883 [Sigmoid] outputs: [1678 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Mul_884 [Mul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1677 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1678 [05/10/2022-20:07:09] [V] [TRT] Mul_884 [Mul] inputs: [1677 -> (-1, -1, 2048)[FLOAT]], [1678 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Mul_884 for ONNX node: Mul_884 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1679 for ONNX tensor: 1679 [05/10/2022-20:07:09] [V] [TRT] Mul_884 [Mul] outputs: [1679 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_885 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1679 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3317 [05/10/2022-20:07:09] [V] [TRT] MatMul_885 [MatMul] inputs: [1679 -> (-1, -1, 2048)[FLOAT]], [3317 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3317 for ONNX node: 3317 [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_885 for ONNX node: MatMul_885 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1681 for ONNX tensor: 1681 [05/10/2022-20:07:09] [V] [TRT] MatMul_885 [MatMul] outputs: [1681 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_886 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.feed_forward_macaron.w_2.bias [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1681 [05/10/2022-20:07:09] [V] [TRT] Add_886 [Add] inputs: [encoder.encoders.5.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [1681 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.5.feed_forward_macaron.w_2.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_886 for ONNX node: Add_886 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1682 for ONNX tensor: 1682 [05/10/2022-20:07:09] [V] [TRT] Add_886 [Add] outputs: [1682 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_887 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_887 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_887 [Constant] outputs: [1683 -> ()[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Mul_888 [Mul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1682 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1683 [05/10/2022-20:07:09] [V] [TRT] Mul_888 [Mul] inputs: [1682 -> (-1, -1, 256)[FLOAT]], [1683 -> ()[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 1683 for ONNX node: 1683 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Mul_888 for ONNX node: Mul_888 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1684 for ONNX tensor: 1684 [05/10/2022-20:07:09] [V] [TRT] Mul_888 [Mul] outputs: [1684 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_889 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1663 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1684 [05/10/2022-20:07:09] [V] [TRT] Add_889 [Add] inputs: [1663 -> (-1, -1, 256)[FLOAT]], [1684 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_889 for ONNX node: Add_889 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1685 for ONNX tensor: 1685 [05/10/2022-20:07:09] [V] [TRT] Add_889 [Add] outputs: [1685 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: ReduceMean_890 [ReduceMean] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1685 [05/10/2022-20:07:09] [V] [TRT] ReduceMean_890 [ReduceMean] inputs: [1685 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: ReduceMean_890 for ONNX node: ReduceMean_890 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1686 for ONNX tensor: 1686 [05/10/2022-20:07:09] [V] [TRT] ReduceMean_890 [ReduceMean] outputs: [1686 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Sub_891 [Sub] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1685 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1686 [05/10/2022-20:07:09] [V] [TRT] Sub_891 [Sub] inputs: [1685 -> (-1, -1, 256)[FLOAT]], [1686 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Sub_891 for ONNX node: Sub_891 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1687 for ONNX tensor: 1687 [05/10/2022-20:07:09] [V] [TRT] Sub_891 [Sub] outputs: [1687 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_892 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_892 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_892 [Constant] outputs: [1688 -> ()[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Pow_893 [Pow] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1687 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1688 [05/10/2022-20:07:09] [V] [TRT] Pow_893 [Pow] inputs: [1687 -> (-1, -1, 256)[FLOAT]], [1688 -> ()[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 1688 for ONNX node: 1688 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Pow_893 for ONNX node: Pow_893 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1689 for ONNX tensor: 1689 [05/10/2022-20:07:09] [V] [TRT] Pow_893 [Pow] outputs: [1689 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: ReduceMean_894 [ReduceMean] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1689 [05/10/2022-20:07:09] [V] [TRT] ReduceMean_894 [ReduceMean] inputs: [1689 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: ReduceMean_894 for ONNX node: ReduceMean_894 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1690 for ONNX tensor: 1690 [05/10/2022-20:07:09] [V] [TRT] ReduceMean_894 [ReduceMean] outputs: [1690 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_895 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_895 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_895 [Constant] outputs: [1691 -> ()[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_896 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1690 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1691 [05/10/2022-20:07:09] [V] [TRT] Add_896 [Add] inputs: [1690 -> (-1, -1, 1)[FLOAT]], [1691 -> ()[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 1691 for ONNX node: 1691 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_896 for ONNX node: Add_896 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1692 for ONNX tensor: 1692 [05/10/2022-20:07:09] [V] [TRT] Add_896 [Add] outputs: [1692 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Sqrt_897 [Sqrt] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1692 [05/10/2022-20:07:09] [V] [TRT] Sqrt_897 [Sqrt] inputs: [1692 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Sqrt_897 for ONNX node: Sqrt_897 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1693 for ONNX tensor: 1693 [05/10/2022-20:07:09] [V] [TRT] Sqrt_897 [Sqrt] outputs: [1693 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Div_898 [Div] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1687 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1693 [05/10/2022-20:07:09] [V] [TRT] Div_898 [Div] inputs: [1687 -> (-1, -1, 256)[FLOAT]], [1693 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Div_898 for ONNX node: Div_898 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1694 for ONNX tensor: 1694 [05/10/2022-20:07:09] [V] [TRT] Div_898 [Div] outputs: [1694 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Mul_899 [Mul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1694 [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.norm_mha.weight [05/10/2022-20:07:09] [V] [TRT] Mul_899 [Mul] inputs: [1694 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.norm_mha.weight for ONNX node: encoder.encoders.5.norm_mha.weight [05/10/2022-20:07:09] [V] [TRT] Registering layer: Mul_899 for ONNX node: Mul_899 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1695 for ONNX tensor: 1695 [05/10/2022-20:07:09] [V] [TRT] Mul_899 [Mul] outputs: [1695 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_900 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1695 [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.norm_mha.bias [05/10/2022-20:07:09] [V] [TRT] Add_900 [Add] inputs: [1695 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.norm_mha.bias for ONNX node: encoder.encoders.5.norm_mha.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_900 for ONNX node: Add_900 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1696 for ONNX tensor: 1696 [05/10/2022-20:07:09] [V] [TRT] Add_900 [Add] outputs: [1696 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Shape_901 [Shape] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1696 [05/10/2022-20:07:09] [V] [TRT] Shape_901 [Shape] inputs: [1696 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Shape_901 for ONNX node: Shape_901 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1697 for ONNX tensor: 1697 [05/10/2022-20:07:09] [V] [TRT] Shape_901 [Shape] outputs: [1697 -> (3)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_902 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_902 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_902 [Constant] outputs: [1698 -> ()[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Gather_903 [Gather] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1697 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1698 [05/10/2022-20:07:09] [V] [TRT] Gather_903 [Gather] inputs: [1697 -> (3)[INT32]], [1698 -> ()[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 1698 for ONNX node: 1698 [05/10/2022-20:07:09] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Gather_903 for ONNX node: Gather_903 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1699 for ONNX tensor: 1699 [05/10/2022-20:07:09] [V] [TRT] Gather_903 [Gather] outputs: [1699 -> ()[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_904 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1696 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3318 [05/10/2022-20:07:09] [V] [TRT] MatMul_904 [MatMul] inputs: [1696 -> (-1, -1, 256)[FLOAT]], [3318 -> (256, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3318 for ONNX node: 3318 [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_904 for ONNX node: MatMul_904 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1701 for ONNX tensor: 1701 [05/10/2022-20:07:09] [V] [TRT] MatMul_904 [MatMul] outputs: [1701 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_905 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.self_attn.linear_q.bias [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1701 [05/10/2022-20:07:09] [V] [TRT] Add_905 [Add] inputs: [encoder.encoders.5.self_attn.linear_q.bias -> (256)[FLOAT]], [1701 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.self_attn.linear_q.bias for ONNX node: encoder.encoders.5.self_attn.linear_q.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_905 for ONNX node: Add_905 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1702 for ONNX tensor: 1702 [05/10/2022-20:07:09] [V] [TRT] Add_905 [Add] outputs: [1702 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_906 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_906 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_906 [Constant] outputs: [1706 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Unsqueeze_907 [Unsqueeze] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1699 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1706 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_907 [Unsqueeze] inputs: [1699 -> ()[INT32]], [1706 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:09] [V] [TRT] Registering layer: Unsqueeze_907 for ONNX node: Unsqueeze_907 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1707 for ONNX tensor: 1707 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_907 [Unsqueeze] outputs: [1707 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Concat_908 [Concat] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1707 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3319 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3320 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3321 [05/10/2022-20:07:09] [V] [TRT] Concat_908 [Concat] inputs: [1707 -> (1)[INT32]], [3319 -> (1)[INT32]], [3320 -> (1)[INT32]], [3321 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3319 for ONNX node: 3319 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3320 for ONNX node: 3320 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3321 for ONNX node: 3321 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Concat_908 for ONNX node: Concat_908 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1714 for ONNX tensor: 1714 [05/10/2022-20:07:09] [V] [TRT] Concat_908 [Concat] outputs: [1714 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Reshape_909 [Reshape] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1702 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1714 [05/10/2022-20:07:09] [V] [TRT] Reshape_909 [Reshape] inputs: [1702 -> (-1, -1, 256)[FLOAT]], [1714 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Reshape_909 for ONNX node: Reshape_909 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1715 for ONNX tensor: 1715 [05/10/2022-20:07:09] [V] [TRT] Reshape_909 [Reshape] outputs: [1715 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_910 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1696 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3322 [05/10/2022-20:07:09] [V] [TRT] MatMul_910 [MatMul] inputs: [1696 -> (-1, -1, 256)[FLOAT]], [3322 -> (256, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3322 for ONNX node: 3322 [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_910 for ONNX node: MatMul_910 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1717 for ONNX tensor: 1717 [05/10/2022-20:07:09] [V] [TRT] MatMul_910 [MatMul] outputs: [1717 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_911 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.self_attn.linear_k.bias [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1717 [05/10/2022-20:07:09] [V] [TRT] Add_911 [Add] inputs: [encoder.encoders.5.self_attn.linear_k.bias -> (256)[FLOAT]], [1717 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.self_attn.linear_k.bias for ONNX node: encoder.encoders.5.self_attn.linear_k.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_911 for ONNX node: Add_911 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1718 for ONNX tensor: 1718 [05/10/2022-20:07:09] [V] [TRT] Add_911 [Add] outputs: [1718 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_912 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_912 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_912 [Constant] outputs: [1722 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Unsqueeze_913 [Unsqueeze] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1699 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1722 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_913 [Unsqueeze] inputs: [1699 -> ()[INT32]], [1722 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:09] [V] [TRT] Registering layer: Unsqueeze_913 for ONNX node: Unsqueeze_913 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1723 for ONNX tensor: 1723 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_913 [Unsqueeze] outputs: [1723 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Concat_914 [Concat] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1723 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3323 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3324 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3325 [05/10/2022-20:07:09] [V] [TRT] Concat_914 [Concat] inputs: [1723 -> (1)[INT32]], [3323 -> (1)[INT32]], [3324 -> (1)[INT32]], [3325 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3323 for ONNX node: 3323 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3324 for ONNX node: 3324 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3325 for ONNX node: 3325 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Concat_914 for ONNX node: Concat_914 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1730 for ONNX tensor: 1730 [05/10/2022-20:07:09] [V] [TRT] Concat_914 [Concat] outputs: [1730 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Reshape_915 [Reshape] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1718 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1730 [05/10/2022-20:07:09] [V] [TRT] Reshape_915 [Reshape] inputs: [1718 -> (-1, -1, 256)[FLOAT]], [1730 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Reshape_915 for ONNX node: Reshape_915 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1731 for ONNX tensor: 1731 [05/10/2022-20:07:09] [V] [TRT] Reshape_915 [Reshape] outputs: [1731 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_916 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1696 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3326 [05/10/2022-20:07:09] [V] [TRT] MatMul_916 [MatMul] inputs: [1696 -> (-1, -1, 256)[FLOAT]], [3326 -> (256, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3326 for ONNX node: 3326 [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_916 for ONNX node: MatMul_916 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1733 for ONNX tensor: 1733 [05/10/2022-20:07:09] [V] [TRT] MatMul_916 [MatMul] outputs: [1733 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_917 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.self_attn.linear_v.bias [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1733 [05/10/2022-20:07:09] [V] [TRT] Add_917 [Add] inputs: [encoder.encoders.5.self_attn.linear_v.bias -> (256)[FLOAT]], [1733 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.self_attn.linear_v.bias for ONNX node: encoder.encoders.5.self_attn.linear_v.bias [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_917 for ONNX node: Add_917 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1734 for ONNX tensor: 1734 [05/10/2022-20:07:09] [V] [TRT] Add_917 [Add] outputs: [1734 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_918 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_918 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_918 [Constant] outputs: [1738 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Unsqueeze_919 [Unsqueeze] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1699 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1738 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_919 [Unsqueeze] inputs: [1699 -> ()[INT32]], [1738 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:09] [V] [TRT] Registering layer: Unsqueeze_919 for ONNX node: Unsqueeze_919 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1739 for ONNX tensor: 1739 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_919 [Unsqueeze] outputs: [1739 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Concat_920 [Concat] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1739 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3327 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3328 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3329 [05/10/2022-20:07:09] [V] [TRT] Concat_920 [Concat] inputs: [1739 -> (1)[INT32]], [3327 -> (1)[INT32]], [3328 -> (1)[INT32]], [3329 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3327 for ONNX node: 3327 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3328 for ONNX node: 3328 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3329 for ONNX node: 3329 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Concat_920 for ONNX node: Concat_920 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1746 for ONNX tensor: 1746 [05/10/2022-20:07:09] [V] [TRT] Concat_920 [Concat] outputs: [1746 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Reshape_921 [Reshape] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1734 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1746 [05/10/2022-20:07:09] [V] [TRT] Reshape_921 [Reshape] inputs: [1734 -> (-1, -1, 256)[FLOAT]], [1746 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Reshape_921 for ONNX node: Reshape_921 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1747 for ONNX tensor: 1747 [05/10/2022-20:07:09] [V] [TRT] Reshape_921 [Reshape] outputs: [1747 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Transpose_922 [Transpose] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1747 [05/10/2022-20:07:09] [V] [TRT] Transpose_922 [Transpose] inputs: [1747 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Transpose_922 for ONNX node: Transpose_922 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1748 for ONNX tensor: 1748 [05/10/2022-20:07:09] [V] [TRT] Transpose_922 [Transpose] outputs: [1748 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Shape_923 [Shape] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:09] [V] [TRT] Shape_923 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Shape_923 for ONNX node: Shape_923 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1749 for ONNX tensor: 1749 [05/10/2022-20:07:09] [V] [TRT] Shape_923 [Shape] outputs: [1749 -> (3)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_924 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_924 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_924 [Constant] outputs: [1750 -> ()[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Gather_925 [Gather] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1749 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1750 [05/10/2022-20:07:09] [V] [TRT] Gather_925 [Gather] inputs: [1749 -> (3)[INT32]], [1750 -> ()[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 1750 for ONNX node: 1750 [05/10/2022-20:07:09] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Gather_925 for ONNX node: Gather_925 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1751 for ONNX tensor: 1751 [05/10/2022-20:07:09] [V] [TRT] Gather_925 [Gather] outputs: [1751 -> ()[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_926 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3330 [05/10/2022-20:07:09] [V] [TRT] MatMul_926 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3330 -> (256, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3330 for ONNX node: 3330 [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_926 for ONNX node: MatMul_926 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1753 for ONNX tensor: 1753 [05/10/2022-20:07:09] [V] [TRT] MatMul_926 [MatMul] outputs: [1753 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Constant_927 [Constant] [05/10/2022-20:07:09] [V] [TRT] Constant_927 [Constant] inputs: [05/10/2022-20:07:09] [V] [TRT] Constant_927 [Constant] outputs: [1757 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Unsqueeze_928 [Unsqueeze] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1751 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1757 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_928 [Unsqueeze] inputs: [1751 -> ()[INT32]], [1757 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:09] [V] [TRT] Registering layer: Unsqueeze_928 for ONNX node: Unsqueeze_928 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1758 for ONNX tensor: 1758 [05/10/2022-20:07:09] [V] [TRT] Unsqueeze_928 [Unsqueeze] outputs: [1758 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Concat_929 [Concat] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1758 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3331 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3332 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 3333 [05/10/2022-20:07:09] [V] [TRT] Concat_929 [Concat] inputs: [1758 -> (1)[INT32]], [3331 -> (1)[INT32]], [3332 -> (1)[INT32]], [3333 -> (1)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3331 for ONNX node: 3331 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3332 for ONNX node: 3332 [05/10/2022-20:07:09] [V] [TRT] Registering layer: 3333 for ONNX node: 3333 [05/10/2022-20:07:09] [V] [TRT] Registering layer: Concat_929 for ONNX node: Concat_929 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1765 for ONNX tensor: 1765 [05/10/2022-20:07:09] [V] [TRT] Concat_929 [Concat] outputs: [1765 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Reshape_930 [Reshape] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1753 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1765 [05/10/2022-20:07:09] [V] [TRT] Reshape_930 [Reshape] inputs: [1753 -> (1, -1, 256)[FLOAT]], [1765 -> (4)[INT32]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Reshape_930 for ONNX node: Reshape_930 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1766 for ONNX tensor: 1766 [05/10/2022-20:07:09] [V] [TRT] Reshape_930 [Reshape] outputs: [1766 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_931 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1715 [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.self_attn.pos_bias_u [05/10/2022-20:07:09] [V] [TRT] Add_931 [Add] inputs: [1715 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.5.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.self_attn.pos_bias_u for ONNX node: encoder.encoders.5.self_attn.pos_bias_u [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_931 for ONNX node: Add_931 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1767 for ONNX tensor: 1767 [05/10/2022-20:07:09] [V] [TRT] Add_931 [Add] outputs: [1767 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Transpose_932 [Transpose] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1767 [05/10/2022-20:07:09] [V] [TRT] Transpose_932 [Transpose] inputs: [1767 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Transpose_932 for ONNX node: Transpose_932 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1768 for ONNX tensor: 1768 [05/10/2022-20:07:09] [V] [TRT] Transpose_932 [Transpose] outputs: [1768 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_933 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1715 [05/10/2022-20:07:09] [V] [TRT] Searching for input: encoder.encoders.5.self_attn.pos_bias_v [05/10/2022-20:07:09] [V] [TRT] Add_933 [Add] inputs: [1715 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.5.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: encoder.encoders.5.self_attn.pos_bias_v for ONNX node: encoder.encoders.5.self_attn.pos_bias_v [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_933 for ONNX node: Add_933 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1769 for ONNX tensor: 1769 [05/10/2022-20:07:09] [V] [TRT] Add_933 [Add] outputs: [1769 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Transpose_934 [Transpose] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1769 [05/10/2022-20:07:09] [V] [TRT] Transpose_934 [Transpose] inputs: [1769 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Transpose_934 for ONNX node: Transpose_934 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1770 for ONNX tensor: 1770 [05/10/2022-20:07:09] [V] [TRT] Transpose_934 [Transpose] outputs: [1770 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Transpose_935 [Transpose] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1731 [05/10/2022-20:07:09] [V] [TRT] Transpose_935 [Transpose] inputs: [1731 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Transpose_935 for ONNX node: Transpose_935 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1771 for ONNX tensor: 1771 [05/10/2022-20:07:09] [V] [TRT] Transpose_935 [Transpose] outputs: [1771 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_936 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1768 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1771 [05/10/2022-20:07:09] [V] [TRT] MatMul_936 [MatMul] inputs: [1768 -> (-1, 4, -1, 64)[FLOAT]], [1771 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_936 for ONNX node: MatMul_936 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1772 for ONNX tensor: 1772 [05/10/2022-20:07:09] [V] [TRT] MatMul_936 [MatMul] outputs: [1772 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Transpose_937 [Transpose] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1766 [05/10/2022-20:07:09] [V] [TRT] Transpose_937 [Transpose] inputs: [1766 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Transpose_937 for ONNX node: Transpose_937 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1773 for ONNX tensor: 1773 [05/10/2022-20:07:09] [V] [TRT] Transpose_937 [Transpose] outputs: [1773 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: MatMul_938 [MatMul] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1770 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1773 [05/10/2022-20:07:09] [V] [TRT] MatMul_938 [MatMul] inputs: [1770 -> (-1, 4, -1, 64)[FLOAT]], [1773 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: MatMul_938 for ONNX node: MatMul_938 [05/10/2022-20:07:09] [V] [TRT] Registering tensor: 1774 for ONNX tensor: 1774 [05/10/2022-20:07:09] [V] [TRT] MatMul_938 [MatMul] outputs: [1774 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Parsing node: Add_939 [Add] [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1772 [05/10/2022-20:07:09] [V] [TRT] Searching for input: 1774 [05/10/2022-20:07:09] [V] [TRT] Add_939 [Add] inputs: [1772 -> (-1, 4, -1, -1)[FLOAT]], [1774 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:09] [V] [TRT] Registering layer: Add_939 for ONNX node: Add_939 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1775 for ONNX tensor: 1775 [05/10/2022-20:07:10] [V] [TRT] Add_939 [Add] outputs: [1775 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_940 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_940 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_940 [Constant] outputs: [1776 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Div_941 [Div] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1775 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1776 [05/10/2022-20:07:10] [V] [TRT] Div_941 [Div] inputs: [1775 -> (-1, 4, -1, -1)[FLOAT]], [1776 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1776 for ONNX node: 1776 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Div_941 for ONNX node: Div_941 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1777 for ONNX tensor: 1777 [05/10/2022-20:07:10] [V] [TRT] Div_941 [Div] outputs: [1777 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Shape_942 [Shape] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1748 [05/10/2022-20:07:10] [V] [TRT] Shape_942 [Shape] inputs: [1748 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Shape_942 for ONNX node: Shape_942 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1778 for ONNX tensor: 1778 [05/10/2022-20:07:10] [V] [TRT] Shape_942 [Shape] outputs: [1778 -> (4)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_943 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_943 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_943 [Constant] outputs: [1779 -> ()[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Gather_944 [Gather] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1778 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1779 [05/10/2022-20:07:10] [V] [TRT] Gather_944 [Gather] inputs: [1778 -> (4)[INT32]], [1779 -> ()[INT32]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1779 for ONNX node: 1779 [05/10/2022-20:07:10] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Gather_944 for ONNX node: Gather_944 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1780 for ONNX tensor: 1780 [05/10/2022-20:07:10] [V] [TRT] Gather_944 [Gather] outputs: [1780 -> ()[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_945 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_945 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_945 [Constant] outputs: [1781 -> (1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Unsqueeze_946 [Unsqueeze] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1781 [05/10/2022-20:07:10] [V] [TRT] Unsqueeze_946 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [1781 -> (1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:10] [V] [TRT] Registering layer: Unsqueeze_946 for ONNX node: Unsqueeze_946 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1782 for ONNX tensor: 1782 [05/10/2022-20:07:10] [V] [TRT] Unsqueeze_946 [Unsqueeze] outputs: [1782 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Cast_947 [Cast] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1782 [05/10/2022-20:07:10] [V] [TRT] Cast_947 [Cast] inputs: [1782 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Cast_947 for ONNX node: Cast_947 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1783 for ONNX tensor: 1783 [05/10/2022-20:07:10] [V] [TRT] Cast_947 [Cast] outputs: [1783 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_948 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_948 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_948 [Constant] outputs: [1784 -> ()[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Equal_949 [Equal] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1783 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1784 [05/10/2022-20:07:10] [V] [TRT] Equal_949 [Equal] inputs: [1783 -> (-1, 1, 1, -1)[INT32]], [1784 -> ()[INT32]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1784 for ONNX node: 1784 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Equal_949 for ONNX node: Equal_949 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1785 for ONNX tensor: 1785 [05/10/2022-20:07:10] [V] [TRT] Equal_949 [Equal] outputs: [1785 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Cast_950 [Cast] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1785 [05/10/2022-20:07:10] [V] [TRT] Cast_950 [Cast] inputs: [1785 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Casting to type: bool [05/10/2022-20:07:10] [V] [TRT] Registering layer: Cast_950 for ONNX node: Cast_950 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1786 for ONNX tensor: 1786 [05/10/2022-20:07:10] [V] [TRT] Cast_950 [Cast] outputs: [1786 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_951 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_951 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_951 [Constant] outputs: [1787 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Where_952 [Where] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1786 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1787 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1777 [05/10/2022-20:07:10] [V] [TRT] Where_952 [Where] inputs: [1786 -> (-1, 1, 1, -1)[BOOL]], [1787 -> ()[FLOAT]], [1777 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1787 for ONNX node: 1787 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Where_952 for ONNX node: Where_952 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1788 for ONNX tensor: 1788 [05/10/2022-20:07:10] [V] [TRT] Where_952 [Where] outputs: [1788 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Softmax_953 [Softmax] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1788 [05/10/2022-20:07:10] [V] [TRT] Softmax_953 [Softmax] inputs: [1788 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Softmax_953 for ONNX node: Softmax_953 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1789 for ONNX tensor: 1789 [05/10/2022-20:07:10] [V] [TRT] Softmax_953 [Softmax] outputs: [1789 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Cast_954 [Cast] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1785 [05/10/2022-20:07:10] [V] [TRT] Cast_954 [Cast] inputs: [1785 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Casting to type: bool [05/10/2022-20:07:10] [V] [TRT] Registering layer: Cast_954 for ONNX node: Cast_954 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1790 for ONNX tensor: 1790 [05/10/2022-20:07:10] [V] [TRT] Cast_954 [Cast] outputs: [1790 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_955 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_955 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_955 [Constant] outputs: [1791 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Where_956 [Where] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1790 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1791 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1789 [05/10/2022-20:07:10] [V] [TRT] Where_956 [Where] inputs: [1790 -> (-1, 1, 1, -1)[BOOL]], [1791 -> ()[FLOAT]], [1789 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1791 for ONNX node: 1791 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Where_956 for ONNX node: Where_956 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1792 for ONNX tensor: 1792 [05/10/2022-20:07:10] [V] [TRT] Where_956 [Where] outputs: [1792 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: MatMul_957 [MatMul] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1792 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1748 [05/10/2022-20:07:10] [V] [TRT] MatMul_957 [MatMul] inputs: [1792 -> (-1, 4, -1, -1)[FLOAT]], [1748 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: MatMul_957 for ONNX node: MatMul_957 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1793 for ONNX tensor: 1793 [05/10/2022-20:07:10] [V] [TRT] MatMul_957 [MatMul] outputs: [1793 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Transpose_958 [Transpose] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1793 [05/10/2022-20:07:10] [V] [TRT] Transpose_958 [Transpose] inputs: [1793 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Transpose_958 for ONNX node: Transpose_958 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1794 for ONNX tensor: 1794 [05/10/2022-20:07:10] [V] [TRT] Transpose_958 [Transpose] outputs: [1794 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_959 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_959 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_959 [Constant] outputs: [1797 -> (1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Unsqueeze_960 [Unsqueeze] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1780 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1797 [05/10/2022-20:07:10] [V] [TRT] Unsqueeze_960 [Unsqueeze] inputs: [1780 -> ()[INT32]], [1797 -> (1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:10] [V] [TRT] Registering layer: Unsqueeze_960 for ONNX node: Unsqueeze_960 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1798 for ONNX tensor: 1798 [05/10/2022-20:07:10] [V] [TRT] Unsqueeze_960 [Unsqueeze] outputs: [1798 -> (1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Concat_961 [Concat] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1798 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3334 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3335 [05/10/2022-20:07:10] [V] [TRT] Concat_961 [Concat] inputs: [1798 -> (1)[INT32]], [3334 -> (1)[INT32]], [3335 -> (1)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 3334 for ONNX node: 3334 [05/10/2022-20:07:10] [V] [TRT] Registering layer: 3335 for ONNX node: 3335 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Concat_961 for ONNX node: Concat_961 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1803 for ONNX tensor: 1803 [05/10/2022-20:07:10] [V] [TRT] Concat_961 [Concat] outputs: [1803 -> (3)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Reshape_962 [Reshape] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1794 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1803 [05/10/2022-20:07:10] [V] [TRT] Reshape_962 [Reshape] inputs: [1794 -> (-1, -1, 4, 64)[FLOAT]], [1803 -> (3)[INT32]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Reshape_962 for ONNX node: Reshape_962 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1804 for ONNX tensor: 1804 [05/10/2022-20:07:10] [V] [TRT] Reshape_962 [Reshape] outputs: [1804 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: MatMul_963 [MatMul] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1804 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3336 [05/10/2022-20:07:10] [V] [TRT] MatMul_963 [MatMul] inputs: [1804 -> (-1, -1, 256)[FLOAT]], [3336 -> (256, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 3336 for ONNX node: 3336 [05/10/2022-20:07:10] [V] [TRT] Registering layer: MatMul_963 for ONNX node: MatMul_963 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1806 for ONNX tensor: 1806 [05/10/2022-20:07:10] [V] [TRT] MatMul_963 [MatMul] outputs: [1806 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Add_964 [Add] [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.self_attn.linear_out.bias [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1806 [05/10/2022-20:07:10] [V] [TRT] Add_964 [Add] inputs: [encoder.encoders.5.self_attn.linear_out.bias -> (256)[FLOAT]], [1806 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: encoder.encoders.5.self_attn.linear_out.bias for ONNX node: encoder.encoders.5.self_attn.linear_out.bias [05/10/2022-20:07:10] [V] [TRT] Registering layer: Add_964 for ONNX node: Add_964 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1807 for ONNX tensor: 1807 [05/10/2022-20:07:10] [V] [TRT] Add_964 [Add] outputs: [1807 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Add_965 [Add] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1685 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1807 [05/10/2022-20:07:10] [V] [TRT] Add_965 [Add] inputs: [1685 -> (-1, -1, 256)[FLOAT]], [1807 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Add_965 for ONNX node: Add_965 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1808 for ONNX tensor: 1808 [05/10/2022-20:07:10] [V] [TRT] Add_965 [Add] outputs: [1808 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: ReduceMean_966 [ReduceMean] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1808 [05/10/2022-20:07:10] [V] [TRT] ReduceMean_966 [ReduceMean] inputs: [1808 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: ReduceMean_966 for ONNX node: ReduceMean_966 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1809 for ONNX tensor: 1809 [05/10/2022-20:07:10] [V] [TRT] ReduceMean_966 [ReduceMean] outputs: [1809 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Sub_967 [Sub] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1808 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1809 [05/10/2022-20:07:10] [V] [TRT] Sub_967 [Sub] inputs: [1808 -> (-1, -1, 256)[FLOAT]], [1809 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Sub_967 for ONNX node: Sub_967 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1810 for ONNX tensor: 1810 [05/10/2022-20:07:10] [V] [TRT] Sub_967 [Sub] outputs: [1810 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_968 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_968 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_968 [Constant] outputs: [1811 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Pow_969 [Pow] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1810 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1811 [05/10/2022-20:07:10] [V] [TRT] Pow_969 [Pow] inputs: [1810 -> (-1, -1, 256)[FLOAT]], [1811 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1811 for ONNX node: 1811 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Pow_969 for ONNX node: Pow_969 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1812 for ONNX tensor: 1812 [05/10/2022-20:07:10] [V] [TRT] Pow_969 [Pow] outputs: [1812 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: ReduceMean_970 [ReduceMean] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1812 [05/10/2022-20:07:10] [V] [TRT] ReduceMean_970 [ReduceMean] inputs: [1812 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: ReduceMean_970 for ONNX node: ReduceMean_970 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1813 for ONNX tensor: 1813 [05/10/2022-20:07:10] [V] [TRT] ReduceMean_970 [ReduceMean] outputs: [1813 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_971 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_971 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_971 [Constant] outputs: [1814 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Add_972 [Add] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1813 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1814 [05/10/2022-20:07:10] [V] [TRT] Add_972 [Add] inputs: [1813 -> (-1, -1, 1)[FLOAT]], [1814 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1814 for ONNX node: 1814 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Add_972 for ONNX node: Add_972 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1815 for ONNX tensor: 1815 [05/10/2022-20:07:10] [V] [TRT] Add_972 [Add] outputs: [1815 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Sqrt_973 [Sqrt] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1815 [05/10/2022-20:07:10] [V] [TRT] Sqrt_973 [Sqrt] inputs: [1815 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Sqrt_973 for ONNX node: Sqrt_973 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1816 for ONNX tensor: 1816 [05/10/2022-20:07:10] [V] [TRT] Sqrt_973 [Sqrt] outputs: [1816 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Div_974 [Div] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1810 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1816 [05/10/2022-20:07:10] [V] [TRT] Div_974 [Div] inputs: [1810 -> (-1, -1, 256)[FLOAT]], [1816 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Div_974 for ONNX node: Div_974 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1817 for ONNX tensor: 1817 [05/10/2022-20:07:10] [V] [TRT] Div_974 [Div] outputs: [1817 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Mul_975 [Mul] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1817 [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.norm_conv.weight [05/10/2022-20:07:10] [V] [TRT] Mul_975 [Mul] inputs: [1817 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: encoder.encoders.5.norm_conv.weight for ONNX node: encoder.encoders.5.norm_conv.weight [05/10/2022-20:07:10] [V] [TRT] Registering layer: Mul_975 for ONNX node: Mul_975 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1818 for ONNX tensor: 1818 [05/10/2022-20:07:10] [V] [TRT] Mul_975 [Mul] outputs: [1818 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Add_976 [Add] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1818 [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.norm_conv.bias [05/10/2022-20:07:10] [V] [TRT] Add_976 [Add] inputs: [1818 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: encoder.encoders.5.norm_conv.bias for ONNX node: encoder.encoders.5.norm_conv.bias [05/10/2022-20:07:10] [V] [TRT] Registering layer: Add_976 for ONNX node: Add_976 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1819 for ONNX tensor: 1819 [05/10/2022-20:07:10] [V] [TRT] Add_976 [Add] outputs: [1819 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Transpose_977 [Transpose] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1819 [05/10/2022-20:07:10] [V] [TRT] Transpose_977 [Transpose] inputs: [1819 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Transpose_977 for ONNX node: Transpose_977 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1820 for ONNX tensor: 1820 [05/10/2022-20:07:10] [V] [TRT] Transpose_977 [Transpose] outputs: [1820 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Not_978 [Not] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:10] [V] [TRT] Not_978 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Not_978 for ONNX node: Not_978 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1821 for ONNX tensor: 1821 [05/10/2022-20:07:10] [V] [TRT] Not_978 [Not] outputs: [1821 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Cast_979 [Cast] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1821 [05/10/2022-20:07:10] [V] [TRT] Cast_979 [Cast] inputs: [1821 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Casting to type: bool [05/10/2022-20:07:10] [V] [TRT] Registering layer: Cast_979 for ONNX node: Cast_979 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1822 for ONNX tensor: 1822 [05/10/2022-20:07:10] [V] [TRT] Cast_979 [Cast] outputs: [1822 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Constant_980 [Constant] [05/10/2022-20:07:10] [V] [TRT] Constant_980 [Constant] inputs: [05/10/2022-20:07:10] [V] [TRT] Constant_980 [Constant] outputs: [1823 -> ()[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Where_981 [Where] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1822 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1823 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1820 [05/10/2022-20:07:10] [V] [TRT] Where_981 [Where] inputs: [1822 -> (-1, 1, -1)[BOOL]], [1823 -> ()[FLOAT]], [1820 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: 1823 for ONNX node: 1823 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Where_981 for ONNX node: Where_981 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1824 for ONNX tensor: 1824 [05/10/2022-20:07:10] [V] [TRT] Where_981 [Where] outputs: [1824 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Conv_982 [Conv] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1824 [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.conv_module.pointwise_conv1.weight [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.conv_module.pointwise_conv1.bias [05/10/2022-20:07:10] [V] [TRT] Conv_982 [Conv] inputs: [1824 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.5.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.5.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:10] [V] [TRT] Registering layer: Conv_982 for ONNX node: Conv_982 [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:10] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:10] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1825 for ONNX tensor: 1825 [05/10/2022-20:07:10] [V] [TRT] Conv_982 [Conv] outputs: [1825 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Split_983 [Split] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1825 [05/10/2022-20:07:10] [V] [TRT] Split_983 [Split] inputs: [1825 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Split_983 for ONNX node: Split_983 [05/10/2022-20:07:10] [V] [TRT] Registering layer: Split_983_7 for ONNX node: Split_983 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1826 for ONNX tensor: 1826 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1827 for ONNX tensor: 1827 [05/10/2022-20:07:10] [V] [TRT] Split_983 [Split] outputs: [1826 -> (-1, 256, -1)[FLOAT]], [1827 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Sigmoid_984 [Sigmoid] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1827 [05/10/2022-20:07:10] [V] [TRT] Sigmoid_984 [Sigmoid] inputs: [1827 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Sigmoid_984 for ONNX node: Sigmoid_984 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1828 for ONNX tensor: 1828 [05/10/2022-20:07:10] [V] [TRT] Sigmoid_984 [Sigmoid] outputs: [1828 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Mul_985 [Mul] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1826 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1828 [05/10/2022-20:07:10] [V] [TRT] Mul_985 [Mul] inputs: [1826 -> (-1, 256, -1)[FLOAT]], [1828 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Mul_985 for ONNX node: Mul_985 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1829 for ONNX tensor: 1829 [05/10/2022-20:07:10] [V] [TRT] Mul_985 [Mul] outputs: [1829 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Conv_986 [Conv] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1829 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3176 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3177 [05/10/2022-20:07:10] [V] [TRT] Conv_986 [Conv] inputs: [1829 -> (-1, 256, -1)[FLOAT]], [3176 -> (256, 1, 15)[FLOAT]], [3177 -> (256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:10] [V] [TRT] Registering layer: Conv_986 for ONNX node: Conv_986 [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:10] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:10] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 3175 for ONNX tensor: 3175 [05/10/2022-20:07:10] [V] [TRT] Conv_986 [Conv] outputs: [3175 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Sigmoid_987 [Sigmoid] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3175 [05/10/2022-20:07:10] [V] [TRT] Sigmoid_987 [Sigmoid] inputs: [3175 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Sigmoid_987 for ONNX node: Sigmoid_987 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1832 for ONNX tensor: 1832 [05/10/2022-20:07:10] [V] [TRT] Sigmoid_987 [Sigmoid] outputs: [1832 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Mul_988 [Mul] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 3175 [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1832 [05/10/2022-20:07:10] [V] [TRT] Mul_988 [Mul] inputs: [3175 -> (-1, 256, -1)[FLOAT]], [1832 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Mul_988 for ONNX node: Mul_988 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1833 for ONNX tensor: 1833 [05/10/2022-20:07:10] [V] [TRT] Mul_988 [Mul] outputs: [1833 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Not_989 [Not] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:10] [V] [TRT] Not_989 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Registering layer: Not_989 for ONNX node: Not_989 [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1834 for ONNX tensor: 1834 [05/10/2022-20:07:10] [V] [TRT] Not_989 [Not] outputs: [1834 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Conv_990 [Conv] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1833 [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.conv_module.pointwise_conv2.weight [05/10/2022-20:07:10] [V] [TRT] Searching for input: encoder.encoders.5.conv_module.pointwise_conv2.bias [05/10/2022-20:07:10] [V] [TRT] Conv_990 [Conv] inputs: [1833 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.5.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.5.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:10] [V] [TRT] Registering layer: Conv_990 for ONNX node: Conv_990 [05/10/2022-20:07:10] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:10] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:10] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:10] [V] [TRT] Registering tensor: 1835 for ONNX tensor: 1835 [05/10/2022-20:07:10] [V] [TRT] Conv_990 [Conv] outputs: [1835 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:10] [V] [TRT] Parsing node: Cast_991 [Cast] [05/10/2022-20:07:10] [V] [TRT] Searching for input: 1834 [05/10/2022-20:07:10] [V] [TRT] Cast_991 [Cast] inputs: [1834 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:10] [V] [TRT] Casting to type: bool [05/10/2022-20:07:10] [V] [TRT] Registering layer: Cast_991 for ONNX node: Cast_991 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1836 for ONNX tensor: 1836 [05/10/2022-20:07:11] [V] [TRT] Cast_991 [Cast] outputs: [1836 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_992 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_992 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_992 [Constant] outputs: [1837 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Where_993 [Where] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1836 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1837 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1835 [05/10/2022-20:07:11] [V] [TRT] Where_993 [Where] inputs: [1836 -> (-1, 1, -1)[BOOL]], [1837 -> ()[FLOAT]], [1835 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1837 for ONNX node: 1837 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Where_993 for ONNX node: Where_993 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1838 for ONNX tensor: 1838 [05/10/2022-20:07:11] [V] [TRT] Where_993 [Where] outputs: [1838 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Transpose_994 [Transpose] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1838 [05/10/2022-20:07:11] [V] [TRT] Transpose_994 [Transpose] inputs: [1838 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Transpose_994 for ONNX node: Transpose_994 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1839 for ONNX tensor: 1839 [05/10/2022-20:07:11] [V] [TRT] Transpose_994 [Transpose] outputs: [1839 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_995 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1808 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1839 [05/10/2022-20:07:11] [V] [TRT] Add_995 [Add] inputs: [1808 -> (-1, -1, 256)[FLOAT]], [1839 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_995 for ONNX node: Add_995 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1840 for ONNX tensor: 1840 [05/10/2022-20:07:11] [V] [TRT] Add_995 [Add] outputs: [1840 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: ReduceMean_996 [ReduceMean] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1840 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_996 [ReduceMean] inputs: [1840 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: ReduceMean_996 for ONNX node: ReduceMean_996 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1841 for ONNX tensor: 1841 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_996 [ReduceMean] outputs: [1841 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sub_997 [Sub] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1840 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1841 [05/10/2022-20:07:11] [V] [TRT] Sub_997 [Sub] inputs: [1840 -> (-1, -1, 256)[FLOAT]], [1841 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sub_997 for ONNX node: Sub_997 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1842 for ONNX tensor: 1842 [05/10/2022-20:07:11] [V] [TRT] Sub_997 [Sub] outputs: [1842 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_998 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_998 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_998 [Constant] outputs: [1843 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Pow_999 [Pow] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1842 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1843 [05/10/2022-20:07:11] [V] [TRT] Pow_999 [Pow] inputs: [1842 -> (-1, -1, 256)[FLOAT]], [1843 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1843 for ONNX node: 1843 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Pow_999 for ONNX node: Pow_999 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1844 for ONNX tensor: 1844 [05/10/2022-20:07:11] [V] [TRT] Pow_999 [Pow] outputs: [1844 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: ReduceMean_1000 [ReduceMean] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1844 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1000 [ReduceMean] inputs: [1844 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: ReduceMean_1000 for ONNX node: ReduceMean_1000 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1845 for ONNX tensor: 1845 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1000 [ReduceMean] outputs: [1845 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_1001 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_1001 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_1001 [Constant] outputs: [1846 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1002 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1845 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1846 [05/10/2022-20:07:11] [V] [TRT] Add_1002 [Add] inputs: [1845 -> (-1, -1, 1)[FLOAT]], [1846 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1846 for ONNX node: 1846 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1002 for ONNX node: Add_1002 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1847 for ONNX tensor: 1847 [05/10/2022-20:07:11] [V] [TRT] Add_1002 [Add] outputs: [1847 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sqrt_1003 [Sqrt] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1847 [05/10/2022-20:07:11] [V] [TRT] Sqrt_1003 [Sqrt] inputs: [1847 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sqrt_1003 for ONNX node: Sqrt_1003 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1848 for ONNX tensor: 1848 [05/10/2022-20:07:11] [V] [TRT] Sqrt_1003 [Sqrt] outputs: [1848 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Div_1004 [Div] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1842 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1848 [05/10/2022-20:07:11] [V] [TRT] Div_1004 [Div] inputs: [1842 -> (-1, -1, 256)[FLOAT]], [1848 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Div_1004 for ONNX node: Div_1004 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1849 for ONNX tensor: 1849 [05/10/2022-20:07:11] [V] [TRT] Div_1004 [Div] outputs: [1849 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Mul_1005 [Mul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1849 [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.5.norm_ff.weight [05/10/2022-20:07:11] [V] [TRT] Mul_1005 [Mul] inputs: [1849 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.5.norm_ff.weight for ONNX node: encoder.encoders.5.norm_ff.weight [05/10/2022-20:07:11] [V] [TRT] Registering layer: Mul_1005 for ONNX node: Mul_1005 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1850 for ONNX tensor: 1850 [05/10/2022-20:07:11] [V] [TRT] Mul_1005 [Mul] outputs: [1850 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1006 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1850 [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.5.norm_ff.bias [05/10/2022-20:07:11] [V] [TRT] Add_1006 [Add] inputs: [1850 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.5.norm_ff.bias for ONNX node: encoder.encoders.5.norm_ff.bias [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1006 for ONNX node: Add_1006 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1851 for ONNX tensor: 1851 [05/10/2022-20:07:11] [V] [TRT] Add_1006 [Add] outputs: [1851 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: MatMul_1007 [MatMul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1851 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 3337 [05/10/2022-20:07:11] [V] [TRT] MatMul_1007 [MatMul] inputs: [1851 -> (-1, -1, 256)[FLOAT]], [3337 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 3337 for ONNX node: 3337 [05/10/2022-20:07:11] [V] [TRT] Registering layer: MatMul_1007 for ONNX node: MatMul_1007 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1853 for ONNX tensor: 1853 [05/10/2022-20:07:11] [V] [TRT] MatMul_1007 [MatMul] outputs: [1853 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1008 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.5.feed_forward.w_1.bias [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1853 [05/10/2022-20:07:11] [V] [TRT] Add_1008 [Add] inputs: [encoder.encoders.5.feed_forward.w_1.bias -> (2048)[FLOAT]], [1853 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.5.feed_forward.w_1.bias for ONNX node: encoder.encoders.5.feed_forward.w_1.bias [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1008 for ONNX node: Add_1008 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1854 for ONNX tensor: 1854 [05/10/2022-20:07:11] [V] [TRT] Add_1008 [Add] outputs: [1854 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sigmoid_1009 [Sigmoid] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1854 [05/10/2022-20:07:11] [V] [TRT] Sigmoid_1009 [Sigmoid] inputs: [1854 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sigmoid_1009 for ONNX node: Sigmoid_1009 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1855 for ONNX tensor: 1855 [05/10/2022-20:07:11] [V] [TRT] Sigmoid_1009 [Sigmoid] outputs: [1855 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Mul_1010 [Mul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1854 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1855 [05/10/2022-20:07:11] [V] [TRT] Mul_1010 [Mul] inputs: [1854 -> (-1, -1, 2048)[FLOAT]], [1855 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Mul_1010 for ONNX node: Mul_1010 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1856 for ONNX tensor: 1856 [05/10/2022-20:07:11] [V] [TRT] Mul_1010 [Mul] outputs: [1856 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: MatMul_1011 [MatMul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1856 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 3338 [05/10/2022-20:07:11] [V] [TRT] MatMul_1011 [MatMul] inputs: [1856 -> (-1, -1, 2048)[FLOAT]], [3338 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 3338 for ONNX node: 3338 [05/10/2022-20:07:11] [V] [TRT] Registering layer: MatMul_1011 for ONNX node: MatMul_1011 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1858 for ONNX tensor: 1858 [05/10/2022-20:07:11] [V] [TRT] MatMul_1011 [MatMul] outputs: [1858 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1012 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.5.feed_forward.w_2.bias [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1858 [05/10/2022-20:07:11] [V] [TRT] Add_1012 [Add] inputs: [encoder.encoders.5.feed_forward.w_2.bias -> (256)[FLOAT]], [1858 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.5.feed_forward.w_2.bias for ONNX node: encoder.encoders.5.feed_forward.w_2.bias [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1012 for ONNX node: Add_1012 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1859 for ONNX tensor: 1859 [05/10/2022-20:07:11] [V] [TRT] Add_1012 [Add] outputs: [1859 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_1013 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_1013 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_1013 [Constant] outputs: [1860 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Mul_1014 [Mul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1859 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1860 [05/10/2022-20:07:11] [V] [TRT] Mul_1014 [Mul] inputs: [1859 -> (-1, -1, 256)[FLOAT]], [1860 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1860 for ONNX node: 1860 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Mul_1014 for ONNX node: Mul_1014 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1861 for ONNX tensor: 1861 [05/10/2022-20:07:11] [V] [TRT] Mul_1014 [Mul] outputs: [1861 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1015 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1840 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1861 [05/10/2022-20:07:11] [V] [TRT] Add_1015 [Add] inputs: [1840 -> (-1, -1, 256)[FLOAT]], [1861 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1015 for ONNX node: Add_1015 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1862 for ONNX tensor: 1862 [05/10/2022-20:07:11] [V] [TRT] Add_1015 [Add] outputs: [1862 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: ReduceMean_1016 [ReduceMean] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1862 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1016 [ReduceMean] inputs: [1862 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: ReduceMean_1016 for ONNX node: ReduceMean_1016 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1863 for ONNX tensor: 1863 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1016 [ReduceMean] outputs: [1863 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sub_1017 [Sub] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1862 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1863 [05/10/2022-20:07:11] [V] [TRT] Sub_1017 [Sub] inputs: [1862 -> (-1, -1, 256)[FLOAT]], [1863 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sub_1017 for ONNX node: Sub_1017 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1864 for ONNX tensor: 1864 [05/10/2022-20:07:11] [V] [TRT] Sub_1017 [Sub] outputs: [1864 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_1018 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_1018 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_1018 [Constant] outputs: [1865 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Pow_1019 [Pow] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1864 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1865 [05/10/2022-20:07:11] [V] [TRT] Pow_1019 [Pow] inputs: [1864 -> (-1, -1, 256)[FLOAT]], [1865 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1865 for ONNX node: 1865 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Pow_1019 for ONNX node: Pow_1019 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1866 for ONNX tensor: 1866 [05/10/2022-20:07:11] [V] [TRT] Pow_1019 [Pow] outputs: [1866 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: ReduceMean_1020 [ReduceMean] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1866 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1020 [ReduceMean] inputs: [1866 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: ReduceMean_1020 for ONNX node: ReduceMean_1020 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1867 for ONNX tensor: 1867 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1020 [ReduceMean] outputs: [1867 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_1021 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_1021 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_1021 [Constant] outputs: [1868 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1022 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1867 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1868 [05/10/2022-20:07:11] [V] [TRT] Add_1022 [Add] inputs: [1867 -> (-1, -1, 1)[FLOAT]], [1868 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1868 for ONNX node: 1868 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1022 for ONNX node: Add_1022 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1869 for ONNX tensor: 1869 [05/10/2022-20:07:11] [V] [TRT] Add_1022 [Add] outputs: [1869 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sqrt_1023 [Sqrt] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1869 [05/10/2022-20:07:11] [V] [TRT] Sqrt_1023 [Sqrt] inputs: [1869 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sqrt_1023 for ONNX node: Sqrt_1023 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1870 for ONNX tensor: 1870 [05/10/2022-20:07:11] [V] [TRT] Sqrt_1023 [Sqrt] outputs: [1870 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Div_1024 [Div] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1864 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1870 [05/10/2022-20:07:11] [V] [TRT] Div_1024 [Div] inputs: [1864 -> (-1, -1, 256)[FLOAT]], [1870 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Div_1024 for ONNX node: Div_1024 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1871 for ONNX tensor: 1871 [05/10/2022-20:07:11] [V] [TRT] Div_1024 [Div] outputs: [1871 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Mul_1025 [Mul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1871 [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.5.norm_final.weight [05/10/2022-20:07:11] [V] [TRT] Mul_1025 [Mul] inputs: [1871 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.5.norm_final.weight for ONNX node: encoder.encoders.5.norm_final.weight [05/10/2022-20:07:11] [V] [TRT] Registering layer: Mul_1025 for ONNX node: Mul_1025 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1872 for ONNX tensor: 1872 [05/10/2022-20:07:11] [V] [TRT] Mul_1025 [Mul] outputs: [1872 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1026 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1872 [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.5.norm_final.bias [05/10/2022-20:07:11] [V] [TRT] Add_1026 [Add] inputs: [1872 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.5.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.5.norm_final.bias for ONNX node: encoder.encoders.5.norm_final.bias [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1026 for ONNX node: Add_1026 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1873 for ONNX tensor: 1873 [05/10/2022-20:07:11] [V] [TRT] Add_1026 [Add] outputs: [1873 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: ReduceMean_1027 [ReduceMean] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1873 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1027 [ReduceMean] inputs: [1873 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: ReduceMean_1027 for ONNX node: ReduceMean_1027 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1874 for ONNX tensor: 1874 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1027 [ReduceMean] outputs: [1874 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sub_1028 [Sub] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1873 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1874 [05/10/2022-20:07:11] [V] [TRT] Sub_1028 [Sub] inputs: [1873 -> (-1, -1, 256)[FLOAT]], [1874 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sub_1028 for ONNX node: Sub_1028 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1875 for ONNX tensor: 1875 [05/10/2022-20:07:11] [V] [TRT] Sub_1028 [Sub] outputs: [1875 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_1029 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_1029 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_1029 [Constant] outputs: [1876 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Pow_1030 [Pow] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1875 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1876 [05/10/2022-20:07:11] [V] [TRT] Pow_1030 [Pow] inputs: [1875 -> (-1, -1, 256)[FLOAT]], [1876 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1876 for ONNX node: 1876 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Pow_1030 for ONNX node: Pow_1030 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1877 for ONNX tensor: 1877 [05/10/2022-20:07:11] [V] [TRT] Pow_1030 [Pow] outputs: [1877 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: ReduceMean_1031 [ReduceMean] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1877 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1031 [ReduceMean] inputs: [1877 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: ReduceMean_1031 for ONNX node: ReduceMean_1031 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1878 for ONNX tensor: 1878 [05/10/2022-20:07:11] [V] [TRT] ReduceMean_1031 [ReduceMean] outputs: [1878 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Constant_1032 [Constant] [05/10/2022-20:07:11] [V] [TRT] Constant_1032 [Constant] inputs: [05/10/2022-20:07:11] [V] [TRT] Constant_1032 [Constant] outputs: [1879 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1033 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1878 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1879 [05/10/2022-20:07:11] [V] [TRT] Add_1033 [Add] inputs: [1878 -> (-1, -1, 1)[FLOAT]], [1879 -> ()[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 1879 for ONNX node: 1879 [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1033 for ONNX node: Add_1033 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1880 for ONNX tensor: 1880 [05/10/2022-20:07:11] [V] [TRT] Add_1033 [Add] outputs: [1880 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sqrt_1034 [Sqrt] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1880 [05/10/2022-20:07:11] [V] [TRT] Sqrt_1034 [Sqrt] inputs: [1880 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sqrt_1034 for ONNX node: Sqrt_1034 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1881 for ONNX tensor: 1881 [05/10/2022-20:07:11] [V] [TRT] Sqrt_1034 [Sqrt] outputs: [1881 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Div_1035 [Div] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1875 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1881 [05/10/2022-20:07:11] [V] [TRT] Div_1035 [Div] inputs: [1875 -> (-1, -1, 256)[FLOAT]], [1881 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Div_1035 for ONNX node: Div_1035 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1882 for ONNX tensor: 1882 [05/10/2022-20:07:11] [V] [TRT] Div_1035 [Div] outputs: [1882 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Mul_1036 [Mul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1882 [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.6.norm_ff_macaron.weight [05/10/2022-20:07:11] [V] [TRT] Mul_1036 [Mul] inputs: [1882 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.6.norm_ff_macaron.weight for ONNX node: encoder.encoders.6.norm_ff_macaron.weight [05/10/2022-20:07:11] [V] [TRT] Registering layer: Mul_1036 for ONNX node: Mul_1036 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1883 for ONNX tensor: 1883 [05/10/2022-20:07:11] [V] [TRT] Mul_1036 [Mul] outputs: [1883 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1037 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1883 [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.6.norm_ff_macaron.bias [05/10/2022-20:07:11] [V] [TRT] Add_1037 [Add] inputs: [1883 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.6.norm_ff_macaron.bias for ONNX node: encoder.encoders.6.norm_ff_macaron.bias [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1037 for ONNX node: Add_1037 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1884 for ONNX tensor: 1884 [05/10/2022-20:07:11] [V] [TRT] Add_1037 [Add] outputs: [1884 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: MatMul_1038 [MatMul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1884 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 3339 [05/10/2022-20:07:11] [V] [TRT] MatMul_1038 [MatMul] inputs: [1884 -> (-1, -1, 256)[FLOAT]], [3339 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 3339 for ONNX node: 3339 [05/10/2022-20:07:11] [V] [TRT] Registering layer: MatMul_1038 for ONNX node: MatMul_1038 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1886 for ONNX tensor: 1886 [05/10/2022-20:07:11] [V] [TRT] MatMul_1038 [MatMul] outputs: [1886 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1039 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.6.feed_forward_macaron.w_1.bias [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1886 [05/10/2022-20:07:11] [V] [TRT] Add_1039 [Add] inputs: [encoder.encoders.6.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [1886 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.6.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.6.feed_forward_macaron.w_1.bias [05/10/2022-20:07:11] [V] [TRT] Registering layer: Add_1039 for ONNX node: Add_1039 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1887 for ONNX tensor: 1887 [05/10/2022-20:07:11] [V] [TRT] Add_1039 [Add] outputs: [1887 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Sigmoid_1040 [Sigmoid] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1887 [05/10/2022-20:07:11] [V] [TRT] Sigmoid_1040 [Sigmoid] inputs: [1887 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Sigmoid_1040 for ONNX node: Sigmoid_1040 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1888 for ONNX tensor: 1888 [05/10/2022-20:07:11] [V] [TRT] Sigmoid_1040 [Sigmoid] outputs: [1888 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Mul_1041 [Mul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1887 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1888 [05/10/2022-20:07:11] [V] [TRT] Mul_1041 [Mul] inputs: [1887 -> (-1, -1, 2048)[FLOAT]], [1888 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: Mul_1041 for ONNX node: Mul_1041 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1889 for ONNX tensor: 1889 [05/10/2022-20:07:11] [V] [TRT] Mul_1041 [Mul] outputs: [1889 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: MatMul_1042 [MatMul] [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1889 [05/10/2022-20:07:11] [V] [TRT] Searching for input: 3340 [05/10/2022-20:07:11] [V] [TRT] MatMul_1042 [MatMul] inputs: [1889 -> (-1, -1, 2048)[FLOAT]], [3340 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: 3340 for ONNX node: 3340 [05/10/2022-20:07:11] [V] [TRT] Registering layer: MatMul_1042 for ONNX node: MatMul_1042 [05/10/2022-20:07:11] [V] [TRT] Registering tensor: 1891 for ONNX tensor: 1891 [05/10/2022-20:07:11] [V] [TRT] MatMul_1042 [MatMul] outputs: [1891 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Parsing node: Add_1043 [Add] [05/10/2022-20:07:11] [V] [TRT] Searching for input: encoder.encoders.6.feed_forward_macaron.w_2.bias [05/10/2022-20:07:11] [V] [TRT] Searching for input: 1891 [05/10/2022-20:07:11] [V] [TRT] Add_1043 [Add] inputs: [encoder.encoders.6.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [1891 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:11] [V] [TRT] Registering layer: encoder.encoders.6.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.6.feed_forward_macaron.w_2.bias [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1043 for ONNX node: Add_1043 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1892 for ONNX tensor: 1892 [05/10/2022-20:07:12] [V] [TRT] Add_1043 [Add] outputs: [1892 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1044 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1044 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1044 [Constant] outputs: [1893 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Mul_1045 [Mul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1892 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1893 [05/10/2022-20:07:12] [V] [TRT] Mul_1045 [Mul] inputs: [1892 -> (-1, -1, 256)[FLOAT]], [1893 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 1893 for ONNX node: 1893 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Mul_1045 for ONNX node: Mul_1045 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1894 for ONNX tensor: 1894 [05/10/2022-20:07:12] [V] [TRT] Mul_1045 [Mul] outputs: [1894 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1046 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1873 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1894 [05/10/2022-20:07:12] [V] [TRT] Add_1046 [Add] inputs: [1873 -> (-1, -1, 256)[FLOAT]], [1894 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1046 for ONNX node: Add_1046 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1895 for ONNX tensor: 1895 [05/10/2022-20:07:12] [V] [TRT] Add_1046 [Add] outputs: [1895 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: ReduceMean_1047 [ReduceMean] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1895 [05/10/2022-20:07:12] [V] [TRT] ReduceMean_1047 [ReduceMean] inputs: [1895 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: ReduceMean_1047 for ONNX node: ReduceMean_1047 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1896 for ONNX tensor: 1896 [05/10/2022-20:07:12] [V] [TRT] ReduceMean_1047 [ReduceMean] outputs: [1896 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Sub_1048 [Sub] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1895 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1896 [05/10/2022-20:07:12] [V] [TRT] Sub_1048 [Sub] inputs: [1895 -> (-1, -1, 256)[FLOAT]], [1896 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Sub_1048 for ONNX node: Sub_1048 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1897 for ONNX tensor: 1897 [05/10/2022-20:07:12] [V] [TRT] Sub_1048 [Sub] outputs: [1897 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1049 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1049 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1049 [Constant] outputs: [1898 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Pow_1050 [Pow] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1897 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1898 [05/10/2022-20:07:12] [V] [TRT] Pow_1050 [Pow] inputs: [1897 -> (-1, -1, 256)[FLOAT]], [1898 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 1898 for ONNX node: 1898 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Pow_1050 for ONNX node: Pow_1050 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1899 for ONNX tensor: 1899 [05/10/2022-20:07:12] [V] [TRT] Pow_1050 [Pow] outputs: [1899 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: ReduceMean_1051 [ReduceMean] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1899 [05/10/2022-20:07:12] [V] [TRT] ReduceMean_1051 [ReduceMean] inputs: [1899 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: ReduceMean_1051 for ONNX node: ReduceMean_1051 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1900 for ONNX tensor: 1900 [05/10/2022-20:07:12] [V] [TRT] ReduceMean_1051 [ReduceMean] outputs: [1900 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1052 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1052 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1052 [Constant] outputs: [1901 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1053 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1900 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1901 [05/10/2022-20:07:12] [V] [TRT] Add_1053 [Add] inputs: [1900 -> (-1, -1, 1)[FLOAT]], [1901 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 1901 for ONNX node: 1901 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1053 for ONNX node: Add_1053 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1902 for ONNX tensor: 1902 [05/10/2022-20:07:12] [V] [TRT] Add_1053 [Add] outputs: [1902 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Sqrt_1054 [Sqrt] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1902 [05/10/2022-20:07:12] [V] [TRT] Sqrt_1054 [Sqrt] inputs: [1902 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Sqrt_1054 for ONNX node: Sqrt_1054 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1903 for ONNX tensor: 1903 [05/10/2022-20:07:12] [V] [TRT] Sqrt_1054 [Sqrt] outputs: [1903 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Div_1055 [Div] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1897 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1903 [05/10/2022-20:07:12] [V] [TRT] Div_1055 [Div] inputs: [1897 -> (-1, -1, 256)[FLOAT]], [1903 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Div_1055 for ONNX node: Div_1055 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1904 for ONNX tensor: 1904 [05/10/2022-20:07:12] [V] [TRT] Div_1055 [Div] outputs: [1904 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Mul_1056 [Mul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1904 [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.norm_mha.weight [05/10/2022-20:07:12] [V] [TRT] Mul_1056 [Mul] inputs: [1904 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.norm_mha.weight for ONNX node: encoder.encoders.6.norm_mha.weight [05/10/2022-20:07:12] [V] [TRT] Registering layer: Mul_1056 for ONNX node: Mul_1056 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1905 for ONNX tensor: 1905 [05/10/2022-20:07:12] [V] [TRT] Mul_1056 [Mul] outputs: [1905 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1057 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1905 [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.norm_mha.bias [05/10/2022-20:07:12] [V] [TRT] Add_1057 [Add] inputs: [1905 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.norm_mha.bias for ONNX node: encoder.encoders.6.norm_mha.bias [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1057 for ONNX node: Add_1057 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1906 for ONNX tensor: 1906 [05/10/2022-20:07:12] [V] [TRT] Add_1057 [Add] outputs: [1906 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Shape_1058 [Shape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1906 [05/10/2022-20:07:12] [V] [TRT] Shape_1058 [Shape] inputs: [1906 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Shape_1058 for ONNX node: Shape_1058 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1907 for ONNX tensor: 1907 [05/10/2022-20:07:12] [V] [TRT] Shape_1058 [Shape] outputs: [1907 -> (3)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1059 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1059 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1059 [Constant] outputs: [1908 -> ()[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Gather_1060 [Gather] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1907 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1908 [05/10/2022-20:07:12] [V] [TRT] Gather_1060 [Gather] inputs: [1907 -> (3)[INT32]], [1908 -> ()[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 1908 for ONNX node: 1908 [05/10/2022-20:07:12] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Gather_1060 for ONNX node: Gather_1060 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1909 for ONNX tensor: 1909 [05/10/2022-20:07:12] [V] [TRT] Gather_1060 [Gather] outputs: [1909 -> ()[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: MatMul_1061 [MatMul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1906 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3341 [05/10/2022-20:07:12] [V] [TRT] MatMul_1061 [MatMul] inputs: [1906 -> (-1, -1, 256)[FLOAT]], [3341 -> (256, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3341 for ONNX node: 3341 [05/10/2022-20:07:12] [V] [TRT] Registering layer: MatMul_1061 for ONNX node: MatMul_1061 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1911 for ONNX tensor: 1911 [05/10/2022-20:07:12] [V] [TRT] MatMul_1061 [MatMul] outputs: [1911 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1062 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.self_attn.linear_q.bias [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1911 [05/10/2022-20:07:12] [V] [TRT] Add_1062 [Add] inputs: [encoder.encoders.6.self_attn.linear_q.bias -> (256)[FLOAT]], [1911 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.self_attn.linear_q.bias for ONNX node: encoder.encoders.6.self_attn.linear_q.bias [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1062 for ONNX node: Add_1062 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1912 for ONNX tensor: 1912 [05/10/2022-20:07:12] [V] [TRT] Add_1062 [Add] outputs: [1912 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1063 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1063 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1063 [Constant] outputs: [1916 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Unsqueeze_1064 [Unsqueeze] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1909 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1916 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1064 [Unsqueeze] inputs: [1909 -> ()[INT32]], [1916 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:12] [V] [TRT] Registering layer: Unsqueeze_1064 for ONNX node: Unsqueeze_1064 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1917 for ONNX tensor: 1917 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1064 [Unsqueeze] outputs: [1917 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Concat_1065 [Concat] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1917 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3342 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3343 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3344 [05/10/2022-20:07:12] [V] [TRT] Concat_1065 [Concat] inputs: [1917 -> (1)[INT32]], [3342 -> (1)[INT32]], [3343 -> (1)[INT32]], [3344 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3342 for ONNX node: 3342 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3343 for ONNX node: 3343 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3344 for ONNX node: 3344 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Concat_1065 for ONNX node: Concat_1065 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1924 for ONNX tensor: 1924 [05/10/2022-20:07:12] [V] [TRT] Concat_1065 [Concat] outputs: [1924 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Reshape_1066 [Reshape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1912 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1924 [05/10/2022-20:07:12] [V] [TRT] Reshape_1066 [Reshape] inputs: [1912 -> (-1, -1, 256)[FLOAT]], [1924 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Reshape_1066 for ONNX node: Reshape_1066 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1925 for ONNX tensor: 1925 [05/10/2022-20:07:12] [V] [TRT] Reshape_1066 [Reshape] outputs: [1925 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: MatMul_1067 [MatMul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1906 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3345 [05/10/2022-20:07:12] [V] [TRT] MatMul_1067 [MatMul] inputs: [1906 -> (-1, -1, 256)[FLOAT]], [3345 -> (256, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3345 for ONNX node: 3345 [05/10/2022-20:07:12] [V] [TRT] Registering layer: MatMul_1067 for ONNX node: MatMul_1067 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1927 for ONNX tensor: 1927 [05/10/2022-20:07:12] [V] [TRT] MatMul_1067 [MatMul] outputs: [1927 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1068 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.self_attn.linear_k.bias [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1927 [05/10/2022-20:07:12] [V] [TRT] Add_1068 [Add] inputs: [encoder.encoders.6.self_attn.linear_k.bias -> (256)[FLOAT]], [1927 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.self_attn.linear_k.bias for ONNX node: encoder.encoders.6.self_attn.linear_k.bias [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1068 for ONNX node: Add_1068 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1928 for ONNX tensor: 1928 [05/10/2022-20:07:12] [V] [TRT] Add_1068 [Add] outputs: [1928 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1069 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1069 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1069 [Constant] outputs: [1932 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Unsqueeze_1070 [Unsqueeze] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1909 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1932 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1070 [Unsqueeze] inputs: [1909 -> ()[INT32]], [1932 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:12] [V] [TRT] Registering layer: Unsqueeze_1070 for ONNX node: Unsqueeze_1070 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1933 for ONNX tensor: 1933 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1070 [Unsqueeze] outputs: [1933 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Concat_1071 [Concat] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1933 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3346 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3347 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3348 [05/10/2022-20:07:12] [V] [TRT] Concat_1071 [Concat] inputs: [1933 -> (1)[INT32]], [3346 -> (1)[INT32]], [3347 -> (1)[INT32]], [3348 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3346 for ONNX node: 3346 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3347 for ONNX node: 3347 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3348 for ONNX node: 3348 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Concat_1071 for ONNX node: Concat_1071 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1940 for ONNX tensor: 1940 [05/10/2022-20:07:12] [V] [TRT] Concat_1071 [Concat] outputs: [1940 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Reshape_1072 [Reshape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1928 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1940 [05/10/2022-20:07:12] [V] [TRT] Reshape_1072 [Reshape] inputs: [1928 -> (-1, -1, 256)[FLOAT]], [1940 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Reshape_1072 for ONNX node: Reshape_1072 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1941 for ONNX tensor: 1941 [05/10/2022-20:07:12] [V] [TRT] Reshape_1072 [Reshape] outputs: [1941 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: MatMul_1073 [MatMul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1906 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3349 [05/10/2022-20:07:12] [V] [TRT] MatMul_1073 [MatMul] inputs: [1906 -> (-1, -1, 256)[FLOAT]], [3349 -> (256, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3349 for ONNX node: 3349 [05/10/2022-20:07:12] [V] [TRT] Registering layer: MatMul_1073 for ONNX node: MatMul_1073 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1943 for ONNX tensor: 1943 [05/10/2022-20:07:12] [V] [TRT] MatMul_1073 [MatMul] outputs: [1943 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1074 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.self_attn.linear_v.bias [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1943 [05/10/2022-20:07:12] [V] [TRT] Add_1074 [Add] inputs: [encoder.encoders.6.self_attn.linear_v.bias -> (256)[FLOAT]], [1943 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.self_attn.linear_v.bias for ONNX node: encoder.encoders.6.self_attn.linear_v.bias [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1074 for ONNX node: Add_1074 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1944 for ONNX tensor: 1944 [05/10/2022-20:07:12] [V] [TRT] Add_1074 [Add] outputs: [1944 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1075 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1075 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1075 [Constant] outputs: [1948 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Unsqueeze_1076 [Unsqueeze] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1909 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1948 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1076 [Unsqueeze] inputs: [1909 -> ()[INT32]], [1948 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:12] [V] [TRT] Registering layer: Unsqueeze_1076 for ONNX node: Unsqueeze_1076 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1949 for ONNX tensor: 1949 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1076 [Unsqueeze] outputs: [1949 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Concat_1077 [Concat] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1949 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3350 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3351 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3352 [05/10/2022-20:07:12] [V] [TRT] Concat_1077 [Concat] inputs: [1949 -> (1)[INT32]], [3350 -> (1)[INT32]], [3351 -> (1)[INT32]], [3352 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3350 for ONNX node: 3350 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3351 for ONNX node: 3351 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3352 for ONNX node: 3352 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Concat_1077 for ONNX node: Concat_1077 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1956 for ONNX tensor: 1956 [05/10/2022-20:07:12] [V] [TRT] Concat_1077 [Concat] outputs: [1956 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Reshape_1078 [Reshape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1944 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1956 [05/10/2022-20:07:12] [V] [TRT] Reshape_1078 [Reshape] inputs: [1944 -> (-1, -1, 256)[FLOAT]], [1956 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Reshape_1078 for ONNX node: Reshape_1078 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1957 for ONNX tensor: 1957 [05/10/2022-20:07:12] [V] [TRT] Reshape_1078 [Reshape] outputs: [1957 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Transpose_1079 [Transpose] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1957 [05/10/2022-20:07:12] [V] [TRT] Transpose_1079 [Transpose] inputs: [1957 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Transpose_1079 for ONNX node: Transpose_1079 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1958 for ONNX tensor: 1958 [05/10/2022-20:07:12] [V] [TRT] Transpose_1079 [Transpose] outputs: [1958 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Shape_1080 [Shape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:12] [V] [TRT] Shape_1080 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Shape_1080 for ONNX node: Shape_1080 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1959 for ONNX tensor: 1959 [05/10/2022-20:07:12] [V] [TRT] Shape_1080 [Shape] outputs: [1959 -> (3)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1081 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1081 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1081 [Constant] outputs: [1960 -> ()[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Gather_1082 [Gather] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1959 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1960 [05/10/2022-20:07:12] [V] [TRT] Gather_1082 [Gather] inputs: [1959 -> (3)[INT32]], [1960 -> ()[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 1960 for ONNX node: 1960 [05/10/2022-20:07:12] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Gather_1082 for ONNX node: Gather_1082 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1961 for ONNX tensor: 1961 [05/10/2022-20:07:12] [V] [TRT] Gather_1082 [Gather] outputs: [1961 -> ()[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: MatMul_1083 [MatMul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3353 [05/10/2022-20:07:12] [V] [TRT] MatMul_1083 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3353 -> (256, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3353 for ONNX node: 3353 [05/10/2022-20:07:12] [V] [TRT] Registering layer: MatMul_1083 for ONNX node: MatMul_1083 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1963 for ONNX tensor: 1963 [05/10/2022-20:07:12] [V] [TRT] MatMul_1083 [MatMul] outputs: [1963 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1084 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1084 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1084 [Constant] outputs: [1967 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Unsqueeze_1085 [Unsqueeze] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1961 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1967 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1085 [Unsqueeze] inputs: [1961 -> ()[INT32]], [1967 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:12] [V] [TRT] Registering layer: Unsqueeze_1085 for ONNX node: Unsqueeze_1085 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1968 for ONNX tensor: 1968 [05/10/2022-20:07:12] [V] [TRT] Unsqueeze_1085 [Unsqueeze] outputs: [1968 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Concat_1086 [Concat] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1968 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3354 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3355 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 3356 [05/10/2022-20:07:12] [V] [TRT] Concat_1086 [Concat] inputs: [1968 -> (1)[INT32]], [3354 -> (1)[INT32]], [3355 -> (1)[INT32]], [3356 -> (1)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3354 for ONNX node: 3354 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3355 for ONNX node: 3355 [05/10/2022-20:07:12] [V] [TRT] Registering layer: 3356 for ONNX node: 3356 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Concat_1086 for ONNX node: Concat_1086 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1975 for ONNX tensor: 1975 [05/10/2022-20:07:12] [V] [TRT] Concat_1086 [Concat] outputs: [1975 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Reshape_1087 [Reshape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1963 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1975 [05/10/2022-20:07:12] [V] [TRT] Reshape_1087 [Reshape] inputs: [1963 -> (1, -1, 256)[FLOAT]], [1975 -> (4)[INT32]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Reshape_1087 for ONNX node: Reshape_1087 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1976 for ONNX tensor: 1976 [05/10/2022-20:07:12] [V] [TRT] Reshape_1087 [Reshape] outputs: [1976 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1088 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1925 [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.self_attn.pos_bias_u [05/10/2022-20:07:12] [V] [TRT] Add_1088 [Add] inputs: [1925 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.6.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.self_attn.pos_bias_u for ONNX node: encoder.encoders.6.self_attn.pos_bias_u [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1088 for ONNX node: Add_1088 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1977 for ONNX tensor: 1977 [05/10/2022-20:07:12] [V] [TRT] Add_1088 [Add] outputs: [1977 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Transpose_1089 [Transpose] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1977 [05/10/2022-20:07:12] [V] [TRT] Transpose_1089 [Transpose] inputs: [1977 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Transpose_1089 for ONNX node: Transpose_1089 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1978 for ONNX tensor: 1978 [05/10/2022-20:07:12] [V] [TRT] Transpose_1089 [Transpose] outputs: [1978 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1090 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1925 [05/10/2022-20:07:12] [V] [TRT] Searching for input: encoder.encoders.6.self_attn.pos_bias_v [05/10/2022-20:07:12] [V] [TRT] Add_1090 [Add] inputs: [1925 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.6.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: encoder.encoders.6.self_attn.pos_bias_v for ONNX node: encoder.encoders.6.self_attn.pos_bias_v [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1090 for ONNX node: Add_1090 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1979 for ONNX tensor: 1979 [05/10/2022-20:07:12] [V] [TRT] Add_1090 [Add] outputs: [1979 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Transpose_1091 [Transpose] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1979 [05/10/2022-20:07:12] [V] [TRT] Transpose_1091 [Transpose] inputs: [1979 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Transpose_1091 for ONNX node: Transpose_1091 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1980 for ONNX tensor: 1980 [05/10/2022-20:07:12] [V] [TRT] Transpose_1091 [Transpose] outputs: [1980 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Transpose_1092 [Transpose] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1941 [05/10/2022-20:07:12] [V] [TRT] Transpose_1092 [Transpose] inputs: [1941 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Transpose_1092 for ONNX node: Transpose_1092 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1981 for ONNX tensor: 1981 [05/10/2022-20:07:12] [V] [TRT] Transpose_1092 [Transpose] outputs: [1981 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: MatMul_1093 [MatMul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1978 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1981 [05/10/2022-20:07:12] [V] [TRT] MatMul_1093 [MatMul] inputs: [1978 -> (-1, 4, -1, 64)[FLOAT]], [1981 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: MatMul_1093 for ONNX node: MatMul_1093 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1982 for ONNX tensor: 1982 [05/10/2022-20:07:12] [V] [TRT] MatMul_1093 [MatMul] outputs: [1982 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Transpose_1094 [Transpose] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1976 [05/10/2022-20:07:12] [V] [TRT] Transpose_1094 [Transpose] inputs: [1976 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Transpose_1094 for ONNX node: Transpose_1094 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1983 for ONNX tensor: 1983 [05/10/2022-20:07:12] [V] [TRT] Transpose_1094 [Transpose] outputs: [1983 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: MatMul_1095 [MatMul] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1980 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1983 [05/10/2022-20:07:12] [V] [TRT] MatMul_1095 [MatMul] inputs: [1980 -> (-1, 4, -1, 64)[FLOAT]], [1983 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: MatMul_1095 for ONNX node: MatMul_1095 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1984 for ONNX tensor: 1984 [05/10/2022-20:07:12] [V] [TRT] MatMul_1095 [MatMul] outputs: [1984 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Add_1096 [Add] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1982 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1984 [05/10/2022-20:07:12] [V] [TRT] Add_1096 [Add] inputs: [1982 -> (-1, 4, -1, -1)[FLOAT]], [1984 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Add_1096 for ONNX node: Add_1096 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1985 for ONNX tensor: 1985 [05/10/2022-20:07:12] [V] [TRT] Add_1096 [Add] outputs: [1985 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Constant_1097 [Constant] [05/10/2022-20:07:12] [V] [TRT] Constant_1097 [Constant] inputs: [05/10/2022-20:07:12] [V] [TRT] Constant_1097 [Constant] outputs: [1986 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Div_1098 [Div] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1985 [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1986 [05/10/2022-20:07:12] [V] [TRT] Div_1098 [Div] inputs: [1985 -> (-1, 4, -1, -1)[FLOAT]], [1986 -> ()[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: 1986 for ONNX node: 1986 [05/10/2022-20:07:12] [V] [TRT] Registering layer: Div_1098 for ONNX node: Div_1098 [05/10/2022-20:07:12] [V] [TRT] Registering tensor: 1987 for ONNX tensor: 1987 [05/10/2022-20:07:12] [V] [TRT] Div_1098 [Div] outputs: [1987 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Parsing node: Shape_1099 [Shape] [05/10/2022-20:07:12] [V] [TRT] Searching for input: 1958 [05/10/2022-20:07:12] [V] [TRT] Shape_1099 [Shape] inputs: [1958 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:12] [V] [TRT] Registering layer: Shape_1099 for ONNX node: Shape_1099 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1988 for ONNX tensor: 1988 [05/10/2022-20:07:13] [V] [TRT] Shape_1099 [Shape] outputs: [1988 -> (4)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1100 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1100 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1100 [Constant] outputs: [1989 -> ()[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Gather_1101 [Gather] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1988 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1989 [05/10/2022-20:07:13] [V] [TRT] Gather_1101 [Gather] inputs: [1988 -> (4)[INT32]], [1989 -> ()[INT32]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 1989 for ONNX node: 1989 [05/10/2022-20:07:13] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Gather_1101 for ONNX node: Gather_1101 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1990 for ONNX tensor: 1990 [05/10/2022-20:07:13] [V] [TRT] Gather_1101 [Gather] outputs: [1990 -> ()[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1102 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1102 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1102 [Constant] outputs: [1991 -> (1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Unsqueeze_1103 [Unsqueeze] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1991 [05/10/2022-20:07:13] [V] [TRT] Unsqueeze_1103 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [1991 -> (1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:13] [V] [TRT] Registering layer: Unsqueeze_1103 for ONNX node: Unsqueeze_1103 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1992 for ONNX tensor: 1992 [05/10/2022-20:07:13] [V] [TRT] Unsqueeze_1103 [Unsqueeze] outputs: [1992 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Cast_1104 [Cast] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1992 [05/10/2022-20:07:13] [V] [TRT] Cast_1104 [Cast] inputs: [1992 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Cast_1104 for ONNX node: Cast_1104 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1993 for ONNX tensor: 1993 [05/10/2022-20:07:13] [V] [TRT] Cast_1104 [Cast] outputs: [1993 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1105 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1105 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1105 [Constant] outputs: [1994 -> ()[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Equal_1106 [Equal] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1993 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1994 [05/10/2022-20:07:13] [V] [TRT] Equal_1106 [Equal] inputs: [1993 -> (-1, 1, 1, -1)[INT32]], [1994 -> ()[INT32]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 1994 for ONNX node: 1994 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Equal_1106 for ONNX node: Equal_1106 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1995 for ONNX tensor: 1995 [05/10/2022-20:07:13] [V] [TRT] Equal_1106 [Equal] outputs: [1995 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Cast_1107 [Cast] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1995 [05/10/2022-20:07:13] [V] [TRT] Cast_1107 [Cast] inputs: [1995 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Casting to type: bool [05/10/2022-20:07:13] [V] [TRT] Registering layer: Cast_1107 for ONNX node: Cast_1107 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1996 for ONNX tensor: 1996 [05/10/2022-20:07:13] [V] [TRT] Cast_1107 [Cast] outputs: [1996 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1108 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1108 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1108 [Constant] outputs: [1997 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Where_1109 [Where] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1996 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1997 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1987 [05/10/2022-20:07:13] [V] [TRT] Where_1109 [Where] inputs: [1996 -> (-1, 1, 1, -1)[BOOL]], [1997 -> ()[FLOAT]], [1987 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 1997 for ONNX node: 1997 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Where_1109 for ONNX node: Where_1109 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1998 for ONNX tensor: 1998 [05/10/2022-20:07:13] [V] [TRT] Where_1109 [Where] outputs: [1998 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Softmax_1110 [Softmax] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1998 [05/10/2022-20:07:13] [V] [TRT] Softmax_1110 [Softmax] inputs: [1998 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Softmax_1110 for ONNX node: Softmax_1110 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 1999 for ONNX tensor: 1999 [05/10/2022-20:07:13] [V] [TRT] Softmax_1110 [Softmax] outputs: [1999 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Cast_1111 [Cast] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1995 [05/10/2022-20:07:13] [V] [TRT] Cast_1111 [Cast] inputs: [1995 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Casting to type: bool [05/10/2022-20:07:13] [V] [TRT] Registering layer: Cast_1111 for ONNX node: Cast_1111 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2000 for ONNX tensor: 2000 [05/10/2022-20:07:13] [V] [TRT] Cast_1111 [Cast] outputs: [2000 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1112 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1112 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1112 [Constant] outputs: [2001 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Where_1113 [Where] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2000 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2001 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1999 [05/10/2022-20:07:13] [V] [TRT] Where_1113 [Where] inputs: [2000 -> (-1, 1, 1, -1)[BOOL]], [2001 -> ()[FLOAT]], [1999 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 2001 for ONNX node: 2001 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Where_1113 for ONNX node: Where_1113 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2002 for ONNX tensor: 2002 [05/10/2022-20:07:13] [V] [TRT] Where_1113 [Where] outputs: [2002 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: MatMul_1114 [MatMul] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2002 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1958 [05/10/2022-20:07:13] [V] [TRT] MatMul_1114 [MatMul] inputs: [2002 -> (-1, 4, -1, -1)[FLOAT]], [1958 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: MatMul_1114 for ONNX node: MatMul_1114 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2003 for ONNX tensor: 2003 [05/10/2022-20:07:13] [V] [TRT] MatMul_1114 [MatMul] outputs: [2003 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Transpose_1115 [Transpose] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2003 [05/10/2022-20:07:13] [V] [TRT] Transpose_1115 [Transpose] inputs: [2003 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Transpose_1115 for ONNX node: Transpose_1115 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2004 for ONNX tensor: 2004 [05/10/2022-20:07:13] [V] [TRT] Transpose_1115 [Transpose] outputs: [2004 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1116 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1116 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1116 [Constant] outputs: [2007 -> (1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Unsqueeze_1117 [Unsqueeze] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1990 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2007 [05/10/2022-20:07:13] [V] [TRT] Unsqueeze_1117 [Unsqueeze] inputs: [1990 -> ()[INT32]], [2007 -> (1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:13] [V] [TRT] Registering layer: Unsqueeze_1117 for ONNX node: Unsqueeze_1117 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2008 for ONNX tensor: 2008 [05/10/2022-20:07:13] [V] [TRT] Unsqueeze_1117 [Unsqueeze] outputs: [2008 -> (1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Concat_1118 [Concat] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2008 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 3357 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 3358 [05/10/2022-20:07:13] [V] [TRT] Concat_1118 [Concat] inputs: [2008 -> (1)[INT32]], [3357 -> (1)[INT32]], [3358 -> (1)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 3357 for ONNX node: 3357 [05/10/2022-20:07:13] [V] [TRT] Registering layer: 3358 for ONNX node: 3358 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Concat_1118 for ONNX node: Concat_1118 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2013 for ONNX tensor: 2013 [05/10/2022-20:07:13] [V] [TRT] Concat_1118 [Concat] outputs: [2013 -> (3)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Reshape_1119 [Reshape] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2004 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2013 [05/10/2022-20:07:13] [V] [TRT] Reshape_1119 [Reshape] inputs: [2004 -> (-1, -1, 4, 64)[FLOAT]], [2013 -> (3)[INT32]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Reshape_1119 for ONNX node: Reshape_1119 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2014 for ONNX tensor: 2014 [05/10/2022-20:07:13] [V] [TRT] Reshape_1119 [Reshape] outputs: [2014 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: MatMul_1120 [MatMul] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2014 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 3359 [05/10/2022-20:07:13] [V] [TRT] MatMul_1120 [MatMul] inputs: [2014 -> (-1, -1, 256)[FLOAT]], [3359 -> (256, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 3359 for ONNX node: 3359 [05/10/2022-20:07:13] [V] [TRT] Registering layer: MatMul_1120 for ONNX node: MatMul_1120 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2016 for ONNX tensor: 2016 [05/10/2022-20:07:13] [V] [TRT] MatMul_1120 [MatMul] outputs: [2016 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Add_1121 [Add] [05/10/2022-20:07:13] [V] [TRT] Searching for input: encoder.encoders.6.self_attn.linear_out.bias [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2016 [05/10/2022-20:07:13] [V] [TRT] Add_1121 [Add] inputs: [encoder.encoders.6.self_attn.linear_out.bias -> (256)[FLOAT]], [2016 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: encoder.encoders.6.self_attn.linear_out.bias for ONNX node: encoder.encoders.6.self_attn.linear_out.bias [05/10/2022-20:07:13] [V] [TRT] Registering layer: Add_1121 for ONNX node: Add_1121 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2017 for ONNX tensor: 2017 [05/10/2022-20:07:13] [V] [TRT] Add_1121 [Add] outputs: [2017 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Add_1122 [Add] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 1895 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2017 [05/10/2022-20:07:13] [V] [TRT] Add_1122 [Add] inputs: [1895 -> (-1, -1, 256)[FLOAT]], [2017 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Add_1122 for ONNX node: Add_1122 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2018 for ONNX tensor: 2018 [05/10/2022-20:07:13] [V] [TRT] Add_1122 [Add] outputs: [2018 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: ReduceMean_1123 [ReduceMean] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2018 [05/10/2022-20:07:13] [V] [TRT] ReduceMean_1123 [ReduceMean] inputs: [2018 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: ReduceMean_1123 for ONNX node: ReduceMean_1123 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2019 for ONNX tensor: 2019 [05/10/2022-20:07:13] [V] [TRT] ReduceMean_1123 [ReduceMean] outputs: [2019 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Sub_1124 [Sub] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2018 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2019 [05/10/2022-20:07:13] [V] [TRT] Sub_1124 [Sub] inputs: [2018 -> (-1, -1, 256)[FLOAT]], [2019 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Sub_1124 for ONNX node: Sub_1124 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2020 for ONNX tensor: 2020 [05/10/2022-20:07:13] [V] [TRT] Sub_1124 [Sub] outputs: [2020 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1125 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1125 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1125 [Constant] outputs: [2021 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Pow_1126 [Pow] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2020 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2021 [05/10/2022-20:07:13] [V] [TRT] Pow_1126 [Pow] inputs: [2020 -> (-1, -1, 256)[FLOAT]], [2021 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 2021 for ONNX node: 2021 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Pow_1126 for ONNX node: Pow_1126 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2022 for ONNX tensor: 2022 [05/10/2022-20:07:13] [V] [TRT] Pow_1126 [Pow] outputs: [2022 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: ReduceMean_1127 [ReduceMean] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2022 [05/10/2022-20:07:13] [V] [TRT] ReduceMean_1127 [ReduceMean] inputs: [2022 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: ReduceMean_1127 for ONNX node: ReduceMean_1127 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2023 for ONNX tensor: 2023 [05/10/2022-20:07:13] [V] [TRT] ReduceMean_1127 [ReduceMean] outputs: [2023 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1128 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1128 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1128 [Constant] outputs: [2024 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Add_1129 [Add] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2023 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2024 [05/10/2022-20:07:13] [V] [TRT] Add_1129 [Add] inputs: [2023 -> (-1, -1, 1)[FLOAT]], [2024 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 2024 for ONNX node: 2024 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Add_1129 for ONNX node: Add_1129 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2025 for ONNX tensor: 2025 [05/10/2022-20:07:13] [V] [TRT] Add_1129 [Add] outputs: [2025 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Sqrt_1130 [Sqrt] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2025 [05/10/2022-20:07:13] [V] [TRT] Sqrt_1130 [Sqrt] inputs: [2025 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Sqrt_1130 for ONNX node: Sqrt_1130 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2026 for ONNX tensor: 2026 [05/10/2022-20:07:13] [V] [TRT] Sqrt_1130 [Sqrt] outputs: [2026 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Div_1131 [Div] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2020 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2026 [05/10/2022-20:07:13] [V] [TRT] Div_1131 [Div] inputs: [2020 -> (-1, -1, 256)[FLOAT]], [2026 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Div_1131 for ONNX node: Div_1131 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2027 for ONNX tensor: 2027 [05/10/2022-20:07:13] [V] [TRT] Div_1131 [Div] outputs: [2027 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Mul_1132 [Mul] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2027 [05/10/2022-20:07:13] [V] [TRT] Searching for input: encoder.encoders.6.norm_conv.weight [05/10/2022-20:07:13] [V] [TRT] Mul_1132 [Mul] inputs: [2027 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: encoder.encoders.6.norm_conv.weight for ONNX node: encoder.encoders.6.norm_conv.weight [05/10/2022-20:07:13] [V] [TRT] Registering layer: Mul_1132 for ONNX node: Mul_1132 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2028 for ONNX tensor: 2028 [05/10/2022-20:07:13] [V] [TRT] Mul_1132 [Mul] outputs: [2028 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Add_1133 [Add] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2028 [05/10/2022-20:07:13] [V] [TRT] Searching for input: encoder.encoders.6.norm_conv.bias [05/10/2022-20:07:13] [V] [TRT] Add_1133 [Add] inputs: [2028 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: encoder.encoders.6.norm_conv.bias for ONNX node: encoder.encoders.6.norm_conv.bias [05/10/2022-20:07:13] [V] [TRT] Registering layer: Add_1133 for ONNX node: Add_1133 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2029 for ONNX tensor: 2029 [05/10/2022-20:07:13] [V] [TRT] Add_1133 [Add] outputs: [2029 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Transpose_1134 [Transpose] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2029 [05/10/2022-20:07:13] [V] [TRT] Transpose_1134 [Transpose] inputs: [2029 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Transpose_1134 for ONNX node: Transpose_1134 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2030 for ONNX tensor: 2030 [05/10/2022-20:07:13] [V] [TRT] Transpose_1134 [Transpose] outputs: [2030 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Not_1135 [Not] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:13] [V] [TRT] Not_1135 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Not_1135 for ONNX node: Not_1135 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2031 for ONNX tensor: 2031 [05/10/2022-20:07:13] [V] [TRT] Not_1135 [Not] outputs: [2031 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Cast_1136 [Cast] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2031 [05/10/2022-20:07:13] [V] [TRT] Cast_1136 [Cast] inputs: [2031 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Casting to type: bool [05/10/2022-20:07:13] [V] [TRT] Registering layer: Cast_1136 for ONNX node: Cast_1136 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2032 for ONNX tensor: 2032 [05/10/2022-20:07:13] [V] [TRT] Cast_1136 [Cast] outputs: [2032 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Constant_1137 [Constant] [05/10/2022-20:07:13] [V] [TRT] Constant_1137 [Constant] inputs: [05/10/2022-20:07:13] [V] [TRT] Constant_1137 [Constant] outputs: [2033 -> ()[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Where_1138 [Where] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2032 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2033 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2030 [05/10/2022-20:07:13] [V] [TRT] Where_1138 [Where] inputs: [2032 -> (-1, 1, -1)[BOOL]], [2033 -> ()[FLOAT]], [2030 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: 2033 for ONNX node: 2033 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Where_1138 for ONNX node: Where_1138 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2034 for ONNX tensor: 2034 [05/10/2022-20:07:13] [V] [TRT] Where_1138 [Where] outputs: [2034 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Conv_1139 [Conv] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2034 [05/10/2022-20:07:13] [V] [TRT] Searching for input: encoder.encoders.6.conv_module.pointwise_conv1.weight [05/10/2022-20:07:13] [V] [TRT] Searching for input: encoder.encoders.6.conv_module.pointwise_conv1.bias [05/10/2022-20:07:13] [V] [TRT] Conv_1139 [Conv] inputs: [2034 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.6.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.6.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:13] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:13] [V] [TRT] Registering layer: Conv_1139 for ONNX node: Conv_1139 [05/10/2022-20:07:13] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:13] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:13] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2035 for ONNX tensor: 2035 [05/10/2022-20:07:13] [V] [TRT] Conv_1139 [Conv] outputs: [2035 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Split_1140 [Split] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2035 [05/10/2022-20:07:13] [V] [TRT] Split_1140 [Split] inputs: [2035 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Split_1140 for ONNX node: Split_1140 [05/10/2022-20:07:13] [V] [TRT] Registering layer: Split_1140_8 for ONNX node: Split_1140 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2036 for ONNX tensor: 2036 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2037 for ONNX tensor: 2037 [05/10/2022-20:07:13] [V] [TRT] Split_1140 [Split] outputs: [2036 -> (-1, 256, -1)[FLOAT]], [2037 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Sigmoid_1141 [Sigmoid] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2037 [05/10/2022-20:07:13] [V] [TRT] Sigmoid_1141 [Sigmoid] inputs: [2037 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Sigmoid_1141 for ONNX node: Sigmoid_1141 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2038 for ONNX tensor: 2038 [05/10/2022-20:07:13] [V] [TRT] Sigmoid_1141 [Sigmoid] outputs: [2038 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Mul_1142 [Mul] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2036 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2038 [05/10/2022-20:07:13] [V] [TRT] Mul_1142 [Mul] inputs: [2036 -> (-1, 256, -1)[FLOAT]], [2038 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Mul_1142 for ONNX node: Mul_1142 [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 2039 for ONNX tensor: 2039 [05/10/2022-20:07:13] [V] [TRT] Mul_1142 [Mul] outputs: [2039 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Conv_1143 [Conv] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 2039 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 3179 [05/10/2022-20:07:13] [V] [TRT] Searching for input: 3180 [05/10/2022-20:07:13] [V] [TRT] Conv_1143 [Conv] inputs: [2039 -> (-1, 256, -1)[FLOAT]], [3179 -> (256, 1, 15)[FLOAT]], [3180 -> (256)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:13] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:13] [V] [TRT] Registering layer: Conv_1143 for ONNX node: Conv_1143 [05/10/2022-20:07:13] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:13] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:13] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:13] [V] [TRT] Registering tensor: 3178 for ONNX tensor: 3178 [05/10/2022-20:07:13] [V] [TRT] Conv_1143 [Conv] outputs: [3178 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Parsing node: Sigmoid_1144 [Sigmoid] [05/10/2022-20:07:13] [V] [TRT] Searching for input: 3178 [05/10/2022-20:07:13] [V] [TRT] Sigmoid_1144 [Sigmoid] inputs: [3178 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:13] [V] [TRT] Registering layer: Sigmoid_1144 for ONNX node: Sigmoid_1144 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2042 for ONNX tensor: 2042 [05/10/2022-20:07:14] [V] [TRT] Sigmoid_1144 [Sigmoid] outputs: [2042 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Mul_1145 [Mul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 3178 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2042 [05/10/2022-20:07:14] [V] [TRT] Mul_1145 [Mul] inputs: [3178 -> (-1, 256, -1)[FLOAT]], [2042 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Mul_1145 for ONNX node: Mul_1145 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2043 for ONNX tensor: 2043 [05/10/2022-20:07:14] [V] [TRT] Mul_1145 [Mul] outputs: [2043 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Not_1146 [Not] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:14] [V] [TRT] Not_1146 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Not_1146 for ONNX node: Not_1146 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2044 for ONNX tensor: 2044 [05/10/2022-20:07:14] [V] [TRT] Not_1146 [Not] outputs: [2044 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Conv_1147 [Conv] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2043 [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.conv_module.pointwise_conv2.weight [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.conv_module.pointwise_conv2.bias [05/10/2022-20:07:14] [V] [TRT] Conv_1147 [Conv] inputs: [2043 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.6.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.6.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:14] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:14] [V] [TRT] Registering layer: Conv_1147 for ONNX node: Conv_1147 [05/10/2022-20:07:14] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:14] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:14] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2045 for ONNX tensor: 2045 [05/10/2022-20:07:14] [V] [TRT] Conv_1147 [Conv] outputs: [2045 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Cast_1148 [Cast] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2044 [05/10/2022-20:07:14] [V] [TRT] Cast_1148 [Cast] inputs: [2044 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:14] [V] [TRT] Casting to type: bool [05/10/2022-20:07:14] [V] [TRT] Registering layer: Cast_1148 for ONNX node: Cast_1148 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2046 for ONNX tensor: 2046 [05/10/2022-20:07:14] [V] [TRT] Cast_1148 [Cast] outputs: [2046 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1149 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1149 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1149 [Constant] outputs: [2047 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Where_1150 [Where] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2046 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2047 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2045 [05/10/2022-20:07:14] [V] [TRT] Where_1150 [Where] inputs: [2046 -> (-1, 1, -1)[BOOL]], [2047 -> ()[FLOAT]], [2045 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2047 for ONNX node: 2047 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Where_1150 for ONNX node: Where_1150 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2048 for ONNX tensor: 2048 [05/10/2022-20:07:14] [V] [TRT] Where_1150 [Where] outputs: [2048 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Transpose_1151 [Transpose] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2048 [05/10/2022-20:07:14] [V] [TRT] Transpose_1151 [Transpose] inputs: [2048 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Transpose_1151 for ONNX node: Transpose_1151 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2049 for ONNX tensor: 2049 [05/10/2022-20:07:14] [V] [TRT] Transpose_1151 [Transpose] outputs: [2049 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1152 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2018 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2049 [05/10/2022-20:07:14] [V] [TRT] Add_1152 [Add] inputs: [2018 -> (-1, -1, 256)[FLOAT]], [2049 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1152 for ONNX node: Add_1152 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2050 for ONNX tensor: 2050 [05/10/2022-20:07:14] [V] [TRT] Add_1152 [Add] outputs: [2050 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: ReduceMean_1153 [ReduceMean] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2050 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1153 [ReduceMean] inputs: [2050 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: ReduceMean_1153 for ONNX node: ReduceMean_1153 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2051 for ONNX tensor: 2051 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1153 [ReduceMean] outputs: [2051 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Sub_1154 [Sub] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2050 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2051 [05/10/2022-20:07:14] [V] [TRT] Sub_1154 [Sub] inputs: [2050 -> (-1, -1, 256)[FLOAT]], [2051 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Sub_1154 for ONNX node: Sub_1154 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2052 for ONNX tensor: 2052 [05/10/2022-20:07:14] [V] [TRT] Sub_1154 [Sub] outputs: [2052 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1155 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1155 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1155 [Constant] outputs: [2053 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Pow_1156 [Pow] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2052 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2053 [05/10/2022-20:07:14] [V] [TRT] Pow_1156 [Pow] inputs: [2052 -> (-1, -1, 256)[FLOAT]], [2053 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2053 for ONNX node: 2053 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Pow_1156 for ONNX node: Pow_1156 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2054 for ONNX tensor: 2054 [05/10/2022-20:07:14] [V] [TRT] Pow_1156 [Pow] outputs: [2054 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: ReduceMean_1157 [ReduceMean] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2054 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1157 [ReduceMean] inputs: [2054 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: ReduceMean_1157 for ONNX node: ReduceMean_1157 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2055 for ONNX tensor: 2055 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1157 [ReduceMean] outputs: [2055 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1158 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1158 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1158 [Constant] outputs: [2056 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1159 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2055 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2056 [05/10/2022-20:07:14] [V] [TRT] Add_1159 [Add] inputs: [2055 -> (-1, -1, 1)[FLOAT]], [2056 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2056 for ONNX node: 2056 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1159 for ONNX node: Add_1159 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2057 for ONNX tensor: 2057 [05/10/2022-20:07:14] [V] [TRT] Add_1159 [Add] outputs: [2057 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Sqrt_1160 [Sqrt] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2057 [05/10/2022-20:07:14] [V] [TRT] Sqrt_1160 [Sqrt] inputs: [2057 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Sqrt_1160 for ONNX node: Sqrt_1160 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2058 for ONNX tensor: 2058 [05/10/2022-20:07:14] [V] [TRT] Sqrt_1160 [Sqrt] outputs: [2058 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Div_1161 [Div] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2052 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2058 [05/10/2022-20:07:14] [V] [TRT] Div_1161 [Div] inputs: [2052 -> (-1, -1, 256)[FLOAT]], [2058 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Div_1161 for ONNX node: Div_1161 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2059 for ONNX tensor: 2059 [05/10/2022-20:07:14] [V] [TRT] Div_1161 [Div] outputs: [2059 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Mul_1162 [Mul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2059 [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.norm_ff.weight [05/10/2022-20:07:14] [V] [TRT] Mul_1162 [Mul] inputs: [2059 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: encoder.encoders.6.norm_ff.weight for ONNX node: encoder.encoders.6.norm_ff.weight [05/10/2022-20:07:14] [V] [TRT] Registering layer: Mul_1162 for ONNX node: Mul_1162 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2060 for ONNX tensor: 2060 [05/10/2022-20:07:14] [V] [TRT] Mul_1162 [Mul] outputs: [2060 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1163 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2060 [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.norm_ff.bias [05/10/2022-20:07:14] [V] [TRT] Add_1163 [Add] inputs: [2060 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: encoder.encoders.6.norm_ff.bias for ONNX node: encoder.encoders.6.norm_ff.bias [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1163 for ONNX node: Add_1163 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2061 for ONNX tensor: 2061 [05/10/2022-20:07:14] [V] [TRT] Add_1163 [Add] outputs: [2061 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: MatMul_1164 [MatMul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2061 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 3360 [05/10/2022-20:07:14] [V] [TRT] MatMul_1164 [MatMul] inputs: [2061 -> (-1, -1, 256)[FLOAT]], [3360 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 3360 for ONNX node: 3360 [05/10/2022-20:07:14] [V] [TRT] Registering layer: MatMul_1164 for ONNX node: MatMul_1164 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2063 for ONNX tensor: 2063 [05/10/2022-20:07:14] [V] [TRT] MatMul_1164 [MatMul] outputs: [2063 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1165 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.feed_forward.w_1.bias [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2063 [05/10/2022-20:07:14] [V] [TRT] Add_1165 [Add] inputs: [encoder.encoders.6.feed_forward.w_1.bias -> (2048)[FLOAT]], [2063 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: encoder.encoders.6.feed_forward.w_1.bias for ONNX node: encoder.encoders.6.feed_forward.w_1.bias [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1165 for ONNX node: Add_1165 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2064 for ONNX tensor: 2064 [05/10/2022-20:07:14] [V] [TRT] Add_1165 [Add] outputs: [2064 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Sigmoid_1166 [Sigmoid] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2064 [05/10/2022-20:07:14] [V] [TRT] Sigmoid_1166 [Sigmoid] inputs: [2064 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Sigmoid_1166 for ONNX node: Sigmoid_1166 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2065 for ONNX tensor: 2065 [05/10/2022-20:07:14] [V] [TRT] Sigmoid_1166 [Sigmoid] outputs: [2065 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Mul_1167 [Mul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2064 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2065 [05/10/2022-20:07:14] [V] [TRT] Mul_1167 [Mul] inputs: [2064 -> (-1, -1, 2048)[FLOAT]], [2065 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Mul_1167 for ONNX node: Mul_1167 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2066 for ONNX tensor: 2066 [05/10/2022-20:07:14] [V] [TRT] Mul_1167 [Mul] outputs: [2066 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: MatMul_1168 [MatMul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2066 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 3361 [05/10/2022-20:07:14] [V] [TRT] MatMul_1168 [MatMul] inputs: [2066 -> (-1, -1, 2048)[FLOAT]], [3361 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 3361 for ONNX node: 3361 [05/10/2022-20:07:14] [V] [TRT] Registering layer: MatMul_1168 for ONNX node: MatMul_1168 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2068 for ONNX tensor: 2068 [05/10/2022-20:07:14] [V] [TRT] MatMul_1168 [MatMul] outputs: [2068 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1169 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.feed_forward.w_2.bias [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2068 [05/10/2022-20:07:14] [V] [TRT] Add_1169 [Add] inputs: [encoder.encoders.6.feed_forward.w_2.bias -> (256)[FLOAT]], [2068 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: encoder.encoders.6.feed_forward.w_2.bias for ONNX node: encoder.encoders.6.feed_forward.w_2.bias [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1169 for ONNX node: Add_1169 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2069 for ONNX tensor: 2069 [05/10/2022-20:07:14] [V] [TRT] Add_1169 [Add] outputs: [2069 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1170 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1170 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1170 [Constant] outputs: [2070 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Mul_1171 [Mul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2069 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2070 [05/10/2022-20:07:14] [V] [TRT] Mul_1171 [Mul] inputs: [2069 -> (-1, -1, 256)[FLOAT]], [2070 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2070 for ONNX node: 2070 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Mul_1171 for ONNX node: Mul_1171 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2071 for ONNX tensor: 2071 [05/10/2022-20:07:14] [V] [TRT] Mul_1171 [Mul] outputs: [2071 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1172 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2050 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2071 [05/10/2022-20:07:14] [V] [TRT] Add_1172 [Add] inputs: [2050 -> (-1, -1, 256)[FLOAT]], [2071 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1172 for ONNX node: Add_1172 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2072 for ONNX tensor: 2072 [05/10/2022-20:07:14] [V] [TRT] Add_1172 [Add] outputs: [2072 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: ReduceMean_1173 [ReduceMean] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2072 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1173 [ReduceMean] inputs: [2072 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: ReduceMean_1173 for ONNX node: ReduceMean_1173 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2073 for ONNX tensor: 2073 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1173 [ReduceMean] outputs: [2073 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Sub_1174 [Sub] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2072 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2073 [05/10/2022-20:07:14] [V] [TRT] Sub_1174 [Sub] inputs: [2072 -> (-1, -1, 256)[FLOAT]], [2073 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Sub_1174 for ONNX node: Sub_1174 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2074 for ONNX tensor: 2074 [05/10/2022-20:07:14] [V] [TRT] Sub_1174 [Sub] outputs: [2074 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1175 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1175 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1175 [Constant] outputs: [2075 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Pow_1176 [Pow] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2074 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2075 [05/10/2022-20:07:14] [V] [TRT] Pow_1176 [Pow] inputs: [2074 -> (-1, -1, 256)[FLOAT]], [2075 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2075 for ONNX node: 2075 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Pow_1176 for ONNX node: Pow_1176 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2076 for ONNX tensor: 2076 [05/10/2022-20:07:14] [V] [TRT] Pow_1176 [Pow] outputs: [2076 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: ReduceMean_1177 [ReduceMean] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2076 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1177 [ReduceMean] inputs: [2076 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: ReduceMean_1177 for ONNX node: ReduceMean_1177 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2077 for ONNX tensor: 2077 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1177 [ReduceMean] outputs: [2077 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1178 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1178 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1178 [Constant] outputs: [2078 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1179 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2077 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2078 [05/10/2022-20:07:14] [V] [TRT] Add_1179 [Add] inputs: [2077 -> (-1, -1, 1)[FLOAT]], [2078 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2078 for ONNX node: 2078 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1179 for ONNX node: Add_1179 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2079 for ONNX tensor: 2079 [05/10/2022-20:07:14] [V] [TRT] Add_1179 [Add] outputs: [2079 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Sqrt_1180 [Sqrt] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2079 [05/10/2022-20:07:14] [V] [TRT] Sqrt_1180 [Sqrt] inputs: [2079 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Sqrt_1180 for ONNX node: Sqrt_1180 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2080 for ONNX tensor: 2080 [05/10/2022-20:07:14] [V] [TRT] Sqrt_1180 [Sqrt] outputs: [2080 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Div_1181 [Div] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2074 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2080 [05/10/2022-20:07:14] [V] [TRT] Div_1181 [Div] inputs: [2074 -> (-1, -1, 256)[FLOAT]], [2080 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Div_1181 for ONNX node: Div_1181 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2081 for ONNX tensor: 2081 [05/10/2022-20:07:14] [V] [TRT] Div_1181 [Div] outputs: [2081 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Mul_1182 [Mul] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2081 [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.norm_final.weight [05/10/2022-20:07:14] [V] [TRT] Mul_1182 [Mul] inputs: [2081 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: encoder.encoders.6.norm_final.weight for ONNX node: encoder.encoders.6.norm_final.weight [05/10/2022-20:07:14] [V] [TRT] Registering layer: Mul_1182 for ONNX node: Mul_1182 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2082 for ONNX tensor: 2082 [05/10/2022-20:07:14] [V] [TRT] Mul_1182 [Mul] outputs: [2082 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1183 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2082 [05/10/2022-20:07:14] [V] [TRT] Searching for input: encoder.encoders.6.norm_final.bias [05/10/2022-20:07:14] [V] [TRT] Add_1183 [Add] inputs: [2082 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.6.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: encoder.encoders.6.norm_final.bias for ONNX node: encoder.encoders.6.norm_final.bias [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1183 for ONNX node: Add_1183 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2083 for ONNX tensor: 2083 [05/10/2022-20:07:14] [V] [TRT] Add_1183 [Add] outputs: [2083 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: ReduceMean_1184 [ReduceMean] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2083 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1184 [ReduceMean] inputs: [2083 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: ReduceMean_1184 for ONNX node: ReduceMean_1184 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2084 for ONNX tensor: 2084 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1184 [ReduceMean] outputs: [2084 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Sub_1185 [Sub] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2083 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2084 [05/10/2022-20:07:14] [V] [TRT] Sub_1185 [Sub] inputs: [2083 -> (-1, -1, 256)[FLOAT]], [2084 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: Sub_1185 for ONNX node: Sub_1185 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2085 for ONNX tensor: 2085 [05/10/2022-20:07:14] [V] [TRT] Sub_1185 [Sub] outputs: [2085 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1186 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1186 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1186 [Constant] outputs: [2086 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Pow_1187 [Pow] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2085 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2086 [05/10/2022-20:07:14] [V] [TRT] Pow_1187 [Pow] inputs: [2085 -> (-1, -1, 256)[FLOAT]], [2086 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2086 for ONNX node: 2086 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Pow_1187 for ONNX node: Pow_1187 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2087 for ONNX tensor: 2087 [05/10/2022-20:07:14] [V] [TRT] Pow_1187 [Pow] outputs: [2087 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: ReduceMean_1188 [ReduceMean] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2087 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1188 [ReduceMean] inputs: [2087 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: ReduceMean_1188 for ONNX node: ReduceMean_1188 [05/10/2022-20:07:14] [V] [TRT] Registering tensor: 2088 for ONNX tensor: 2088 [05/10/2022-20:07:14] [V] [TRT] ReduceMean_1188 [ReduceMean] outputs: [2088 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Constant_1189 [Constant] [05/10/2022-20:07:14] [V] [TRT] Constant_1189 [Constant] inputs: [05/10/2022-20:07:14] [V] [TRT] Constant_1189 [Constant] outputs: [2089 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Parsing node: Add_1190 [Add] [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2088 [05/10/2022-20:07:14] [V] [TRT] Searching for input: 2089 [05/10/2022-20:07:14] [V] [TRT] Add_1190 [Add] inputs: [2088 -> (-1, -1, 1)[FLOAT]], [2089 -> ()[FLOAT]], [05/10/2022-20:07:14] [V] [TRT] Registering layer: 2089 for ONNX node: 2089 [05/10/2022-20:07:14] [V] [TRT] Registering layer: Add_1190 for ONNX node: Add_1190 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2090 for ONNX tensor: 2090 [05/10/2022-20:07:15] [V] [TRT] Add_1190 [Add] outputs: [2090 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Sqrt_1191 [Sqrt] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2090 [05/10/2022-20:07:15] [V] [TRT] Sqrt_1191 [Sqrt] inputs: [2090 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Sqrt_1191 for ONNX node: Sqrt_1191 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2091 for ONNX tensor: 2091 [05/10/2022-20:07:15] [V] [TRT] Sqrt_1191 [Sqrt] outputs: [2091 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Div_1192 [Div] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2085 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2091 [05/10/2022-20:07:15] [V] [TRT] Div_1192 [Div] inputs: [2085 -> (-1, -1, 256)[FLOAT]], [2091 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Div_1192 for ONNX node: Div_1192 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2092 for ONNX tensor: 2092 [05/10/2022-20:07:15] [V] [TRT] Div_1192 [Div] outputs: [2092 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Mul_1193 [Mul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2092 [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.norm_ff_macaron.weight [05/10/2022-20:07:15] [V] [TRT] Mul_1193 [Mul] inputs: [2092 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.norm_ff_macaron.weight for ONNX node: encoder.encoders.7.norm_ff_macaron.weight [05/10/2022-20:07:15] [V] [TRT] Registering layer: Mul_1193 for ONNX node: Mul_1193 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2093 for ONNX tensor: 2093 [05/10/2022-20:07:15] [V] [TRT] Mul_1193 [Mul] outputs: [2093 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1194 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2093 [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.norm_ff_macaron.bias [05/10/2022-20:07:15] [V] [TRT] Add_1194 [Add] inputs: [2093 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.norm_ff_macaron.bias for ONNX node: encoder.encoders.7.norm_ff_macaron.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1194 for ONNX node: Add_1194 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2094 for ONNX tensor: 2094 [05/10/2022-20:07:15] [V] [TRT] Add_1194 [Add] outputs: [2094 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: MatMul_1195 [MatMul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2094 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3362 [05/10/2022-20:07:15] [V] [TRT] MatMul_1195 [MatMul] inputs: [2094 -> (-1, -1, 256)[FLOAT]], [3362 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3362 for ONNX node: 3362 [05/10/2022-20:07:15] [V] [TRT] Registering layer: MatMul_1195 for ONNX node: MatMul_1195 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2096 for ONNX tensor: 2096 [05/10/2022-20:07:15] [V] [TRT] MatMul_1195 [MatMul] outputs: [2096 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1196 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.feed_forward_macaron.w_1.bias [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2096 [05/10/2022-20:07:15] [V] [TRT] Add_1196 [Add] inputs: [encoder.encoders.7.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [2096 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.7.feed_forward_macaron.w_1.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1196 for ONNX node: Add_1196 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2097 for ONNX tensor: 2097 [05/10/2022-20:07:15] [V] [TRT] Add_1196 [Add] outputs: [2097 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Sigmoid_1197 [Sigmoid] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2097 [05/10/2022-20:07:15] [V] [TRT] Sigmoid_1197 [Sigmoid] inputs: [2097 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Sigmoid_1197 for ONNX node: Sigmoid_1197 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2098 for ONNX tensor: 2098 [05/10/2022-20:07:15] [V] [TRT] Sigmoid_1197 [Sigmoid] outputs: [2098 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Mul_1198 [Mul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2097 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2098 [05/10/2022-20:07:15] [V] [TRT] Mul_1198 [Mul] inputs: [2097 -> (-1, -1, 2048)[FLOAT]], [2098 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Mul_1198 for ONNX node: Mul_1198 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2099 for ONNX tensor: 2099 [05/10/2022-20:07:15] [V] [TRT] Mul_1198 [Mul] outputs: [2099 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: MatMul_1199 [MatMul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2099 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3363 [05/10/2022-20:07:15] [V] [TRT] MatMul_1199 [MatMul] inputs: [2099 -> (-1, -1, 2048)[FLOAT]], [3363 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3363 for ONNX node: 3363 [05/10/2022-20:07:15] [V] [TRT] Registering layer: MatMul_1199 for ONNX node: MatMul_1199 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2101 for ONNX tensor: 2101 [05/10/2022-20:07:15] [V] [TRT] MatMul_1199 [MatMul] outputs: [2101 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1200 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.feed_forward_macaron.w_2.bias [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2101 [05/10/2022-20:07:15] [V] [TRT] Add_1200 [Add] inputs: [encoder.encoders.7.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [2101 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.7.feed_forward_macaron.w_2.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1200 for ONNX node: Add_1200 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2102 for ONNX tensor: 2102 [05/10/2022-20:07:15] [V] [TRT] Add_1200 [Add] outputs: [2102 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Constant_1201 [Constant] [05/10/2022-20:07:15] [V] [TRT] Constant_1201 [Constant] inputs: [05/10/2022-20:07:15] [V] [TRT] Constant_1201 [Constant] outputs: [2103 -> ()[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Mul_1202 [Mul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2102 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2103 [05/10/2022-20:07:15] [V] [TRT] Mul_1202 [Mul] inputs: [2102 -> (-1, -1, 256)[FLOAT]], [2103 -> ()[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 2103 for ONNX node: 2103 [05/10/2022-20:07:15] [V] [TRT] Registering layer: Mul_1202 for ONNX node: Mul_1202 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2104 for ONNX tensor: 2104 [05/10/2022-20:07:15] [V] [TRT] Mul_1202 [Mul] outputs: [2104 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1203 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2083 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2104 [05/10/2022-20:07:15] [V] [TRT] Add_1203 [Add] inputs: [2083 -> (-1, -1, 256)[FLOAT]], [2104 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1203 for ONNX node: Add_1203 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2105 for ONNX tensor: 2105 [05/10/2022-20:07:15] [V] [TRT] Add_1203 [Add] outputs: [2105 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: ReduceMean_1204 [ReduceMean] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2105 [05/10/2022-20:07:15] [V] [TRT] ReduceMean_1204 [ReduceMean] inputs: [2105 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: ReduceMean_1204 for ONNX node: ReduceMean_1204 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2106 for ONNX tensor: 2106 [05/10/2022-20:07:15] [V] [TRT] ReduceMean_1204 [ReduceMean] outputs: [2106 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Sub_1205 [Sub] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2105 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2106 [05/10/2022-20:07:15] [V] [TRT] Sub_1205 [Sub] inputs: [2105 -> (-1, -1, 256)[FLOAT]], [2106 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Sub_1205 for ONNX node: Sub_1205 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2107 for ONNX tensor: 2107 [05/10/2022-20:07:15] [V] [TRT] Sub_1205 [Sub] outputs: [2107 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Constant_1206 [Constant] [05/10/2022-20:07:15] [V] [TRT] Constant_1206 [Constant] inputs: [05/10/2022-20:07:15] [V] [TRT] Constant_1206 [Constant] outputs: [2108 -> ()[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Pow_1207 [Pow] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2107 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2108 [05/10/2022-20:07:15] [V] [TRT] Pow_1207 [Pow] inputs: [2107 -> (-1, -1, 256)[FLOAT]], [2108 -> ()[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 2108 for ONNX node: 2108 [05/10/2022-20:07:15] [V] [TRT] Registering layer: Pow_1207 for ONNX node: Pow_1207 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2109 for ONNX tensor: 2109 [05/10/2022-20:07:15] [V] [TRT] Pow_1207 [Pow] outputs: [2109 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: ReduceMean_1208 [ReduceMean] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2109 [05/10/2022-20:07:15] [V] [TRT] ReduceMean_1208 [ReduceMean] inputs: [2109 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: ReduceMean_1208 for ONNX node: ReduceMean_1208 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2110 for ONNX tensor: 2110 [05/10/2022-20:07:15] [V] [TRT] ReduceMean_1208 [ReduceMean] outputs: [2110 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Constant_1209 [Constant] [05/10/2022-20:07:15] [V] [TRT] Constant_1209 [Constant] inputs: [05/10/2022-20:07:15] [V] [TRT] Constant_1209 [Constant] outputs: [2111 -> ()[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1210 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2110 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2111 [05/10/2022-20:07:15] [V] [TRT] Add_1210 [Add] inputs: [2110 -> (-1, -1, 1)[FLOAT]], [2111 -> ()[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 2111 for ONNX node: 2111 [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1210 for ONNX node: Add_1210 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2112 for ONNX tensor: 2112 [05/10/2022-20:07:15] [V] [TRT] Add_1210 [Add] outputs: [2112 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Sqrt_1211 [Sqrt] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2112 [05/10/2022-20:07:15] [V] [TRT] Sqrt_1211 [Sqrt] inputs: [2112 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Sqrt_1211 for ONNX node: Sqrt_1211 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2113 for ONNX tensor: 2113 [05/10/2022-20:07:15] [V] [TRT] Sqrt_1211 [Sqrt] outputs: [2113 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Div_1212 [Div] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2107 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2113 [05/10/2022-20:07:15] [V] [TRT] Div_1212 [Div] inputs: [2107 -> (-1, -1, 256)[FLOAT]], [2113 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Div_1212 for ONNX node: Div_1212 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2114 for ONNX tensor: 2114 [05/10/2022-20:07:15] [V] [TRT] Div_1212 [Div] outputs: [2114 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Mul_1213 [Mul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2114 [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.norm_mha.weight [05/10/2022-20:07:15] [V] [TRT] Mul_1213 [Mul] inputs: [2114 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.norm_mha.weight for ONNX node: encoder.encoders.7.norm_mha.weight [05/10/2022-20:07:15] [V] [TRT] Registering layer: Mul_1213 for ONNX node: Mul_1213 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2115 for ONNX tensor: 2115 [05/10/2022-20:07:15] [V] [TRT] Mul_1213 [Mul] outputs: [2115 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1214 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2115 [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.norm_mha.bias [05/10/2022-20:07:15] [V] [TRT] Add_1214 [Add] inputs: [2115 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.norm_mha.bias for ONNX node: encoder.encoders.7.norm_mha.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1214 for ONNX node: Add_1214 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2116 for ONNX tensor: 2116 [05/10/2022-20:07:15] [V] [TRT] Add_1214 [Add] outputs: [2116 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Shape_1215 [Shape] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2116 [05/10/2022-20:07:15] [V] [TRT] Shape_1215 [Shape] inputs: [2116 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Shape_1215 for ONNX node: Shape_1215 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2117 for ONNX tensor: 2117 [05/10/2022-20:07:15] [V] [TRT] Shape_1215 [Shape] outputs: [2117 -> (3)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Constant_1216 [Constant] [05/10/2022-20:07:15] [V] [TRT] Constant_1216 [Constant] inputs: [05/10/2022-20:07:15] [V] [TRT] Constant_1216 [Constant] outputs: [2118 -> ()[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Gather_1217 [Gather] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2117 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2118 [05/10/2022-20:07:15] [V] [TRT] Gather_1217 [Gather] inputs: [2117 -> (3)[INT32]], [2118 -> ()[INT32]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 2118 for ONNX node: 2118 [05/10/2022-20:07:15] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:15] [V] [TRT] Registering layer: Gather_1217 for ONNX node: Gather_1217 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2119 for ONNX tensor: 2119 [05/10/2022-20:07:15] [V] [TRT] Gather_1217 [Gather] outputs: [2119 -> ()[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: MatMul_1218 [MatMul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2116 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3364 [05/10/2022-20:07:15] [V] [TRT] MatMul_1218 [MatMul] inputs: [2116 -> (-1, -1, 256)[FLOAT]], [3364 -> (256, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3364 for ONNX node: 3364 [05/10/2022-20:07:15] [V] [TRT] Registering layer: MatMul_1218 for ONNX node: MatMul_1218 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2121 for ONNX tensor: 2121 [05/10/2022-20:07:15] [V] [TRT] MatMul_1218 [MatMul] outputs: [2121 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1219 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.self_attn.linear_q.bias [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2121 [05/10/2022-20:07:15] [V] [TRT] Add_1219 [Add] inputs: [encoder.encoders.7.self_attn.linear_q.bias -> (256)[FLOAT]], [2121 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.self_attn.linear_q.bias for ONNX node: encoder.encoders.7.self_attn.linear_q.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1219 for ONNX node: Add_1219 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2122 for ONNX tensor: 2122 [05/10/2022-20:07:15] [V] [TRT] Add_1219 [Add] outputs: [2122 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Constant_1220 [Constant] [05/10/2022-20:07:15] [V] [TRT] Constant_1220 [Constant] inputs: [05/10/2022-20:07:15] [V] [TRT] Constant_1220 [Constant] outputs: [2126 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Unsqueeze_1221 [Unsqueeze] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2119 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2126 [05/10/2022-20:07:15] [V] [TRT] Unsqueeze_1221 [Unsqueeze] inputs: [2119 -> ()[INT32]], [2126 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:15] [V] [TRT] Registering layer: Unsqueeze_1221 for ONNX node: Unsqueeze_1221 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2127 for ONNX tensor: 2127 [05/10/2022-20:07:15] [V] [TRT] Unsqueeze_1221 [Unsqueeze] outputs: [2127 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Concat_1222 [Concat] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2127 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3365 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3366 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3367 [05/10/2022-20:07:15] [V] [TRT] Concat_1222 [Concat] inputs: [2127 -> (1)[INT32]], [3365 -> (1)[INT32]], [3366 -> (1)[INT32]], [3367 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3365 for ONNX node: 3365 [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3366 for ONNX node: 3366 [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3367 for ONNX node: 3367 [05/10/2022-20:07:15] [V] [TRT] Registering layer: Concat_1222 for ONNX node: Concat_1222 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2134 for ONNX tensor: 2134 [05/10/2022-20:07:15] [V] [TRT] Concat_1222 [Concat] outputs: [2134 -> (4)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Reshape_1223 [Reshape] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2122 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2134 [05/10/2022-20:07:15] [V] [TRT] Reshape_1223 [Reshape] inputs: [2122 -> (-1, -1, 256)[FLOAT]], [2134 -> (4)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Reshape_1223 for ONNX node: Reshape_1223 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2135 for ONNX tensor: 2135 [05/10/2022-20:07:15] [V] [TRT] Reshape_1223 [Reshape] outputs: [2135 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: MatMul_1224 [MatMul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2116 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3368 [05/10/2022-20:07:15] [V] [TRT] MatMul_1224 [MatMul] inputs: [2116 -> (-1, -1, 256)[FLOAT]], [3368 -> (256, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3368 for ONNX node: 3368 [05/10/2022-20:07:15] [V] [TRT] Registering layer: MatMul_1224 for ONNX node: MatMul_1224 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2137 for ONNX tensor: 2137 [05/10/2022-20:07:15] [V] [TRT] MatMul_1224 [MatMul] outputs: [2137 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1225 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.self_attn.linear_k.bias [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2137 [05/10/2022-20:07:15] [V] [TRT] Add_1225 [Add] inputs: [encoder.encoders.7.self_attn.linear_k.bias -> (256)[FLOAT]], [2137 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.self_attn.linear_k.bias for ONNX node: encoder.encoders.7.self_attn.linear_k.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1225 for ONNX node: Add_1225 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2138 for ONNX tensor: 2138 [05/10/2022-20:07:15] [V] [TRT] Add_1225 [Add] outputs: [2138 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Constant_1226 [Constant] [05/10/2022-20:07:15] [V] [TRT] Constant_1226 [Constant] inputs: [05/10/2022-20:07:15] [V] [TRT] Constant_1226 [Constant] outputs: [2142 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Unsqueeze_1227 [Unsqueeze] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2119 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2142 [05/10/2022-20:07:15] [V] [TRT] Unsqueeze_1227 [Unsqueeze] inputs: [2119 -> ()[INT32]], [2142 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:15] [V] [TRT] Registering layer: Unsqueeze_1227 for ONNX node: Unsqueeze_1227 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2143 for ONNX tensor: 2143 [05/10/2022-20:07:15] [V] [TRT] Unsqueeze_1227 [Unsqueeze] outputs: [2143 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Concat_1228 [Concat] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2143 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3369 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3370 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3371 [05/10/2022-20:07:15] [V] [TRT] Concat_1228 [Concat] inputs: [2143 -> (1)[INT32]], [3369 -> (1)[INT32]], [3370 -> (1)[INT32]], [3371 -> (1)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3369 for ONNX node: 3369 [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3370 for ONNX node: 3370 [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3371 for ONNX node: 3371 [05/10/2022-20:07:15] [V] [TRT] Registering layer: Concat_1228 for ONNX node: Concat_1228 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2150 for ONNX tensor: 2150 [05/10/2022-20:07:15] [V] [TRT] Concat_1228 [Concat] outputs: [2150 -> (4)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Reshape_1229 [Reshape] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2138 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2150 [05/10/2022-20:07:15] [V] [TRT] Reshape_1229 [Reshape] inputs: [2138 -> (-1, -1, 256)[FLOAT]], [2150 -> (4)[INT32]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: Reshape_1229 for ONNX node: Reshape_1229 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2151 for ONNX tensor: 2151 [05/10/2022-20:07:15] [V] [TRT] Reshape_1229 [Reshape] outputs: [2151 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: MatMul_1230 [MatMul] [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2116 [05/10/2022-20:07:15] [V] [TRT] Searching for input: 3372 [05/10/2022-20:07:15] [V] [TRT] MatMul_1230 [MatMul] inputs: [2116 -> (-1, -1, 256)[FLOAT]], [3372 -> (256, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: 3372 for ONNX node: 3372 [05/10/2022-20:07:15] [V] [TRT] Registering layer: MatMul_1230 for ONNX node: MatMul_1230 [05/10/2022-20:07:15] [V] [TRT] Registering tensor: 2153 for ONNX tensor: 2153 [05/10/2022-20:07:15] [V] [TRT] MatMul_1230 [MatMul] outputs: [2153 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Parsing node: Add_1231 [Add] [05/10/2022-20:07:15] [V] [TRT] Searching for input: encoder.encoders.7.self_attn.linear_v.bias [05/10/2022-20:07:15] [V] [TRT] Searching for input: 2153 [05/10/2022-20:07:15] [V] [TRT] Add_1231 [Add] inputs: [encoder.encoders.7.self_attn.linear_v.bias -> (256)[FLOAT]], [2153 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:15] [V] [TRT] Registering layer: encoder.encoders.7.self_attn.linear_v.bias for ONNX node: encoder.encoders.7.self_attn.linear_v.bias [05/10/2022-20:07:15] [V] [TRT] Registering layer: Add_1231 for ONNX node: Add_1231 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2154 for ONNX tensor: 2154 [05/10/2022-20:07:16] [V] [TRT] Add_1231 [Add] outputs: [2154 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1232 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1232 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1232 [Constant] outputs: [2158 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Unsqueeze_1233 [Unsqueeze] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2119 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2158 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1233 [Unsqueeze] inputs: [2119 -> ()[INT32]], [2158 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:16] [V] [TRT] Registering layer: Unsqueeze_1233 for ONNX node: Unsqueeze_1233 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2159 for ONNX tensor: 2159 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1233 [Unsqueeze] outputs: [2159 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Concat_1234 [Concat] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2159 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3373 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3374 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3375 [05/10/2022-20:07:16] [V] [TRT] Concat_1234 [Concat] inputs: [2159 -> (1)[INT32]], [3373 -> (1)[INT32]], [3374 -> (1)[INT32]], [3375 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3373 for ONNX node: 3373 [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3374 for ONNX node: 3374 [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3375 for ONNX node: 3375 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Concat_1234 for ONNX node: Concat_1234 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2166 for ONNX tensor: 2166 [05/10/2022-20:07:16] [V] [TRT] Concat_1234 [Concat] outputs: [2166 -> (4)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Reshape_1235 [Reshape] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2154 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2166 [05/10/2022-20:07:16] [V] [TRT] Reshape_1235 [Reshape] inputs: [2154 -> (-1, -1, 256)[FLOAT]], [2166 -> (4)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Reshape_1235 for ONNX node: Reshape_1235 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2167 for ONNX tensor: 2167 [05/10/2022-20:07:16] [V] [TRT] Reshape_1235 [Reshape] outputs: [2167 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Transpose_1236 [Transpose] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2167 [05/10/2022-20:07:16] [V] [TRT] Transpose_1236 [Transpose] inputs: [2167 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Transpose_1236 for ONNX node: Transpose_1236 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2168 for ONNX tensor: 2168 [05/10/2022-20:07:16] [V] [TRT] Transpose_1236 [Transpose] outputs: [2168 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Shape_1237 [Shape] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:16] [V] [TRT] Shape_1237 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Shape_1237 for ONNX node: Shape_1237 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2169 for ONNX tensor: 2169 [05/10/2022-20:07:16] [V] [TRT] Shape_1237 [Shape] outputs: [2169 -> (3)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1238 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1238 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1238 [Constant] outputs: [2170 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Gather_1239 [Gather] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2169 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2170 [05/10/2022-20:07:16] [V] [TRT] Gather_1239 [Gather] inputs: [2169 -> (3)[INT32]], [2170 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2170 for ONNX node: 2170 [05/10/2022-20:07:16] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Gather_1239 for ONNX node: Gather_1239 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2171 for ONNX tensor: 2171 [05/10/2022-20:07:16] [V] [TRT] Gather_1239 [Gather] outputs: [2171 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: MatMul_1240 [MatMul] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3376 [05/10/2022-20:07:16] [V] [TRT] MatMul_1240 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3376 -> (256, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3376 for ONNX node: 3376 [05/10/2022-20:07:16] [V] [TRT] Registering layer: MatMul_1240 for ONNX node: MatMul_1240 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2173 for ONNX tensor: 2173 [05/10/2022-20:07:16] [V] [TRT] MatMul_1240 [MatMul] outputs: [2173 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1241 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1241 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1241 [Constant] outputs: [2177 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Unsqueeze_1242 [Unsqueeze] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2171 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2177 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1242 [Unsqueeze] inputs: [2171 -> ()[INT32]], [2177 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:16] [V] [TRT] Registering layer: Unsqueeze_1242 for ONNX node: Unsqueeze_1242 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2178 for ONNX tensor: 2178 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1242 [Unsqueeze] outputs: [2178 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Concat_1243 [Concat] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2178 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3377 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3378 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3379 [05/10/2022-20:07:16] [V] [TRT] Concat_1243 [Concat] inputs: [2178 -> (1)[INT32]], [3377 -> (1)[INT32]], [3378 -> (1)[INT32]], [3379 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3377 for ONNX node: 3377 [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3378 for ONNX node: 3378 [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3379 for ONNX node: 3379 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Concat_1243 for ONNX node: Concat_1243 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2185 for ONNX tensor: 2185 [05/10/2022-20:07:16] [V] [TRT] Concat_1243 [Concat] outputs: [2185 -> (4)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Reshape_1244 [Reshape] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2173 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2185 [05/10/2022-20:07:16] [V] [TRT] Reshape_1244 [Reshape] inputs: [2173 -> (1, -1, 256)[FLOAT]], [2185 -> (4)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Reshape_1244 for ONNX node: Reshape_1244 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2186 for ONNX tensor: 2186 [05/10/2022-20:07:16] [V] [TRT] Reshape_1244 [Reshape] outputs: [2186 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Add_1245 [Add] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2135 [05/10/2022-20:07:16] [V] [TRT] Searching for input: encoder.encoders.7.self_attn.pos_bias_u [05/10/2022-20:07:16] [V] [TRT] Add_1245 [Add] inputs: [2135 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.7.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: encoder.encoders.7.self_attn.pos_bias_u for ONNX node: encoder.encoders.7.self_attn.pos_bias_u [05/10/2022-20:07:16] [V] [TRT] Registering layer: Add_1245 for ONNX node: Add_1245 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2187 for ONNX tensor: 2187 [05/10/2022-20:07:16] [V] [TRT] Add_1245 [Add] outputs: [2187 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Transpose_1246 [Transpose] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2187 [05/10/2022-20:07:16] [V] [TRT] Transpose_1246 [Transpose] inputs: [2187 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Transpose_1246 for ONNX node: Transpose_1246 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2188 for ONNX tensor: 2188 [05/10/2022-20:07:16] [V] [TRT] Transpose_1246 [Transpose] outputs: [2188 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Add_1247 [Add] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2135 [05/10/2022-20:07:16] [V] [TRT] Searching for input: encoder.encoders.7.self_attn.pos_bias_v [05/10/2022-20:07:16] [V] [TRT] Add_1247 [Add] inputs: [2135 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.7.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: encoder.encoders.7.self_attn.pos_bias_v for ONNX node: encoder.encoders.7.self_attn.pos_bias_v [05/10/2022-20:07:16] [V] [TRT] Registering layer: Add_1247 for ONNX node: Add_1247 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2189 for ONNX tensor: 2189 [05/10/2022-20:07:16] [V] [TRT] Add_1247 [Add] outputs: [2189 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Transpose_1248 [Transpose] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2189 [05/10/2022-20:07:16] [V] [TRT] Transpose_1248 [Transpose] inputs: [2189 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Transpose_1248 for ONNX node: Transpose_1248 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2190 for ONNX tensor: 2190 [05/10/2022-20:07:16] [V] [TRT] Transpose_1248 [Transpose] outputs: [2190 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Transpose_1249 [Transpose] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2151 [05/10/2022-20:07:16] [V] [TRT] Transpose_1249 [Transpose] inputs: [2151 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Transpose_1249 for ONNX node: Transpose_1249 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2191 for ONNX tensor: 2191 [05/10/2022-20:07:16] [V] [TRT] Transpose_1249 [Transpose] outputs: [2191 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: MatMul_1250 [MatMul] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2188 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2191 [05/10/2022-20:07:16] [V] [TRT] MatMul_1250 [MatMul] inputs: [2188 -> (-1, 4, -1, 64)[FLOAT]], [2191 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: MatMul_1250 for ONNX node: MatMul_1250 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2192 for ONNX tensor: 2192 [05/10/2022-20:07:16] [V] [TRT] MatMul_1250 [MatMul] outputs: [2192 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Transpose_1251 [Transpose] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2186 [05/10/2022-20:07:16] [V] [TRT] Transpose_1251 [Transpose] inputs: [2186 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Transpose_1251 for ONNX node: Transpose_1251 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2193 for ONNX tensor: 2193 [05/10/2022-20:07:16] [V] [TRT] Transpose_1251 [Transpose] outputs: [2193 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: MatMul_1252 [MatMul] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2190 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2193 [05/10/2022-20:07:16] [V] [TRT] MatMul_1252 [MatMul] inputs: [2190 -> (-1, 4, -1, 64)[FLOAT]], [2193 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: MatMul_1252 for ONNX node: MatMul_1252 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2194 for ONNX tensor: 2194 [05/10/2022-20:07:16] [V] [TRT] MatMul_1252 [MatMul] outputs: [2194 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Add_1253 [Add] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2192 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2194 [05/10/2022-20:07:16] [V] [TRT] Add_1253 [Add] inputs: [2192 -> (-1, 4, -1, -1)[FLOAT]], [2194 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Add_1253 for ONNX node: Add_1253 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2195 for ONNX tensor: 2195 [05/10/2022-20:07:16] [V] [TRT] Add_1253 [Add] outputs: [2195 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1254 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1254 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1254 [Constant] outputs: [2196 -> ()[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Div_1255 [Div] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2195 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2196 [05/10/2022-20:07:16] [V] [TRT] Div_1255 [Div] inputs: [2195 -> (-1, 4, -1, -1)[FLOAT]], [2196 -> ()[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2196 for ONNX node: 2196 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Div_1255 for ONNX node: Div_1255 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2197 for ONNX tensor: 2197 [05/10/2022-20:07:16] [V] [TRT] Div_1255 [Div] outputs: [2197 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Shape_1256 [Shape] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2168 [05/10/2022-20:07:16] [V] [TRT] Shape_1256 [Shape] inputs: [2168 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Shape_1256 for ONNX node: Shape_1256 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2198 for ONNX tensor: 2198 [05/10/2022-20:07:16] [V] [TRT] Shape_1256 [Shape] outputs: [2198 -> (4)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1257 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1257 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1257 [Constant] outputs: [2199 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Gather_1258 [Gather] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2198 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2199 [05/10/2022-20:07:16] [V] [TRT] Gather_1258 [Gather] inputs: [2198 -> (4)[INT32]], [2199 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2199 for ONNX node: 2199 [05/10/2022-20:07:16] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Gather_1258 for ONNX node: Gather_1258 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2200 for ONNX tensor: 2200 [05/10/2022-20:07:16] [V] [TRT] Gather_1258 [Gather] outputs: [2200 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1259 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1259 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1259 [Constant] outputs: [2201 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Unsqueeze_1260 [Unsqueeze] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2201 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1260 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [2201 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:16] [V] [TRT] Registering layer: Unsqueeze_1260 for ONNX node: Unsqueeze_1260 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2202 for ONNX tensor: 2202 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1260 [Unsqueeze] outputs: [2202 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Cast_1261 [Cast] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2202 [05/10/2022-20:07:16] [V] [TRT] Cast_1261 [Cast] inputs: [2202 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Cast_1261 for ONNX node: Cast_1261 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2203 for ONNX tensor: 2203 [05/10/2022-20:07:16] [V] [TRT] Cast_1261 [Cast] outputs: [2203 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1262 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1262 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1262 [Constant] outputs: [2204 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Equal_1263 [Equal] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2203 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2204 [05/10/2022-20:07:16] [V] [TRT] Equal_1263 [Equal] inputs: [2203 -> (-1, 1, 1, -1)[INT32]], [2204 -> ()[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2204 for ONNX node: 2204 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Equal_1263 for ONNX node: Equal_1263 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2205 for ONNX tensor: 2205 [05/10/2022-20:07:16] [V] [TRT] Equal_1263 [Equal] outputs: [2205 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Cast_1264 [Cast] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2205 [05/10/2022-20:07:16] [V] [TRT] Cast_1264 [Cast] inputs: [2205 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Casting to type: bool [05/10/2022-20:07:16] [V] [TRT] Registering layer: Cast_1264 for ONNX node: Cast_1264 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2206 for ONNX tensor: 2206 [05/10/2022-20:07:16] [V] [TRT] Cast_1264 [Cast] outputs: [2206 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1265 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1265 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1265 [Constant] outputs: [2207 -> ()[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Where_1266 [Where] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2206 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2207 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2197 [05/10/2022-20:07:16] [V] [TRT] Where_1266 [Where] inputs: [2206 -> (-1, 1, 1, -1)[BOOL]], [2207 -> ()[FLOAT]], [2197 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2207 for ONNX node: 2207 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Where_1266 for ONNX node: Where_1266 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2208 for ONNX tensor: 2208 [05/10/2022-20:07:16] [V] [TRT] Where_1266 [Where] outputs: [2208 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Softmax_1267 [Softmax] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2208 [05/10/2022-20:07:16] [V] [TRT] Softmax_1267 [Softmax] inputs: [2208 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Softmax_1267 for ONNX node: Softmax_1267 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2209 for ONNX tensor: 2209 [05/10/2022-20:07:16] [V] [TRT] Softmax_1267 [Softmax] outputs: [2209 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Cast_1268 [Cast] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2205 [05/10/2022-20:07:16] [V] [TRT] Cast_1268 [Cast] inputs: [2205 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Casting to type: bool [05/10/2022-20:07:16] [V] [TRT] Registering layer: Cast_1268 for ONNX node: Cast_1268 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2210 for ONNX tensor: 2210 [05/10/2022-20:07:16] [V] [TRT] Cast_1268 [Cast] outputs: [2210 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1269 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1269 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1269 [Constant] outputs: [2211 -> ()[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Where_1270 [Where] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2210 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2211 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2209 [05/10/2022-20:07:16] [V] [TRT] Where_1270 [Where] inputs: [2210 -> (-1, 1, 1, -1)[BOOL]], [2211 -> ()[FLOAT]], [2209 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2211 for ONNX node: 2211 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Where_1270 for ONNX node: Where_1270 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2212 for ONNX tensor: 2212 [05/10/2022-20:07:16] [V] [TRT] Where_1270 [Where] outputs: [2212 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: MatMul_1271 [MatMul] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2212 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2168 [05/10/2022-20:07:16] [V] [TRT] MatMul_1271 [MatMul] inputs: [2212 -> (-1, 4, -1, -1)[FLOAT]], [2168 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: MatMul_1271 for ONNX node: MatMul_1271 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2213 for ONNX tensor: 2213 [05/10/2022-20:07:16] [V] [TRT] MatMul_1271 [MatMul] outputs: [2213 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Transpose_1272 [Transpose] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2213 [05/10/2022-20:07:16] [V] [TRT] Transpose_1272 [Transpose] inputs: [2213 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Transpose_1272 for ONNX node: Transpose_1272 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2214 for ONNX tensor: 2214 [05/10/2022-20:07:16] [V] [TRT] Transpose_1272 [Transpose] outputs: [2214 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1273 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1273 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1273 [Constant] outputs: [2217 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Unsqueeze_1274 [Unsqueeze] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2200 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2217 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1274 [Unsqueeze] inputs: [2200 -> ()[INT32]], [2217 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:16] [V] [TRT] Registering layer: Unsqueeze_1274 for ONNX node: Unsqueeze_1274 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2218 for ONNX tensor: 2218 [05/10/2022-20:07:16] [V] [TRT] Unsqueeze_1274 [Unsqueeze] outputs: [2218 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Concat_1275 [Concat] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2218 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3380 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3381 [05/10/2022-20:07:16] [V] [TRT] Concat_1275 [Concat] inputs: [2218 -> (1)[INT32]], [3380 -> (1)[INT32]], [3381 -> (1)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3380 for ONNX node: 3380 [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3381 for ONNX node: 3381 [05/10/2022-20:07:16] [V] [TRT] Registering layer: Concat_1275 for ONNX node: Concat_1275 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2223 for ONNX tensor: 2223 [05/10/2022-20:07:16] [V] [TRT] Concat_1275 [Concat] outputs: [2223 -> (3)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Reshape_1276 [Reshape] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2214 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2223 [05/10/2022-20:07:16] [V] [TRT] Reshape_1276 [Reshape] inputs: [2214 -> (-1, -1, 4, 64)[FLOAT]], [2223 -> (3)[INT32]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Reshape_1276 for ONNX node: Reshape_1276 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2224 for ONNX tensor: 2224 [05/10/2022-20:07:16] [V] [TRT] Reshape_1276 [Reshape] outputs: [2224 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: MatMul_1277 [MatMul] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2224 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 3382 [05/10/2022-20:07:16] [V] [TRT] MatMul_1277 [MatMul] inputs: [2224 -> (-1, -1, 256)[FLOAT]], [3382 -> (256, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 3382 for ONNX node: 3382 [05/10/2022-20:07:16] [V] [TRT] Registering layer: MatMul_1277 for ONNX node: MatMul_1277 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2226 for ONNX tensor: 2226 [05/10/2022-20:07:16] [V] [TRT] MatMul_1277 [MatMul] outputs: [2226 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Add_1278 [Add] [05/10/2022-20:07:16] [V] [TRT] Searching for input: encoder.encoders.7.self_attn.linear_out.bias [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2226 [05/10/2022-20:07:16] [V] [TRT] Add_1278 [Add] inputs: [encoder.encoders.7.self_attn.linear_out.bias -> (256)[FLOAT]], [2226 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: encoder.encoders.7.self_attn.linear_out.bias for ONNX node: encoder.encoders.7.self_attn.linear_out.bias [05/10/2022-20:07:16] [V] [TRT] Registering layer: Add_1278 for ONNX node: Add_1278 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2227 for ONNX tensor: 2227 [05/10/2022-20:07:16] [V] [TRT] Add_1278 [Add] outputs: [2227 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Add_1279 [Add] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2105 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2227 [05/10/2022-20:07:16] [V] [TRT] Add_1279 [Add] inputs: [2105 -> (-1, -1, 256)[FLOAT]], [2227 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Add_1279 for ONNX node: Add_1279 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2228 for ONNX tensor: 2228 [05/10/2022-20:07:16] [V] [TRT] Add_1279 [Add] outputs: [2228 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: ReduceMean_1280 [ReduceMean] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2228 [05/10/2022-20:07:16] [V] [TRT] ReduceMean_1280 [ReduceMean] inputs: [2228 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: ReduceMean_1280 for ONNX node: ReduceMean_1280 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2229 for ONNX tensor: 2229 [05/10/2022-20:07:16] [V] [TRT] ReduceMean_1280 [ReduceMean] outputs: [2229 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Sub_1281 [Sub] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2228 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2229 [05/10/2022-20:07:16] [V] [TRT] Sub_1281 [Sub] inputs: [2228 -> (-1, -1, 256)[FLOAT]], [2229 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: Sub_1281 for ONNX node: Sub_1281 [05/10/2022-20:07:16] [V] [TRT] Registering tensor: 2230 for ONNX tensor: 2230 [05/10/2022-20:07:16] [V] [TRT] Sub_1281 [Sub] outputs: [2230 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Constant_1282 [Constant] [05/10/2022-20:07:16] [V] [TRT] Constant_1282 [Constant] inputs: [05/10/2022-20:07:16] [V] [TRT] Constant_1282 [Constant] outputs: [2231 -> ()[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Parsing node: Pow_1283 [Pow] [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2230 [05/10/2022-20:07:16] [V] [TRT] Searching for input: 2231 [05/10/2022-20:07:16] [V] [TRT] Pow_1283 [Pow] inputs: [2230 -> (-1, -1, 256)[FLOAT]], [2231 -> ()[FLOAT]], [05/10/2022-20:07:16] [V] [TRT] Registering layer: 2231 for ONNX node: 2231 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Pow_1283 for ONNX node: Pow_1283 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2232 for ONNX tensor: 2232 [05/10/2022-20:07:17] [V] [TRT] Pow_1283 [Pow] outputs: [2232 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: ReduceMean_1284 [ReduceMean] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2232 [05/10/2022-20:07:17] [V] [TRT] ReduceMean_1284 [ReduceMean] inputs: [2232 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: ReduceMean_1284 for ONNX node: ReduceMean_1284 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2233 for ONNX tensor: 2233 [05/10/2022-20:07:17] [V] [TRT] ReduceMean_1284 [ReduceMean] outputs: [2233 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Constant_1285 [Constant] [05/10/2022-20:07:17] [V] [TRT] Constant_1285 [Constant] inputs: [05/10/2022-20:07:17] [V] [TRT] Constant_1285 [Constant] outputs: [2234 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Add_1286 [Add] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2233 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2234 [05/10/2022-20:07:17] [V] [TRT] Add_1286 [Add] inputs: [2233 -> (-1, -1, 1)[FLOAT]], [2234 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: 2234 for ONNX node: 2234 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Add_1286 for ONNX node: Add_1286 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2235 for ONNX tensor: 2235 [05/10/2022-20:07:17] [V] [TRT] Add_1286 [Add] outputs: [2235 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Sqrt_1287 [Sqrt] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2235 [05/10/2022-20:07:17] [V] [TRT] Sqrt_1287 [Sqrt] inputs: [2235 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Sqrt_1287 for ONNX node: Sqrt_1287 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2236 for ONNX tensor: 2236 [05/10/2022-20:07:17] [V] [TRT] Sqrt_1287 [Sqrt] outputs: [2236 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Div_1288 [Div] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2230 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2236 [05/10/2022-20:07:17] [V] [TRT] Div_1288 [Div] inputs: [2230 -> (-1, -1, 256)[FLOAT]], [2236 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Div_1288 for ONNX node: Div_1288 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2237 for ONNX tensor: 2237 [05/10/2022-20:07:17] [V] [TRT] Div_1288 [Div] outputs: [2237 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Mul_1289 [Mul] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2237 [05/10/2022-20:07:17] [V] [TRT] Searching for input: encoder.encoders.7.norm_conv.weight [05/10/2022-20:07:17] [V] [TRT] Mul_1289 [Mul] inputs: [2237 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: encoder.encoders.7.norm_conv.weight for ONNX node: encoder.encoders.7.norm_conv.weight [05/10/2022-20:07:17] [V] [TRT] Registering layer: Mul_1289 for ONNX node: Mul_1289 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2238 for ONNX tensor: 2238 [05/10/2022-20:07:17] [V] [TRT] Mul_1289 [Mul] outputs: [2238 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Add_1290 [Add] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2238 [05/10/2022-20:07:17] [V] [TRT] Searching for input: encoder.encoders.7.norm_conv.bias [05/10/2022-20:07:17] [V] [TRT] Add_1290 [Add] inputs: [2238 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: encoder.encoders.7.norm_conv.bias for ONNX node: encoder.encoders.7.norm_conv.bias [05/10/2022-20:07:17] [V] [TRT] Registering layer: Add_1290 for ONNX node: Add_1290 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2239 for ONNX tensor: 2239 [05/10/2022-20:07:17] [V] [TRT] Add_1290 [Add] outputs: [2239 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Transpose_1291 [Transpose] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2239 [05/10/2022-20:07:17] [V] [TRT] Transpose_1291 [Transpose] inputs: [2239 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Transpose_1291 for ONNX node: Transpose_1291 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2240 for ONNX tensor: 2240 [05/10/2022-20:07:17] [V] [TRT] Transpose_1291 [Transpose] outputs: [2240 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Not_1292 [Not] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:17] [V] [TRT] Not_1292 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Not_1292 for ONNX node: Not_1292 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2241 for ONNX tensor: 2241 [05/10/2022-20:07:17] [V] [TRT] Not_1292 [Not] outputs: [2241 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Cast_1293 [Cast] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2241 [05/10/2022-20:07:17] [V] [TRT] Cast_1293 [Cast] inputs: [2241 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Casting to type: bool [05/10/2022-20:07:17] [V] [TRT] Registering layer: Cast_1293 for ONNX node: Cast_1293 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2242 for ONNX tensor: 2242 [05/10/2022-20:07:17] [V] [TRT] Cast_1293 [Cast] outputs: [2242 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Constant_1294 [Constant] [05/10/2022-20:07:17] [V] [TRT] Constant_1294 [Constant] inputs: [05/10/2022-20:07:17] [V] [TRT] Constant_1294 [Constant] outputs: [2243 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Where_1295 [Where] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2242 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2243 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2240 [05/10/2022-20:07:17] [V] [TRT] Where_1295 [Where] inputs: [2242 -> (-1, 1, -1)[BOOL]], [2243 -> ()[FLOAT]], [2240 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: 2243 for ONNX node: 2243 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Where_1295 for ONNX node: Where_1295 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2244 for ONNX tensor: 2244 [05/10/2022-20:07:17] [V] [TRT] Where_1295 [Where] outputs: [2244 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Conv_1296 [Conv] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2244 [05/10/2022-20:07:17] [V] [TRT] Searching for input: encoder.encoders.7.conv_module.pointwise_conv1.weight [05/10/2022-20:07:17] [V] [TRT] Searching for input: encoder.encoders.7.conv_module.pointwise_conv1.bias [05/10/2022-20:07:17] [V] [TRT] Conv_1296 [Conv] inputs: [2244 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.7.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.7.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:17] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:17] [V] [TRT] Registering layer: Conv_1296 for ONNX node: Conv_1296 [05/10/2022-20:07:17] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:17] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:17] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2245 for ONNX tensor: 2245 [05/10/2022-20:07:17] [V] [TRT] Conv_1296 [Conv] outputs: [2245 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Split_1297 [Split] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2245 [05/10/2022-20:07:17] [V] [TRT] Split_1297 [Split] inputs: [2245 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Split_1297 for ONNX node: Split_1297 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Split_1297_9 for ONNX node: Split_1297 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2246 for ONNX tensor: 2246 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2247 for ONNX tensor: 2247 [05/10/2022-20:07:17] [V] [TRT] Split_1297 [Split] outputs: [2246 -> (-1, 256, -1)[FLOAT]], [2247 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Sigmoid_1298 [Sigmoid] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2247 [05/10/2022-20:07:17] [V] [TRT] Sigmoid_1298 [Sigmoid] inputs: [2247 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Sigmoid_1298 for ONNX node: Sigmoid_1298 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2248 for ONNX tensor: 2248 [05/10/2022-20:07:17] [V] [TRT] Sigmoid_1298 [Sigmoid] outputs: [2248 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Mul_1299 [Mul] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2246 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2248 [05/10/2022-20:07:17] [V] [TRT] Mul_1299 [Mul] inputs: [2246 -> (-1, 256, -1)[FLOAT]], [2248 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Mul_1299 for ONNX node: Mul_1299 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2249 for ONNX tensor: 2249 [05/10/2022-20:07:17] [V] [TRT] Mul_1299 [Mul] outputs: [2249 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Conv_1300 [Conv] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2249 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 3182 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 3183 [05/10/2022-20:07:17] [V] [TRT] Conv_1300 [Conv] inputs: [2249 -> (-1, 256, -1)[FLOAT]], [3182 -> (256, 1, 15)[FLOAT]], [3183 -> (256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:17] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:17] [V] [TRT] Registering layer: Conv_1300 for ONNX node: Conv_1300 [05/10/2022-20:07:17] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:17] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:17] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 3181 for ONNX tensor: 3181 [05/10/2022-20:07:17] [V] [TRT] Conv_1300 [Conv] outputs: [3181 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Sigmoid_1301 [Sigmoid] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 3181 [05/10/2022-20:07:17] [V] [TRT] Sigmoid_1301 [Sigmoid] inputs: [3181 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Sigmoid_1301 for ONNX node: Sigmoid_1301 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2252 for ONNX tensor: 2252 [05/10/2022-20:07:17] [V] [TRT] Sigmoid_1301 [Sigmoid] outputs: [2252 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Mul_1302 [Mul] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 3181 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2252 [05/10/2022-20:07:17] [V] [TRT] Mul_1302 [Mul] inputs: [3181 -> (-1, 256, -1)[FLOAT]], [2252 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Mul_1302 for ONNX node: Mul_1302 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2253 for ONNX tensor: 2253 [05/10/2022-20:07:17] [V] [TRT] Mul_1302 [Mul] outputs: [2253 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Not_1303 [Not] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:17] [V] [TRT] Not_1303 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Not_1303 for ONNX node: Not_1303 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2254 for ONNX tensor: 2254 [05/10/2022-20:07:17] [V] [TRT] Not_1303 [Not] outputs: [2254 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Conv_1304 [Conv] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2253 [05/10/2022-20:07:17] [V] [TRT] Searching for input: encoder.encoders.7.conv_module.pointwise_conv2.weight [05/10/2022-20:07:17] [V] [TRT] Searching for input: encoder.encoders.7.conv_module.pointwise_conv2.bias [05/10/2022-20:07:17] [V] [TRT] Conv_1304 [Conv] inputs: [2253 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.7.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.7.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:17] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:17] [V] [TRT] Registering layer: Conv_1304 for ONNX node: Conv_1304 [05/10/2022-20:07:17] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:17] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:17] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2255 for ONNX tensor: 2255 [05/10/2022-20:07:17] [V] [TRT] Conv_1304 [Conv] outputs: [2255 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Cast_1305 [Cast] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2254 [05/10/2022-20:07:17] [V] [TRT] Cast_1305 [Cast] inputs: [2254 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Casting to type: bool [05/10/2022-20:07:17] [V] [TRT] Registering layer: Cast_1305 for ONNX node: Cast_1305 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2256 for ONNX tensor: 2256 [05/10/2022-20:07:17] [V] [TRT] Cast_1305 [Cast] outputs: [2256 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Constant_1306 [Constant] [05/10/2022-20:07:17] [V] [TRT] Constant_1306 [Constant] inputs: [05/10/2022-20:07:17] [V] [TRT] Constant_1306 [Constant] outputs: [2257 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Where_1307 [Where] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2256 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2257 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2255 [05/10/2022-20:07:17] [V] [TRT] Where_1307 [Where] inputs: [2256 -> (-1, 1, -1)[BOOL]], [2257 -> ()[FLOAT]], [2255 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: 2257 for ONNX node: 2257 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Where_1307 for ONNX node: Where_1307 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2258 for ONNX tensor: 2258 [05/10/2022-20:07:17] [V] [TRT] Where_1307 [Where] outputs: [2258 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Transpose_1308 [Transpose] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2258 [05/10/2022-20:07:17] [V] [TRT] Transpose_1308 [Transpose] inputs: [2258 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Transpose_1308 for ONNX node: Transpose_1308 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2259 for ONNX tensor: 2259 [05/10/2022-20:07:17] [V] [TRT] Transpose_1308 [Transpose] outputs: [2259 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Add_1309 [Add] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2228 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2259 [05/10/2022-20:07:17] [V] [TRT] Add_1309 [Add] inputs: [2228 -> (-1, -1, 256)[FLOAT]], [2259 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Add_1309 for ONNX node: Add_1309 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2260 for ONNX tensor: 2260 [05/10/2022-20:07:17] [V] [TRT] Add_1309 [Add] outputs: [2260 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: ReduceMean_1310 [ReduceMean] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2260 [05/10/2022-20:07:17] [V] [TRT] ReduceMean_1310 [ReduceMean] inputs: [2260 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: ReduceMean_1310 for ONNX node: ReduceMean_1310 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2261 for ONNX tensor: 2261 [05/10/2022-20:07:17] [V] [TRT] ReduceMean_1310 [ReduceMean] outputs: [2261 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Sub_1311 [Sub] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2260 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2261 [05/10/2022-20:07:17] [V] [TRT] Sub_1311 [Sub] inputs: [2260 -> (-1, -1, 256)[FLOAT]], [2261 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Sub_1311 for ONNX node: Sub_1311 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2262 for ONNX tensor: 2262 [05/10/2022-20:07:17] [V] [TRT] Sub_1311 [Sub] outputs: [2262 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Constant_1312 [Constant] [05/10/2022-20:07:17] [V] [TRT] Constant_1312 [Constant] inputs: [05/10/2022-20:07:17] [V] [TRT] Constant_1312 [Constant] outputs: [2263 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Pow_1313 [Pow] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2262 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2263 [05/10/2022-20:07:17] [V] [TRT] Pow_1313 [Pow] inputs: [2262 -> (-1, -1, 256)[FLOAT]], [2263 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: 2263 for ONNX node: 2263 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Pow_1313 for ONNX node: Pow_1313 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2264 for ONNX tensor: 2264 [05/10/2022-20:07:17] [V] [TRT] Pow_1313 [Pow] outputs: [2264 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: ReduceMean_1314 [ReduceMean] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2264 [05/10/2022-20:07:17] [V] [TRT] ReduceMean_1314 [ReduceMean] inputs: [2264 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: ReduceMean_1314 for ONNX node: ReduceMean_1314 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2265 for ONNX tensor: 2265 [05/10/2022-20:07:17] [V] [TRT] ReduceMean_1314 [ReduceMean] outputs: [2265 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Constant_1315 [Constant] [05/10/2022-20:07:17] [V] [TRT] Constant_1315 [Constant] inputs: [05/10/2022-20:07:17] [V] [TRT] Constant_1315 [Constant] outputs: [2266 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Add_1316 [Add] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2265 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2266 [05/10/2022-20:07:17] [V] [TRT] Add_1316 [Add] inputs: [2265 -> (-1, -1, 1)[FLOAT]], [2266 -> ()[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: 2266 for ONNX node: 2266 [05/10/2022-20:07:17] [V] [TRT] Registering layer: Add_1316 for ONNX node: Add_1316 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2267 for ONNX tensor: 2267 [05/10/2022-20:07:17] [V] [TRT] Add_1316 [Add] outputs: [2267 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Sqrt_1317 [Sqrt] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2267 [05/10/2022-20:07:17] [V] [TRT] Sqrt_1317 [Sqrt] inputs: [2267 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Sqrt_1317 for ONNX node: Sqrt_1317 [05/10/2022-20:07:17] [V] [TRT] Registering tensor: 2268 for ONNX tensor: 2268 [05/10/2022-20:07:17] [V] [TRT] Sqrt_1317 [Sqrt] outputs: [2268 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Parsing node: Div_1318 [Div] [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2262 [05/10/2022-20:07:17] [V] [TRT] Searching for input: 2268 [05/10/2022-20:07:17] [V] [TRT] Div_1318 [Div] inputs: [2262 -> (-1, -1, 256)[FLOAT]], [2268 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:17] [V] [TRT] Registering layer: Div_1318 for ONNX node: Div_1318 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2269 for ONNX tensor: 2269 [05/10/2022-20:07:18] [V] [TRT] Div_1318 [Div] outputs: [2269 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Mul_1319 [Mul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2269 [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.7.norm_ff.weight [05/10/2022-20:07:18] [V] [TRT] Mul_1319 [Mul] inputs: [2269 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.7.norm_ff.weight for ONNX node: encoder.encoders.7.norm_ff.weight [05/10/2022-20:07:18] [V] [TRT] Registering layer: Mul_1319 for ONNX node: Mul_1319 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2270 for ONNX tensor: 2270 [05/10/2022-20:07:18] [V] [TRT] Mul_1319 [Mul] outputs: [2270 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1320 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2270 [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.7.norm_ff.bias [05/10/2022-20:07:18] [V] [TRT] Add_1320 [Add] inputs: [2270 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.7.norm_ff.bias for ONNX node: encoder.encoders.7.norm_ff.bias [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1320 for ONNX node: Add_1320 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2271 for ONNX tensor: 2271 [05/10/2022-20:07:18] [V] [TRT] Add_1320 [Add] outputs: [2271 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: MatMul_1321 [MatMul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2271 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 3383 [05/10/2022-20:07:18] [V] [TRT] MatMul_1321 [MatMul] inputs: [2271 -> (-1, -1, 256)[FLOAT]], [3383 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 3383 for ONNX node: 3383 [05/10/2022-20:07:18] [V] [TRT] Registering layer: MatMul_1321 for ONNX node: MatMul_1321 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2273 for ONNX tensor: 2273 [05/10/2022-20:07:18] [V] [TRT] MatMul_1321 [MatMul] outputs: [2273 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1322 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.7.feed_forward.w_1.bias [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2273 [05/10/2022-20:07:18] [V] [TRT] Add_1322 [Add] inputs: [encoder.encoders.7.feed_forward.w_1.bias -> (2048)[FLOAT]], [2273 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.7.feed_forward.w_1.bias for ONNX node: encoder.encoders.7.feed_forward.w_1.bias [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1322 for ONNX node: Add_1322 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2274 for ONNX tensor: 2274 [05/10/2022-20:07:18] [V] [TRT] Add_1322 [Add] outputs: [2274 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Sigmoid_1323 [Sigmoid] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2274 [05/10/2022-20:07:18] [V] [TRT] Sigmoid_1323 [Sigmoid] inputs: [2274 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Sigmoid_1323 for ONNX node: Sigmoid_1323 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2275 for ONNX tensor: 2275 [05/10/2022-20:07:18] [V] [TRT] Sigmoid_1323 [Sigmoid] outputs: [2275 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Mul_1324 [Mul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2274 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2275 [05/10/2022-20:07:18] [V] [TRT] Mul_1324 [Mul] inputs: [2274 -> (-1, -1, 2048)[FLOAT]], [2275 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Mul_1324 for ONNX node: Mul_1324 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2276 for ONNX tensor: 2276 [05/10/2022-20:07:18] [V] [TRT] Mul_1324 [Mul] outputs: [2276 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: MatMul_1325 [MatMul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2276 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 3384 [05/10/2022-20:07:18] [V] [TRT] MatMul_1325 [MatMul] inputs: [2276 -> (-1, -1, 2048)[FLOAT]], [3384 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 3384 for ONNX node: 3384 [05/10/2022-20:07:18] [V] [TRT] Registering layer: MatMul_1325 for ONNX node: MatMul_1325 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2278 for ONNX tensor: 2278 [05/10/2022-20:07:18] [V] [TRT] MatMul_1325 [MatMul] outputs: [2278 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1326 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.7.feed_forward.w_2.bias [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2278 [05/10/2022-20:07:18] [V] [TRT] Add_1326 [Add] inputs: [encoder.encoders.7.feed_forward.w_2.bias -> (256)[FLOAT]], [2278 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.7.feed_forward.w_2.bias for ONNX node: encoder.encoders.7.feed_forward.w_2.bias [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1326 for ONNX node: Add_1326 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2279 for ONNX tensor: 2279 [05/10/2022-20:07:18] [V] [TRT] Add_1326 [Add] outputs: [2279 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Constant_1327 [Constant] [05/10/2022-20:07:18] [V] [TRT] Constant_1327 [Constant] inputs: [05/10/2022-20:07:18] [V] [TRT] Constant_1327 [Constant] outputs: [2280 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Mul_1328 [Mul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2279 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2280 [05/10/2022-20:07:18] [V] [TRT] Mul_1328 [Mul] inputs: [2279 -> (-1, -1, 256)[FLOAT]], [2280 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 2280 for ONNX node: 2280 [05/10/2022-20:07:18] [V] [TRT] Registering layer: Mul_1328 for ONNX node: Mul_1328 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2281 for ONNX tensor: 2281 [05/10/2022-20:07:18] [V] [TRT] Mul_1328 [Mul] outputs: [2281 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1329 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2260 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2281 [05/10/2022-20:07:18] [V] [TRT] Add_1329 [Add] inputs: [2260 -> (-1, -1, 256)[FLOAT]], [2281 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1329 for ONNX node: Add_1329 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2282 for ONNX tensor: 2282 [05/10/2022-20:07:18] [V] [TRT] Add_1329 [Add] outputs: [2282 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: ReduceMean_1330 [ReduceMean] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2282 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1330 [ReduceMean] inputs: [2282 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: ReduceMean_1330 for ONNX node: ReduceMean_1330 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2283 for ONNX tensor: 2283 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1330 [ReduceMean] outputs: [2283 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Sub_1331 [Sub] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2282 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2283 [05/10/2022-20:07:18] [V] [TRT] Sub_1331 [Sub] inputs: [2282 -> (-1, -1, 256)[FLOAT]], [2283 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Sub_1331 for ONNX node: Sub_1331 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2284 for ONNX tensor: 2284 [05/10/2022-20:07:18] [V] [TRT] Sub_1331 [Sub] outputs: [2284 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Constant_1332 [Constant] [05/10/2022-20:07:18] [V] [TRT] Constant_1332 [Constant] inputs: [05/10/2022-20:07:18] [V] [TRT] Constant_1332 [Constant] outputs: [2285 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Pow_1333 [Pow] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2284 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2285 [05/10/2022-20:07:18] [V] [TRT] Pow_1333 [Pow] inputs: [2284 -> (-1, -1, 256)[FLOAT]], [2285 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 2285 for ONNX node: 2285 [05/10/2022-20:07:18] [V] [TRT] Registering layer: Pow_1333 for ONNX node: Pow_1333 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2286 for ONNX tensor: 2286 [05/10/2022-20:07:18] [V] [TRT] Pow_1333 [Pow] outputs: [2286 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: ReduceMean_1334 [ReduceMean] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2286 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1334 [ReduceMean] inputs: [2286 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: ReduceMean_1334 for ONNX node: ReduceMean_1334 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2287 for ONNX tensor: 2287 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1334 [ReduceMean] outputs: [2287 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Constant_1335 [Constant] [05/10/2022-20:07:18] [V] [TRT] Constant_1335 [Constant] inputs: [05/10/2022-20:07:18] [V] [TRT] Constant_1335 [Constant] outputs: [2288 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1336 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2287 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2288 [05/10/2022-20:07:18] [V] [TRT] Add_1336 [Add] inputs: [2287 -> (-1, -1, 1)[FLOAT]], [2288 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 2288 for ONNX node: 2288 [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1336 for ONNX node: Add_1336 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2289 for ONNX tensor: 2289 [05/10/2022-20:07:18] [V] [TRT] Add_1336 [Add] outputs: [2289 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Sqrt_1337 [Sqrt] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2289 [05/10/2022-20:07:18] [V] [TRT] Sqrt_1337 [Sqrt] inputs: [2289 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Sqrt_1337 for ONNX node: Sqrt_1337 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2290 for ONNX tensor: 2290 [05/10/2022-20:07:18] [V] [TRT] Sqrt_1337 [Sqrt] outputs: [2290 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Div_1338 [Div] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2284 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2290 [05/10/2022-20:07:18] [V] [TRT] Div_1338 [Div] inputs: [2284 -> (-1, -1, 256)[FLOAT]], [2290 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Div_1338 for ONNX node: Div_1338 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2291 for ONNX tensor: 2291 [05/10/2022-20:07:18] [V] [TRT] Div_1338 [Div] outputs: [2291 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Mul_1339 [Mul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2291 [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.7.norm_final.weight [05/10/2022-20:07:18] [V] [TRT] Mul_1339 [Mul] inputs: [2291 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.7.norm_final.weight for ONNX node: encoder.encoders.7.norm_final.weight [05/10/2022-20:07:18] [V] [TRT] Registering layer: Mul_1339 for ONNX node: Mul_1339 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2292 for ONNX tensor: 2292 [05/10/2022-20:07:18] [V] [TRT] Mul_1339 [Mul] outputs: [2292 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1340 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2292 [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.7.norm_final.bias [05/10/2022-20:07:18] [V] [TRT] Add_1340 [Add] inputs: [2292 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.7.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.7.norm_final.bias for ONNX node: encoder.encoders.7.norm_final.bias [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1340 for ONNX node: Add_1340 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2293 for ONNX tensor: 2293 [05/10/2022-20:07:18] [V] [TRT] Add_1340 [Add] outputs: [2293 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: ReduceMean_1341 [ReduceMean] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2293 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1341 [ReduceMean] inputs: [2293 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: ReduceMean_1341 for ONNX node: ReduceMean_1341 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2294 for ONNX tensor: 2294 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1341 [ReduceMean] outputs: [2294 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Sub_1342 [Sub] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2293 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2294 [05/10/2022-20:07:18] [V] [TRT] Sub_1342 [Sub] inputs: [2293 -> (-1, -1, 256)[FLOAT]], [2294 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Sub_1342 for ONNX node: Sub_1342 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2295 for ONNX tensor: 2295 [05/10/2022-20:07:18] [V] [TRT] Sub_1342 [Sub] outputs: [2295 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Constant_1343 [Constant] [05/10/2022-20:07:18] [V] [TRT] Constant_1343 [Constant] inputs: [05/10/2022-20:07:18] [V] [TRT] Constant_1343 [Constant] outputs: [2296 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Pow_1344 [Pow] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2295 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2296 [05/10/2022-20:07:18] [V] [TRT] Pow_1344 [Pow] inputs: [2295 -> (-1, -1, 256)[FLOAT]], [2296 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 2296 for ONNX node: 2296 [05/10/2022-20:07:18] [V] [TRT] Registering layer: Pow_1344 for ONNX node: Pow_1344 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2297 for ONNX tensor: 2297 [05/10/2022-20:07:18] [V] [TRT] Pow_1344 [Pow] outputs: [2297 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: ReduceMean_1345 [ReduceMean] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2297 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1345 [ReduceMean] inputs: [2297 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: ReduceMean_1345 for ONNX node: ReduceMean_1345 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2298 for ONNX tensor: 2298 [05/10/2022-20:07:18] [V] [TRT] ReduceMean_1345 [ReduceMean] outputs: [2298 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Constant_1346 [Constant] [05/10/2022-20:07:18] [V] [TRT] Constant_1346 [Constant] inputs: [05/10/2022-20:07:18] [V] [TRT] Constant_1346 [Constant] outputs: [2299 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1347 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2298 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2299 [05/10/2022-20:07:18] [V] [TRT] Add_1347 [Add] inputs: [2298 -> (-1, -1, 1)[FLOAT]], [2299 -> ()[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 2299 for ONNX node: 2299 [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1347 for ONNX node: Add_1347 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2300 for ONNX tensor: 2300 [05/10/2022-20:07:18] [V] [TRT] Add_1347 [Add] outputs: [2300 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Sqrt_1348 [Sqrt] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2300 [05/10/2022-20:07:18] [V] [TRT] Sqrt_1348 [Sqrt] inputs: [2300 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Sqrt_1348 for ONNX node: Sqrt_1348 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2301 for ONNX tensor: 2301 [05/10/2022-20:07:18] [V] [TRT] Sqrt_1348 [Sqrt] outputs: [2301 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Div_1349 [Div] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2295 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2301 [05/10/2022-20:07:18] [V] [TRT] Div_1349 [Div] inputs: [2295 -> (-1, -1, 256)[FLOAT]], [2301 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Div_1349 for ONNX node: Div_1349 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2302 for ONNX tensor: 2302 [05/10/2022-20:07:18] [V] [TRT] Div_1349 [Div] outputs: [2302 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Mul_1350 [Mul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2302 [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.8.norm_ff_macaron.weight [05/10/2022-20:07:18] [V] [TRT] Mul_1350 [Mul] inputs: [2302 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.8.norm_ff_macaron.weight for ONNX node: encoder.encoders.8.norm_ff_macaron.weight [05/10/2022-20:07:18] [V] [TRT] Registering layer: Mul_1350 for ONNX node: Mul_1350 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2303 for ONNX tensor: 2303 [05/10/2022-20:07:18] [V] [TRT] Mul_1350 [Mul] outputs: [2303 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1351 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2303 [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.8.norm_ff_macaron.bias [05/10/2022-20:07:18] [V] [TRT] Add_1351 [Add] inputs: [2303 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.8.norm_ff_macaron.bias for ONNX node: encoder.encoders.8.norm_ff_macaron.bias [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1351 for ONNX node: Add_1351 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2304 for ONNX tensor: 2304 [05/10/2022-20:07:18] [V] [TRT] Add_1351 [Add] outputs: [2304 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: MatMul_1352 [MatMul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2304 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 3385 [05/10/2022-20:07:18] [V] [TRT] MatMul_1352 [MatMul] inputs: [2304 -> (-1, -1, 256)[FLOAT]], [3385 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: 3385 for ONNX node: 3385 [05/10/2022-20:07:18] [V] [TRT] Registering layer: MatMul_1352 for ONNX node: MatMul_1352 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2306 for ONNX tensor: 2306 [05/10/2022-20:07:18] [V] [TRT] MatMul_1352 [MatMul] outputs: [2306 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Add_1353 [Add] [05/10/2022-20:07:18] [V] [TRT] Searching for input: encoder.encoders.8.feed_forward_macaron.w_1.bias [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2306 [05/10/2022-20:07:18] [V] [TRT] Add_1353 [Add] inputs: [encoder.encoders.8.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [2306 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: encoder.encoders.8.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.8.feed_forward_macaron.w_1.bias [05/10/2022-20:07:18] [V] [TRT] Registering layer: Add_1353 for ONNX node: Add_1353 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2307 for ONNX tensor: 2307 [05/10/2022-20:07:18] [V] [TRT] Add_1353 [Add] outputs: [2307 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Sigmoid_1354 [Sigmoid] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2307 [05/10/2022-20:07:18] [V] [TRT] Sigmoid_1354 [Sigmoid] inputs: [2307 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Sigmoid_1354 for ONNX node: Sigmoid_1354 [05/10/2022-20:07:18] [V] [TRT] Registering tensor: 2308 for ONNX tensor: 2308 [05/10/2022-20:07:18] [V] [TRT] Sigmoid_1354 [Sigmoid] outputs: [2308 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Parsing node: Mul_1355 [Mul] [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2307 [05/10/2022-20:07:18] [V] [TRT] Searching for input: 2308 [05/10/2022-20:07:18] [V] [TRT] Mul_1355 [Mul] inputs: [2307 -> (-1, -1, 2048)[FLOAT]], [2308 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:18] [V] [TRT] Registering layer: Mul_1355 for ONNX node: Mul_1355 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2309 for ONNX tensor: 2309 [05/10/2022-20:07:19] [V] [TRT] Mul_1355 [Mul] outputs: [2309 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: MatMul_1356 [MatMul] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2309 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3386 [05/10/2022-20:07:19] [V] [TRT] MatMul_1356 [MatMul] inputs: [2309 -> (-1, -1, 2048)[FLOAT]], [3386 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3386 for ONNX node: 3386 [05/10/2022-20:07:19] [V] [TRT] Registering layer: MatMul_1356 for ONNX node: MatMul_1356 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2311 for ONNX tensor: 2311 [05/10/2022-20:07:19] [V] [TRT] MatMul_1356 [MatMul] outputs: [2311 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1357 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: encoder.encoders.8.feed_forward_macaron.w_2.bias [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2311 [05/10/2022-20:07:19] [V] [TRT] Add_1357 [Add] inputs: [encoder.encoders.8.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [2311 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: encoder.encoders.8.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.8.feed_forward_macaron.w_2.bias [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1357 for ONNX node: Add_1357 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2312 for ONNX tensor: 2312 [05/10/2022-20:07:19] [V] [TRT] Add_1357 [Add] outputs: [2312 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1358 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1358 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1358 [Constant] outputs: [2313 -> ()[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Mul_1359 [Mul] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2312 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2313 [05/10/2022-20:07:19] [V] [TRT] Mul_1359 [Mul] inputs: [2312 -> (-1, -1, 256)[FLOAT]], [2313 -> ()[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 2313 for ONNX node: 2313 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Mul_1359 for ONNX node: Mul_1359 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2314 for ONNX tensor: 2314 [05/10/2022-20:07:19] [V] [TRT] Mul_1359 [Mul] outputs: [2314 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1360 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2293 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2314 [05/10/2022-20:07:19] [V] [TRT] Add_1360 [Add] inputs: [2293 -> (-1, -1, 256)[FLOAT]], [2314 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1360 for ONNX node: Add_1360 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2315 for ONNX tensor: 2315 [05/10/2022-20:07:19] [V] [TRT] Add_1360 [Add] outputs: [2315 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: ReduceMean_1361 [ReduceMean] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2315 [05/10/2022-20:07:19] [V] [TRT] ReduceMean_1361 [ReduceMean] inputs: [2315 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: ReduceMean_1361 for ONNX node: ReduceMean_1361 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2316 for ONNX tensor: 2316 [05/10/2022-20:07:19] [V] [TRT] ReduceMean_1361 [ReduceMean] outputs: [2316 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Sub_1362 [Sub] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2315 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2316 [05/10/2022-20:07:19] [V] [TRT] Sub_1362 [Sub] inputs: [2315 -> (-1, -1, 256)[FLOAT]], [2316 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Sub_1362 for ONNX node: Sub_1362 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2317 for ONNX tensor: 2317 [05/10/2022-20:07:19] [V] [TRT] Sub_1362 [Sub] outputs: [2317 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1363 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1363 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1363 [Constant] outputs: [2318 -> ()[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Pow_1364 [Pow] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2317 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2318 [05/10/2022-20:07:19] [V] [TRT] Pow_1364 [Pow] inputs: [2317 -> (-1, -1, 256)[FLOAT]], [2318 -> ()[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 2318 for ONNX node: 2318 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Pow_1364 for ONNX node: Pow_1364 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2319 for ONNX tensor: 2319 [05/10/2022-20:07:19] [V] [TRT] Pow_1364 [Pow] outputs: [2319 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: ReduceMean_1365 [ReduceMean] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2319 [05/10/2022-20:07:19] [V] [TRT] ReduceMean_1365 [ReduceMean] inputs: [2319 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: ReduceMean_1365 for ONNX node: ReduceMean_1365 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2320 for ONNX tensor: 2320 [05/10/2022-20:07:19] [V] [TRT] ReduceMean_1365 [ReduceMean] outputs: [2320 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1366 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1366 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1366 [Constant] outputs: [2321 -> ()[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1367 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2320 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2321 [05/10/2022-20:07:19] [V] [TRT] Add_1367 [Add] inputs: [2320 -> (-1, -1, 1)[FLOAT]], [2321 -> ()[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 2321 for ONNX node: 2321 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1367 for ONNX node: Add_1367 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2322 for ONNX tensor: 2322 [05/10/2022-20:07:19] [V] [TRT] Add_1367 [Add] outputs: [2322 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Sqrt_1368 [Sqrt] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2322 [05/10/2022-20:07:19] [V] [TRT] Sqrt_1368 [Sqrt] inputs: [2322 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Sqrt_1368 for ONNX node: Sqrt_1368 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2323 for ONNX tensor: 2323 [05/10/2022-20:07:19] [V] [TRT] Sqrt_1368 [Sqrt] outputs: [2323 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Div_1369 [Div] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2317 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2323 [05/10/2022-20:07:19] [V] [TRT] Div_1369 [Div] inputs: [2317 -> (-1, -1, 256)[FLOAT]], [2323 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Div_1369 for ONNX node: Div_1369 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2324 for ONNX tensor: 2324 [05/10/2022-20:07:19] [V] [TRT] Div_1369 [Div] outputs: [2324 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Mul_1370 [Mul] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2324 [05/10/2022-20:07:19] [V] [TRT] Searching for input: encoder.encoders.8.norm_mha.weight [05/10/2022-20:07:19] [V] [TRT] Mul_1370 [Mul] inputs: [2324 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: encoder.encoders.8.norm_mha.weight for ONNX node: encoder.encoders.8.norm_mha.weight [05/10/2022-20:07:19] [V] [TRT] Registering layer: Mul_1370 for ONNX node: Mul_1370 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2325 for ONNX tensor: 2325 [05/10/2022-20:07:19] [V] [TRT] Mul_1370 [Mul] outputs: [2325 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1371 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2325 [05/10/2022-20:07:19] [V] [TRT] Searching for input: encoder.encoders.8.norm_mha.bias [05/10/2022-20:07:19] [V] [TRT] Add_1371 [Add] inputs: [2325 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: encoder.encoders.8.norm_mha.bias for ONNX node: encoder.encoders.8.norm_mha.bias [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1371 for ONNX node: Add_1371 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2326 for ONNX tensor: 2326 [05/10/2022-20:07:19] [V] [TRT] Add_1371 [Add] outputs: [2326 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Shape_1372 [Shape] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2326 [05/10/2022-20:07:19] [V] [TRT] Shape_1372 [Shape] inputs: [2326 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Shape_1372 for ONNX node: Shape_1372 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2327 for ONNX tensor: 2327 [05/10/2022-20:07:19] [V] [TRT] Shape_1372 [Shape] outputs: [2327 -> (3)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1373 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1373 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1373 [Constant] outputs: [2328 -> ()[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Gather_1374 [Gather] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2327 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2328 [05/10/2022-20:07:19] [V] [TRT] Gather_1374 [Gather] inputs: [2327 -> (3)[INT32]], [2328 -> ()[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 2328 for ONNX node: 2328 [05/10/2022-20:07:19] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Gather_1374 for ONNX node: Gather_1374 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2329 for ONNX tensor: 2329 [05/10/2022-20:07:19] [V] [TRT] Gather_1374 [Gather] outputs: [2329 -> ()[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: MatMul_1375 [MatMul] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2326 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3387 [05/10/2022-20:07:19] [V] [TRT] MatMul_1375 [MatMul] inputs: [2326 -> (-1, -1, 256)[FLOAT]], [3387 -> (256, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3387 for ONNX node: 3387 [05/10/2022-20:07:19] [V] [TRT] Registering layer: MatMul_1375 for ONNX node: MatMul_1375 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2331 for ONNX tensor: 2331 [05/10/2022-20:07:19] [V] [TRT] MatMul_1375 [MatMul] outputs: [2331 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1376 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: encoder.encoders.8.self_attn.linear_q.bias [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2331 [05/10/2022-20:07:19] [V] [TRT] Add_1376 [Add] inputs: [encoder.encoders.8.self_attn.linear_q.bias -> (256)[FLOAT]], [2331 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: encoder.encoders.8.self_attn.linear_q.bias for ONNX node: encoder.encoders.8.self_attn.linear_q.bias [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1376 for ONNX node: Add_1376 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2332 for ONNX tensor: 2332 [05/10/2022-20:07:19] [V] [TRT] Add_1376 [Add] outputs: [2332 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1377 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1377 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1377 [Constant] outputs: [2336 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Unsqueeze_1378 [Unsqueeze] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2329 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2336 [05/10/2022-20:07:19] [V] [TRT] Unsqueeze_1378 [Unsqueeze] inputs: [2329 -> ()[INT32]], [2336 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:19] [V] [TRT] Registering layer: Unsqueeze_1378 for ONNX node: Unsqueeze_1378 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2337 for ONNX tensor: 2337 [05/10/2022-20:07:19] [V] [TRT] Unsqueeze_1378 [Unsqueeze] outputs: [2337 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Concat_1379 [Concat] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2337 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3388 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3389 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3390 [05/10/2022-20:07:19] [V] [TRT] Concat_1379 [Concat] inputs: [2337 -> (1)[INT32]], [3388 -> (1)[INT32]], [3389 -> (1)[INT32]], [3390 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3388 for ONNX node: 3388 [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3389 for ONNX node: 3389 [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3390 for ONNX node: 3390 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Concat_1379 for ONNX node: Concat_1379 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2344 for ONNX tensor: 2344 [05/10/2022-20:07:19] [V] [TRT] Concat_1379 [Concat] outputs: [2344 -> (4)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Reshape_1380 [Reshape] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2332 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2344 [05/10/2022-20:07:19] [V] [TRT] Reshape_1380 [Reshape] inputs: [2332 -> (-1, -1, 256)[FLOAT]], [2344 -> (4)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Reshape_1380 for ONNX node: Reshape_1380 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2345 for ONNX tensor: 2345 [05/10/2022-20:07:19] [V] [TRT] Reshape_1380 [Reshape] outputs: [2345 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: MatMul_1381 [MatMul] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2326 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3391 [05/10/2022-20:07:19] [V] [TRT] MatMul_1381 [MatMul] inputs: [2326 -> (-1, -1, 256)[FLOAT]], [3391 -> (256, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3391 for ONNX node: 3391 [05/10/2022-20:07:19] [V] [TRT] Registering layer: MatMul_1381 for ONNX node: MatMul_1381 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2347 for ONNX tensor: 2347 [05/10/2022-20:07:19] [V] [TRT] MatMul_1381 [MatMul] outputs: [2347 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1382 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: encoder.encoders.8.self_attn.linear_k.bias [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2347 [05/10/2022-20:07:19] [V] [TRT] Add_1382 [Add] inputs: [encoder.encoders.8.self_attn.linear_k.bias -> (256)[FLOAT]], [2347 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: encoder.encoders.8.self_attn.linear_k.bias for ONNX node: encoder.encoders.8.self_attn.linear_k.bias [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1382 for ONNX node: Add_1382 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2348 for ONNX tensor: 2348 [05/10/2022-20:07:19] [V] [TRT] Add_1382 [Add] outputs: [2348 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1383 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1383 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1383 [Constant] outputs: [2352 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Unsqueeze_1384 [Unsqueeze] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2329 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2352 [05/10/2022-20:07:19] [V] [TRT] Unsqueeze_1384 [Unsqueeze] inputs: [2329 -> ()[INT32]], [2352 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:19] [V] [TRT] Registering layer: Unsqueeze_1384 for ONNX node: Unsqueeze_1384 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2353 for ONNX tensor: 2353 [05/10/2022-20:07:19] [V] [TRT] Unsqueeze_1384 [Unsqueeze] outputs: [2353 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Concat_1385 [Concat] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2353 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3392 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3393 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3394 [05/10/2022-20:07:19] [V] [TRT] Concat_1385 [Concat] inputs: [2353 -> (1)[INT32]], [3392 -> (1)[INT32]], [3393 -> (1)[INT32]], [3394 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3392 for ONNX node: 3392 [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3393 for ONNX node: 3393 [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3394 for ONNX node: 3394 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Concat_1385 for ONNX node: Concat_1385 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2360 for ONNX tensor: 2360 [05/10/2022-20:07:19] [V] [TRT] Concat_1385 [Concat] outputs: [2360 -> (4)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Reshape_1386 [Reshape] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2348 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2360 [05/10/2022-20:07:19] [V] [TRT] Reshape_1386 [Reshape] inputs: [2348 -> (-1, -1, 256)[FLOAT]], [2360 -> (4)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Reshape_1386 for ONNX node: Reshape_1386 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2361 for ONNX tensor: 2361 [05/10/2022-20:07:19] [V] [TRT] Reshape_1386 [Reshape] outputs: [2361 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: MatMul_1387 [MatMul] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2326 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3395 [05/10/2022-20:07:19] [V] [TRT] MatMul_1387 [MatMul] inputs: [2326 -> (-1, -1, 256)[FLOAT]], [3395 -> (256, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3395 for ONNX node: 3395 [05/10/2022-20:07:19] [V] [TRT] Registering layer: MatMul_1387 for ONNX node: MatMul_1387 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2363 for ONNX tensor: 2363 [05/10/2022-20:07:19] [V] [TRT] MatMul_1387 [MatMul] outputs: [2363 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Add_1388 [Add] [05/10/2022-20:07:19] [V] [TRT] Searching for input: encoder.encoders.8.self_attn.linear_v.bias [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2363 [05/10/2022-20:07:19] [V] [TRT] Add_1388 [Add] inputs: [encoder.encoders.8.self_attn.linear_v.bias -> (256)[FLOAT]], [2363 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: encoder.encoders.8.self_attn.linear_v.bias for ONNX node: encoder.encoders.8.self_attn.linear_v.bias [05/10/2022-20:07:19] [V] [TRT] Registering layer: Add_1388 for ONNX node: Add_1388 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2364 for ONNX tensor: 2364 [05/10/2022-20:07:19] [V] [TRT] Add_1388 [Add] outputs: [2364 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Constant_1389 [Constant] [05/10/2022-20:07:19] [V] [TRT] Constant_1389 [Constant] inputs: [05/10/2022-20:07:19] [V] [TRT] Constant_1389 [Constant] outputs: [2368 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Unsqueeze_1390 [Unsqueeze] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2329 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2368 [05/10/2022-20:07:19] [V] [TRT] Unsqueeze_1390 [Unsqueeze] inputs: [2329 -> ()[INT32]], [2368 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:19] [V] [TRT] Registering layer: Unsqueeze_1390 for ONNX node: Unsqueeze_1390 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2369 for ONNX tensor: 2369 [05/10/2022-20:07:19] [V] [TRT] Unsqueeze_1390 [Unsqueeze] outputs: [2369 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Concat_1391 [Concat] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2369 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3396 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3397 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 3398 [05/10/2022-20:07:19] [V] [TRT] Concat_1391 [Concat] inputs: [2369 -> (1)[INT32]], [3396 -> (1)[INT32]], [3397 -> (1)[INT32]], [3398 -> (1)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3396 for ONNX node: 3396 [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3397 for ONNX node: 3397 [05/10/2022-20:07:19] [V] [TRT] Registering layer: 3398 for ONNX node: 3398 [05/10/2022-20:07:19] [V] [TRT] Registering layer: Concat_1391 for ONNX node: Concat_1391 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2376 for ONNX tensor: 2376 [05/10/2022-20:07:19] [V] [TRT] Concat_1391 [Concat] outputs: [2376 -> (4)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Reshape_1392 [Reshape] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2364 [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2376 [05/10/2022-20:07:19] [V] [TRT] Reshape_1392 [Reshape] inputs: [2364 -> (-1, -1, 256)[FLOAT]], [2376 -> (4)[INT32]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Reshape_1392 for ONNX node: Reshape_1392 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2377 for ONNX tensor: 2377 [05/10/2022-20:07:19] [V] [TRT] Reshape_1392 [Reshape] outputs: [2377 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Transpose_1393 [Transpose] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 2377 [05/10/2022-20:07:19] [V] [TRT] Transpose_1393 [Transpose] inputs: [2377 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Transpose_1393 for ONNX node: Transpose_1393 [05/10/2022-20:07:19] [V] [TRT] Registering tensor: 2378 for ONNX tensor: 2378 [05/10/2022-20:07:19] [V] [TRT] Transpose_1393 [Transpose] outputs: [2378 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Parsing node: Shape_1394 [Shape] [05/10/2022-20:07:19] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:19] [V] [TRT] Shape_1394 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:19] [V] [TRT] Registering layer: Shape_1394 for ONNX node: Shape_1394 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2379 for ONNX tensor: 2379 [05/10/2022-20:07:20] [V] [TRT] Shape_1394 [Shape] outputs: [2379 -> (3)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1395 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1395 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1395 [Constant] outputs: [2380 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Gather_1396 [Gather] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2379 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2380 [05/10/2022-20:07:20] [V] [TRT] Gather_1396 [Gather] inputs: [2379 -> (3)[INT32]], [2380 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 2380 for ONNX node: 2380 [05/10/2022-20:07:20] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Gather_1396 for ONNX node: Gather_1396 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2381 for ONNX tensor: 2381 [05/10/2022-20:07:20] [V] [TRT] Gather_1396 [Gather] outputs: [2381 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: MatMul_1397 [MatMul] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3399 [05/10/2022-20:07:20] [V] [TRT] MatMul_1397 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3399 -> (256, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3399 for ONNX node: 3399 [05/10/2022-20:07:20] [V] [TRT] Registering layer: MatMul_1397 for ONNX node: MatMul_1397 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2383 for ONNX tensor: 2383 [05/10/2022-20:07:20] [V] [TRT] MatMul_1397 [MatMul] outputs: [2383 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1398 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1398 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1398 [Constant] outputs: [2387 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Unsqueeze_1399 [Unsqueeze] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2381 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2387 [05/10/2022-20:07:20] [V] [TRT] Unsqueeze_1399 [Unsqueeze] inputs: [2381 -> ()[INT32]], [2387 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:20] [V] [TRT] Registering layer: Unsqueeze_1399 for ONNX node: Unsqueeze_1399 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2388 for ONNX tensor: 2388 [05/10/2022-20:07:20] [V] [TRT] Unsqueeze_1399 [Unsqueeze] outputs: [2388 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Concat_1400 [Concat] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2388 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3400 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3401 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3402 [05/10/2022-20:07:20] [V] [TRT] Concat_1400 [Concat] inputs: [2388 -> (1)[INT32]], [3400 -> (1)[INT32]], [3401 -> (1)[INT32]], [3402 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3400 for ONNX node: 3400 [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3401 for ONNX node: 3401 [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3402 for ONNX node: 3402 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Concat_1400 for ONNX node: Concat_1400 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2395 for ONNX tensor: 2395 [05/10/2022-20:07:20] [V] [TRT] Concat_1400 [Concat] outputs: [2395 -> (4)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Reshape_1401 [Reshape] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2383 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2395 [05/10/2022-20:07:20] [V] [TRT] Reshape_1401 [Reshape] inputs: [2383 -> (1, -1, 256)[FLOAT]], [2395 -> (4)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Reshape_1401 for ONNX node: Reshape_1401 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2396 for ONNX tensor: 2396 [05/10/2022-20:07:20] [V] [TRT] Reshape_1401 [Reshape] outputs: [2396 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Add_1402 [Add] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2345 [05/10/2022-20:07:20] [V] [TRT] Searching for input: encoder.encoders.8.self_attn.pos_bias_u [05/10/2022-20:07:20] [V] [TRT] Add_1402 [Add] inputs: [2345 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.8.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: encoder.encoders.8.self_attn.pos_bias_u for ONNX node: encoder.encoders.8.self_attn.pos_bias_u [05/10/2022-20:07:20] [V] [TRT] Registering layer: Add_1402 for ONNX node: Add_1402 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2397 for ONNX tensor: 2397 [05/10/2022-20:07:20] [V] [TRT] Add_1402 [Add] outputs: [2397 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Transpose_1403 [Transpose] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2397 [05/10/2022-20:07:20] [V] [TRT] Transpose_1403 [Transpose] inputs: [2397 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Transpose_1403 for ONNX node: Transpose_1403 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2398 for ONNX tensor: 2398 [05/10/2022-20:07:20] [V] [TRT] Transpose_1403 [Transpose] outputs: [2398 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Add_1404 [Add] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2345 [05/10/2022-20:07:20] [V] [TRT] Searching for input: encoder.encoders.8.self_attn.pos_bias_v [05/10/2022-20:07:20] [V] [TRT] Add_1404 [Add] inputs: [2345 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.8.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: encoder.encoders.8.self_attn.pos_bias_v for ONNX node: encoder.encoders.8.self_attn.pos_bias_v [05/10/2022-20:07:20] [V] [TRT] Registering layer: Add_1404 for ONNX node: Add_1404 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2399 for ONNX tensor: 2399 [05/10/2022-20:07:20] [V] [TRT] Add_1404 [Add] outputs: [2399 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Transpose_1405 [Transpose] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2399 [05/10/2022-20:07:20] [V] [TRT] Transpose_1405 [Transpose] inputs: [2399 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Transpose_1405 for ONNX node: Transpose_1405 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2400 for ONNX tensor: 2400 [05/10/2022-20:07:20] [V] [TRT] Transpose_1405 [Transpose] outputs: [2400 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Transpose_1406 [Transpose] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2361 [05/10/2022-20:07:20] [V] [TRT] Transpose_1406 [Transpose] inputs: [2361 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Transpose_1406 for ONNX node: Transpose_1406 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2401 for ONNX tensor: 2401 [05/10/2022-20:07:20] [V] [TRT] Transpose_1406 [Transpose] outputs: [2401 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: MatMul_1407 [MatMul] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2398 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2401 [05/10/2022-20:07:20] [V] [TRT] MatMul_1407 [MatMul] inputs: [2398 -> (-1, 4, -1, 64)[FLOAT]], [2401 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: MatMul_1407 for ONNX node: MatMul_1407 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2402 for ONNX tensor: 2402 [05/10/2022-20:07:20] [V] [TRT] MatMul_1407 [MatMul] outputs: [2402 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Transpose_1408 [Transpose] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2396 [05/10/2022-20:07:20] [V] [TRT] Transpose_1408 [Transpose] inputs: [2396 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Transpose_1408 for ONNX node: Transpose_1408 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2403 for ONNX tensor: 2403 [05/10/2022-20:07:20] [V] [TRT] Transpose_1408 [Transpose] outputs: [2403 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: MatMul_1409 [MatMul] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2400 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2403 [05/10/2022-20:07:20] [V] [TRT] MatMul_1409 [MatMul] inputs: [2400 -> (-1, 4, -1, 64)[FLOAT]], [2403 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: MatMul_1409 for ONNX node: MatMul_1409 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2404 for ONNX tensor: 2404 [05/10/2022-20:07:20] [V] [TRT] MatMul_1409 [MatMul] outputs: [2404 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Add_1410 [Add] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2402 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2404 [05/10/2022-20:07:20] [V] [TRT] Add_1410 [Add] inputs: [2402 -> (-1, 4, -1, -1)[FLOAT]], [2404 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Add_1410 for ONNX node: Add_1410 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2405 for ONNX tensor: 2405 [05/10/2022-20:07:20] [V] [TRT] Add_1410 [Add] outputs: [2405 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1411 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1411 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1411 [Constant] outputs: [2406 -> ()[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Div_1412 [Div] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2405 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2406 [05/10/2022-20:07:20] [V] [TRT] Div_1412 [Div] inputs: [2405 -> (-1, 4, -1, -1)[FLOAT]], [2406 -> ()[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 2406 for ONNX node: 2406 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Div_1412 for ONNX node: Div_1412 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2407 for ONNX tensor: 2407 [05/10/2022-20:07:20] [V] [TRT] Div_1412 [Div] outputs: [2407 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Shape_1413 [Shape] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2378 [05/10/2022-20:07:20] [V] [TRT] Shape_1413 [Shape] inputs: [2378 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Shape_1413 for ONNX node: Shape_1413 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2408 for ONNX tensor: 2408 [05/10/2022-20:07:20] [V] [TRT] Shape_1413 [Shape] outputs: [2408 -> (4)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1414 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1414 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1414 [Constant] outputs: [2409 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Gather_1415 [Gather] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2408 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2409 [05/10/2022-20:07:20] [V] [TRT] Gather_1415 [Gather] inputs: [2408 -> (4)[INT32]], [2409 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 2409 for ONNX node: 2409 [05/10/2022-20:07:20] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Gather_1415 for ONNX node: Gather_1415 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2410 for ONNX tensor: 2410 [05/10/2022-20:07:20] [V] [TRT] Gather_1415 [Gather] outputs: [2410 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1416 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1416 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1416 [Constant] outputs: [2411 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Unsqueeze_1417 [Unsqueeze] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2411 [05/10/2022-20:07:20] [V] [TRT] Unsqueeze_1417 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [2411 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:20] [V] [TRT] Registering layer: Unsqueeze_1417 for ONNX node: Unsqueeze_1417 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2412 for ONNX tensor: 2412 [05/10/2022-20:07:20] [V] [TRT] Unsqueeze_1417 [Unsqueeze] outputs: [2412 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Cast_1418 [Cast] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2412 [05/10/2022-20:07:20] [V] [TRT] Cast_1418 [Cast] inputs: [2412 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Cast_1418 for ONNX node: Cast_1418 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2413 for ONNX tensor: 2413 [05/10/2022-20:07:20] [V] [TRT] Cast_1418 [Cast] outputs: [2413 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1419 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1419 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1419 [Constant] outputs: [2414 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Equal_1420 [Equal] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2413 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2414 [05/10/2022-20:07:20] [V] [TRT] Equal_1420 [Equal] inputs: [2413 -> (-1, 1, 1, -1)[INT32]], [2414 -> ()[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 2414 for ONNX node: 2414 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Equal_1420 for ONNX node: Equal_1420 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2415 for ONNX tensor: 2415 [05/10/2022-20:07:20] [V] [TRT] Equal_1420 [Equal] outputs: [2415 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Cast_1421 [Cast] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2415 [05/10/2022-20:07:20] [V] [TRT] Cast_1421 [Cast] inputs: [2415 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Casting to type: bool [05/10/2022-20:07:20] [V] [TRT] Registering layer: Cast_1421 for ONNX node: Cast_1421 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2416 for ONNX tensor: 2416 [05/10/2022-20:07:20] [V] [TRT] Cast_1421 [Cast] outputs: [2416 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1422 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1422 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1422 [Constant] outputs: [2417 -> ()[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Where_1423 [Where] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2416 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2417 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2407 [05/10/2022-20:07:20] [V] [TRT] Where_1423 [Where] inputs: [2416 -> (-1, 1, 1, -1)[BOOL]], [2417 -> ()[FLOAT]], [2407 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 2417 for ONNX node: 2417 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Where_1423 for ONNX node: Where_1423 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2418 for ONNX tensor: 2418 [05/10/2022-20:07:20] [V] [TRT] Where_1423 [Where] outputs: [2418 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Softmax_1424 [Softmax] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2418 [05/10/2022-20:07:20] [V] [TRT] Softmax_1424 [Softmax] inputs: [2418 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Softmax_1424 for ONNX node: Softmax_1424 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2419 for ONNX tensor: 2419 [05/10/2022-20:07:20] [V] [TRT] Softmax_1424 [Softmax] outputs: [2419 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Cast_1425 [Cast] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2415 [05/10/2022-20:07:20] [V] [TRT] Cast_1425 [Cast] inputs: [2415 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Casting to type: bool [05/10/2022-20:07:20] [V] [TRT] Registering layer: Cast_1425 for ONNX node: Cast_1425 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2420 for ONNX tensor: 2420 [05/10/2022-20:07:20] [V] [TRT] Cast_1425 [Cast] outputs: [2420 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1426 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1426 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1426 [Constant] outputs: [2421 -> ()[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Where_1427 [Where] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2420 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2421 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2419 [05/10/2022-20:07:20] [V] [TRT] Where_1427 [Where] inputs: [2420 -> (-1, 1, 1, -1)[BOOL]], [2421 -> ()[FLOAT]], [2419 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 2421 for ONNX node: 2421 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Where_1427 for ONNX node: Where_1427 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2422 for ONNX tensor: 2422 [05/10/2022-20:07:20] [V] [TRT] Where_1427 [Where] outputs: [2422 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: MatMul_1428 [MatMul] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2422 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2378 [05/10/2022-20:07:20] [V] [TRT] MatMul_1428 [MatMul] inputs: [2422 -> (-1, 4, -1, -1)[FLOAT]], [2378 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: MatMul_1428 for ONNX node: MatMul_1428 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2423 for ONNX tensor: 2423 [05/10/2022-20:07:20] [V] [TRT] MatMul_1428 [MatMul] outputs: [2423 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Transpose_1429 [Transpose] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2423 [05/10/2022-20:07:20] [V] [TRT] Transpose_1429 [Transpose] inputs: [2423 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Transpose_1429 for ONNX node: Transpose_1429 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2424 for ONNX tensor: 2424 [05/10/2022-20:07:20] [V] [TRT] Transpose_1429 [Transpose] outputs: [2424 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Constant_1430 [Constant] [05/10/2022-20:07:20] [V] [TRT] Constant_1430 [Constant] inputs: [05/10/2022-20:07:20] [V] [TRT] Constant_1430 [Constant] outputs: [2427 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Unsqueeze_1431 [Unsqueeze] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2410 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2427 [05/10/2022-20:07:20] [V] [TRT] Unsqueeze_1431 [Unsqueeze] inputs: [2410 -> ()[INT32]], [2427 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:20] [V] [TRT] Registering layer: Unsqueeze_1431 for ONNX node: Unsqueeze_1431 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2428 for ONNX tensor: 2428 [05/10/2022-20:07:20] [V] [TRT] Unsqueeze_1431 [Unsqueeze] outputs: [2428 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Concat_1432 [Concat] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2428 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3403 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3404 [05/10/2022-20:07:20] [V] [TRT] Concat_1432 [Concat] inputs: [2428 -> (1)[INT32]], [3403 -> (1)[INT32]], [3404 -> (1)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3403 for ONNX node: 3403 [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3404 for ONNX node: 3404 [05/10/2022-20:07:20] [V] [TRT] Registering layer: Concat_1432 for ONNX node: Concat_1432 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2433 for ONNX tensor: 2433 [05/10/2022-20:07:20] [V] [TRT] Concat_1432 [Concat] outputs: [2433 -> (3)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Reshape_1433 [Reshape] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2424 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2433 [05/10/2022-20:07:20] [V] [TRT] Reshape_1433 [Reshape] inputs: [2424 -> (-1, -1, 4, 64)[FLOAT]], [2433 -> (3)[INT32]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Reshape_1433 for ONNX node: Reshape_1433 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2434 for ONNX tensor: 2434 [05/10/2022-20:07:20] [V] [TRT] Reshape_1433 [Reshape] outputs: [2434 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: MatMul_1434 [MatMul] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2434 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 3405 [05/10/2022-20:07:20] [V] [TRT] MatMul_1434 [MatMul] inputs: [2434 -> (-1, -1, 256)[FLOAT]], [3405 -> (256, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: 3405 for ONNX node: 3405 [05/10/2022-20:07:20] [V] [TRT] Registering layer: MatMul_1434 for ONNX node: MatMul_1434 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2436 for ONNX tensor: 2436 [05/10/2022-20:07:20] [V] [TRT] MatMul_1434 [MatMul] outputs: [2436 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Add_1435 [Add] [05/10/2022-20:07:20] [V] [TRT] Searching for input: encoder.encoders.8.self_attn.linear_out.bias [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2436 [05/10/2022-20:07:20] [V] [TRT] Add_1435 [Add] inputs: [encoder.encoders.8.self_attn.linear_out.bias -> (256)[FLOAT]], [2436 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: encoder.encoders.8.self_attn.linear_out.bias for ONNX node: encoder.encoders.8.self_attn.linear_out.bias [05/10/2022-20:07:20] [V] [TRT] Registering layer: Add_1435 for ONNX node: Add_1435 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2437 for ONNX tensor: 2437 [05/10/2022-20:07:20] [V] [TRT] Add_1435 [Add] outputs: [2437 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Add_1436 [Add] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2315 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2437 [05/10/2022-20:07:20] [V] [TRT] Add_1436 [Add] inputs: [2315 -> (-1, -1, 256)[FLOAT]], [2437 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Add_1436 for ONNX node: Add_1436 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2438 for ONNX tensor: 2438 [05/10/2022-20:07:20] [V] [TRT] Add_1436 [Add] outputs: [2438 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: ReduceMean_1437 [ReduceMean] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2438 [05/10/2022-20:07:20] [V] [TRT] ReduceMean_1437 [ReduceMean] inputs: [2438 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: ReduceMean_1437 for ONNX node: ReduceMean_1437 [05/10/2022-20:07:20] [V] [TRT] Registering tensor: 2439 for ONNX tensor: 2439 [05/10/2022-20:07:20] [V] [TRT] ReduceMean_1437 [ReduceMean] outputs: [2439 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Parsing node: Sub_1438 [Sub] [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2438 [05/10/2022-20:07:20] [V] [TRT] Searching for input: 2439 [05/10/2022-20:07:20] [V] [TRT] Sub_1438 [Sub] inputs: [2438 -> (-1, -1, 256)[FLOAT]], [2439 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:20] [V] [TRT] Registering layer: Sub_1438 for ONNX node: Sub_1438 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2440 for ONNX tensor: 2440 [05/10/2022-20:07:21] [V] [TRT] Sub_1438 [Sub] outputs: [2440 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Constant_1439 [Constant] [05/10/2022-20:07:21] [V] [TRT] Constant_1439 [Constant] inputs: [05/10/2022-20:07:21] [V] [TRT] Constant_1439 [Constant] outputs: [2441 -> ()[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Pow_1440 [Pow] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2440 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2441 [05/10/2022-20:07:21] [V] [TRT] Pow_1440 [Pow] inputs: [2440 -> (-1, -1, 256)[FLOAT]], [2441 -> ()[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: 2441 for ONNX node: 2441 [05/10/2022-20:07:21] [V] [TRT] Registering layer: Pow_1440 for ONNX node: Pow_1440 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2442 for ONNX tensor: 2442 [05/10/2022-20:07:21] [V] [TRT] Pow_1440 [Pow] outputs: [2442 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: ReduceMean_1441 [ReduceMean] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2442 [05/10/2022-20:07:21] [V] [TRT] ReduceMean_1441 [ReduceMean] inputs: [2442 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: ReduceMean_1441 for ONNX node: ReduceMean_1441 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2443 for ONNX tensor: 2443 [05/10/2022-20:07:21] [V] [TRT] ReduceMean_1441 [ReduceMean] outputs: [2443 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Constant_1442 [Constant] [05/10/2022-20:07:21] [V] [TRT] Constant_1442 [Constant] inputs: [05/10/2022-20:07:21] [V] [TRT] Constant_1442 [Constant] outputs: [2444 -> ()[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Add_1443 [Add] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2443 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2444 [05/10/2022-20:07:21] [V] [TRT] Add_1443 [Add] inputs: [2443 -> (-1, -1, 1)[FLOAT]], [2444 -> ()[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: 2444 for ONNX node: 2444 [05/10/2022-20:07:21] [V] [TRT] Registering layer: Add_1443 for ONNX node: Add_1443 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2445 for ONNX tensor: 2445 [05/10/2022-20:07:21] [V] [TRT] Add_1443 [Add] outputs: [2445 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Sqrt_1444 [Sqrt] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2445 [05/10/2022-20:07:21] [V] [TRT] Sqrt_1444 [Sqrt] inputs: [2445 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Sqrt_1444 for ONNX node: Sqrt_1444 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2446 for ONNX tensor: 2446 [05/10/2022-20:07:21] [V] [TRT] Sqrt_1444 [Sqrt] outputs: [2446 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Div_1445 [Div] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2440 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2446 [05/10/2022-20:07:21] [V] [TRT] Div_1445 [Div] inputs: [2440 -> (-1, -1, 256)[FLOAT]], [2446 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Div_1445 for ONNX node: Div_1445 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2447 for ONNX tensor: 2447 [05/10/2022-20:07:21] [V] [TRT] Div_1445 [Div] outputs: [2447 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Mul_1446 [Mul] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2447 [05/10/2022-20:07:21] [V] [TRT] Searching for input: encoder.encoders.8.norm_conv.weight [05/10/2022-20:07:21] [V] [TRT] Mul_1446 [Mul] inputs: [2447 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: encoder.encoders.8.norm_conv.weight for ONNX node: encoder.encoders.8.norm_conv.weight [05/10/2022-20:07:21] [V] [TRT] Registering layer: Mul_1446 for ONNX node: Mul_1446 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2448 for ONNX tensor: 2448 [05/10/2022-20:07:21] [V] [TRT] Mul_1446 [Mul] outputs: [2448 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Add_1447 [Add] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2448 [05/10/2022-20:07:21] [V] [TRT] Searching for input: encoder.encoders.8.norm_conv.bias [05/10/2022-20:07:21] [V] [TRT] Add_1447 [Add] inputs: [2448 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: encoder.encoders.8.norm_conv.bias for ONNX node: encoder.encoders.8.norm_conv.bias [05/10/2022-20:07:21] [V] [TRT] Registering layer: Add_1447 for ONNX node: Add_1447 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2449 for ONNX tensor: 2449 [05/10/2022-20:07:21] [V] [TRT] Add_1447 [Add] outputs: [2449 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Transpose_1448 [Transpose] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2449 [05/10/2022-20:07:21] [V] [TRT] Transpose_1448 [Transpose] inputs: [2449 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Transpose_1448 for ONNX node: Transpose_1448 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2450 for ONNX tensor: 2450 [05/10/2022-20:07:21] [V] [TRT] Transpose_1448 [Transpose] outputs: [2450 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Not_1449 [Not] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:21] [V] [TRT] Not_1449 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Not_1449 for ONNX node: Not_1449 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2451 for ONNX tensor: 2451 [05/10/2022-20:07:21] [V] [TRT] Not_1449 [Not] outputs: [2451 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Cast_1450 [Cast] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2451 [05/10/2022-20:07:21] [V] [TRT] Cast_1450 [Cast] inputs: [2451 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Casting to type: bool [05/10/2022-20:07:21] [V] [TRT] Registering layer: Cast_1450 for ONNX node: Cast_1450 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2452 for ONNX tensor: 2452 [05/10/2022-20:07:21] [V] [TRT] Cast_1450 [Cast] outputs: [2452 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Constant_1451 [Constant] [05/10/2022-20:07:21] [V] [TRT] Constant_1451 [Constant] inputs: [05/10/2022-20:07:21] [V] [TRT] Constant_1451 [Constant] outputs: [2453 -> ()[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Where_1452 [Where] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2452 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2453 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2450 [05/10/2022-20:07:21] [V] [TRT] Where_1452 [Where] inputs: [2452 -> (-1, 1, -1)[BOOL]], [2453 -> ()[FLOAT]], [2450 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: 2453 for ONNX node: 2453 [05/10/2022-20:07:21] [V] [TRT] Registering layer: Where_1452 for ONNX node: Where_1452 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2454 for ONNX tensor: 2454 [05/10/2022-20:07:21] [V] [TRT] Where_1452 [Where] outputs: [2454 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Conv_1453 [Conv] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2454 [05/10/2022-20:07:21] [V] [TRT] Searching for input: encoder.encoders.8.conv_module.pointwise_conv1.weight [05/10/2022-20:07:21] [V] [TRT] Searching for input: encoder.encoders.8.conv_module.pointwise_conv1.bias [05/10/2022-20:07:21] [V] [TRT] Conv_1453 [Conv] inputs: [2454 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.8.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.8.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:21] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:21] [V] [TRT] Registering layer: Conv_1453 for ONNX node: Conv_1453 [05/10/2022-20:07:21] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:21] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:21] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2455 for ONNX tensor: 2455 [05/10/2022-20:07:21] [V] [TRT] Conv_1453 [Conv] outputs: [2455 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Split_1454 [Split] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2455 [05/10/2022-20:07:21] [V] [TRT] Split_1454 [Split] inputs: [2455 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Split_1454 for ONNX node: Split_1454 [05/10/2022-20:07:21] [V] [TRT] Registering layer: Split_1454_10 for ONNX node: Split_1454 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2456 for ONNX tensor: 2456 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2457 for ONNX tensor: 2457 [05/10/2022-20:07:21] [V] [TRT] Split_1454 [Split] outputs: [2456 -> (-1, 256, -1)[FLOAT]], [2457 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Sigmoid_1455 [Sigmoid] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2457 [05/10/2022-20:07:21] [V] [TRT] Sigmoid_1455 [Sigmoid] inputs: [2457 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Sigmoid_1455 for ONNX node: Sigmoid_1455 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2458 for ONNX tensor: 2458 [05/10/2022-20:07:21] [V] [TRT] Sigmoid_1455 [Sigmoid] outputs: [2458 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Mul_1456 [Mul] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2456 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2458 [05/10/2022-20:07:21] [V] [TRT] Mul_1456 [Mul] inputs: [2456 -> (-1, 256, -1)[FLOAT]], [2458 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Mul_1456 for ONNX node: Mul_1456 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2459 for ONNX tensor: 2459 [05/10/2022-20:07:21] [V] [TRT] Mul_1456 [Mul] outputs: [2459 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Conv_1457 [Conv] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2459 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 3185 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 3186 [05/10/2022-20:07:21] [V] [TRT] Conv_1457 [Conv] inputs: [2459 -> (-1, 256, -1)[FLOAT]], [3185 -> (256, 1, 15)[FLOAT]], [3186 -> (256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:21] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:21] [V] [TRT] Registering layer: Conv_1457 for ONNX node: Conv_1457 [05/10/2022-20:07:21] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:21] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:21] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 3184 for ONNX tensor: 3184 [05/10/2022-20:07:21] [V] [TRT] Conv_1457 [Conv] outputs: [3184 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Sigmoid_1458 [Sigmoid] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 3184 [05/10/2022-20:07:21] [V] [TRT] Sigmoid_1458 [Sigmoid] inputs: [3184 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Sigmoid_1458 for ONNX node: Sigmoid_1458 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2462 for ONNX tensor: 2462 [05/10/2022-20:07:21] [V] [TRT] Sigmoid_1458 [Sigmoid] outputs: [2462 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Mul_1459 [Mul] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 3184 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2462 [05/10/2022-20:07:21] [V] [TRT] Mul_1459 [Mul] inputs: [3184 -> (-1, 256, -1)[FLOAT]], [2462 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Mul_1459 for ONNX node: Mul_1459 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2463 for ONNX tensor: 2463 [05/10/2022-20:07:21] [V] [TRT] Mul_1459 [Mul] outputs: [2463 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Not_1460 [Not] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:21] [V] [TRT] Not_1460 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Not_1460 for ONNX node: Not_1460 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2464 for ONNX tensor: 2464 [05/10/2022-20:07:21] [V] [TRT] Not_1460 [Not] outputs: [2464 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Conv_1461 [Conv] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2463 [05/10/2022-20:07:21] [V] [TRT] Searching for input: encoder.encoders.8.conv_module.pointwise_conv2.weight [05/10/2022-20:07:21] [V] [TRT] Searching for input: encoder.encoders.8.conv_module.pointwise_conv2.bias [05/10/2022-20:07:21] [V] [TRT] Conv_1461 [Conv] inputs: [2463 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.8.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.8.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:21] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:21] [V] [TRT] Registering layer: Conv_1461 for ONNX node: Conv_1461 [05/10/2022-20:07:21] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:21] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:21] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2465 for ONNX tensor: 2465 [05/10/2022-20:07:21] [V] [TRT] Conv_1461 [Conv] outputs: [2465 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Cast_1462 [Cast] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2464 [05/10/2022-20:07:21] [V] [TRT] Cast_1462 [Cast] inputs: [2464 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Casting to type: bool [05/10/2022-20:07:21] [V] [TRT] Registering layer: Cast_1462 for ONNX node: Cast_1462 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2466 for ONNX tensor: 2466 [05/10/2022-20:07:21] [V] [TRT] Cast_1462 [Cast] outputs: [2466 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Constant_1463 [Constant] [05/10/2022-20:07:21] [V] [TRT] Constant_1463 [Constant] inputs: [05/10/2022-20:07:21] [V] [TRT] Constant_1463 [Constant] outputs: [2467 -> ()[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Where_1464 [Where] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2466 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2467 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2465 [05/10/2022-20:07:21] [V] [TRT] Where_1464 [Where] inputs: [2466 -> (-1, 1, -1)[BOOL]], [2467 -> ()[FLOAT]], [2465 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: 2467 for ONNX node: 2467 [05/10/2022-20:07:21] [V] [TRT] Registering layer: Where_1464 for ONNX node: Where_1464 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2468 for ONNX tensor: 2468 [05/10/2022-20:07:21] [V] [TRT] Where_1464 [Where] outputs: [2468 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Transpose_1465 [Transpose] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2468 [05/10/2022-20:07:21] [V] [TRT] Transpose_1465 [Transpose] inputs: [2468 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Transpose_1465 for ONNX node: Transpose_1465 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2469 for ONNX tensor: 2469 [05/10/2022-20:07:21] [V] [TRT] Transpose_1465 [Transpose] outputs: [2469 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: Add_1466 [Add] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2438 [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2469 [05/10/2022-20:07:21] [V] [TRT] Add_1466 [Add] inputs: [2438 -> (-1, -1, 256)[FLOAT]], [2469 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: Add_1466 for ONNX node: Add_1466 [05/10/2022-20:07:21] [V] [TRT] Registering tensor: 2470 for ONNX tensor: 2470 [05/10/2022-20:07:21] [V] [TRT] Add_1466 [Add] outputs: [2470 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Parsing node: ReduceMean_1467 [ReduceMean] [05/10/2022-20:07:21] [V] [TRT] Searching for input: 2470 [05/10/2022-20:07:21] [V] [TRT] ReduceMean_1467 [ReduceMean] inputs: [2470 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:21] [V] [TRT] Registering layer: ReduceMean_1467 for ONNX node: ReduceMean_1467 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2471 for ONNX tensor: 2471 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1467 [ReduceMean] outputs: [2471 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Sub_1468 [Sub] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2470 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2471 [05/10/2022-20:07:22] [V] [TRT] Sub_1468 [Sub] inputs: [2470 -> (-1, -1, 256)[FLOAT]], [2471 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Sub_1468 for ONNX node: Sub_1468 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2472 for ONNX tensor: 2472 [05/10/2022-20:07:22] [V] [TRT] Sub_1468 [Sub] outputs: [2472 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1469 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1469 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1469 [Constant] outputs: [2473 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Pow_1470 [Pow] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2472 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2473 [05/10/2022-20:07:22] [V] [TRT] Pow_1470 [Pow] inputs: [2472 -> (-1, -1, 256)[FLOAT]], [2473 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2473 for ONNX node: 2473 [05/10/2022-20:07:22] [V] [TRT] Registering layer: Pow_1470 for ONNX node: Pow_1470 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2474 for ONNX tensor: 2474 [05/10/2022-20:07:22] [V] [TRT] Pow_1470 [Pow] outputs: [2474 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: ReduceMean_1471 [ReduceMean] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2474 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1471 [ReduceMean] inputs: [2474 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: ReduceMean_1471 for ONNX node: ReduceMean_1471 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2475 for ONNX tensor: 2475 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1471 [ReduceMean] outputs: [2475 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1472 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1472 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1472 [Constant] outputs: [2476 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1473 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2475 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2476 [05/10/2022-20:07:22] [V] [TRT] Add_1473 [Add] inputs: [2475 -> (-1, -1, 1)[FLOAT]], [2476 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2476 for ONNX node: 2476 [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1473 for ONNX node: Add_1473 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2477 for ONNX tensor: 2477 [05/10/2022-20:07:22] [V] [TRT] Add_1473 [Add] outputs: [2477 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Sqrt_1474 [Sqrt] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2477 [05/10/2022-20:07:22] [V] [TRT] Sqrt_1474 [Sqrt] inputs: [2477 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Sqrt_1474 for ONNX node: Sqrt_1474 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2478 for ONNX tensor: 2478 [05/10/2022-20:07:22] [V] [TRT] Sqrt_1474 [Sqrt] outputs: [2478 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Div_1475 [Div] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2472 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2478 [05/10/2022-20:07:22] [V] [TRT] Div_1475 [Div] inputs: [2472 -> (-1, -1, 256)[FLOAT]], [2478 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Div_1475 for ONNX node: Div_1475 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2479 for ONNX tensor: 2479 [05/10/2022-20:07:22] [V] [TRT] Div_1475 [Div] outputs: [2479 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Mul_1476 [Mul] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2479 [05/10/2022-20:07:22] [V] [TRT] Searching for input: encoder.encoders.8.norm_ff.weight [05/10/2022-20:07:22] [V] [TRT] Mul_1476 [Mul] inputs: [2479 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: encoder.encoders.8.norm_ff.weight for ONNX node: encoder.encoders.8.norm_ff.weight [05/10/2022-20:07:22] [V] [TRT] Registering layer: Mul_1476 for ONNX node: Mul_1476 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2480 for ONNX tensor: 2480 [05/10/2022-20:07:22] [V] [TRT] Mul_1476 [Mul] outputs: [2480 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1477 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2480 [05/10/2022-20:07:22] [V] [TRT] Searching for input: encoder.encoders.8.norm_ff.bias [05/10/2022-20:07:22] [V] [TRT] Add_1477 [Add] inputs: [2480 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: encoder.encoders.8.norm_ff.bias for ONNX node: encoder.encoders.8.norm_ff.bias [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1477 for ONNX node: Add_1477 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2481 for ONNX tensor: 2481 [05/10/2022-20:07:22] [V] [TRT] Add_1477 [Add] outputs: [2481 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: MatMul_1478 [MatMul] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2481 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 3406 [05/10/2022-20:07:22] [V] [TRT] MatMul_1478 [MatMul] inputs: [2481 -> (-1, -1, 256)[FLOAT]], [3406 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 3406 for ONNX node: 3406 [05/10/2022-20:07:22] [V] [TRT] Registering layer: MatMul_1478 for ONNX node: MatMul_1478 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2483 for ONNX tensor: 2483 [05/10/2022-20:07:22] [V] [TRT] MatMul_1478 [MatMul] outputs: [2483 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1479 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: encoder.encoders.8.feed_forward.w_1.bias [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2483 [05/10/2022-20:07:22] [V] [TRT] Add_1479 [Add] inputs: [encoder.encoders.8.feed_forward.w_1.bias -> (2048)[FLOAT]], [2483 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: encoder.encoders.8.feed_forward.w_1.bias for ONNX node: encoder.encoders.8.feed_forward.w_1.bias [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1479 for ONNX node: Add_1479 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2484 for ONNX tensor: 2484 [05/10/2022-20:07:22] [V] [TRT] Add_1479 [Add] outputs: [2484 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Sigmoid_1480 [Sigmoid] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2484 [05/10/2022-20:07:22] [V] [TRT] Sigmoid_1480 [Sigmoid] inputs: [2484 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Sigmoid_1480 for ONNX node: Sigmoid_1480 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2485 for ONNX tensor: 2485 [05/10/2022-20:07:22] [V] [TRT] Sigmoid_1480 [Sigmoid] outputs: [2485 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Mul_1481 [Mul] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2484 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2485 [05/10/2022-20:07:22] [V] [TRT] Mul_1481 [Mul] inputs: [2484 -> (-1, -1, 2048)[FLOAT]], [2485 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Mul_1481 for ONNX node: Mul_1481 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2486 for ONNX tensor: 2486 [05/10/2022-20:07:22] [V] [TRT] Mul_1481 [Mul] outputs: [2486 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: MatMul_1482 [MatMul] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2486 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 3407 [05/10/2022-20:07:22] [V] [TRT] MatMul_1482 [MatMul] inputs: [2486 -> (-1, -1, 2048)[FLOAT]], [3407 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 3407 for ONNX node: 3407 [05/10/2022-20:07:22] [V] [TRT] Registering layer: MatMul_1482 for ONNX node: MatMul_1482 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2488 for ONNX tensor: 2488 [05/10/2022-20:07:22] [V] [TRT] MatMul_1482 [MatMul] outputs: [2488 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1483 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: encoder.encoders.8.feed_forward.w_2.bias [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2488 [05/10/2022-20:07:22] [V] [TRT] Add_1483 [Add] inputs: [encoder.encoders.8.feed_forward.w_2.bias -> (256)[FLOAT]], [2488 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: encoder.encoders.8.feed_forward.w_2.bias for ONNX node: encoder.encoders.8.feed_forward.w_2.bias [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1483 for ONNX node: Add_1483 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2489 for ONNX tensor: 2489 [05/10/2022-20:07:22] [V] [TRT] Add_1483 [Add] outputs: [2489 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1484 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1484 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1484 [Constant] outputs: [2490 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Mul_1485 [Mul] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2489 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2490 [05/10/2022-20:07:22] [V] [TRT] Mul_1485 [Mul] inputs: [2489 -> (-1, -1, 256)[FLOAT]], [2490 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2490 for ONNX node: 2490 [05/10/2022-20:07:22] [V] [TRT] Registering layer: Mul_1485 for ONNX node: Mul_1485 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2491 for ONNX tensor: 2491 [05/10/2022-20:07:22] [V] [TRT] Mul_1485 [Mul] outputs: [2491 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1486 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2470 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2491 [05/10/2022-20:07:22] [V] [TRT] Add_1486 [Add] inputs: [2470 -> (-1, -1, 256)[FLOAT]], [2491 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1486 for ONNX node: Add_1486 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2492 for ONNX tensor: 2492 [05/10/2022-20:07:22] [V] [TRT] Add_1486 [Add] outputs: [2492 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: ReduceMean_1487 [ReduceMean] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2492 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1487 [ReduceMean] inputs: [2492 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: ReduceMean_1487 for ONNX node: ReduceMean_1487 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2493 for ONNX tensor: 2493 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1487 [ReduceMean] outputs: [2493 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Sub_1488 [Sub] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2492 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2493 [05/10/2022-20:07:22] [V] [TRT] Sub_1488 [Sub] inputs: [2492 -> (-1, -1, 256)[FLOAT]], [2493 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Sub_1488 for ONNX node: Sub_1488 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2494 for ONNX tensor: 2494 [05/10/2022-20:07:22] [V] [TRT] Sub_1488 [Sub] outputs: [2494 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1489 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1489 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1489 [Constant] outputs: [2495 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Pow_1490 [Pow] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2494 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2495 [05/10/2022-20:07:22] [V] [TRT] Pow_1490 [Pow] inputs: [2494 -> (-1, -1, 256)[FLOAT]], [2495 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2495 for ONNX node: 2495 [05/10/2022-20:07:22] [V] [TRT] Registering layer: Pow_1490 for ONNX node: Pow_1490 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2496 for ONNX tensor: 2496 [05/10/2022-20:07:22] [V] [TRT] Pow_1490 [Pow] outputs: [2496 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: ReduceMean_1491 [ReduceMean] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2496 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1491 [ReduceMean] inputs: [2496 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: ReduceMean_1491 for ONNX node: ReduceMean_1491 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2497 for ONNX tensor: 2497 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1491 [ReduceMean] outputs: [2497 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1492 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1492 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1492 [Constant] outputs: [2498 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1493 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2497 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2498 [05/10/2022-20:07:22] [V] [TRT] Add_1493 [Add] inputs: [2497 -> (-1, -1, 1)[FLOAT]], [2498 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2498 for ONNX node: 2498 [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1493 for ONNX node: Add_1493 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2499 for ONNX tensor: 2499 [05/10/2022-20:07:22] [V] [TRT] Add_1493 [Add] outputs: [2499 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Sqrt_1494 [Sqrt] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2499 [05/10/2022-20:07:22] [V] [TRT] Sqrt_1494 [Sqrt] inputs: [2499 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Sqrt_1494 for ONNX node: Sqrt_1494 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2500 for ONNX tensor: 2500 [05/10/2022-20:07:22] [V] [TRT] Sqrt_1494 [Sqrt] outputs: [2500 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Div_1495 [Div] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2494 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2500 [05/10/2022-20:07:22] [V] [TRT] Div_1495 [Div] inputs: [2494 -> (-1, -1, 256)[FLOAT]], [2500 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Div_1495 for ONNX node: Div_1495 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2501 for ONNX tensor: 2501 [05/10/2022-20:07:22] [V] [TRT] Div_1495 [Div] outputs: [2501 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Mul_1496 [Mul] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2501 [05/10/2022-20:07:22] [V] [TRT] Searching for input: encoder.encoders.8.norm_final.weight [05/10/2022-20:07:22] [V] [TRT] Mul_1496 [Mul] inputs: [2501 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: encoder.encoders.8.norm_final.weight for ONNX node: encoder.encoders.8.norm_final.weight [05/10/2022-20:07:22] [V] [TRT] Registering layer: Mul_1496 for ONNX node: Mul_1496 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2502 for ONNX tensor: 2502 [05/10/2022-20:07:22] [V] [TRT] Mul_1496 [Mul] outputs: [2502 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1497 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2502 [05/10/2022-20:07:22] [V] [TRT] Searching for input: encoder.encoders.8.norm_final.bias [05/10/2022-20:07:22] [V] [TRT] Add_1497 [Add] inputs: [2502 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.8.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: encoder.encoders.8.norm_final.bias for ONNX node: encoder.encoders.8.norm_final.bias [05/10/2022-20:07:22] [V] [TRT] Registering layer: Add_1497 for ONNX node: Add_1497 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2503 for ONNX tensor: 2503 [05/10/2022-20:07:22] [V] [TRT] Add_1497 [Add] outputs: [2503 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: ReduceMean_1498 [ReduceMean] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2503 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1498 [ReduceMean] inputs: [2503 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: ReduceMean_1498 for ONNX node: ReduceMean_1498 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2504 for ONNX tensor: 2504 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1498 [ReduceMean] outputs: [2504 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Sub_1499 [Sub] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2503 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2504 [05/10/2022-20:07:22] [V] [TRT] Sub_1499 [Sub] inputs: [2503 -> (-1, -1, 256)[FLOAT]], [2504 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: Sub_1499 for ONNX node: Sub_1499 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2505 for ONNX tensor: 2505 [05/10/2022-20:07:22] [V] [TRT] Sub_1499 [Sub] outputs: [2505 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1500 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1500 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1500 [Constant] outputs: [2506 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Pow_1501 [Pow] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2505 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2506 [05/10/2022-20:07:22] [V] [TRT] Pow_1501 [Pow] inputs: [2505 -> (-1, -1, 256)[FLOAT]], [2506 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2506 for ONNX node: 2506 [05/10/2022-20:07:22] [V] [TRT] Registering layer: Pow_1501 for ONNX node: Pow_1501 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2507 for ONNX tensor: 2507 [05/10/2022-20:07:22] [V] [TRT] Pow_1501 [Pow] outputs: [2507 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: ReduceMean_1502 [ReduceMean] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2507 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1502 [ReduceMean] inputs: [2507 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: ReduceMean_1502 for ONNX node: ReduceMean_1502 [05/10/2022-20:07:22] [V] [TRT] Registering tensor: 2508 for ONNX tensor: 2508 [05/10/2022-20:07:22] [V] [TRT] ReduceMean_1502 [ReduceMean] outputs: [2508 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Constant_1503 [Constant] [05/10/2022-20:07:22] [V] [TRT] Constant_1503 [Constant] inputs: [05/10/2022-20:07:22] [V] [TRT] Constant_1503 [Constant] outputs: [2509 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Parsing node: Add_1504 [Add] [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2508 [05/10/2022-20:07:22] [V] [TRT] Searching for input: 2509 [05/10/2022-20:07:22] [V] [TRT] Add_1504 [Add] inputs: [2508 -> (-1, -1, 1)[FLOAT]], [2509 -> ()[FLOAT]], [05/10/2022-20:07:22] [V] [TRT] Registering layer: 2509 for ONNX node: 2509 [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1504 for ONNX node: Add_1504 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2510 for ONNX tensor: 2510 [05/10/2022-20:07:23] [V] [TRT] Add_1504 [Add] outputs: [2510 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Sqrt_1505 [Sqrt] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2510 [05/10/2022-20:07:23] [V] [TRT] Sqrt_1505 [Sqrt] inputs: [2510 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Sqrt_1505 for ONNX node: Sqrt_1505 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2511 for ONNX tensor: 2511 [05/10/2022-20:07:23] [V] [TRT] Sqrt_1505 [Sqrt] outputs: [2511 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Div_1506 [Div] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2505 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2511 [05/10/2022-20:07:23] [V] [TRT] Div_1506 [Div] inputs: [2505 -> (-1, -1, 256)[FLOAT]], [2511 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Div_1506 for ONNX node: Div_1506 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2512 for ONNX tensor: 2512 [05/10/2022-20:07:23] [V] [TRT] Div_1506 [Div] outputs: [2512 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Mul_1507 [Mul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2512 [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.norm_ff_macaron.weight [05/10/2022-20:07:23] [V] [TRT] Mul_1507 [Mul] inputs: [2512 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.norm_ff_macaron.weight for ONNX node: encoder.encoders.9.norm_ff_macaron.weight [05/10/2022-20:07:23] [V] [TRT] Registering layer: Mul_1507 for ONNX node: Mul_1507 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2513 for ONNX tensor: 2513 [05/10/2022-20:07:23] [V] [TRT] Mul_1507 [Mul] outputs: [2513 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1508 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2513 [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.norm_ff_macaron.bias [05/10/2022-20:07:23] [V] [TRT] Add_1508 [Add] inputs: [2513 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.norm_ff_macaron.bias for ONNX node: encoder.encoders.9.norm_ff_macaron.bias [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1508 for ONNX node: Add_1508 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2514 for ONNX tensor: 2514 [05/10/2022-20:07:23] [V] [TRT] Add_1508 [Add] outputs: [2514 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: MatMul_1509 [MatMul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2514 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 3408 [05/10/2022-20:07:23] [V] [TRT] MatMul_1509 [MatMul] inputs: [2514 -> (-1, -1, 256)[FLOAT]], [3408 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 3408 for ONNX node: 3408 [05/10/2022-20:07:23] [V] [TRT] Registering layer: MatMul_1509 for ONNX node: MatMul_1509 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2516 for ONNX tensor: 2516 [05/10/2022-20:07:23] [V] [TRT] MatMul_1509 [MatMul] outputs: [2516 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1510 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.feed_forward_macaron.w_1.bias [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2516 [05/10/2022-20:07:23] [V] [TRT] Add_1510 [Add] inputs: [encoder.encoders.9.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [2516 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.9.feed_forward_macaron.w_1.bias [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1510 for ONNX node: Add_1510 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2517 for ONNX tensor: 2517 [05/10/2022-20:07:23] [V] [TRT] Add_1510 [Add] outputs: [2517 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Sigmoid_1511 [Sigmoid] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2517 [05/10/2022-20:07:23] [V] [TRT] Sigmoid_1511 [Sigmoid] inputs: [2517 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Sigmoid_1511 for ONNX node: Sigmoid_1511 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2518 for ONNX tensor: 2518 [05/10/2022-20:07:23] [V] [TRT] Sigmoid_1511 [Sigmoid] outputs: [2518 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Mul_1512 [Mul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2517 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2518 [05/10/2022-20:07:23] [V] [TRT] Mul_1512 [Mul] inputs: [2517 -> (-1, -1, 2048)[FLOAT]], [2518 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Mul_1512 for ONNX node: Mul_1512 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2519 for ONNX tensor: 2519 [05/10/2022-20:07:23] [V] [TRT] Mul_1512 [Mul] outputs: [2519 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: MatMul_1513 [MatMul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2519 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 3409 [05/10/2022-20:07:23] [V] [TRT] MatMul_1513 [MatMul] inputs: [2519 -> (-1, -1, 2048)[FLOAT]], [3409 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 3409 for ONNX node: 3409 [05/10/2022-20:07:23] [V] [TRT] Registering layer: MatMul_1513 for ONNX node: MatMul_1513 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2521 for ONNX tensor: 2521 [05/10/2022-20:07:23] [V] [TRT] MatMul_1513 [MatMul] outputs: [2521 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1514 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.feed_forward_macaron.w_2.bias [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2521 [05/10/2022-20:07:23] [V] [TRT] Add_1514 [Add] inputs: [encoder.encoders.9.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [2521 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.9.feed_forward_macaron.w_2.bias [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1514 for ONNX node: Add_1514 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2522 for ONNX tensor: 2522 [05/10/2022-20:07:23] [V] [TRT] Add_1514 [Add] outputs: [2522 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Constant_1515 [Constant] [05/10/2022-20:07:23] [V] [TRT] Constant_1515 [Constant] inputs: [05/10/2022-20:07:23] [V] [TRT] Constant_1515 [Constant] outputs: [2523 -> ()[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Mul_1516 [Mul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2522 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2523 [05/10/2022-20:07:23] [V] [TRT] Mul_1516 [Mul] inputs: [2522 -> (-1, -1, 256)[FLOAT]], [2523 -> ()[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 2523 for ONNX node: 2523 [05/10/2022-20:07:23] [V] [TRT] Registering layer: Mul_1516 for ONNX node: Mul_1516 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2524 for ONNX tensor: 2524 [05/10/2022-20:07:23] [V] [TRT] Mul_1516 [Mul] outputs: [2524 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1517 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2503 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2524 [05/10/2022-20:07:23] [V] [TRT] Add_1517 [Add] inputs: [2503 -> (-1, -1, 256)[FLOAT]], [2524 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1517 for ONNX node: Add_1517 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2525 for ONNX tensor: 2525 [05/10/2022-20:07:23] [V] [TRT] Add_1517 [Add] outputs: [2525 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: ReduceMean_1518 [ReduceMean] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2525 [05/10/2022-20:07:23] [V] [TRT] ReduceMean_1518 [ReduceMean] inputs: [2525 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: ReduceMean_1518 for ONNX node: ReduceMean_1518 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2526 for ONNX tensor: 2526 [05/10/2022-20:07:23] [V] [TRT] ReduceMean_1518 [ReduceMean] outputs: [2526 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Sub_1519 [Sub] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2525 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2526 [05/10/2022-20:07:23] [V] [TRT] Sub_1519 [Sub] inputs: [2525 -> (-1, -1, 256)[FLOAT]], [2526 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Sub_1519 for ONNX node: Sub_1519 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2527 for ONNX tensor: 2527 [05/10/2022-20:07:23] [V] [TRT] Sub_1519 [Sub] outputs: [2527 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Constant_1520 [Constant] [05/10/2022-20:07:23] [V] [TRT] Constant_1520 [Constant] inputs: [05/10/2022-20:07:23] [V] [TRT] Constant_1520 [Constant] outputs: [2528 -> ()[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Pow_1521 [Pow] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2527 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2528 [05/10/2022-20:07:23] [V] [TRT] Pow_1521 [Pow] inputs: [2527 -> (-1, -1, 256)[FLOAT]], [2528 -> ()[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 2528 for ONNX node: 2528 [05/10/2022-20:07:23] [V] [TRT] Registering layer: Pow_1521 for ONNX node: Pow_1521 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2529 for ONNX tensor: 2529 [05/10/2022-20:07:23] [V] [TRT] Pow_1521 [Pow] outputs: [2529 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: ReduceMean_1522 [ReduceMean] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2529 [05/10/2022-20:07:23] [V] [TRT] ReduceMean_1522 [ReduceMean] inputs: [2529 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: ReduceMean_1522 for ONNX node: ReduceMean_1522 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2530 for ONNX tensor: 2530 [05/10/2022-20:07:23] [V] [TRT] ReduceMean_1522 [ReduceMean] outputs: [2530 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Constant_1523 [Constant] [05/10/2022-20:07:23] [V] [TRT] Constant_1523 [Constant] inputs: [05/10/2022-20:07:23] [V] [TRT] Constant_1523 [Constant] outputs: [2531 -> ()[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1524 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2530 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2531 [05/10/2022-20:07:23] [V] [TRT] Add_1524 [Add] inputs: [2530 -> (-1, -1, 1)[FLOAT]], [2531 -> ()[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 2531 for ONNX node: 2531 [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1524 for ONNX node: Add_1524 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2532 for ONNX tensor: 2532 [05/10/2022-20:07:23] [V] [TRT] Add_1524 [Add] outputs: [2532 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Sqrt_1525 [Sqrt] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2532 [05/10/2022-20:07:23] [V] [TRT] Sqrt_1525 [Sqrt] inputs: [2532 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Sqrt_1525 for ONNX node: Sqrt_1525 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2533 for ONNX tensor: 2533 [05/10/2022-20:07:23] [V] [TRT] Sqrt_1525 [Sqrt] outputs: [2533 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Div_1526 [Div] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2527 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2533 [05/10/2022-20:07:23] [V] [TRT] Div_1526 [Div] inputs: [2527 -> (-1, -1, 256)[FLOAT]], [2533 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Div_1526 for ONNX node: Div_1526 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2534 for ONNX tensor: 2534 [05/10/2022-20:07:23] [V] [TRT] Div_1526 [Div] outputs: [2534 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Mul_1527 [Mul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2534 [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.norm_mha.weight [05/10/2022-20:07:23] [V] [TRT] Mul_1527 [Mul] inputs: [2534 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.norm_mha.weight for ONNX node: encoder.encoders.9.norm_mha.weight [05/10/2022-20:07:23] [V] [TRT] Registering layer: Mul_1527 for ONNX node: Mul_1527 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2535 for ONNX tensor: 2535 [05/10/2022-20:07:23] [V] [TRT] Mul_1527 [Mul] outputs: [2535 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1528 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2535 [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.norm_mha.bias [05/10/2022-20:07:23] [V] [TRT] Add_1528 [Add] inputs: [2535 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.norm_mha.bias for ONNX node: encoder.encoders.9.norm_mha.bias [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1528 for ONNX node: Add_1528 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2536 for ONNX tensor: 2536 [05/10/2022-20:07:23] [V] [TRT] Add_1528 [Add] outputs: [2536 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Shape_1529 [Shape] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2536 [05/10/2022-20:07:23] [V] [TRT] Shape_1529 [Shape] inputs: [2536 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Shape_1529 for ONNX node: Shape_1529 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2537 for ONNX tensor: 2537 [05/10/2022-20:07:23] [V] [TRT] Shape_1529 [Shape] outputs: [2537 -> (3)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Constant_1530 [Constant] [05/10/2022-20:07:23] [V] [TRT] Constant_1530 [Constant] inputs: [05/10/2022-20:07:23] [V] [TRT] Constant_1530 [Constant] outputs: [2538 -> ()[INT32]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Gather_1531 [Gather] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2537 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2538 [05/10/2022-20:07:23] [V] [TRT] Gather_1531 [Gather] inputs: [2537 -> (3)[INT32]], [2538 -> ()[INT32]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 2538 for ONNX node: 2538 [05/10/2022-20:07:23] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:23] [V] [TRT] Registering layer: Gather_1531 for ONNX node: Gather_1531 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2539 for ONNX tensor: 2539 [05/10/2022-20:07:23] [V] [TRT] Gather_1531 [Gather] outputs: [2539 -> ()[INT32]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: MatMul_1532 [MatMul] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2536 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 3410 [05/10/2022-20:07:23] [V] [TRT] MatMul_1532 [MatMul] inputs: [2536 -> (-1, -1, 256)[FLOAT]], [3410 -> (256, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 3410 for ONNX node: 3410 [05/10/2022-20:07:23] [V] [TRT] Registering layer: MatMul_1532 for ONNX node: MatMul_1532 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2541 for ONNX tensor: 2541 [05/10/2022-20:07:23] [V] [TRT] MatMul_1532 [MatMul] outputs: [2541 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Add_1533 [Add] [05/10/2022-20:07:23] [V] [TRT] Searching for input: encoder.encoders.9.self_attn.linear_q.bias [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2541 [05/10/2022-20:07:23] [V] [TRT] Add_1533 [Add] inputs: [encoder.encoders.9.self_attn.linear_q.bias -> (256)[FLOAT]], [2541 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: encoder.encoders.9.self_attn.linear_q.bias for ONNX node: encoder.encoders.9.self_attn.linear_q.bias [05/10/2022-20:07:23] [V] [TRT] Registering layer: Add_1533 for ONNX node: Add_1533 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2542 for ONNX tensor: 2542 [05/10/2022-20:07:23] [V] [TRT] Add_1533 [Add] outputs: [2542 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Constant_1534 [Constant] [05/10/2022-20:07:23] [V] [TRT] Constant_1534 [Constant] inputs: [05/10/2022-20:07:23] [V] [TRT] Constant_1534 [Constant] outputs: [2546 -> (1)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Unsqueeze_1535 [Unsqueeze] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2539 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2546 [05/10/2022-20:07:23] [V] [TRT] Unsqueeze_1535 [Unsqueeze] inputs: [2539 -> ()[INT32]], [2546 -> (1)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:23] [V] [TRT] Registering layer: Unsqueeze_1535 for ONNX node: Unsqueeze_1535 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2547 for ONNX tensor: 2547 [05/10/2022-20:07:23] [V] [TRT] Unsqueeze_1535 [Unsqueeze] outputs: [2547 -> (1)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Concat_1536 [Concat] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2547 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 3411 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 3412 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 3413 [05/10/2022-20:07:23] [V] [TRT] Concat_1536 [Concat] inputs: [2547 -> (1)[INT32]], [3411 -> (1)[INT32]], [3412 -> (1)[INT32]], [3413 -> (1)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: 3411 for ONNX node: 3411 [05/10/2022-20:07:23] [V] [TRT] Registering layer: 3412 for ONNX node: 3412 [05/10/2022-20:07:23] [V] [TRT] Registering layer: 3413 for ONNX node: 3413 [05/10/2022-20:07:23] [V] [TRT] Registering layer: Concat_1536 for ONNX node: Concat_1536 [05/10/2022-20:07:23] [V] [TRT] Registering tensor: 2554 for ONNX tensor: 2554 [05/10/2022-20:07:23] [V] [TRT] Concat_1536 [Concat] outputs: [2554 -> (4)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Parsing node: Reshape_1537 [Reshape] [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2542 [05/10/2022-20:07:23] [V] [TRT] Searching for input: 2554 [05/10/2022-20:07:23] [V] [TRT] Reshape_1537 [Reshape] inputs: [2542 -> (-1, -1, 256)[FLOAT]], [2554 -> (4)[INT32]], [05/10/2022-20:07:23] [V] [TRT] Registering layer: Reshape_1537 for ONNX node: Reshape_1537 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2555 for ONNX tensor: 2555 [05/10/2022-20:07:24] [V] [TRT] Reshape_1537 [Reshape] outputs: [2555 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: MatMul_1538 [MatMul] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2536 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3414 [05/10/2022-20:07:24] [V] [TRT] MatMul_1538 [MatMul] inputs: [2536 -> (-1, -1, 256)[FLOAT]], [3414 -> (256, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3414 for ONNX node: 3414 [05/10/2022-20:07:24] [V] [TRT] Registering layer: MatMul_1538 for ONNX node: MatMul_1538 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2557 for ONNX tensor: 2557 [05/10/2022-20:07:24] [V] [TRT] MatMul_1538 [MatMul] outputs: [2557 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Add_1539 [Add] [05/10/2022-20:07:24] [V] [TRT] Searching for input: encoder.encoders.9.self_attn.linear_k.bias [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2557 [05/10/2022-20:07:24] [V] [TRT] Add_1539 [Add] inputs: [encoder.encoders.9.self_attn.linear_k.bias -> (256)[FLOAT]], [2557 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: encoder.encoders.9.self_attn.linear_k.bias for ONNX node: encoder.encoders.9.self_attn.linear_k.bias [05/10/2022-20:07:24] [V] [TRT] Registering layer: Add_1539 for ONNX node: Add_1539 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2558 for ONNX tensor: 2558 [05/10/2022-20:07:24] [V] [TRT] Add_1539 [Add] outputs: [2558 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1540 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1540 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1540 [Constant] outputs: [2562 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Unsqueeze_1541 [Unsqueeze] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2539 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2562 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1541 [Unsqueeze] inputs: [2539 -> ()[INT32]], [2562 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:24] [V] [TRT] Registering layer: Unsqueeze_1541 for ONNX node: Unsqueeze_1541 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2563 for ONNX tensor: 2563 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1541 [Unsqueeze] outputs: [2563 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Concat_1542 [Concat] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2563 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3415 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3416 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3417 [05/10/2022-20:07:24] [V] [TRT] Concat_1542 [Concat] inputs: [2563 -> (1)[INT32]], [3415 -> (1)[INT32]], [3416 -> (1)[INT32]], [3417 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3415 for ONNX node: 3415 [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3416 for ONNX node: 3416 [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3417 for ONNX node: 3417 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Concat_1542 for ONNX node: Concat_1542 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2570 for ONNX tensor: 2570 [05/10/2022-20:07:24] [V] [TRT] Concat_1542 [Concat] outputs: [2570 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Reshape_1543 [Reshape] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2558 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2570 [05/10/2022-20:07:24] [V] [TRT] Reshape_1543 [Reshape] inputs: [2558 -> (-1, -1, 256)[FLOAT]], [2570 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Reshape_1543 for ONNX node: Reshape_1543 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2571 for ONNX tensor: 2571 [05/10/2022-20:07:24] [V] [TRT] Reshape_1543 [Reshape] outputs: [2571 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: MatMul_1544 [MatMul] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2536 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3418 [05/10/2022-20:07:24] [V] [TRT] MatMul_1544 [MatMul] inputs: [2536 -> (-1, -1, 256)[FLOAT]], [3418 -> (256, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3418 for ONNX node: 3418 [05/10/2022-20:07:24] [V] [TRT] Registering layer: MatMul_1544 for ONNX node: MatMul_1544 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2573 for ONNX tensor: 2573 [05/10/2022-20:07:24] [V] [TRT] MatMul_1544 [MatMul] outputs: [2573 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Add_1545 [Add] [05/10/2022-20:07:24] [V] [TRT] Searching for input: encoder.encoders.9.self_attn.linear_v.bias [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2573 [05/10/2022-20:07:24] [V] [TRT] Add_1545 [Add] inputs: [encoder.encoders.9.self_attn.linear_v.bias -> (256)[FLOAT]], [2573 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: encoder.encoders.9.self_attn.linear_v.bias for ONNX node: encoder.encoders.9.self_attn.linear_v.bias [05/10/2022-20:07:24] [V] [TRT] Registering layer: Add_1545 for ONNX node: Add_1545 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2574 for ONNX tensor: 2574 [05/10/2022-20:07:24] [V] [TRT] Add_1545 [Add] outputs: [2574 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1546 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1546 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1546 [Constant] outputs: [2578 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Unsqueeze_1547 [Unsqueeze] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2539 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2578 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1547 [Unsqueeze] inputs: [2539 -> ()[INT32]], [2578 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:24] [V] [TRT] Registering layer: Unsqueeze_1547 for ONNX node: Unsqueeze_1547 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2579 for ONNX tensor: 2579 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1547 [Unsqueeze] outputs: [2579 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Concat_1548 [Concat] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2579 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3419 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3420 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3421 [05/10/2022-20:07:24] [V] [TRT] Concat_1548 [Concat] inputs: [2579 -> (1)[INT32]], [3419 -> (1)[INT32]], [3420 -> (1)[INT32]], [3421 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3419 for ONNX node: 3419 [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3420 for ONNX node: 3420 [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3421 for ONNX node: 3421 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Concat_1548 for ONNX node: Concat_1548 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2586 for ONNX tensor: 2586 [05/10/2022-20:07:24] [V] [TRT] Concat_1548 [Concat] outputs: [2586 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Reshape_1549 [Reshape] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2574 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2586 [05/10/2022-20:07:24] [V] [TRT] Reshape_1549 [Reshape] inputs: [2574 -> (-1, -1, 256)[FLOAT]], [2586 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Reshape_1549 for ONNX node: Reshape_1549 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2587 for ONNX tensor: 2587 [05/10/2022-20:07:24] [V] [TRT] Reshape_1549 [Reshape] outputs: [2587 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Transpose_1550 [Transpose] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2587 [05/10/2022-20:07:24] [V] [TRT] Transpose_1550 [Transpose] inputs: [2587 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Transpose_1550 for ONNX node: Transpose_1550 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2588 for ONNX tensor: 2588 [05/10/2022-20:07:24] [V] [TRT] Transpose_1550 [Transpose] outputs: [2588 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Shape_1551 [Shape] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:24] [V] [TRT] Shape_1551 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Shape_1551 for ONNX node: Shape_1551 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2589 for ONNX tensor: 2589 [05/10/2022-20:07:24] [V] [TRT] Shape_1551 [Shape] outputs: [2589 -> (3)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1552 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1552 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1552 [Constant] outputs: [2590 -> ()[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Gather_1553 [Gather] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2589 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2590 [05/10/2022-20:07:24] [V] [TRT] Gather_1553 [Gather] inputs: [2589 -> (3)[INT32]], [2590 -> ()[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 2590 for ONNX node: 2590 [05/10/2022-20:07:24] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Gather_1553 for ONNX node: Gather_1553 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2591 for ONNX tensor: 2591 [05/10/2022-20:07:24] [V] [TRT] Gather_1553 [Gather] outputs: [2591 -> ()[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: MatMul_1554 [MatMul] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3422 [05/10/2022-20:07:24] [V] [TRT] MatMul_1554 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3422 -> (256, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3422 for ONNX node: 3422 [05/10/2022-20:07:24] [V] [TRT] Registering layer: MatMul_1554 for ONNX node: MatMul_1554 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2593 for ONNX tensor: 2593 [05/10/2022-20:07:24] [V] [TRT] MatMul_1554 [MatMul] outputs: [2593 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1555 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1555 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1555 [Constant] outputs: [2597 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Unsqueeze_1556 [Unsqueeze] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2591 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2597 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1556 [Unsqueeze] inputs: [2591 -> ()[INT32]], [2597 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:24] [V] [TRT] Registering layer: Unsqueeze_1556 for ONNX node: Unsqueeze_1556 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2598 for ONNX tensor: 2598 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1556 [Unsqueeze] outputs: [2598 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Concat_1557 [Concat] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2598 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3423 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3424 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 3425 [05/10/2022-20:07:24] [V] [TRT] Concat_1557 [Concat] inputs: [2598 -> (1)[INT32]], [3423 -> (1)[INT32]], [3424 -> (1)[INT32]], [3425 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3423 for ONNX node: 3423 [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3424 for ONNX node: 3424 [05/10/2022-20:07:24] [V] [TRT] Registering layer: 3425 for ONNX node: 3425 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Concat_1557 for ONNX node: Concat_1557 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2605 for ONNX tensor: 2605 [05/10/2022-20:07:24] [V] [TRT] Concat_1557 [Concat] outputs: [2605 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Reshape_1558 [Reshape] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2593 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2605 [05/10/2022-20:07:24] [V] [TRT] Reshape_1558 [Reshape] inputs: [2593 -> (1, -1, 256)[FLOAT]], [2605 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Reshape_1558 for ONNX node: Reshape_1558 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2606 for ONNX tensor: 2606 [05/10/2022-20:07:24] [V] [TRT] Reshape_1558 [Reshape] outputs: [2606 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Add_1559 [Add] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2555 [05/10/2022-20:07:24] [V] [TRT] Searching for input: encoder.encoders.9.self_attn.pos_bias_u [05/10/2022-20:07:24] [V] [TRT] Add_1559 [Add] inputs: [2555 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.9.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: encoder.encoders.9.self_attn.pos_bias_u for ONNX node: encoder.encoders.9.self_attn.pos_bias_u [05/10/2022-20:07:24] [V] [TRT] Registering layer: Add_1559 for ONNX node: Add_1559 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2607 for ONNX tensor: 2607 [05/10/2022-20:07:24] [V] [TRT] Add_1559 [Add] outputs: [2607 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Transpose_1560 [Transpose] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2607 [05/10/2022-20:07:24] [V] [TRT] Transpose_1560 [Transpose] inputs: [2607 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Transpose_1560 for ONNX node: Transpose_1560 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2608 for ONNX tensor: 2608 [05/10/2022-20:07:24] [V] [TRT] Transpose_1560 [Transpose] outputs: [2608 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Add_1561 [Add] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2555 [05/10/2022-20:07:24] [V] [TRT] Searching for input: encoder.encoders.9.self_attn.pos_bias_v [05/10/2022-20:07:24] [V] [TRT] Add_1561 [Add] inputs: [2555 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.9.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: encoder.encoders.9.self_attn.pos_bias_v for ONNX node: encoder.encoders.9.self_attn.pos_bias_v [05/10/2022-20:07:24] [V] [TRT] Registering layer: Add_1561 for ONNX node: Add_1561 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2609 for ONNX tensor: 2609 [05/10/2022-20:07:24] [V] [TRT] Add_1561 [Add] outputs: [2609 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Transpose_1562 [Transpose] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2609 [05/10/2022-20:07:24] [V] [TRT] Transpose_1562 [Transpose] inputs: [2609 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Transpose_1562 for ONNX node: Transpose_1562 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2610 for ONNX tensor: 2610 [05/10/2022-20:07:24] [V] [TRT] Transpose_1562 [Transpose] outputs: [2610 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Transpose_1563 [Transpose] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2571 [05/10/2022-20:07:24] [V] [TRT] Transpose_1563 [Transpose] inputs: [2571 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Transpose_1563 for ONNX node: Transpose_1563 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2611 for ONNX tensor: 2611 [05/10/2022-20:07:24] [V] [TRT] Transpose_1563 [Transpose] outputs: [2611 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: MatMul_1564 [MatMul] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2608 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2611 [05/10/2022-20:07:24] [V] [TRT] MatMul_1564 [MatMul] inputs: [2608 -> (-1, 4, -1, 64)[FLOAT]], [2611 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: MatMul_1564 for ONNX node: MatMul_1564 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2612 for ONNX tensor: 2612 [05/10/2022-20:07:24] [V] [TRT] MatMul_1564 [MatMul] outputs: [2612 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Transpose_1565 [Transpose] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2606 [05/10/2022-20:07:24] [V] [TRT] Transpose_1565 [Transpose] inputs: [2606 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Transpose_1565 for ONNX node: Transpose_1565 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2613 for ONNX tensor: 2613 [05/10/2022-20:07:24] [V] [TRT] Transpose_1565 [Transpose] outputs: [2613 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: MatMul_1566 [MatMul] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2610 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2613 [05/10/2022-20:07:24] [V] [TRT] MatMul_1566 [MatMul] inputs: [2610 -> (-1, 4, -1, 64)[FLOAT]], [2613 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: MatMul_1566 for ONNX node: MatMul_1566 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2614 for ONNX tensor: 2614 [05/10/2022-20:07:24] [V] [TRT] MatMul_1566 [MatMul] outputs: [2614 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Add_1567 [Add] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2612 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2614 [05/10/2022-20:07:24] [V] [TRT] Add_1567 [Add] inputs: [2612 -> (-1, 4, -1, -1)[FLOAT]], [2614 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Add_1567 for ONNX node: Add_1567 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2615 for ONNX tensor: 2615 [05/10/2022-20:07:24] [V] [TRT] Add_1567 [Add] outputs: [2615 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1568 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1568 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1568 [Constant] outputs: [2616 -> ()[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Div_1569 [Div] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2615 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2616 [05/10/2022-20:07:24] [V] [TRT] Div_1569 [Div] inputs: [2615 -> (-1, 4, -1, -1)[FLOAT]], [2616 -> ()[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 2616 for ONNX node: 2616 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Div_1569 for ONNX node: Div_1569 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2617 for ONNX tensor: 2617 [05/10/2022-20:07:24] [V] [TRT] Div_1569 [Div] outputs: [2617 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Shape_1570 [Shape] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2588 [05/10/2022-20:07:24] [V] [TRT] Shape_1570 [Shape] inputs: [2588 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: Shape_1570 for ONNX node: Shape_1570 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2618 for ONNX tensor: 2618 [05/10/2022-20:07:24] [V] [TRT] Shape_1570 [Shape] outputs: [2618 -> (4)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1571 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1571 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1571 [Constant] outputs: [2619 -> ()[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Gather_1572 [Gather] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2618 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2619 [05/10/2022-20:07:24] [V] [TRT] Gather_1572 [Gather] inputs: [2618 -> (4)[INT32]], [2619 -> ()[INT32]], [05/10/2022-20:07:24] [V] [TRT] Registering layer: 2619 for ONNX node: 2619 [05/10/2022-20:07:24] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Gather_1572 for ONNX node: Gather_1572 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2620 for ONNX tensor: 2620 [05/10/2022-20:07:24] [V] [TRT] Gather_1572 [Gather] outputs: [2620 -> ()[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Constant_1573 [Constant] [05/10/2022-20:07:24] [V] [TRT] Constant_1573 [Constant] inputs: [05/10/2022-20:07:24] [V] [TRT] Constant_1573 [Constant] outputs: [2621 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Unsqueeze_1574 [Unsqueeze] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2621 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1574 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [2621 -> (1)[INT32]], [05/10/2022-20:07:24] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:24] [V] [TRT] Registering layer: Unsqueeze_1574 for ONNX node: Unsqueeze_1574 [05/10/2022-20:07:24] [V] [TRT] Registering tensor: 2622 for ONNX tensor: 2622 [05/10/2022-20:07:24] [V] [TRT] Unsqueeze_1574 [Unsqueeze] outputs: [2622 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:24] [V] [TRT] Parsing node: Cast_1575 [Cast] [05/10/2022-20:07:24] [V] [TRT] Searching for input: 2622 [05/10/2022-20:07:24] [V] [TRT] Cast_1575 [Cast] inputs: [2622 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:24] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:24] [V] [TRT] Registering layer: Cast_1575 for ONNX node: Cast_1575 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2623 for ONNX tensor: 2623 [05/10/2022-20:07:25] [V] [TRT] Cast_1575 [Cast] outputs: [2623 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1576 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1576 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1576 [Constant] outputs: [2624 -> ()[INT32]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Equal_1577 [Equal] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2623 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2624 [05/10/2022-20:07:25] [V] [TRT] Equal_1577 [Equal] inputs: [2623 -> (-1, 1, 1, -1)[INT32]], [2624 -> ()[INT32]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 2624 for ONNX node: 2624 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Equal_1577 for ONNX node: Equal_1577 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2625 for ONNX tensor: 2625 [05/10/2022-20:07:25] [V] [TRT] Equal_1577 [Equal] outputs: [2625 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Cast_1578 [Cast] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2625 [05/10/2022-20:07:25] [V] [TRT] Cast_1578 [Cast] inputs: [2625 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Casting to type: bool [05/10/2022-20:07:25] [V] [TRT] Registering layer: Cast_1578 for ONNX node: Cast_1578 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2626 for ONNX tensor: 2626 [05/10/2022-20:07:25] [V] [TRT] Cast_1578 [Cast] outputs: [2626 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1579 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1579 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1579 [Constant] outputs: [2627 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Where_1580 [Where] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2626 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2627 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2617 [05/10/2022-20:07:25] [V] [TRT] Where_1580 [Where] inputs: [2626 -> (-1, 1, 1, -1)[BOOL]], [2627 -> ()[FLOAT]], [2617 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 2627 for ONNX node: 2627 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Where_1580 for ONNX node: Where_1580 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2628 for ONNX tensor: 2628 [05/10/2022-20:07:25] [V] [TRT] Where_1580 [Where] outputs: [2628 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Softmax_1581 [Softmax] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2628 [05/10/2022-20:07:25] [V] [TRT] Softmax_1581 [Softmax] inputs: [2628 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Softmax_1581 for ONNX node: Softmax_1581 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2629 for ONNX tensor: 2629 [05/10/2022-20:07:25] [V] [TRT] Softmax_1581 [Softmax] outputs: [2629 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Cast_1582 [Cast] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2625 [05/10/2022-20:07:25] [V] [TRT] Cast_1582 [Cast] inputs: [2625 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Casting to type: bool [05/10/2022-20:07:25] [V] [TRT] Registering layer: Cast_1582 for ONNX node: Cast_1582 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2630 for ONNX tensor: 2630 [05/10/2022-20:07:25] [V] [TRT] Cast_1582 [Cast] outputs: [2630 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1583 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1583 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1583 [Constant] outputs: [2631 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Where_1584 [Where] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2630 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2631 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2629 [05/10/2022-20:07:25] [V] [TRT] Where_1584 [Where] inputs: [2630 -> (-1, 1, 1, -1)[BOOL]], [2631 -> ()[FLOAT]], [2629 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 2631 for ONNX node: 2631 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Where_1584 for ONNX node: Where_1584 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2632 for ONNX tensor: 2632 [05/10/2022-20:07:25] [V] [TRT] Where_1584 [Where] outputs: [2632 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: MatMul_1585 [MatMul] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2632 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2588 [05/10/2022-20:07:25] [V] [TRT] MatMul_1585 [MatMul] inputs: [2632 -> (-1, 4, -1, -1)[FLOAT]], [2588 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: MatMul_1585 for ONNX node: MatMul_1585 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2633 for ONNX tensor: 2633 [05/10/2022-20:07:25] [V] [TRT] MatMul_1585 [MatMul] outputs: [2633 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Transpose_1586 [Transpose] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2633 [05/10/2022-20:07:25] [V] [TRT] Transpose_1586 [Transpose] inputs: [2633 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Transpose_1586 for ONNX node: Transpose_1586 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2634 for ONNX tensor: 2634 [05/10/2022-20:07:25] [V] [TRT] Transpose_1586 [Transpose] outputs: [2634 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1587 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1587 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1587 [Constant] outputs: [2637 -> (1)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Unsqueeze_1588 [Unsqueeze] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2620 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2637 [05/10/2022-20:07:25] [V] [TRT] Unsqueeze_1588 [Unsqueeze] inputs: [2620 -> ()[INT32]], [2637 -> (1)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:25] [V] [TRT] Registering layer: Unsqueeze_1588 for ONNX node: Unsqueeze_1588 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2638 for ONNX tensor: 2638 [05/10/2022-20:07:25] [V] [TRT] Unsqueeze_1588 [Unsqueeze] outputs: [2638 -> (1)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Concat_1589 [Concat] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2638 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 3426 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 3427 [05/10/2022-20:07:25] [V] [TRT] Concat_1589 [Concat] inputs: [2638 -> (1)[INT32]], [3426 -> (1)[INT32]], [3427 -> (1)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 3426 for ONNX node: 3426 [05/10/2022-20:07:25] [V] [TRT] Registering layer: 3427 for ONNX node: 3427 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Concat_1589 for ONNX node: Concat_1589 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2643 for ONNX tensor: 2643 [05/10/2022-20:07:25] [V] [TRT] Concat_1589 [Concat] outputs: [2643 -> (3)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Reshape_1590 [Reshape] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2634 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2643 [05/10/2022-20:07:25] [V] [TRT] Reshape_1590 [Reshape] inputs: [2634 -> (-1, -1, 4, 64)[FLOAT]], [2643 -> (3)[INT32]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Reshape_1590 for ONNX node: Reshape_1590 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2644 for ONNX tensor: 2644 [05/10/2022-20:07:25] [V] [TRT] Reshape_1590 [Reshape] outputs: [2644 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: MatMul_1591 [MatMul] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2644 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 3428 [05/10/2022-20:07:25] [V] [TRT] MatMul_1591 [MatMul] inputs: [2644 -> (-1, -1, 256)[FLOAT]], [3428 -> (256, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 3428 for ONNX node: 3428 [05/10/2022-20:07:25] [V] [TRT] Registering layer: MatMul_1591 for ONNX node: MatMul_1591 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2646 for ONNX tensor: 2646 [05/10/2022-20:07:25] [V] [TRT] MatMul_1591 [MatMul] outputs: [2646 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Add_1592 [Add] [05/10/2022-20:07:25] [V] [TRT] Searching for input: encoder.encoders.9.self_attn.linear_out.bias [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2646 [05/10/2022-20:07:25] [V] [TRT] Add_1592 [Add] inputs: [encoder.encoders.9.self_attn.linear_out.bias -> (256)[FLOAT]], [2646 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: encoder.encoders.9.self_attn.linear_out.bias for ONNX node: encoder.encoders.9.self_attn.linear_out.bias [05/10/2022-20:07:25] [V] [TRT] Registering layer: Add_1592 for ONNX node: Add_1592 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2647 for ONNX tensor: 2647 [05/10/2022-20:07:25] [V] [TRT] Add_1592 [Add] outputs: [2647 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Add_1593 [Add] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2525 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2647 [05/10/2022-20:07:25] [V] [TRT] Add_1593 [Add] inputs: [2525 -> (-1, -1, 256)[FLOAT]], [2647 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Add_1593 for ONNX node: Add_1593 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2648 for ONNX tensor: 2648 [05/10/2022-20:07:25] [V] [TRT] Add_1593 [Add] outputs: [2648 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: ReduceMean_1594 [ReduceMean] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2648 [05/10/2022-20:07:25] [V] [TRT] ReduceMean_1594 [ReduceMean] inputs: [2648 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: ReduceMean_1594 for ONNX node: ReduceMean_1594 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2649 for ONNX tensor: 2649 [05/10/2022-20:07:25] [V] [TRT] ReduceMean_1594 [ReduceMean] outputs: [2649 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Sub_1595 [Sub] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2648 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2649 [05/10/2022-20:07:25] [V] [TRT] Sub_1595 [Sub] inputs: [2648 -> (-1, -1, 256)[FLOAT]], [2649 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Sub_1595 for ONNX node: Sub_1595 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2650 for ONNX tensor: 2650 [05/10/2022-20:07:25] [V] [TRT] Sub_1595 [Sub] outputs: [2650 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1596 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1596 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1596 [Constant] outputs: [2651 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Pow_1597 [Pow] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2650 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2651 [05/10/2022-20:07:25] [V] [TRT] Pow_1597 [Pow] inputs: [2650 -> (-1, -1, 256)[FLOAT]], [2651 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 2651 for ONNX node: 2651 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Pow_1597 for ONNX node: Pow_1597 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2652 for ONNX tensor: 2652 [05/10/2022-20:07:25] [V] [TRT] Pow_1597 [Pow] outputs: [2652 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: ReduceMean_1598 [ReduceMean] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2652 [05/10/2022-20:07:25] [V] [TRT] ReduceMean_1598 [ReduceMean] inputs: [2652 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: ReduceMean_1598 for ONNX node: ReduceMean_1598 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2653 for ONNX tensor: 2653 [05/10/2022-20:07:25] [V] [TRT] ReduceMean_1598 [ReduceMean] outputs: [2653 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1599 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1599 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1599 [Constant] outputs: [2654 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Add_1600 [Add] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2653 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2654 [05/10/2022-20:07:25] [V] [TRT] Add_1600 [Add] inputs: [2653 -> (-1, -1, 1)[FLOAT]], [2654 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 2654 for ONNX node: 2654 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Add_1600 for ONNX node: Add_1600 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2655 for ONNX tensor: 2655 [05/10/2022-20:07:25] [V] [TRT] Add_1600 [Add] outputs: [2655 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Sqrt_1601 [Sqrt] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2655 [05/10/2022-20:07:25] [V] [TRT] Sqrt_1601 [Sqrt] inputs: [2655 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Sqrt_1601 for ONNX node: Sqrt_1601 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2656 for ONNX tensor: 2656 [05/10/2022-20:07:25] [V] [TRT] Sqrt_1601 [Sqrt] outputs: [2656 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Div_1602 [Div] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2650 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2656 [05/10/2022-20:07:25] [V] [TRT] Div_1602 [Div] inputs: [2650 -> (-1, -1, 256)[FLOAT]], [2656 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Div_1602 for ONNX node: Div_1602 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2657 for ONNX tensor: 2657 [05/10/2022-20:07:25] [V] [TRT] Div_1602 [Div] outputs: [2657 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Mul_1603 [Mul] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2657 [05/10/2022-20:07:25] [V] [TRT] Searching for input: encoder.encoders.9.norm_conv.weight [05/10/2022-20:07:25] [V] [TRT] Mul_1603 [Mul] inputs: [2657 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: encoder.encoders.9.norm_conv.weight for ONNX node: encoder.encoders.9.norm_conv.weight [05/10/2022-20:07:25] [V] [TRT] Registering layer: Mul_1603 for ONNX node: Mul_1603 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2658 for ONNX tensor: 2658 [05/10/2022-20:07:25] [V] [TRT] Mul_1603 [Mul] outputs: [2658 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Add_1604 [Add] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2658 [05/10/2022-20:07:25] [V] [TRT] Searching for input: encoder.encoders.9.norm_conv.bias [05/10/2022-20:07:25] [V] [TRT] Add_1604 [Add] inputs: [2658 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: encoder.encoders.9.norm_conv.bias for ONNX node: encoder.encoders.9.norm_conv.bias [05/10/2022-20:07:25] [V] [TRT] Registering layer: Add_1604 for ONNX node: Add_1604 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2659 for ONNX tensor: 2659 [05/10/2022-20:07:25] [V] [TRT] Add_1604 [Add] outputs: [2659 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Transpose_1605 [Transpose] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2659 [05/10/2022-20:07:25] [V] [TRT] Transpose_1605 [Transpose] inputs: [2659 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Transpose_1605 for ONNX node: Transpose_1605 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2660 for ONNX tensor: 2660 [05/10/2022-20:07:25] [V] [TRT] Transpose_1605 [Transpose] outputs: [2660 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Not_1606 [Not] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:25] [V] [TRT] Not_1606 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: Not_1606 for ONNX node: Not_1606 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2661 for ONNX tensor: 2661 [05/10/2022-20:07:25] [V] [TRT] Not_1606 [Not] outputs: [2661 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Cast_1607 [Cast] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2661 [05/10/2022-20:07:25] [V] [TRT] Cast_1607 [Cast] inputs: [2661 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Casting to type: bool [05/10/2022-20:07:25] [V] [TRT] Registering layer: Cast_1607 for ONNX node: Cast_1607 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2662 for ONNX tensor: 2662 [05/10/2022-20:07:25] [V] [TRT] Cast_1607 [Cast] outputs: [2662 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Constant_1608 [Constant] [05/10/2022-20:07:25] [V] [TRT] Constant_1608 [Constant] inputs: [05/10/2022-20:07:25] [V] [TRT] Constant_1608 [Constant] outputs: [2663 -> ()[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Where_1609 [Where] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2662 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2663 [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2660 [05/10/2022-20:07:25] [V] [TRT] Where_1609 [Where] inputs: [2662 -> (-1, 1, -1)[BOOL]], [2663 -> ()[FLOAT]], [2660 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Registering layer: 2663 for ONNX node: 2663 [05/10/2022-20:07:25] [V] [TRT] Registering layer: Where_1609 for ONNX node: Where_1609 [05/10/2022-20:07:25] [V] [TRT] Registering tensor: 2664 for ONNX tensor: 2664 [05/10/2022-20:07:25] [V] [TRT] Where_1609 [Where] outputs: [2664 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Parsing node: Conv_1610 [Conv] [05/10/2022-20:07:25] [V] [TRT] Searching for input: 2664 [05/10/2022-20:07:25] [V] [TRT] Searching for input: encoder.encoders.9.conv_module.pointwise_conv1.weight [05/10/2022-20:07:25] [V] [TRT] Searching for input: encoder.encoders.9.conv_module.pointwise_conv1.bias [05/10/2022-20:07:25] [V] [TRT] Conv_1610 [Conv] inputs: [2664 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.9.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.9.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:25] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:25] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:26] [V] [TRT] Registering layer: Conv_1610 for ONNX node: Conv_1610 [05/10/2022-20:07:26] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:26] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:26] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2665 for ONNX tensor: 2665 [05/10/2022-20:07:26] [V] [TRT] Conv_1610 [Conv] outputs: [2665 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Split_1611 [Split] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2665 [05/10/2022-20:07:26] [V] [TRT] Split_1611 [Split] inputs: [2665 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Split_1611 for ONNX node: Split_1611 [05/10/2022-20:07:26] [V] [TRT] Registering layer: Split_1611_11 for ONNX node: Split_1611 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2666 for ONNX tensor: 2666 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2667 for ONNX tensor: 2667 [05/10/2022-20:07:26] [V] [TRT] Split_1611 [Split] outputs: [2666 -> (-1, 256, -1)[FLOAT]], [2667 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Sigmoid_1612 [Sigmoid] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2667 [05/10/2022-20:07:26] [V] [TRT] Sigmoid_1612 [Sigmoid] inputs: [2667 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Sigmoid_1612 for ONNX node: Sigmoid_1612 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2668 for ONNX tensor: 2668 [05/10/2022-20:07:26] [V] [TRT] Sigmoid_1612 [Sigmoid] outputs: [2668 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Mul_1613 [Mul] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2666 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2668 [05/10/2022-20:07:26] [V] [TRT] Mul_1613 [Mul] inputs: [2666 -> (-1, 256, -1)[FLOAT]], [2668 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Mul_1613 for ONNX node: Mul_1613 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2669 for ONNX tensor: 2669 [05/10/2022-20:07:26] [V] [TRT] Mul_1613 [Mul] outputs: [2669 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Conv_1614 [Conv] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2669 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 3188 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 3189 [05/10/2022-20:07:26] [V] [TRT] Conv_1614 [Conv] inputs: [2669 -> (-1, 256, -1)[FLOAT]], [3188 -> (256, 1, 15)[FLOAT]], [3189 -> (256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:26] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:26] [V] [TRT] Registering layer: Conv_1614 for ONNX node: Conv_1614 [05/10/2022-20:07:26] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:26] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:26] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 3187 for ONNX tensor: 3187 [05/10/2022-20:07:26] [V] [TRT] Conv_1614 [Conv] outputs: [3187 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Sigmoid_1615 [Sigmoid] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 3187 [05/10/2022-20:07:26] [V] [TRT] Sigmoid_1615 [Sigmoid] inputs: [3187 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Sigmoid_1615 for ONNX node: Sigmoid_1615 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2672 for ONNX tensor: 2672 [05/10/2022-20:07:26] [V] [TRT] Sigmoid_1615 [Sigmoid] outputs: [2672 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Mul_1616 [Mul] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 3187 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2672 [05/10/2022-20:07:26] [V] [TRT] Mul_1616 [Mul] inputs: [3187 -> (-1, 256, -1)[FLOAT]], [2672 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Mul_1616 for ONNX node: Mul_1616 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2673 for ONNX tensor: 2673 [05/10/2022-20:07:26] [V] [TRT] Mul_1616 [Mul] outputs: [2673 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Not_1617 [Not] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:26] [V] [TRT] Not_1617 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Not_1617 for ONNX node: Not_1617 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2674 for ONNX tensor: 2674 [05/10/2022-20:07:26] [V] [TRT] Not_1617 [Not] outputs: [2674 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Conv_1618 [Conv] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2673 [05/10/2022-20:07:26] [V] [TRT] Searching for input: encoder.encoders.9.conv_module.pointwise_conv2.weight [05/10/2022-20:07:26] [V] [TRT] Searching for input: encoder.encoders.9.conv_module.pointwise_conv2.bias [05/10/2022-20:07:26] [V] [TRT] Conv_1618 [Conv] inputs: [2673 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.9.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.9.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:26] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:26] [V] [TRT] Registering layer: Conv_1618 for ONNX node: Conv_1618 [05/10/2022-20:07:26] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:26] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:26] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2675 for ONNX tensor: 2675 [05/10/2022-20:07:26] [V] [TRT] Conv_1618 [Conv] outputs: [2675 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Cast_1619 [Cast] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2674 [05/10/2022-20:07:26] [V] [TRT] Cast_1619 [Cast] inputs: [2674 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:26] [V] [TRT] Casting to type: bool [05/10/2022-20:07:26] [V] [TRT] Registering layer: Cast_1619 for ONNX node: Cast_1619 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2676 for ONNX tensor: 2676 [05/10/2022-20:07:26] [V] [TRT] Cast_1619 [Cast] outputs: [2676 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Constant_1620 [Constant] [05/10/2022-20:07:26] [V] [TRT] Constant_1620 [Constant] inputs: [05/10/2022-20:07:26] [V] [TRT] Constant_1620 [Constant] outputs: [2677 -> ()[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Where_1621 [Where] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2676 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2677 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2675 [05/10/2022-20:07:26] [V] [TRT] Where_1621 [Where] inputs: [2676 -> (-1, 1, -1)[BOOL]], [2677 -> ()[FLOAT]], [2675 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: 2677 for ONNX node: 2677 [05/10/2022-20:07:26] [V] [TRT] Registering layer: Where_1621 for ONNX node: Where_1621 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2678 for ONNX tensor: 2678 [05/10/2022-20:07:26] [V] [TRT] Where_1621 [Where] outputs: [2678 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Transpose_1622 [Transpose] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2678 [05/10/2022-20:07:26] [V] [TRT] Transpose_1622 [Transpose] inputs: [2678 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Transpose_1622 for ONNX node: Transpose_1622 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2679 for ONNX tensor: 2679 [05/10/2022-20:07:26] [V] [TRT] Transpose_1622 [Transpose] outputs: [2679 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Add_1623 [Add] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2648 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2679 [05/10/2022-20:07:26] [V] [TRT] Add_1623 [Add] inputs: [2648 -> (-1, -1, 256)[FLOAT]], [2679 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Add_1623 for ONNX node: Add_1623 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2680 for ONNX tensor: 2680 [05/10/2022-20:07:26] [V] [TRT] Add_1623 [Add] outputs: [2680 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: ReduceMean_1624 [ReduceMean] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2680 [05/10/2022-20:07:26] [V] [TRT] ReduceMean_1624 [ReduceMean] inputs: [2680 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: ReduceMean_1624 for ONNX node: ReduceMean_1624 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2681 for ONNX tensor: 2681 [05/10/2022-20:07:26] [V] [TRT] ReduceMean_1624 [ReduceMean] outputs: [2681 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Sub_1625 [Sub] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2680 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2681 [05/10/2022-20:07:26] [V] [TRT] Sub_1625 [Sub] inputs: [2680 -> (-1, -1, 256)[FLOAT]], [2681 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Sub_1625 for ONNX node: Sub_1625 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2682 for ONNX tensor: 2682 [05/10/2022-20:07:26] [V] [TRT] Sub_1625 [Sub] outputs: [2682 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Constant_1626 [Constant] [05/10/2022-20:07:26] [V] [TRT] Constant_1626 [Constant] inputs: [05/10/2022-20:07:26] [V] [TRT] Constant_1626 [Constant] outputs: [2683 -> ()[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Pow_1627 [Pow] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2682 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2683 [05/10/2022-20:07:26] [V] [TRT] Pow_1627 [Pow] inputs: [2682 -> (-1, -1, 256)[FLOAT]], [2683 -> ()[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: 2683 for ONNX node: 2683 [05/10/2022-20:07:26] [V] [TRT] Registering layer: Pow_1627 for ONNX node: Pow_1627 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2684 for ONNX tensor: 2684 [05/10/2022-20:07:26] [V] [TRT] Pow_1627 [Pow] outputs: [2684 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: ReduceMean_1628 [ReduceMean] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2684 [05/10/2022-20:07:26] [V] [TRT] ReduceMean_1628 [ReduceMean] inputs: [2684 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: ReduceMean_1628 for ONNX node: ReduceMean_1628 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2685 for ONNX tensor: 2685 [05/10/2022-20:07:26] [V] [TRT] ReduceMean_1628 [ReduceMean] outputs: [2685 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Constant_1629 [Constant] [05/10/2022-20:07:26] [V] [TRT] Constant_1629 [Constant] inputs: [05/10/2022-20:07:26] [V] [TRT] Constant_1629 [Constant] outputs: [2686 -> ()[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Add_1630 [Add] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2685 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2686 [05/10/2022-20:07:26] [V] [TRT] Add_1630 [Add] inputs: [2685 -> (-1, -1, 1)[FLOAT]], [2686 -> ()[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: 2686 for ONNX node: 2686 [05/10/2022-20:07:26] [V] [TRT] Registering layer: Add_1630 for ONNX node: Add_1630 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2687 for ONNX tensor: 2687 [05/10/2022-20:07:26] [V] [TRT] Add_1630 [Add] outputs: [2687 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Sqrt_1631 [Sqrt] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2687 [05/10/2022-20:07:26] [V] [TRT] Sqrt_1631 [Sqrt] inputs: [2687 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Sqrt_1631 for ONNX node: Sqrt_1631 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2688 for ONNX tensor: 2688 [05/10/2022-20:07:26] [V] [TRT] Sqrt_1631 [Sqrt] outputs: [2688 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Div_1632 [Div] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2682 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2688 [05/10/2022-20:07:26] [V] [TRT] Div_1632 [Div] inputs: [2682 -> (-1, -1, 256)[FLOAT]], [2688 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: Div_1632 for ONNX node: Div_1632 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2689 for ONNX tensor: 2689 [05/10/2022-20:07:26] [V] [TRT] Div_1632 [Div] outputs: [2689 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Mul_1633 [Mul] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2689 [05/10/2022-20:07:26] [V] [TRT] Searching for input: encoder.encoders.9.norm_ff.weight [05/10/2022-20:07:26] [V] [TRT] Mul_1633 [Mul] inputs: [2689 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: encoder.encoders.9.norm_ff.weight for ONNX node: encoder.encoders.9.norm_ff.weight [05/10/2022-20:07:26] [V] [TRT] Registering layer: Mul_1633 for ONNX node: Mul_1633 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2690 for ONNX tensor: 2690 [05/10/2022-20:07:26] [V] [TRT] Mul_1633 [Mul] outputs: [2690 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: Add_1634 [Add] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2690 [05/10/2022-20:07:26] [V] [TRT] Searching for input: encoder.encoders.9.norm_ff.bias [05/10/2022-20:07:26] [V] [TRT] Add_1634 [Add] inputs: [2690 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: encoder.encoders.9.norm_ff.bias for ONNX node: encoder.encoders.9.norm_ff.bias [05/10/2022-20:07:26] [V] [TRT] Registering layer: Add_1634 for ONNX node: Add_1634 [05/10/2022-20:07:26] [V] [TRT] Registering tensor: 2691 for ONNX tensor: 2691 [05/10/2022-20:07:26] [V] [TRT] Add_1634 [Add] outputs: [2691 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Parsing node: MatMul_1635 [MatMul] [05/10/2022-20:07:26] [V] [TRT] Searching for input: 2691 [05/10/2022-20:07:26] [V] [TRT] Searching for input: 3429 [05/10/2022-20:07:26] [V] [TRT] MatMul_1635 [MatMul] inputs: [2691 -> (-1, -1, 256)[FLOAT]], [3429 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:26] [V] [TRT] Registering layer: 3429 for ONNX node: 3429 [05/10/2022-20:07:26] [V] [TRT] Registering layer: MatMul_1635 for ONNX node: MatMul_1635 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2693 for ONNX tensor: 2693 [05/10/2022-20:07:27] [V] [TRT] MatMul_1635 [MatMul] outputs: [2693 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1636 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: encoder.encoders.9.feed_forward.w_1.bias [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2693 [05/10/2022-20:07:27] [V] [TRT] Add_1636 [Add] inputs: [encoder.encoders.9.feed_forward.w_1.bias -> (2048)[FLOAT]], [2693 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: encoder.encoders.9.feed_forward.w_1.bias for ONNX node: encoder.encoders.9.feed_forward.w_1.bias [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1636 for ONNX node: Add_1636 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2694 for ONNX tensor: 2694 [05/10/2022-20:07:27] [V] [TRT] Add_1636 [Add] outputs: [2694 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Sigmoid_1637 [Sigmoid] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2694 [05/10/2022-20:07:27] [V] [TRT] Sigmoid_1637 [Sigmoid] inputs: [2694 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Sigmoid_1637 for ONNX node: Sigmoid_1637 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2695 for ONNX tensor: 2695 [05/10/2022-20:07:27] [V] [TRT] Sigmoid_1637 [Sigmoid] outputs: [2695 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Mul_1638 [Mul] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2694 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2695 [05/10/2022-20:07:27] [V] [TRT] Mul_1638 [Mul] inputs: [2694 -> (-1, -1, 2048)[FLOAT]], [2695 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Mul_1638 for ONNX node: Mul_1638 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2696 for ONNX tensor: 2696 [05/10/2022-20:07:27] [V] [TRT] Mul_1638 [Mul] outputs: [2696 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: MatMul_1639 [MatMul] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2696 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 3430 [05/10/2022-20:07:27] [V] [TRT] MatMul_1639 [MatMul] inputs: [2696 -> (-1, -1, 2048)[FLOAT]], [3430 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 3430 for ONNX node: 3430 [05/10/2022-20:07:27] [V] [TRT] Registering layer: MatMul_1639 for ONNX node: MatMul_1639 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2698 for ONNX tensor: 2698 [05/10/2022-20:07:27] [V] [TRT] MatMul_1639 [MatMul] outputs: [2698 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1640 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: encoder.encoders.9.feed_forward.w_2.bias [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2698 [05/10/2022-20:07:27] [V] [TRT] Add_1640 [Add] inputs: [encoder.encoders.9.feed_forward.w_2.bias -> (256)[FLOAT]], [2698 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: encoder.encoders.9.feed_forward.w_2.bias for ONNX node: encoder.encoders.9.feed_forward.w_2.bias [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1640 for ONNX node: Add_1640 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2699 for ONNX tensor: 2699 [05/10/2022-20:07:27] [V] [TRT] Add_1640 [Add] outputs: [2699 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Constant_1641 [Constant] [05/10/2022-20:07:27] [V] [TRT] Constant_1641 [Constant] inputs: [05/10/2022-20:07:27] [V] [TRT] Constant_1641 [Constant] outputs: [2700 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Mul_1642 [Mul] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2699 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2700 [05/10/2022-20:07:27] [V] [TRT] Mul_1642 [Mul] inputs: [2699 -> (-1, -1, 256)[FLOAT]], [2700 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 2700 for ONNX node: 2700 [05/10/2022-20:07:27] [V] [TRT] Registering layer: Mul_1642 for ONNX node: Mul_1642 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2701 for ONNX tensor: 2701 [05/10/2022-20:07:27] [V] [TRT] Mul_1642 [Mul] outputs: [2701 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1643 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2680 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2701 [05/10/2022-20:07:27] [V] [TRT] Add_1643 [Add] inputs: [2680 -> (-1, -1, 256)[FLOAT]], [2701 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1643 for ONNX node: Add_1643 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2702 for ONNX tensor: 2702 [05/10/2022-20:07:27] [V] [TRT] Add_1643 [Add] outputs: [2702 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: ReduceMean_1644 [ReduceMean] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2702 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1644 [ReduceMean] inputs: [2702 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: ReduceMean_1644 for ONNX node: ReduceMean_1644 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2703 for ONNX tensor: 2703 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1644 [ReduceMean] outputs: [2703 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Sub_1645 [Sub] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2702 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2703 [05/10/2022-20:07:27] [V] [TRT] Sub_1645 [Sub] inputs: [2702 -> (-1, -1, 256)[FLOAT]], [2703 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Sub_1645 for ONNX node: Sub_1645 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2704 for ONNX tensor: 2704 [05/10/2022-20:07:27] [V] [TRT] Sub_1645 [Sub] outputs: [2704 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Constant_1646 [Constant] [05/10/2022-20:07:27] [V] [TRT] Constant_1646 [Constant] inputs: [05/10/2022-20:07:27] [V] [TRT] Constant_1646 [Constant] outputs: [2705 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Pow_1647 [Pow] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2704 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2705 [05/10/2022-20:07:27] [V] [TRT] Pow_1647 [Pow] inputs: [2704 -> (-1, -1, 256)[FLOAT]], [2705 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 2705 for ONNX node: 2705 [05/10/2022-20:07:27] [V] [TRT] Registering layer: Pow_1647 for ONNX node: Pow_1647 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2706 for ONNX tensor: 2706 [05/10/2022-20:07:27] [V] [TRT] Pow_1647 [Pow] outputs: [2706 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: ReduceMean_1648 [ReduceMean] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2706 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1648 [ReduceMean] inputs: [2706 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: ReduceMean_1648 for ONNX node: ReduceMean_1648 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2707 for ONNX tensor: 2707 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1648 [ReduceMean] outputs: [2707 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Constant_1649 [Constant] [05/10/2022-20:07:27] [V] [TRT] Constant_1649 [Constant] inputs: [05/10/2022-20:07:27] [V] [TRT] Constant_1649 [Constant] outputs: [2708 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1650 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2707 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2708 [05/10/2022-20:07:27] [V] [TRT] Add_1650 [Add] inputs: [2707 -> (-1, -1, 1)[FLOAT]], [2708 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 2708 for ONNX node: 2708 [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1650 for ONNX node: Add_1650 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2709 for ONNX tensor: 2709 [05/10/2022-20:07:27] [V] [TRT] Add_1650 [Add] outputs: [2709 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Sqrt_1651 [Sqrt] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2709 [05/10/2022-20:07:27] [V] [TRT] Sqrt_1651 [Sqrt] inputs: [2709 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Sqrt_1651 for ONNX node: Sqrt_1651 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2710 for ONNX tensor: 2710 [05/10/2022-20:07:27] [V] [TRT] Sqrt_1651 [Sqrt] outputs: [2710 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Div_1652 [Div] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2704 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2710 [05/10/2022-20:07:27] [V] [TRT] Div_1652 [Div] inputs: [2704 -> (-1, -1, 256)[FLOAT]], [2710 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Div_1652 for ONNX node: Div_1652 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2711 for ONNX tensor: 2711 [05/10/2022-20:07:27] [V] [TRT] Div_1652 [Div] outputs: [2711 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Mul_1653 [Mul] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2711 [05/10/2022-20:07:27] [V] [TRT] Searching for input: encoder.encoders.9.norm_final.weight [05/10/2022-20:07:27] [V] [TRT] Mul_1653 [Mul] inputs: [2711 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: encoder.encoders.9.norm_final.weight for ONNX node: encoder.encoders.9.norm_final.weight [05/10/2022-20:07:27] [V] [TRT] Registering layer: Mul_1653 for ONNX node: Mul_1653 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2712 for ONNX tensor: 2712 [05/10/2022-20:07:27] [V] [TRT] Mul_1653 [Mul] outputs: [2712 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1654 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2712 [05/10/2022-20:07:27] [V] [TRT] Searching for input: encoder.encoders.9.norm_final.bias [05/10/2022-20:07:27] [V] [TRT] Add_1654 [Add] inputs: [2712 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.9.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: encoder.encoders.9.norm_final.bias for ONNX node: encoder.encoders.9.norm_final.bias [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1654 for ONNX node: Add_1654 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2713 for ONNX tensor: 2713 [05/10/2022-20:07:27] [V] [TRT] Add_1654 [Add] outputs: [2713 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: ReduceMean_1655 [ReduceMean] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2713 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1655 [ReduceMean] inputs: [2713 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: ReduceMean_1655 for ONNX node: ReduceMean_1655 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2714 for ONNX tensor: 2714 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1655 [ReduceMean] outputs: [2714 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Sub_1656 [Sub] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2713 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2714 [05/10/2022-20:07:27] [V] [TRT] Sub_1656 [Sub] inputs: [2713 -> (-1, -1, 256)[FLOAT]], [2714 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Sub_1656 for ONNX node: Sub_1656 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2715 for ONNX tensor: 2715 [05/10/2022-20:07:27] [V] [TRT] Sub_1656 [Sub] outputs: [2715 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Constant_1657 [Constant] [05/10/2022-20:07:27] [V] [TRT] Constant_1657 [Constant] inputs: [05/10/2022-20:07:27] [V] [TRT] Constant_1657 [Constant] outputs: [2716 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Pow_1658 [Pow] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2715 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2716 [05/10/2022-20:07:27] [V] [TRT] Pow_1658 [Pow] inputs: [2715 -> (-1, -1, 256)[FLOAT]], [2716 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 2716 for ONNX node: 2716 [05/10/2022-20:07:27] [V] [TRT] Registering layer: Pow_1658 for ONNX node: Pow_1658 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2717 for ONNX tensor: 2717 [05/10/2022-20:07:27] [V] [TRT] Pow_1658 [Pow] outputs: [2717 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: ReduceMean_1659 [ReduceMean] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2717 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1659 [ReduceMean] inputs: [2717 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: ReduceMean_1659 for ONNX node: ReduceMean_1659 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2718 for ONNX tensor: 2718 [05/10/2022-20:07:27] [V] [TRT] ReduceMean_1659 [ReduceMean] outputs: [2718 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Constant_1660 [Constant] [05/10/2022-20:07:27] [V] [TRT] Constant_1660 [Constant] inputs: [05/10/2022-20:07:27] [V] [TRT] Constant_1660 [Constant] outputs: [2719 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1661 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2718 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2719 [05/10/2022-20:07:27] [V] [TRT] Add_1661 [Add] inputs: [2718 -> (-1, -1, 1)[FLOAT]], [2719 -> ()[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 2719 for ONNX node: 2719 [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1661 for ONNX node: Add_1661 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2720 for ONNX tensor: 2720 [05/10/2022-20:07:27] [V] [TRT] Add_1661 [Add] outputs: [2720 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Sqrt_1662 [Sqrt] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2720 [05/10/2022-20:07:27] [V] [TRT] Sqrt_1662 [Sqrt] inputs: [2720 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Sqrt_1662 for ONNX node: Sqrt_1662 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2721 for ONNX tensor: 2721 [05/10/2022-20:07:27] [V] [TRT] Sqrt_1662 [Sqrt] outputs: [2721 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Div_1663 [Div] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2715 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2721 [05/10/2022-20:07:27] [V] [TRT] Div_1663 [Div] inputs: [2715 -> (-1, -1, 256)[FLOAT]], [2721 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: Div_1663 for ONNX node: Div_1663 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2722 for ONNX tensor: 2722 [05/10/2022-20:07:27] [V] [TRT] Div_1663 [Div] outputs: [2722 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Mul_1664 [Mul] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2722 [05/10/2022-20:07:27] [V] [TRT] Searching for input: encoder.encoders.10.norm_ff_macaron.weight [05/10/2022-20:07:27] [V] [TRT] Mul_1664 [Mul] inputs: [2722 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: encoder.encoders.10.norm_ff_macaron.weight for ONNX node: encoder.encoders.10.norm_ff_macaron.weight [05/10/2022-20:07:27] [V] [TRT] Registering layer: Mul_1664 for ONNX node: Mul_1664 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2723 for ONNX tensor: 2723 [05/10/2022-20:07:27] [V] [TRT] Mul_1664 [Mul] outputs: [2723 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: Add_1665 [Add] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2723 [05/10/2022-20:07:27] [V] [TRT] Searching for input: encoder.encoders.10.norm_ff_macaron.bias [05/10/2022-20:07:27] [V] [TRT] Add_1665 [Add] inputs: [2723 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: encoder.encoders.10.norm_ff_macaron.bias for ONNX node: encoder.encoders.10.norm_ff_macaron.bias [05/10/2022-20:07:27] [V] [TRT] Registering layer: Add_1665 for ONNX node: Add_1665 [05/10/2022-20:07:27] [V] [TRT] Registering tensor: 2724 for ONNX tensor: 2724 [05/10/2022-20:07:27] [V] [TRT] Add_1665 [Add] outputs: [2724 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Parsing node: MatMul_1666 [MatMul] [05/10/2022-20:07:27] [V] [TRT] Searching for input: 2724 [05/10/2022-20:07:27] [V] [TRT] Searching for input: 3431 [05/10/2022-20:07:27] [V] [TRT] MatMul_1666 [MatMul] inputs: [2724 -> (-1, -1, 256)[FLOAT]], [3431 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:27] [V] [TRT] Registering layer: 3431 for ONNX node: 3431 [05/10/2022-20:07:27] [V] [TRT] Registering layer: MatMul_1666 for ONNX node: MatMul_1666 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2726 for ONNX tensor: 2726 [05/10/2022-20:07:28] [V] [TRT] MatMul_1666 [MatMul] outputs: [2726 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1667 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: encoder.encoders.10.feed_forward_macaron.w_1.bias [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2726 [05/10/2022-20:07:28] [V] [TRT] Add_1667 [Add] inputs: [encoder.encoders.10.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [2726 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: encoder.encoders.10.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.10.feed_forward_macaron.w_1.bias [05/10/2022-20:07:28] [V] [TRT] Registering layer: Add_1667 for ONNX node: Add_1667 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2727 for ONNX tensor: 2727 [05/10/2022-20:07:28] [V] [TRT] Add_1667 [Add] outputs: [2727 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Sigmoid_1668 [Sigmoid] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2727 [05/10/2022-20:07:28] [V] [TRT] Sigmoid_1668 [Sigmoid] inputs: [2727 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Sigmoid_1668 for ONNX node: Sigmoid_1668 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2728 for ONNX tensor: 2728 [05/10/2022-20:07:28] [V] [TRT] Sigmoid_1668 [Sigmoid] outputs: [2728 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Mul_1669 [Mul] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2727 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2728 [05/10/2022-20:07:28] [V] [TRT] Mul_1669 [Mul] inputs: [2727 -> (-1, -1, 2048)[FLOAT]], [2728 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Mul_1669 for ONNX node: Mul_1669 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2729 for ONNX tensor: 2729 [05/10/2022-20:07:28] [V] [TRT] Mul_1669 [Mul] outputs: [2729 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: MatMul_1670 [MatMul] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2729 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 3432 [05/10/2022-20:07:28] [V] [TRT] MatMul_1670 [MatMul] inputs: [2729 -> (-1, -1, 2048)[FLOAT]], [3432 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 3432 for ONNX node: 3432 [05/10/2022-20:07:28] [V] [TRT] Registering layer: MatMul_1670 for ONNX node: MatMul_1670 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2731 for ONNX tensor: 2731 [05/10/2022-20:07:28] [V] [TRT] MatMul_1670 [MatMul] outputs: [2731 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1671 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: encoder.encoders.10.feed_forward_macaron.w_2.bias [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2731 [05/10/2022-20:07:28] [V] [TRT] Add_1671 [Add] inputs: [encoder.encoders.10.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [2731 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: encoder.encoders.10.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.10.feed_forward_macaron.w_2.bias [05/10/2022-20:07:28] [V] [TRT] Registering layer: Add_1671 for ONNX node: Add_1671 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2732 for ONNX tensor: 2732 [05/10/2022-20:07:28] [V] [TRT] Add_1671 [Add] outputs: [2732 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Constant_1672 [Constant] [05/10/2022-20:07:28] [V] [TRT] Constant_1672 [Constant] inputs: [05/10/2022-20:07:28] [V] [TRT] Constant_1672 [Constant] outputs: [2733 -> ()[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Mul_1673 [Mul] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2732 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2733 [05/10/2022-20:07:28] [V] [TRT] Mul_1673 [Mul] inputs: [2732 -> (-1, -1, 256)[FLOAT]], [2733 -> ()[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 2733 for ONNX node: 2733 [05/10/2022-20:07:28] [V] [TRT] Registering layer: Mul_1673 for ONNX node: Mul_1673 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2734 for ONNX tensor: 2734 [05/10/2022-20:07:28] [V] [TRT] Mul_1673 [Mul] outputs: [2734 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1674 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2713 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2734 [05/10/2022-20:07:28] [V] [TRT] Add_1674 [Add] inputs: [2713 -> (-1, -1, 256)[FLOAT]], [2734 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Add_1674 for ONNX node: Add_1674 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2735 for ONNX tensor: 2735 [05/10/2022-20:07:28] [V] [TRT] Add_1674 [Add] outputs: [2735 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: ReduceMean_1675 [ReduceMean] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2735 [05/10/2022-20:07:28] [V] [TRT] ReduceMean_1675 [ReduceMean] inputs: [2735 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: ReduceMean_1675 for ONNX node: ReduceMean_1675 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2736 for ONNX tensor: 2736 [05/10/2022-20:07:28] [V] [TRT] ReduceMean_1675 [ReduceMean] outputs: [2736 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Sub_1676 [Sub] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2735 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2736 [05/10/2022-20:07:28] [V] [TRT] Sub_1676 [Sub] inputs: [2735 -> (-1, -1, 256)[FLOAT]], [2736 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Sub_1676 for ONNX node: Sub_1676 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2737 for ONNX tensor: 2737 [05/10/2022-20:07:28] [V] [TRT] Sub_1676 [Sub] outputs: [2737 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Constant_1677 [Constant] [05/10/2022-20:07:28] [V] [TRT] Constant_1677 [Constant] inputs: [05/10/2022-20:07:28] [V] [TRT] Constant_1677 [Constant] outputs: [2738 -> ()[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Pow_1678 [Pow] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2737 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2738 [05/10/2022-20:07:28] [V] [TRT] Pow_1678 [Pow] inputs: [2737 -> (-1, -1, 256)[FLOAT]], [2738 -> ()[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 2738 for ONNX node: 2738 [05/10/2022-20:07:28] [V] [TRT] Registering layer: Pow_1678 for ONNX node: Pow_1678 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2739 for ONNX tensor: 2739 [05/10/2022-20:07:28] [V] [TRT] Pow_1678 [Pow] outputs: [2739 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: ReduceMean_1679 [ReduceMean] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2739 [05/10/2022-20:07:28] [V] [TRT] ReduceMean_1679 [ReduceMean] inputs: [2739 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: ReduceMean_1679 for ONNX node: ReduceMean_1679 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2740 for ONNX tensor: 2740 [05/10/2022-20:07:28] [V] [TRT] ReduceMean_1679 [ReduceMean] outputs: [2740 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Constant_1680 [Constant] [05/10/2022-20:07:28] [V] [TRT] Constant_1680 [Constant] inputs: [05/10/2022-20:07:28] [V] [TRT] Constant_1680 [Constant] outputs: [2741 -> ()[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1681 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2740 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2741 [05/10/2022-20:07:28] [V] [TRT] Add_1681 [Add] inputs: [2740 -> (-1, -1, 1)[FLOAT]], [2741 -> ()[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 2741 for ONNX node: 2741 [05/10/2022-20:07:28] [V] [TRT] Registering layer: Add_1681 for ONNX node: Add_1681 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2742 for ONNX tensor: 2742 [05/10/2022-20:07:28] [V] [TRT] Add_1681 [Add] outputs: [2742 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Sqrt_1682 [Sqrt] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2742 [05/10/2022-20:07:28] [V] [TRT] Sqrt_1682 [Sqrt] inputs: [2742 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Sqrt_1682 for ONNX node: Sqrt_1682 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2743 for ONNX tensor: 2743 [05/10/2022-20:07:28] [V] [TRT] Sqrt_1682 [Sqrt] outputs: [2743 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Div_1683 [Div] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2737 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2743 [05/10/2022-20:07:28] [V] [TRT] Div_1683 [Div] inputs: [2737 -> (-1, -1, 256)[FLOAT]], [2743 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Div_1683 for ONNX node: Div_1683 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2744 for ONNX tensor: 2744 [05/10/2022-20:07:28] [V] [TRT] Div_1683 [Div] outputs: [2744 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Mul_1684 [Mul] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2744 [05/10/2022-20:07:28] [V] [TRT] Searching for input: encoder.encoders.10.norm_mha.weight [05/10/2022-20:07:28] [V] [TRT] Mul_1684 [Mul] inputs: [2744 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: encoder.encoders.10.norm_mha.weight for ONNX node: encoder.encoders.10.norm_mha.weight [05/10/2022-20:07:28] [V] [TRT] Registering layer: Mul_1684 for ONNX node: Mul_1684 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2745 for ONNX tensor: 2745 [05/10/2022-20:07:28] [V] [TRT] Mul_1684 [Mul] outputs: [2745 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1685 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2745 [05/10/2022-20:07:28] [V] [TRT] Searching for input: encoder.encoders.10.norm_mha.bias [05/10/2022-20:07:28] [V] [TRT] Add_1685 [Add] inputs: [2745 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: encoder.encoders.10.norm_mha.bias for ONNX node: encoder.encoders.10.norm_mha.bias [05/10/2022-20:07:28] [V] [TRT] Registering layer: Add_1685 for ONNX node: Add_1685 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2746 for ONNX tensor: 2746 [05/10/2022-20:07:28] [V] [TRT] Add_1685 [Add] outputs: [2746 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Shape_1686 [Shape] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2746 [05/10/2022-20:07:28] [V] [TRT] Shape_1686 [Shape] inputs: [2746 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Shape_1686 for ONNX node: Shape_1686 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2747 for ONNX tensor: 2747 [05/10/2022-20:07:28] [V] [TRT] Shape_1686 [Shape] outputs: [2747 -> (3)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Constant_1687 [Constant] [05/10/2022-20:07:28] [V] [TRT] Constant_1687 [Constant] inputs: [05/10/2022-20:07:28] [V] [TRT] Constant_1687 [Constant] outputs: [2748 -> ()[INT32]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Gather_1688 [Gather] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2747 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2748 [05/10/2022-20:07:28] [V] [TRT] Gather_1688 [Gather] inputs: [2747 -> (3)[INT32]], [2748 -> ()[INT32]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 2748 for ONNX node: 2748 [05/10/2022-20:07:28] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:28] [V] [TRT] Registering layer: Gather_1688 for ONNX node: Gather_1688 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2749 for ONNX tensor: 2749 [05/10/2022-20:07:28] [V] [TRT] Gather_1688 [Gather] outputs: [2749 -> ()[INT32]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: MatMul_1689 [MatMul] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2746 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 3433 [05/10/2022-20:07:28] [V] [TRT] MatMul_1689 [MatMul] inputs: [2746 -> (-1, -1, 256)[FLOAT]], [3433 -> (256, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 3433 for ONNX node: 3433 [05/10/2022-20:07:28] [V] [TRT] Registering layer: MatMul_1689 for ONNX node: MatMul_1689 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2751 for ONNX tensor: 2751 [05/10/2022-20:07:28] [V] [TRT] MatMul_1689 [MatMul] outputs: [2751 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1690 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: encoder.encoders.10.self_attn.linear_q.bias [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2751 [05/10/2022-20:07:28] [V] [TRT] Add_1690 [Add] inputs: [encoder.encoders.10.self_attn.linear_q.bias -> (256)[FLOAT]], [2751 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: encoder.encoders.10.self_attn.linear_q.bias for ONNX node: encoder.encoders.10.self_attn.linear_q.bias [05/10/2022-20:07:28] [V] [TRT] Registering layer: Add_1690 for ONNX node: Add_1690 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2752 for ONNX tensor: 2752 [05/10/2022-20:07:28] [V] [TRT] Add_1690 [Add] outputs: [2752 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Constant_1691 [Constant] [05/10/2022-20:07:28] [V] [TRT] Constant_1691 [Constant] inputs: [05/10/2022-20:07:28] [V] [TRT] Constant_1691 [Constant] outputs: [2756 -> (1)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Unsqueeze_1692 [Unsqueeze] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2749 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2756 [05/10/2022-20:07:28] [V] [TRT] Unsqueeze_1692 [Unsqueeze] inputs: [2749 -> ()[INT32]], [2756 -> (1)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:28] [V] [TRT] Registering layer: Unsqueeze_1692 for ONNX node: Unsqueeze_1692 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2757 for ONNX tensor: 2757 [05/10/2022-20:07:28] [V] [TRT] Unsqueeze_1692 [Unsqueeze] outputs: [2757 -> (1)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Concat_1693 [Concat] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2757 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 3434 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 3435 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 3436 [05/10/2022-20:07:28] [V] [TRT] Concat_1693 [Concat] inputs: [2757 -> (1)[INT32]], [3434 -> (1)[INT32]], [3435 -> (1)[INT32]], [3436 -> (1)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 3434 for ONNX node: 3434 [05/10/2022-20:07:28] [V] [TRT] Registering layer: 3435 for ONNX node: 3435 [05/10/2022-20:07:28] [V] [TRT] Registering layer: 3436 for ONNX node: 3436 [05/10/2022-20:07:28] [V] [TRT] Registering layer: Concat_1693 for ONNX node: Concat_1693 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2764 for ONNX tensor: 2764 [05/10/2022-20:07:28] [V] [TRT] Concat_1693 [Concat] outputs: [2764 -> (4)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Reshape_1694 [Reshape] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2752 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2764 [05/10/2022-20:07:28] [V] [TRT] Reshape_1694 [Reshape] inputs: [2752 -> (-1, -1, 256)[FLOAT]], [2764 -> (4)[INT32]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: Reshape_1694 for ONNX node: Reshape_1694 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2765 for ONNX tensor: 2765 [05/10/2022-20:07:28] [V] [TRT] Reshape_1694 [Reshape] outputs: [2765 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: MatMul_1695 [MatMul] [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2746 [05/10/2022-20:07:28] [V] [TRT] Searching for input: 3437 [05/10/2022-20:07:28] [V] [TRT] MatMul_1695 [MatMul] inputs: [2746 -> (-1, -1, 256)[FLOAT]], [3437 -> (256, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: 3437 for ONNX node: 3437 [05/10/2022-20:07:28] [V] [TRT] Registering layer: MatMul_1695 for ONNX node: MatMul_1695 [05/10/2022-20:07:28] [V] [TRT] Registering tensor: 2767 for ONNX tensor: 2767 [05/10/2022-20:07:28] [V] [TRT] MatMul_1695 [MatMul] outputs: [2767 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Parsing node: Add_1696 [Add] [05/10/2022-20:07:28] [V] [TRT] Searching for input: encoder.encoders.10.self_attn.linear_k.bias [05/10/2022-20:07:28] [V] [TRT] Searching for input: 2767 [05/10/2022-20:07:28] [V] [TRT] Add_1696 [Add] inputs: [encoder.encoders.10.self_attn.linear_k.bias -> (256)[FLOAT]], [2767 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:28] [V] [TRT] Registering layer: encoder.encoders.10.self_attn.linear_k.bias for ONNX node: encoder.encoders.10.self_attn.linear_k.bias [05/10/2022-20:07:29] [V] [TRT] Registering layer: Add_1696 for ONNX node: Add_1696 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2768 for ONNX tensor: 2768 [05/10/2022-20:07:29] [V] [TRT] Add_1696 [Add] outputs: [2768 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1697 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1697 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1697 [Constant] outputs: [2772 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Unsqueeze_1698 [Unsqueeze] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2749 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2772 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1698 [Unsqueeze] inputs: [2749 -> ()[INT32]], [2772 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:29] [V] [TRT] Registering layer: Unsqueeze_1698 for ONNX node: Unsqueeze_1698 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2773 for ONNX tensor: 2773 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1698 [Unsqueeze] outputs: [2773 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Concat_1699 [Concat] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2773 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3438 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3439 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3440 [05/10/2022-20:07:29] [V] [TRT] Concat_1699 [Concat] inputs: [2773 -> (1)[INT32]], [3438 -> (1)[INT32]], [3439 -> (1)[INT32]], [3440 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3438 for ONNX node: 3438 [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3439 for ONNX node: 3439 [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3440 for ONNX node: 3440 [05/10/2022-20:07:29] [V] [TRT] Registering layer: Concat_1699 for ONNX node: Concat_1699 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2780 for ONNX tensor: 2780 [05/10/2022-20:07:29] [V] [TRT] Concat_1699 [Concat] outputs: [2780 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Reshape_1700 [Reshape] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2768 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2780 [05/10/2022-20:07:29] [V] [TRT] Reshape_1700 [Reshape] inputs: [2768 -> (-1, -1, 256)[FLOAT]], [2780 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Reshape_1700 for ONNX node: Reshape_1700 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2781 for ONNX tensor: 2781 [05/10/2022-20:07:29] [V] [TRT] Reshape_1700 [Reshape] outputs: [2781 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: MatMul_1701 [MatMul] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2746 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3441 [05/10/2022-20:07:29] [V] [TRT] MatMul_1701 [MatMul] inputs: [2746 -> (-1, -1, 256)[FLOAT]], [3441 -> (256, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3441 for ONNX node: 3441 [05/10/2022-20:07:29] [V] [TRT] Registering layer: MatMul_1701 for ONNX node: MatMul_1701 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2783 for ONNX tensor: 2783 [05/10/2022-20:07:29] [V] [TRT] MatMul_1701 [MatMul] outputs: [2783 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Add_1702 [Add] [05/10/2022-20:07:29] [V] [TRT] Searching for input: encoder.encoders.10.self_attn.linear_v.bias [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2783 [05/10/2022-20:07:29] [V] [TRT] Add_1702 [Add] inputs: [encoder.encoders.10.self_attn.linear_v.bias -> (256)[FLOAT]], [2783 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: encoder.encoders.10.self_attn.linear_v.bias for ONNX node: encoder.encoders.10.self_attn.linear_v.bias [05/10/2022-20:07:29] [V] [TRT] Registering layer: Add_1702 for ONNX node: Add_1702 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2784 for ONNX tensor: 2784 [05/10/2022-20:07:29] [V] [TRT] Add_1702 [Add] outputs: [2784 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1703 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1703 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1703 [Constant] outputs: [2788 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Unsqueeze_1704 [Unsqueeze] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2749 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2788 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1704 [Unsqueeze] inputs: [2749 -> ()[INT32]], [2788 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:29] [V] [TRT] Registering layer: Unsqueeze_1704 for ONNX node: Unsqueeze_1704 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2789 for ONNX tensor: 2789 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1704 [Unsqueeze] outputs: [2789 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Concat_1705 [Concat] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2789 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3442 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3443 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3444 [05/10/2022-20:07:29] [V] [TRT] Concat_1705 [Concat] inputs: [2789 -> (1)[INT32]], [3442 -> (1)[INT32]], [3443 -> (1)[INT32]], [3444 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3442 for ONNX node: 3442 [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3443 for ONNX node: 3443 [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3444 for ONNX node: 3444 [05/10/2022-20:07:29] [V] [TRT] Registering layer: Concat_1705 for ONNX node: Concat_1705 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2796 for ONNX tensor: 2796 [05/10/2022-20:07:29] [V] [TRT] Concat_1705 [Concat] outputs: [2796 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Reshape_1706 [Reshape] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2784 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2796 [05/10/2022-20:07:29] [V] [TRT] Reshape_1706 [Reshape] inputs: [2784 -> (-1, -1, 256)[FLOAT]], [2796 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Reshape_1706 for ONNX node: Reshape_1706 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2797 for ONNX tensor: 2797 [05/10/2022-20:07:29] [V] [TRT] Reshape_1706 [Reshape] outputs: [2797 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Transpose_1707 [Transpose] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2797 [05/10/2022-20:07:29] [V] [TRT] Transpose_1707 [Transpose] inputs: [2797 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Transpose_1707 for ONNX node: Transpose_1707 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2798 for ONNX tensor: 2798 [05/10/2022-20:07:29] [V] [TRT] Transpose_1707 [Transpose] outputs: [2798 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Shape_1708 [Shape] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:29] [V] [TRT] Shape_1708 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Shape_1708 for ONNX node: Shape_1708 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2799 for ONNX tensor: 2799 [05/10/2022-20:07:29] [V] [TRT] Shape_1708 [Shape] outputs: [2799 -> (3)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1709 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1709 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1709 [Constant] outputs: [2800 -> ()[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Gather_1710 [Gather] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2799 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2800 [05/10/2022-20:07:29] [V] [TRT] Gather_1710 [Gather] inputs: [2799 -> (3)[INT32]], [2800 -> ()[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 2800 for ONNX node: 2800 [05/10/2022-20:07:29] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:29] [V] [TRT] Registering layer: Gather_1710 for ONNX node: Gather_1710 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2801 for ONNX tensor: 2801 [05/10/2022-20:07:29] [V] [TRT] Gather_1710 [Gather] outputs: [2801 -> ()[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: MatMul_1711 [MatMul] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3445 [05/10/2022-20:07:29] [V] [TRT] MatMul_1711 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3445 -> (256, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3445 for ONNX node: 3445 [05/10/2022-20:07:29] [V] [TRT] Registering layer: MatMul_1711 for ONNX node: MatMul_1711 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2803 for ONNX tensor: 2803 [05/10/2022-20:07:29] [V] [TRT] MatMul_1711 [MatMul] outputs: [2803 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1712 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1712 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1712 [Constant] outputs: [2807 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Unsqueeze_1713 [Unsqueeze] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2801 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2807 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1713 [Unsqueeze] inputs: [2801 -> ()[INT32]], [2807 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:29] [V] [TRT] Registering layer: Unsqueeze_1713 for ONNX node: Unsqueeze_1713 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2808 for ONNX tensor: 2808 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1713 [Unsqueeze] outputs: [2808 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Concat_1714 [Concat] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2808 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3446 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3447 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 3448 [05/10/2022-20:07:29] [V] [TRT] Concat_1714 [Concat] inputs: [2808 -> (1)[INT32]], [3446 -> (1)[INT32]], [3447 -> (1)[INT32]], [3448 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3446 for ONNX node: 3446 [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3447 for ONNX node: 3447 [05/10/2022-20:07:29] [V] [TRT] Registering layer: 3448 for ONNX node: 3448 [05/10/2022-20:07:29] [V] [TRT] Registering layer: Concat_1714 for ONNX node: Concat_1714 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2815 for ONNX tensor: 2815 [05/10/2022-20:07:29] [V] [TRT] Concat_1714 [Concat] outputs: [2815 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Reshape_1715 [Reshape] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2803 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2815 [05/10/2022-20:07:29] [V] [TRT] Reshape_1715 [Reshape] inputs: [2803 -> (1, -1, 256)[FLOAT]], [2815 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Reshape_1715 for ONNX node: Reshape_1715 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2816 for ONNX tensor: 2816 [05/10/2022-20:07:29] [V] [TRT] Reshape_1715 [Reshape] outputs: [2816 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Add_1716 [Add] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2765 [05/10/2022-20:07:29] [V] [TRT] Searching for input: encoder.encoders.10.self_attn.pos_bias_u [05/10/2022-20:07:29] [V] [TRT] Add_1716 [Add] inputs: [2765 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.10.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: encoder.encoders.10.self_attn.pos_bias_u for ONNX node: encoder.encoders.10.self_attn.pos_bias_u [05/10/2022-20:07:29] [V] [TRT] Registering layer: Add_1716 for ONNX node: Add_1716 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2817 for ONNX tensor: 2817 [05/10/2022-20:07:29] [V] [TRT] Add_1716 [Add] outputs: [2817 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Transpose_1717 [Transpose] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2817 [05/10/2022-20:07:29] [V] [TRT] Transpose_1717 [Transpose] inputs: [2817 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Transpose_1717 for ONNX node: Transpose_1717 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2818 for ONNX tensor: 2818 [05/10/2022-20:07:29] [V] [TRT] Transpose_1717 [Transpose] outputs: [2818 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Add_1718 [Add] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2765 [05/10/2022-20:07:29] [V] [TRT] Searching for input: encoder.encoders.10.self_attn.pos_bias_v [05/10/2022-20:07:29] [V] [TRT] Add_1718 [Add] inputs: [2765 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.10.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: encoder.encoders.10.self_attn.pos_bias_v for ONNX node: encoder.encoders.10.self_attn.pos_bias_v [05/10/2022-20:07:29] [V] [TRT] Registering layer: Add_1718 for ONNX node: Add_1718 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2819 for ONNX tensor: 2819 [05/10/2022-20:07:29] [V] [TRT] Add_1718 [Add] outputs: [2819 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Transpose_1719 [Transpose] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2819 [05/10/2022-20:07:29] [V] [TRT] Transpose_1719 [Transpose] inputs: [2819 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Transpose_1719 for ONNX node: Transpose_1719 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2820 for ONNX tensor: 2820 [05/10/2022-20:07:29] [V] [TRT] Transpose_1719 [Transpose] outputs: [2820 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Transpose_1720 [Transpose] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2781 [05/10/2022-20:07:29] [V] [TRT] Transpose_1720 [Transpose] inputs: [2781 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Transpose_1720 for ONNX node: Transpose_1720 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2821 for ONNX tensor: 2821 [05/10/2022-20:07:29] [V] [TRT] Transpose_1720 [Transpose] outputs: [2821 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: MatMul_1721 [MatMul] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2818 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2821 [05/10/2022-20:07:29] [V] [TRT] MatMul_1721 [MatMul] inputs: [2818 -> (-1, 4, -1, 64)[FLOAT]], [2821 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: MatMul_1721 for ONNX node: MatMul_1721 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2822 for ONNX tensor: 2822 [05/10/2022-20:07:29] [V] [TRT] MatMul_1721 [MatMul] outputs: [2822 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Transpose_1722 [Transpose] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2816 [05/10/2022-20:07:29] [V] [TRT] Transpose_1722 [Transpose] inputs: [2816 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Transpose_1722 for ONNX node: Transpose_1722 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2823 for ONNX tensor: 2823 [05/10/2022-20:07:29] [V] [TRT] Transpose_1722 [Transpose] outputs: [2823 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: MatMul_1723 [MatMul] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2820 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2823 [05/10/2022-20:07:29] [V] [TRT] MatMul_1723 [MatMul] inputs: [2820 -> (-1, 4, -1, 64)[FLOAT]], [2823 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: MatMul_1723 for ONNX node: MatMul_1723 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2824 for ONNX tensor: 2824 [05/10/2022-20:07:29] [V] [TRT] MatMul_1723 [MatMul] outputs: [2824 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Add_1724 [Add] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2822 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2824 [05/10/2022-20:07:29] [V] [TRT] Add_1724 [Add] inputs: [2822 -> (-1, 4, -1, -1)[FLOAT]], [2824 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Add_1724 for ONNX node: Add_1724 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2825 for ONNX tensor: 2825 [05/10/2022-20:07:29] [V] [TRT] Add_1724 [Add] outputs: [2825 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1725 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1725 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1725 [Constant] outputs: [2826 -> ()[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Div_1726 [Div] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2825 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2826 [05/10/2022-20:07:29] [V] [TRT] Div_1726 [Div] inputs: [2825 -> (-1, 4, -1, -1)[FLOAT]], [2826 -> ()[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 2826 for ONNX node: 2826 [05/10/2022-20:07:29] [V] [TRT] Registering layer: Div_1726 for ONNX node: Div_1726 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2827 for ONNX tensor: 2827 [05/10/2022-20:07:29] [V] [TRT] Div_1726 [Div] outputs: [2827 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Shape_1727 [Shape] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2798 [05/10/2022-20:07:29] [V] [TRT] Shape_1727 [Shape] inputs: [2798 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: Shape_1727 for ONNX node: Shape_1727 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2828 for ONNX tensor: 2828 [05/10/2022-20:07:29] [V] [TRT] Shape_1727 [Shape] outputs: [2828 -> (4)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1728 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1728 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1728 [Constant] outputs: [2829 -> ()[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Gather_1729 [Gather] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2828 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2829 [05/10/2022-20:07:29] [V] [TRT] Gather_1729 [Gather] inputs: [2828 -> (4)[INT32]], [2829 -> ()[INT32]], [05/10/2022-20:07:29] [V] [TRT] Registering layer: 2829 for ONNX node: 2829 [05/10/2022-20:07:29] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:29] [V] [TRT] Registering layer: Gather_1729 for ONNX node: Gather_1729 [05/10/2022-20:07:29] [V] [TRT] Registering tensor: 2830 for ONNX tensor: 2830 [05/10/2022-20:07:29] [V] [TRT] Gather_1729 [Gather] outputs: [2830 -> ()[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Constant_1730 [Constant] [05/10/2022-20:07:29] [V] [TRT] Constant_1730 [Constant] inputs: [05/10/2022-20:07:29] [V] [TRT] Constant_1730 [Constant] outputs: [2831 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Parsing node: Unsqueeze_1731 [Unsqueeze] [05/10/2022-20:07:29] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:29] [V] [TRT] Searching for input: 2831 [05/10/2022-20:07:29] [V] [TRT] Unsqueeze_1731 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [2831 -> (1)[INT32]], [05/10/2022-20:07:29] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:29] [V] [TRT] Registering layer: Unsqueeze_1731 for ONNX node: Unsqueeze_1731 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2832 for ONNX tensor: 2832 [05/10/2022-20:07:30] [V] [TRT] Unsqueeze_1731 [Unsqueeze] outputs: [2832 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Cast_1732 [Cast] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2832 [05/10/2022-20:07:30] [V] [TRT] Cast_1732 [Cast] inputs: [2832 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Cast_1732 for ONNX node: Cast_1732 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2833 for ONNX tensor: 2833 [05/10/2022-20:07:30] [V] [TRT] Cast_1732 [Cast] outputs: [2833 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1733 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1733 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1733 [Constant] outputs: [2834 -> ()[INT32]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Equal_1734 [Equal] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2833 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2834 [05/10/2022-20:07:30] [V] [TRT] Equal_1734 [Equal] inputs: [2833 -> (-1, 1, 1, -1)[INT32]], [2834 -> ()[INT32]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 2834 for ONNX node: 2834 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Equal_1734 for ONNX node: Equal_1734 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2835 for ONNX tensor: 2835 [05/10/2022-20:07:30] [V] [TRT] Equal_1734 [Equal] outputs: [2835 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Cast_1735 [Cast] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2835 [05/10/2022-20:07:30] [V] [TRT] Cast_1735 [Cast] inputs: [2835 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Casting to type: bool [05/10/2022-20:07:30] [V] [TRT] Registering layer: Cast_1735 for ONNX node: Cast_1735 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2836 for ONNX tensor: 2836 [05/10/2022-20:07:30] [V] [TRT] Cast_1735 [Cast] outputs: [2836 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1736 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1736 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1736 [Constant] outputs: [2837 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Where_1737 [Where] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2836 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2837 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2827 [05/10/2022-20:07:30] [V] [TRT] Where_1737 [Where] inputs: [2836 -> (-1, 1, 1, -1)[BOOL]], [2837 -> ()[FLOAT]], [2827 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 2837 for ONNX node: 2837 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Where_1737 for ONNX node: Where_1737 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2838 for ONNX tensor: 2838 [05/10/2022-20:07:30] [V] [TRT] Where_1737 [Where] outputs: [2838 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Softmax_1738 [Softmax] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2838 [05/10/2022-20:07:30] [V] [TRT] Softmax_1738 [Softmax] inputs: [2838 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Softmax_1738 for ONNX node: Softmax_1738 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2839 for ONNX tensor: 2839 [05/10/2022-20:07:30] [V] [TRT] Softmax_1738 [Softmax] outputs: [2839 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Cast_1739 [Cast] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2835 [05/10/2022-20:07:30] [V] [TRT] Cast_1739 [Cast] inputs: [2835 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Casting to type: bool [05/10/2022-20:07:30] [V] [TRT] Registering layer: Cast_1739 for ONNX node: Cast_1739 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2840 for ONNX tensor: 2840 [05/10/2022-20:07:30] [V] [TRT] Cast_1739 [Cast] outputs: [2840 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1740 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1740 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1740 [Constant] outputs: [2841 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Where_1741 [Where] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2840 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2841 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2839 [05/10/2022-20:07:30] [V] [TRT] Where_1741 [Where] inputs: [2840 -> (-1, 1, 1, -1)[BOOL]], [2841 -> ()[FLOAT]], [2839 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 2841 for ONNX node: 2841 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Where_1741 for ONNX node: Where_1741 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2842 for ONNX tensor: 2842 [05/10/2022-20:07:30] [V] [TRT] Where_1741 [Where] outputs: [2842 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: MatMul_1742 [MatMul] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2842 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2798 [05/10/2022-20:07:30] [V] [TRT] MatMul_1742 [MatMul] inputs: [2842 -> (-1, 4, -1, -1)[FLOAT]], [2798 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: MatMul_1742 for ONNX node: MatMul_1742 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2843 for ONNX tensor: 2843 [05/10/2022-20:07:30] [V] [TRT] MatMul_1742 [MatMul] outputs: [2843 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Transpose_1743 [Transpose] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2843 [05/10/2022-20:07:30] [V] [TRT] Transpose_1743 [Transpose] inputs: [2843 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Transpose_1743 for ONNX node: Transpose_1743 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2844 for ONNX tensor: 2844 [05/10/2022-20:07:30] [V] [TRT] Transpose_1743 [Transpose] outputs: [2844 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1744 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1744 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1744 [Constant] outputs: [2847 -> (1)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Unsqueeze_1745 [Unsqueeze] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2830 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2847 [05/10/2022-20:07:30] [V] [TRT] Unsqueeze_1745 [Unsqueeze] inputs: [2830 -> ()[INT32]], [2847 -> (1)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:30] [V] [TRT] Registering layer: Unsqueeze_1745 for ONNX node: Unsqueeze_1745 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2848 for ONNX tensor: 2848 [05/10/2022-20:07:30] [V] [TRT] Unsqueeze_1745 [Unsqueeze] outputs: [2848 -> (1)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Concat_1746 [Concat] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2848 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 3449 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 3450 [05/10/2022-20:07:30] [V] [TRT] Concat_1746 [Concat] inputs: [2848 -> (1)[INT32]], [3449 -> (1)[INT32]], [3450 -> (1)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 3449 for ONNX node: 3449 [05/10/2022-20:07:30] [V] [TRT] Registering layer: 3450 for ONNX node: 3450 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Concat_1746 for ONNX node: Concat_1746 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2853 for ONNX tensor: 2853 [05/10/2022-20:07:30] [V] [TRT] Concat_1746 [Concat] outputs: [2853 -> (3)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Reshape_1747 [Reshape] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2844 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2853 [05/10/2022-20:07:30] [V] [TRT] Reshape_1747 [Reshape] inputs: [2844 -> (-1, -1, 4, 64)[FLOAT]], [2853 -> (3)[INT32]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Reshape_1747 for ONNX node: Reshape_1747 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2854 for ONNX tensor: 2854 [05/10/2022-20:07:30] [V] [TRT] Reshape_1747 [Reshape] outputs: [2854 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: MatMul_1748 [MatMul] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2854 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 3451 [05/10/2022-20:07:30] [V] [TRT] MatMul_1748 [MatMul] inputs: [2854 -> (-1, -1, 256)[FLOAT]], [3451 -> (256, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 3451 for ONNX node: 3451 [05/10/2022-20:07:30] [V] [TRT] Registering layer: MatMul_1748 for ONNX node: MatMul_1748 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2856 for ONNX tensor: 2856 [05/10/2022-20:07:30] [V] [TRT] MatMul_1748 [MatMul] outputs: [2856 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Add_1749 [Add] [05/10/2022-20:07:30] [V] [TRT] Searching for input: encoder.encoders.10.self_attn.linear_out.bias [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2856 [05/10/2022-20:07:30] [V] [TRT] Add_1749 [Add] inputs: [encoder.encoders.10.self_attn.linear_out.bias -> (256)[FLOAT]], [2856 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: encoder.encoders.10.self_attn.linear_out.bias for ONNX node: encoder.encoders.10.self_attn.linear_out.bias [05/10/2022-20:07:30] [V] [TRT] Registering layer: Add_1749 for ONNX node: Add_1749 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2857 for ONNX tensor: 2857 [05/10/2022-20:07:30] [V] [TRT] Add_1749 [Add] outputs: [2857 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Add_1750 [Add] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2735 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2857 [05/10/2022-20:07:30] [V] [TRT] Add_1750 [Add] inputs: [2735 -> (-1, -1, 256)[FLOAT]], [2857 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Add_1750 for ONNX node: Add_1750 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2858 for ONNX tensor: 2858 [05/10/2022-20:07:30] [V] [TRT] Add_1750 [Add] outputs: [2858 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: ReduceMean_1751 [ReduceMean] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2858 [05/10/2022-20:07:30] [V] [TRT] ReduceMean_1751 [ReduceMean] inputs: [2858 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: ReduceMean_1751 for ONNX node: ReduceMean_1751 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2859 for ONNX tensor: 2859 [05/10/2022-20:07:30] [V] [TRT] ReduceMean_1751 [ReduceMean] outputs: [2859 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Sub_1752 [Sub] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2858 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2859 [05/10/2022-20:07:30] [V] [TRT] Sub_1752 [Sub] inputs: [2858 -> (-1, -1, 256)[FLOAT]], [2859 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Sub_1752 for ONNX node: Sub_1752 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2860 for ONNX tensor: 2860 [05/10/2022-20:07:30] [V] [TRT] Sub_1752 [Sub] outputs: [2860 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1753 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1753 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1753 [Constant] outputs: [2861 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Pow_1754 [Pow] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2860 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2861 [05/10/2022-20:07:30] [V] [TRT] Pow_1754 [Pow] inputs: [2860 -> (-1, -1, 256)[FLOAT]], [2861 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 2861 for ONNX node: 2861 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Pow_1754 for ONNX node: Pow_1754 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2862 for ONNX tensor: 2862 [05/10/2022-20:07:30] [V] [TRT] Pow_1754 [Pow] outputs: [2862 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: ReduceMean_1755 [ReduceMean] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2862 [05/10/2022-20:07:30] [V] [TRT] ReduceMean_1755 [ReduceMean] inputs: [2862 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: ReduceMean_1755 for ONNX node: ReduceMean_1755 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2863 for ONNX tensor: 2863 [05/10/2022-20:07:30] [V] [TRT] ReduceMean_1755 [ReduceMean] outputs: [2863 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1756 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1756 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1756 [Constant] outputs: [2864 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Add_1757 [Add] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2863 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2864 [05/10/2022-20:07:30] [V] [TRT] Add_1757 [Add] inputs: [2863 -> (-1, -1, 1)[FLOAT]], [2864 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 2864 for ONNX node: 2864 [05/10/2022-20:07:30] [V] [TRT] Registering layer: Add_1757 for ONNX node: Add_1757 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2865 for ONNX tensor: 2865 [05/10/2022-20:07:30] [V] [TRT] Add_1757 [Add] outputs: [2865 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Sqrt_1758 [Sqrt] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2865 [05/10/2022-20:07:30] [V] [TRT] Sqrt_1758 [Sqrt] inputs: [2865 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Sqrt_1758 for ONNX node: Sqrt_1758 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2866 for ONNX tensor: 2866 [05/10/2022-20:07:30] [V] [TRT] Sqrt_1758 [Sqrt] outputs: [2866 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Div_1759 [Div] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2860 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2866 [05/10/2022-20:07:30] [V] [TRT] Div_1759 [Div] inputs: [2860 -> (-1, -1, 256)[FLOAT]], [2866 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Div_1759 for ONNX node: Div_1759 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2867 for ONNX tensor: 2867 [05/10/2022-20:07:30] [V] [TRT] Div_1759 [Div] outputs: [2867 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Mul_1760 [Mul] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2867 [05/10/2022-20:07:30] [V] [TRT] Searching for input: encoder.encoders.10.norm_conv.weight [05/10/2022-20:07:30] [V] [TRT] Mul_1760 [Mul] inputs: [2867 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: encoder.encoders.10.norm_conv.weight for ONNX node: encoder.encoders.10.norm_conv.weight [05/10/2022-20:07:30] [V] [TRT] Registering layer: Mul_1760 for ONNX node: Mul_1760 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2868 for ONNX tensor: 2868 [05/10/2022-20:07:30] [V] [TRT] Mul_1760 [Mul] outputs: [2868 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Add_1761 [Add] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2868 [05/10/2022-20:07:30] [V] [TRT] Searching for input: encoder.encoders.10.norm_conv.bias [05/10/2022-20:07:30] [V] [TRT] Add_1761 [Add] inputs: [2868 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: encoder.encoders.10.norm_conv.bias for ONNX node: encoder.encoders.10.norm_conv.bias [05/10/2022-20:07:30] [V] [TRT] Registering layer: Add_1761 for ONNX node: Add_1761 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2869 for ONNX tensor: 2869 [05/10/2022-20:07:30] [V] [TRT] Add_1761 [Add] outputs: [2869 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Transpose_1762 [Transpose] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2869 [05/10/2022-20:07:30] [V] [TRT] Transpose_1762 [Transpose] inputs: [2869 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Transpose_1762 for ONNX node: Transpose_1762 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2870 for ONNX tensor: 2870 [05/10/2022-20:07:30] [V] [TRT] Transpose_1762 [Transpose] outputs: [2870 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Not_1763 [Not] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:30] [V] [TRT] Not_1763 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: Not_1763 for ONNX node: Not_1763 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2871 for ONNX tensor: 2871 [05/10/2022-20:07:30] [V] [TRT] Not_1763 [Not] outputs: [2871 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Cast_1764 [Cast] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2871 [05/10/2022-20:07:30] [V] [TRT] Cast_1764 [Cast] inputs: [2871 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Casting to type: bool [05/10/2022-20:07:30] [V] [TRT] Registering layer: Cast_1764 for ONNX node: Cast_1764 [05/10/2022-20:07:30] [V] [TRT] Registering tensor: 2872 for ONNX tensor: 2872 [05/10/2022-20:07:30] [V] [TRT] Cast_1764 [Cast] outputs: [2872 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Constant_1765 [Constant] [05/10/2022-20:07:30] [V] [TRT] Constant_1765 [Constant] inputs: [05/10/2022-20:07:30] [V] [TRT] Constant_1765 [Constant] outputs: [2873 -> ()[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Parsing node: Where_1766 [Where] [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2872 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2873 [05/10/2022-20:07:30] [V] [TRT] Searching for input: 2870 [05/10/2022-20:07:30] [V] [TRT] Where_1766 [Where] inputs: [2872 -> (-1, 1, -1)[BOOL]], [2873 -> ()[FLOAT]], [2870 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:30] [V] [TRT] Registering layer: 2873 for ONNX node: 2873 [05/10/2022-20:07:31] [V] [TRT] Registering layer: Where_1766 for ONNX node: Where_1766 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2874 for ONNX tensor: 2874 [05/10/2022-20:07:31] [V] [TRT] Where_1766 [Where] outputs: [2874 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Conv_1767 [Conv] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2874 [05/10/2022-20:07:31] [V] [TRT] Searching for input: encoder.encoders.10.conv_module.pointwise_conv1.weight [05/10/2022-20:07:31] [V] [TRT] Searching for input: encoder.encoders.10.conv_module.pointwise_conv1.bias [05/10/2022-20:07:31] [V] [TRT] Conv_1767 [Conv] inputs: [2874 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.10.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.10.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:31] [V] [TRT] Registering layer: Conv_1767 for ONNX node: Conv_1767 [05/10/2022-20:07:31] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:31] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2875 for ONNX tensor: 2875 [05/10/2022-20:07:31] [V] [TRT] Conv_1767 [Conv] outputs: [2875 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Split_1768 [Split] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2875 [05/10/2022-20:07:31] [V] [TRT] Split_1768 [Split] inputs: [2875 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Split_1768 for ONNX node: Split_1768 [05/10/2022-20:07:31] [V] [TRT] Registering layer: Split_1768_12 for ONNX node: Split_1768 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2876 for ONNX tensor: 2876 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2877 for ONNX tensor: 2877 [05/10/2022-20:07:31] [V] [TRT] Split_1768 [Split] outputs: [2876 -> (-1, 256, -1)[FLOAT]], [2877 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Sigmoid_1769 [Sigmoid] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2877 [05/10/2022-20:07:31] [V] [TRT] Sigmoid_1769 [Sigmoid] inputs: [2877 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Sigmoid_1769 for ONNX node: Sigmoid_1769 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2878 for ONNX tensor: 2878 [05/10/2022-20:07:31] [V] [TRT] Sigmoid_1769 [Sigmoid] outputs: [2878 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Mul_1770 [Mul] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2876 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2878 [05/10/2022-20:07:31] [V] [TRT] Mul_1770 [Mul] inputs: [2876 -> (-1, 256, -1)[FLOAT]], [2878 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Mul_1770 for ONNX node: Mul_1770 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2879 for ONNX tensor: 2879 [05/10/2022-20:07:31] [V] [TRT] Mul_1770 [Mul] outputs: [2879 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Conv_1771 [Conv] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2879 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 3191 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 3192 [05/10/2022-20:07:31] [V] [TRT] Conv_1771 [Conv] inputs: [2879 -> (-1, 256, -1)[FLOAT]], [3191 -> (256, 1, 15)[FLOAT]], [3192 -> (256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:31] [V] [TRT] Registering layer: Conv_1771 for ONNX node: Conv_1771 [05/10/2022-20:07:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:31] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 3190 for ONNX tensor: 3190 [05/10/2022-20:07:31] [V] [TRT] Conv_1771 [Conv] outputs: [3190 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Sigmoid_1772 [Sigmoid] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 3190 [05/10/2022-20:07:31] [V] [TRT] Sigmoid_1772 [Sigmoid] inputs: [3190 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Sigmoid_1772 for ONNX node: Sigmoid_1772 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2882 for ONNX tensor: 2882 [05/10/2022-20:07:31] [V] [TRT] Sigmoid_1772 [Sigmoid] outputs: [2882 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Mul_1773 [Mul] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 3190 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2882 [05/10/2022-20:07:31] [V] [TRT] Mul_1773 [Mul] inputs: [3190 -> (-1, 256, -1)[FLOAT]], [2882 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Mul_1773 for ONNX node: Mul_1773 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2883 for ONNX tensor: 2883 [05/10/2022-20:07:31] [V] [TRT] Mul_1773 [Mul] outputs: [2883 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Not_1774 [Not] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:31] [V] [TRT] Not_1774 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Not_1774 for ONNX node: Not_1774 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2884 for ONNX tensor: 2884 [05/10/2022-20:07:31] [V] [TRT] Not_1774 [Not] outputs: [2884 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Conv_1775 [Conv] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2883 [05/10/2022-20:07:31] [V] [TRT] Searching for input: encoder.encoders.10.conv_module.pointwise_conv2.weight [05/10/2022-20:07:31] [V] [TRT] Searching for input: encoder.encoders.10.conv_module.pointwise_conv2.bias [05/10/2022-20:07:31] [V] [TRT] Conv_1775 [Conv] inputs: [2883 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.10.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.10.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:31] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:31] [V] [TRT] Registering layer: Conv_1775 for ONNX node: Conv_1775 [05/10/2022-20:07:31] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:31] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:31] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2885 for ONNX tensor: 2885 [05/10/2022-20:07:31] [V] [TRT] Conv_1775 [Conv] outputs: [2885 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Cast_1776 [Cast] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2884 [05/10/2022-20:07:31] [V] [TRT] Cast_1776 [Cast] inputs: [2884 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:31] [V] [TRT] Casting to type: bool [05/10/2022-20:07:31] [V] [TRT] Registering layer: Cast_1776 for ONNX node: Cast_1776 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2886 for ONNX tensor: 2886 [05/10/2022-20:07:31] [V] [TRT] Cast_1776 [Cast] outputs: [2886 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Constant_1777 [Constant] [05/10/2022-20:07:31] [V] [TRT] Constant_1777 [Constant] inputs: [05/10/2022-20:07:31] [V] [TRT] Constant_1777 [Constant] outputs: [2887 -> ()[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Where_1778 [Where] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2886 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2887 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2885 [05/10/2022-20:07:31] [V] [TRT] Where_1778 [Where] inputs: [2886 -> (-1, 1, -1)[BOOL]], [2887 -> ()[FLOAT]], [2885 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: 2887 for ONNX node: 2887 [05/10/2022-20:07:31] [V] [TRT] Registering layer: Where_1778 for ONNX node: Where_1778 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2888 for ONNX tensor: 2888 [05/10/2022-20:07:31] [V] [TRT] Where_1778 [Where] outputs: [2888 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Transpose_1779 [Transpose] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2888 [05/10/2022-20:07:31] [V] [TRT] Transpose_1779 [Transpose] inputs: [2888 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Transpose_1779 for ONNX node: Transpose_1779 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2889 for ONNX tensor: 2889 [05/10/2022-20:07:31] [V] [TRT] Transpose_1779 [Transpose] outputs: [2889 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Add_1780 [Add] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2858 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2889 [05/10/2022-20:07:31] [V] [TRT] Add_1780 [Add] inputs: [2858 -> (-1, -1, 256)[FLOAT]], [2889 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Add_1780 for ONNX node: Add_1780 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2890 for ONNX tensor: 2890 [05/10/2022-20:07:31] [V] [TRT] Add_1780 [Add] outputs: [2890 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: ReduceMean_1781 [ReduceMean] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2890 [05/10/2022-20:07:31] [V] [TRT] ReduceMean_1781 [ReduceMean] inputs: [2890 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: ReduceMean_1781 for ONNX node: ReduceMean_1781 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2891 for ONNX tensor: 2891 [05/10/2022-20:07:31] [V] [TRT] ReduceMean_1781 [ReduceMean] outputs: [2891 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Sub_1782 [Sub] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2890 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2891 [05/10/2022-20:07:31] [V] [TRT] Sub_1782 [Sub] inputs: [2890 -> (-1, -1, 256)[FLOAT]], [2891 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: Sub_1782 for ONNX node: Sub_1782 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2892 for ONNX tensor: 2892 [05/10/2022-20:07:31] [V] [TRT] Sub_1782 [Sub] outputs: [2892 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Constant_1783 [Constant] [05/10/2022-20:07:31] [V] [TRT] Constant_1783 [Constant] inputs: [05/10/2022-20:07:31] [V] [TRT] Constant_1783 [Constant] outputs: [2893 -> ()[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Pow_1784 [Pow] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2892 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2893 [05/10/2022-20:07:31] [V] [TRT] Pow_1784 [Pow] inputs: [2892 -> (-1, -1, 256)[FLOAT]], [2893 -> ()[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: 2893 for ONNX node: 2893 [05/10/2022-20:07:31] [V] [TRT] Registering layer: Pow_1784 for ONNX node: Pow_1784 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2894 for ONNX tensor: 2894 [05/10/2022-20:07:31] [V] [TRT] Pow_1784 [Pow] outputs: [2894 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: ReduceMean_1785 [ReduceMean] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2894 [05/10/2022-20:07:31] [V] [TRT] ReduceMean_1785 [ReduceMean] inputs: [2894 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: ReduceMean_1785 for ONNX node: ReduceMean_1785 [05/10/2022-20:07:31] [V] [TRT] Registering tensor: 2895 for ONNX tensor: 2895 [05/10/2022-20:07:31] [V] [TRT] ReduceMean_1785 [ReduceMean] outputs: [2895 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Constant_1786 [Constant] [05/10/2022-20:07:31] [V] [TRT] Constant_1786 [Constant] inputs: [05/10/2022-20:07:31] [V] [TRT] Constant_1786 [Constant] outputs: [2896 -> ()[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Parsing node: Add_1787 [Add] [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2895 [05/10/2022-20:07:31] [V] [TRT] Searching for input: 2896 [05/10/2022-20:07:31] [V] [TRT] Add_1787 [Add] inputs: [2895 -> (-1, -1, 1)[FLOAT]], [2896 -> ()[FLOAT]], [05/10/2022-20:07:31] [V] [TRT] Registering layer: 2896 for ONNX node: 2896 [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1787 for ONNX node: Add_1787 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2897 for ONNX tensor: 2897 [05/10/2022-20:07:32] [V] [TRT] Add_1787 [Add] outputs: [2897 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Sqrt_1788 [Sqrt] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2897 [05/10/2022-20:07:32] [V] [TRT] Sqrt_1788 [Sqrt] inputs: [2897 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Sqrt_1788 for ONNX node: Sqrt_1788 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2898 for ONNX tensor: 2898 [05/10/2022-20:07:32] [V] [TRT] Sqrt_1788 [Sqrt] outputs: [2898 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Div_1789 [Div] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2892 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2898 [05/10/2022-20:07:32] [V] [TRT] Div_1789 [Div] inputs: [2892 -> (-1, -1, 256)[FLOAT]], [2898 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Div_1789 for ONNX node: Div_1789 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2899 for ONNX tensor: 2899 [05/10/2022-20:07:32] [V] [TRT] Div_1789 [Div] outputs: [2899 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Mul_1790 [Mul] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2899 [05/10/2022-20:07:32] [V] [TRT] Searching for input: encoder.encoders.10.norm_ff.weight [05/10/2022-20:07:32] [V] [TRT] Mul_1790 [Mul] inputs: [2899 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: encoder.encoders.10.norm_ff.weight for ONNX node: encoder.encoders.10.norm_ff.weight [05/10/2022-20:07:32] [V] [TRT] Registering layer: Mul_1790 for ONNX node: Mul_1790 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2900 for ONNX tensor: 2900 [05/10/2022-20:07:32] [V] [TRT] Mul_1790 [Mul] outputs: [2900 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Add_1791 [Add] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2900 [05/10/2022-20:07:32] [V] [TRT] Searching for input: encoder.encoders.10.norm_ff.bias [05/10/2022-20:07:32] [V] [TRT] Add_1791 [Add] inputs: [2900 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: encoder.encoders.10.norm_ff.bias for ONNX node: encoder.encoders.10.norm_ff.bias [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1791 for ONNX node: Add_1791 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2901 for ONNX tensor: 2901 [05/10/2022-20:07:32] [V] [TRT] Add_1791 [Add] outputs: [2901 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: MatMul_1792 [MatMul] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2901 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 3452 [05/10/2022-20:07:32] [V] [TRT] MatMul_1792 [MatMul] inputs: [2901 -> (-1, -1, 256)[FLOAT]], [3452 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: 3452 for ONNX node: 3452 [05/10/2022-20:07:32] [V] [TRT] Registering layer: MatMul_1792 for ONNX node: MatMul_1792 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2903 for ONNX tensor: 2903 [05/10/2022-20:07:32] [V] [TRT] MatMul_1792 [MatMul] outputs: [2903 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Add_1793 [Add] [05/10/2022-20:07:32] [V] [TRT] Searching for input: encoder.encoders.10.feed_forward.w_1.bias [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2903 [05/10/2022-20:07:32] [V] [TRT] Add_1793 [Add] inputs: [encoder.encoders.10.feed_forward.w_1.bias -> (2048)[FLOAT]], [2903 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: encoder.encoders.10.feed_forward.w_1.bias for ONNX node: encoder.encoders.10.feed_forward.w_1.bias [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1793 for ONNX node: Add_1793 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2904 for ONNX tensor: 2904 [05/10/2022-20:07:32] [V] [TRT] Add_1793 [Add] outputs: [2904 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Sigmoid_1794 [Sigmoid] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2904 [05/10/2022-20:07:32] [V] [TRT] Sigmoid_1794 [Sigmoid] inputs: [2904 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Sigmoid_1794 for ONNX node: Sigmoid_1794 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2905 for ONNX tensor: 2905 [05/10/2022-20:07:32] [V] [TRT] Sigmoid_1794 [Sigmoid] outputs: [2905 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Mul_1795 [Mul] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2904 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2905 [05/10/2022-20:07:32] [V] [TRT] Mul_1795 [Mul] inputs: [2904 -> (-1, -1, 2048)[FLOAT]], [2905 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Mul_1795 for ONNX node: Mul_1795 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2906 for ONNX tensor: 2906 [05/10/2022-20:07:32] [V] [TRT] Mul_1795 [Mul] outputs: [2906 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: MatMul_1796 [MatMul] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2906 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 3453 [05/10/2022-20:07:32] [V] [TRT] MatMul_1796 [MatMul] inputs: [2906 -> (-1, -1, 2048)[FLOAT]], [3453 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: 3453 for ONNX node: 3453 [05/10/2022-20:07:32] [V] [TRT] Registering layer: MatMul_1796 for ONNX node: MatMul_1796 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2908 for ONNX tensor: 2908 [05/10/2022-20:07:32] [V] [TRT] MatMul_1796 [MatMul] outputs: [2908 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Add_1797 [Add] [05/10/2022-20:07:32] [V] [TRT] Searching for input: encoder.encoders.10.feed_forward.w_2.bias [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2908 [05/10/2022-20:07:32] [V] [TRT] Add_1797 [Add] inputs: [encoder.encoders.10.feed_forward.w_2.bias -> (256)[FLOAT]], [2908 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: encoder.encoders.10.feed_forward.w_2.bias for ONNX node: encoder.encoders.10.feed_forward.w_2.bias [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1797 for ONNX node: Add_1797 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2909 for ONNX tensor: 2909 [05/10/2022-20:07:32] [V] [TRT] Add_1797 [Add] outputs: [2909 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Constant_1798 [Constant] [05/10/2022-20:07:32] [V] [TRT] Constant_1798 [Constant] inputs: [05/10/2022-20:07:32] [V] [TRT] Constant_1798 [Constant] outputs: [2910 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Mul_1799 [Mul] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2909 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2910 [05/10/2022-20:07:32] [V] [TRT] Mul_1799 [Mul] inputs: [2909 -> (-1, -1, 256)[FLOAT]], [2910 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: 2910 for ONNX node: 2910 [05/10/2022-20:07:32] [V] [TRT] Registering layer: Mul_1799 for ONNX node: Mul_1799 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2911 for ONNX tensor: 2911 [05/10/2022-20:07:32] [V] [TRT] Mul_1799 [Mul] outputs: [2911 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Add_1800 [Add] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2890 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2911 [05/10/2022-20:07:32] [V] [TRT] Add_1800 [Add] inputs: [2890 -> (-1, -1, 256)[FLOAT]], [2911 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1800 for ONNX node: Add_1800 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2912 for ONNX tensor: 2912 [05/10/2022-20:07:32] [V] [TRT] Add_1800 [Add] outputs: [2912 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: ReduceMean_1801 [ReduceMean] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2912 [05/10/2022-20:07:32] [V] [TRT] ReduceMean_1801 [ReduceMean] inputs: [2912 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: ReduceMean_1801 for ONNX node: ReduceMean_1801 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2913 for ONNX tensor: 2913 [05/10/2022-20:07:32] [V] [TRT] ReduceMean_1801 [ReduceMean] outputs: [2913 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Sub_1802 [Sub] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2912 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2913 [05/10/2022-20:07:32] [V] [TRT] Sub_1802 [Sub] inputs: [2912 -> (-1, -1, 256)[FLOAT]], [2913 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Sub_1802 for ONNX node: Sub_1802 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2914 for ONNX tensor: 2914 [05/10/2022-20:07:32] [V] [TRT] Sub_1802 [Sub] outputs: [2914 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Constant_1803 [Constant] [05/10/2022-20:07:32] [V] [TRT] Constant_1803 [Constant] inputs: [05/10/2022-20:07:32] [V] [TRT] Constant_1803 [Constant] outputs: [2915 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Pow_1804 [Pow] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2914 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2915 [05/10/2022-20:07:32] [V] [TRT] Pow_1804 [Pow] inputs: [2914 -> (-1, -1, 256)[FLOAT]], [2915 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: 2915 for ONNX node: 2915 [05/10/2022-20:07:32] [V] [TRT] Registering layer: Pow_1804 for ONNX node: Pow_1804 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2916 for ONNX tensor: 2916 [05/10/2022-20:07:32] [V] [TRT] Pow_1804 [Pow] outputs: [2916 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: ReduceMean_1805 [ReduceMean] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2916 [05/10/2022-20:07:32] [V] [TRT] ReduceMean_1805 [ReduceMean] inputs: [2916 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: ReduceMean_1805 for ONNX node: ReduceMean_1805 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2917 for ONNX tensor: 2917 [05/10/2022-20:07:32] [V] [TRT] ReduceMean_1805 [ReduceMean] outputs: [2917 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Constant_1806 [Constant] [05/10/2022-20:07:32] [V] [TRT] Constant_1806 [Constant] inputs: [05/10/2022-20:07:32] [V] [TRT] Constant_1806 [Constant] outputs: [2918 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Add_1807 [Add] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2917 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2918 [05/10/2022-20:07:32] [V] [TRT] Add_1807 [Add] inputs: [2917 -> (-1, -1, 1)[FLOAT]], [2918 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: 2918 for ONNX node: 2918 [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1807 for ONNX node: Add_1807 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2919 for ONNX tensor: 2919 [05/10/2022-20:07:32] [V] [TRT] Add_1807 [Add] outputs: [2919 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Sqrt_1808 [Sqrt] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2919 [05/10/2022-20:07:32] [V] [TRT] Sqrt_1808 [Sqrt] inputs: [2919 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Sqrt_1808 for ONNX node: Sqrt_1808 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2920 for ONNX tensor: 2920 [05/10/2022-20:07:32] [V] [TRT] Sqrt_1808 [Sqrt] outputs: [2920 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Div_1809 [Div] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2914 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2920 [05/10/2022-20:07:32] [V] [TRT] Div_1809 [Div] inputs: [2914 -> (-1, -1, 256)[FLOAT]], [2920 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Div_1809 for ONNX node: Div_1809 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2921 for ONNX tensor: 2921 [05/10/2022-20:07:32] [V] [TRT] Div_1809 [Div] outputs: [2921 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Mul_1810 [Mul] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2921 [05/10/2022-20:07:32] [V] [TRT] Searching for input: encoder.encoders.10.norm_final.weight [05/10/2022-20:07:32] [V] [TRT] Mul_1810 [Mul] inputs: [2921 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: encoder.encoders.10.norm_final.weight for ONNX node: encoder.encoders.10.norm_final.weight [05/10/2022-20:07:32] [V] [TRT] Registering layer: Mul_1810 for ONNX node: Mul_1810 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2922 for ONNX tensor: 2922 [05/10/2022-20:07:32] [V] [TRT] Mul_1810 [Mul] outputs: [2922 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Add_1811 [Add] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2922 [05/10/2022-20:07:32] [V] [TRT] Searching for input: encoder.encoders.10.norm_final.bias [05/10/2022-20:07:32] [V] [TRT] Add_1811 [Add] inputs: [2922 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.10.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: encoder.encoders.10.norm_final.bias for ONNX node: encoder.encoders.10.norm_final.bias [05/10/2022-20:07:32] [V] [TRT] Registering layer: Add_1811 for ONNX node: Add_1811 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2923 for ONNX tensor: 2923 [05/10/2022-20:07:32] [V] [TRT] Add_1811 [Add] outputs: [2923 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: ReduceMean_1812 [ReduceMean] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2923 [05/10/2022-20:07:32] [V] [TRT] ReduceMean_1812 [ReduceMean] inputs: [2923 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: ReduceMean_1812 for ONNX node: ReduceMean_1812 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2924 for ONNX tensor: 2924 [05/10/2022-20:07:32] [V] [TRT] ReduceMean_1812 [ReduceMean] outputs: [2924 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Sub_1813 [Sub] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2923 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2924 [05/10/2022-20:07:32] [V] [TRT] Sub_1813 [Sub] inputs: [2923 -> (-1, -1, 256)[FLOAT]], [2924 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: Sub_1813 for ONNX node: Sub_1813 [05/10/2022-20:07:32] [V] [TRT] Registering tensor: 2925 for ONNX tensor: 2925 [05/10/2022-20:07:32] [V] [TRT] Sub_1813 [Sub] outputs: [2925 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Constant_1814 [Constant] [05/10/2022-20:07:32] [V] [TRT] Constant_1814 [Constant] inputs: [05/10/2022-20:07:32] [V] [TRT] Constant_1814 [Constant] outputs: [2926 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Parsing node: Pow_1815 [Pow] [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2925 [05/10/2022-20:07:32] [V] [TRT] Searching for input: 2926 [05/10/2022-20:07:32] [V] [TRT] Pow_1815 [Pow] inputs: [2925 -> (-1, -1, 256)[FLOAT]], [2926 -> ()[FLOAT]], [05/10/2022-20:07:32] [V] [TRT] Registering layer: 2926 for ONNX node: 2926 [05/10/2022-20:07:33] [V] [TRT] Registering layer: Pow_1815 for ONNX node: Pow_1815 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2927 for ONNX tensor: 2927 [05/10/2022-20:07:33] [V] [TRT] Pow_1815 [Pow] outputs: [2927 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: ReduceMean_1816 [ReduceMean] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2927 [05/10/2022-20:07:33] [V] [TRT] ReduceMean_1816 [ReduceMean] inputs: [2927 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: ReduceMean_1816 for ONNX node: ReduceMean_1816 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2928 for ONNX tensor: 2928 [05/10/2022-20:07:33] [V] [TRT] ReduceMean_1816 [ReduceMean] outputs: [2928 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Constant_1817 [Constant] [05/10/2022-20:07:33] [V] [TRT] Constant_1817 [Constant] inputs: [05/10/2022-20:07:33] [V] [TRT] Constant_1817 [Constant] outputs: [2929 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1818 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2928 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2929 [05/10/2022-20:07:33] [V] [TRT] Add_1818 [Add] inputs: [2928 -> (-1, -1, 1)[FLOAT]], [2929 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: 2929 for ONNX node: 2929 [05/10/2022-20:07:33] [V] [TRT] Registering layer: Add_1818 for ONNX node: Add_1818 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2930 for ONNX tensor: 2930 [05/10/2022-20:07:33] [V] [TRT] Add_1818 [Add] outputs: [2930 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Sqrt_1819 [Sqrt] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2930 [05/10/2022-20:07:33] [V] [TRT] Sqrt_1819 [Sqrt] inputs: [2930 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Sqrt_1819 for ONNX node: Sqrt_1819 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2931 for ONNX tensor: 2931 [05/10/2022-20:07:33] [V] [TRT] Sqrt_1819 [Sqrt] outputs: [2931 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Div_1820 [Div] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2925 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2931 [05/10/2022-20:07:33] [V] [TRT] Div_1820 [Div] inputs: [2925 -> (-1, -1, 256)[FLOAT]], [2931 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Div_1820 for ONNX node: Div_1820 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2932 for ONNX tensor: 2932 [05/10/2022-20:07:33] [V] [TRT] Div_1820 [Div] outputs: [2932 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Mul_1821 [Mul] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2932 [05/10/2022-20:07:33] [V] [TRT] Searching for input: encoder.encoders.11.norm_ff_macaron.weight [05/10/2022-20:07:33] [V] [TRT] Mul_1821 [Mul] inputs: [2932 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_ff_macaron.weight -> (256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: encoder.encoders.11.norm_ff_macaron.weight for ONNX node: encoder.encoders.11.norm_ff_macaron.weight [05/10/2022-20:07:33] [V] [TRT] Registering layer: Mul_1821 for ONNX node: Mul_1821 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2933 for ONNX tensor: 2933 [05/10/2022-20:07:33] [V] [TRT] Mul_1821 [Mul] outputs: [2933 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1822 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2933 [05/10/2022-20:07:33] [V] [TRT] Searching for input: encoder.encoders.11.norm_ff_macaron.bias [05/10/2022-20:07:33] [V] [TRT] Add_1822 [Add] inputs: [2933 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_ff_macaron.bias -> (256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: encoder.encoders.11.norm_ff_macaron.bias for ONNX node: encoder.encoders.11.norm_ff_macaron.bias [05/10/2022-20:07:33] [V] [TRT] Registering layer: Add_1822 for ONNX node: Add_1822 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2934 for ONNX tensor: 2934 [05/10/2022-20:07:33] [V] [TRT] Add_1822 [Add] outputs: [2934 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: MatMul_1823 [MatMul] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2934 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 3454 [05/10/2022-20:07:33] [V] [TRT] MatMul_1823 [MatMul] inputs: [2934 -> (-1, -1, 256)[FLOAT]], [3454 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: 3454 for ONNX node: 3454 [05/10/2022-20:07:33] [V] [TRT] Registering layer: MatMul_1823 for ONNX node: MatMul_1823 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2936 for ONNX tensor: 2936 [05/10/2022-20:07:33] [V] [TRT] MatMul_1823 [MatMul] outputs: [2936 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1824 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: encoder.encoders.11.feed_forward_macaron.w_1.bias [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2936 [05/10/2022-20:07:33] [V] [TRT] Add_1824 [Add] inputs: [encoder.encoders.11.feed_forward_macaron.w_1.bias -> (2048)[FLOAT]], [2936 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: encoder.encoders.11.feed_forward_macaron.w_1.bias for ONNX node: encoder.encoders.11.feed_forward_macaron.w_1.bias [05/10/2022-20:07:33] [V] [TRT] Registering layer: Add_1824 for ONNX node: Add_1824 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2937 for ONNX tensor: 2937 [05/10/2022-20:07:33] [V] [TRT] Add_1824 [Add] outputs: [2937 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Sigmoid_1825 [Sigmoid] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2937 [05/10/2022-20:07:33] [V] [TRT] Sigmoid_1825 [Sigmoid] inputs: [2937 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Sigmoid_1825 for ONNX node: Sigmoid_1825 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2938 for ONNX tensor: 2938 [05/10/2022-20:07:33] [V] [TRT] Sigmoid_1825 [Sigmoid] outputs: [2938 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Mul_1826 [Mul] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2937 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2938 [05/10/2022-20:07:33] [V] [TRT] Mul_1826 [Mul] inputs: [2937 -> (-1, -1, 2048)[FLOAT]], [2938 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Mul_1826 for ONNX node: Mul_1826 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2939 for ONNX tensor: 2939 [05/10/2022-20:07:33] [V] [TRT] Mul_1826 [Mul] outputs: [2939 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: MatMul_1827 [MatMul] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2939 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 3455 [05/10/2022-20:07:33] [V] [TRT] MatMul_1827 [MatMul] inputs: [2939 -> (-1, -1, 2048)[FLOAT]], [3455 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: 3455 for ONNX node: 3455 [05/10/2022-20:07:33] [V] [TRT] Registering layer: MatMul_1827 for ONNX node: MatMul_1827 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2941 for ONNX tensor: 2941 [05/10/2022-20:07:33] [V] [TRT] MatMul_1827 [MatMul] outputs: [2941 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1828 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: encoder.encoders.11.feed_forward_macaron.w_2.bias [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2941 [05/10/2022-20:07:33] [V] [TRT] Add_1828 [Add] inputs: [encoder.encoders.11.feed_forward_macaron.w_2.bias -> (256)[FLOAT]], [2941 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: encoder.encoders.11.feed_forward_macaron.w_2.bias for ONNX node: encoder.encoders.11.feed_forward_macaron.w_2.bias [05/10/2022-20:07:33] [V] [TRT] Registering layer: Add_1828 for ONNX node: Add_1828 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2942 for ONNX tensor: 2942 [05/10/2022-20:07:33] [V] [TRT] Add_1828 [Add] outputs: [2942 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Constant_1829 [Constant] [05/10/2022-20:07:33] [V] [TRT] Constant_1829 [Constant] inputs: [05/10/2022-20:07:33] [V] [TRT] Constant_1829 [Constant] outputs: [2943 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Mul_1830 [Mul] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2942 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2943 [05/10/2022-20:07:33] [V] [TRT] Mul_1830 [Mul] inputs: [2942 -> (-1, -1, 256)[FLOAT]], [2943 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: 2943 for ONNX node: 2943 [05/10/2022-20:07:33] [V] [TRT] Registering layer: Mul_1830 for ONNX node: Mul_1830 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2944 for ONNX tensor: 2944 [05/10/2022-20:07:33] [V] [TRT] Mul_1830 [Mul] outputs: [2944 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1831 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2923 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2944 [05/10/2022-20:07:33] [V] [TRT] Add_1831 [Add] inputs: [2923 -> (-1, -1, 256)[FLOAT]], [2944 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Add_1831 for ONNX node: Add_1831 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2945 for ONNX tensor: 2945 [05/10/2022-20:07:33] [V] [TRT] Add_1831 [Add] outputs: [2945 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: ReduceMean_1832 [ReduceMean] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2945 [05/10/2022-20:07:33] [V] [TRT] ReduceMean_1832 [ReduceMean] inputs: [2945 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: ReduceMean_1832 for ONNX node: ReduceMean_1832 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2946 for ONNX tensor: 2946 [05/10/2022-20:07:33] [V] [TRT] ReduceMean_1832 [ReduceMean] outputs: [2946 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Sub_1833 [Sub] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2945 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2946 [05/10/2022-20:07:33] [V] [TRT] Sub_1833 [Sub] inputs: [2945 -> (-1, -1, 256)[FLOAT]], [2946 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Sub_1833 for ONNX node: Sub_1833 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2947 for ONNX tensor: 2947 [05/10/2022-20:07:33] [V] [TRT] Sub_1833 [Sub] outputs: [2947 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Constant_1834 [Constant] [05/10/2022-20:07:33] [V] [TRT] Constant_1834 [Constant] inputs: [05/10/2022-20:07:33] [V] [TRT] Constant_1834 [Constant] outputs: [2948 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Pow_1835 [Pow] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2947 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2948 [05/10/2022-20:07:33] [V] [TRT] Pow_1835 [Pow] inputs: [2947 -> (-1, -1, 256)[FLOAT]], [2948 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: 2948 for ONNX node: 2948 [05/10/2022-20:07:33] [V] [TRT] Registering layer: Pow_1835 for ONNX node: Pow_1835 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2949 for ONNX tensor: 2949 [05/10/2022-20:07:33] [V] [TRT] Pow_1835 [Pow] outputs: [2949 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: ReduceMean_1836 [ReduceMean] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2949 [05/10/2022-20:07:33] [V] [TRT] ReduceMean_1836 [ReduceMean] inputs: [2949 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: ReduceMean_1836 for ONNX node: ReduceMean_1836 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2950 for ONNX tensor: 2950 [05/10/2022-20:07:33] [V] [TRT] ReduceMean_1836 [ReduceMean] outputs: [2950 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Constant_1837 [Constant] [05/10/2022-20:07:33] [V] [TRT] Constant_1837 [Constant] inputs: [05/10/2022-20:07:33] [V] [TRT] Constant_1837 [Constant] outputs: [2951 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1838 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2950 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2951 [05/10/2022-20:07:33] [V] [TRT] Add_1838 [Add] inputs: [2950 -> (-1, -1, 1)[FLOAT]], [2951 -> ()[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: 2951 for ONNX node: 2951 [05/10/2022-20:07:33] [V] [TRT] Registering layer: Add_1838 for ONNX node: Add_1838 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2952 for ONNX tensor: 2952 [05/10/2022-20:07:33] [V] [TRT] Add_1838 [Add] outputs: [2952 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Sqrt_1839 [Sqrt] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2952 [05/10/2022-20:07:33] [V] [TRT] Sqrt_1839 [Sqrt] inputs: [2952 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Sqrt_1839 for ONNX node: Sqrt_1839 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2953 for ONNX tensor: 2953 [05/10/2022-20:07:33] [V] [TRT] Sqrt_1839 [Sqrt] outputs: [2953 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Div_1840 [Div] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2947 [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2953 [05/10/2022-20:07:33] [V] [TRT] Div_1840 [Div] inputs: [2947 -> (-1, -1, 256)[FLOAT]], [2953 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: Div_1840 for ONNX node: Div_1840 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2954 for ONNX tensor: 2954 [05/10/2022-20:07:33] [V] [TRT] Div_1840 [Div] outputs: [2954 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Mul_1841 [Mul] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2954 [05/10/2022-20:07:33] [V] [TRT] Searching for input: encoder.encoders.11.norm_mha.weight [05/10/2022-20:07:33] [V] [TRT] Mul_1841 [Mul] inputs: [2954 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_mha.weight -> (256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: encoder.encoders.11.norm_mha.weight for ONNX node: encoder.encoders.11.norm_mha.weight [05/10/2022-20:07:33] [V] [TRT] Registering layer: Mul_1841 for ONNX node: Mul_1841 [05/10/2022-20:07:33] [V] [TRT] Registering tensor: 2955 for ONNX tensor: 2955 [05/10/2022-20:07:33] [V] [TRT] Mul_1841 [Mul] outputs: [2955 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Parsing node: Add_1842 [Add] [05/10/2022-20:07:33] [V] [TRT] Searching for input: 2955 [05/10/2022-20:07:33] [V] [TRT] Searching for input: encoder.encoders.11.norm_mha.bias [05/10/2022-20:07:33] [V] [TRT] Add_1842 [Add] inputs: [2955 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_mha.bias -> (256)[FLOAT]], [05/10/2022-20:07:33] [V] [TRT] Registering layer: encoder.encoders.11.norm_mha.bias for ONNX node: encoder.encoders.11.norm_mha.bias [05/10/2022-20:07:34] [V] [TRT] Registering layer: Add_1842 for ONNX node: Add_1842 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2956 for ONNX tensor: 2956 [05/10/2022-20:07:34] [V] [TRT] Add_1842 [Add] outputs: [2956 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Shape_1843 [Shape] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2956 [05/10/2022-20:07:34] [V] [TRT] Shape_1843 [Shape] inputs: [2956 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: Shape_1843 for ONNX node: Shape_1843 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2957 for ONNX tensor: 2957 [05/10/2022-20:07:34] [V] [TRT] Shape_1843 [Shape] outputs: [2957 -> (3)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Constant_1844 [Constant] [05/10/2022-20:07:34] [V] [TRT] Constant_1844 [Constant] inputs: [05/10/2022-20:07:34] [V] [TRT] Constant_1844 [Constant] outputs: [2958 -> ()[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Gather_1845 [Gather] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2957 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2958 [05/10/2022-20:07:34] [V] [TRT] Gather_1845 [Gather] inputs: [2957 -> (3)[INT32]], [2958 -> ()[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 2958 for ONNX node: 2958 [05/10/2022-20:07:34] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:34] [V] [TRT] Registering layer: Gather_1845 for ONNX node: Gather_1845 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2959 for ONNX tensor: 2959 [05/10/2022-20:07:34] [V] [TRT] Gather_1845 [Gather] outputs: [2959 -> ()[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: MatMul_1846 [MatMul] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2956 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3456 [05/10/2022-20:07:34] [V] [TRT] MatMul_1846 [MatMul] inputs: [2956 -> (-1, -1, 256)[FLOAT]], [3456 -> (256, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3456 for ONNX node: 3456 [05/10/2022-20:07:34] [V] [TRT] Registering layer: MatMul_1846 for ONNX node: MatMul_1846 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2961 for ONNX tensor: 2961 [05/10/2022-20:07:34] [V] [TRT] MatMul_1846 [MatMul] outputs: [2961 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Add_1847 [Add] [05/10/2022-20:07:34] [V] [TRT] Searching for input: encoder.encoders.11.self_attn.linear_q.bias [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2961 [05/10/2022-20:07:34] [V] [TRT] Add_1847 [Add] inputs: [encoder.encoders.11.self_attn.linear_q.bias -> (256)[FLOAT]], [2961 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: encoder.encoders.11.self_attn.linear_q.bias for ONNX node: encoder.encoders.11.self_attn.linear_q.bias [05/10/2022-20:07:34] [V] [TRT] Registering layer: Add_1847 for ONNX node: Add_1847 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2962 for ONNX tensor: 2962 [05/10/2022-20:07:34] [V] [TRT] Add_1847 [Add] outputs: [2962 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Constant_1848 [Constant] [05/10/2022-20:07:34] [V] [TRT] Constant_1848 [Constant] inputs: [05/10/2022-20:07:34] [V] [TRT] Constant_1848 [Constant] outputs: [2966 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Unsqueeze_1849 [Unsqueeze] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2959 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2966 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1849 [Unsqueeze] inputs: [2959 -> ()[INT32]], [2966 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:34] [V] [TRT] Registering layer: Unsqueeze_1849 for ONNX node: Unsqueeze_1849 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2967 for ONNX tensor: 2967 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1849 [Unsqueeze] outputs: [2967 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Concat_1850 [Concat] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2967 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3457 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3458 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3459 [05/10/2022-20:07:34] [V] [TRT] Concat_1850 [Concat] inputs: [2967 -> (1)[INT32]], [3457 -> (1)[INT32]], [3458 -> (1)[INT32]], [3459 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3457 for ONNX node: 3457 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3458 for ONNX node: 3458 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3459 for ONNX node: 3459 [05/10/2022-20:07:34] [V] [TRT] Registering layer: Concat_1850 for ONNX node: Concat_1850 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2974 for ONNX tensor: 2974 [05/10/2022-20:07:34] [V] [TRT] Concat_1850 [Concat] outputs: [2974 -> (4)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Reshape_1851 [Reshape] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2962 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2974 [05/10/2022-20:07:34] [V] [TRT] Reshape_1851 [Reshape] inputs: [2962 -> (-1, -1, 256)[FLOAT]], [2974 -> (4)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: Reshape_1851 for ONNX node: Reshape_1851 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2975 for ONNX tensor: 2975 [05/10/2022-20:07:34] [V] [TRT] Reshape_1851 [Reshape] outputs: [2975 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: MatMul_1852 [MatMul] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2956 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3460 [05/10/2022-20:07:34] [V] [TRT] MatMul_1852 [MatMul] inputs: [2956 -> (-1, -1, 256)[FLOAT]], [3460 -> (256, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3460 for ONNX node: 3460 [05/10/2022-20:07:34] [V] [TRT] Registering layer: MatMul_1852 for ONNX node: MatMul_1852 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2977 for ONNX tensor: 2977 [05/10/2022-20:07:34] [V] [TRT] MatMul_1852 [MatMul] outputs: [2977 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Add_1853 [Add] [05/10/2022-20:07:34] [V] [TRT] Searching for input: encoder.encoders.11.self_attn.linear_k.bias [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2977 [05/10/2022-20:07:34] [V] [TRT] Add_1853 [Add] inputs: [encoder.encoders.11.self_attn.linear_k.bias -> (256)[FLOAT]], [2977 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: encoder.encoders.11.self_attn.linear_k.bias for ONNX node: encoder.encoders.11.self_attn.linear_k.bias [05/10/2022-20:07:34] [V] [TRT] Registering layer: Add_1853 for ONNX node: Add_1853 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2978 for ONNX tensor: 2978 [05/10/2022-20:07:34] [V] [TRT] Add_1853 [Add] outputs: [2978 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Constant_1854 [Constant] [05/10/2022-20:07:34] [V] [TRT] Constant_1854 [Constant] inputs: [05/10/2022-20:07:34] [V] [TRT] Constant_1854 [Constant] outputs: [2982 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Unsqueeze_1855 [Unsqueeze] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2959 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2982 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1855 [Unsqueeze] inputs: [2959 -> ()[INT32]], [2982 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:34] [V] [TRT] Registering layer: Unsqueeze_1855 for ONNX node: Unsqueeze_1855 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2983 for ONNX tensor: 2983 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1855 [Unsqueeze] outputs: [2983 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Concat_1856 [Concat] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2983 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3461 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3462 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3463 [05/10/2022-20:07:34] [V] [TRT] Concat_1856 [Concat] inputs: [2983 -> (1)[INT32]], [3461 -> (1)[INT32]], [3462 -> (1)[INT32]], [3463 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3461 for ONNX node: 3461 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3462 for ONNX node: 3462 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3463 for ONNX node: 3463 [05/10/2022-20:07:34] [V] [TRT] Registering layer: Concat_1856 for ONNX node: Concat_1856 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2990 for ONNX tensor: 2990 [05/10/2022-20:07:34] [V] [TRT] Concat_1856 [Concat] outputs: [2990 -> (4)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Reshape_1857 [Reshape] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2978 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2990 [05/10/2022-20:07:34] [V] [TRT] Reshape_1857 [Reshape] inputs: [2978 -> (-1, -1, 256)[FLOAT]], [2990 -> (4)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: Reshape_1857 for ONNX node: Reshape_1857 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2991 for ONNX tensor: 2991 [05/10/2022-20:07:34] [V] [TRT] Reshape_1857 [Reshape] outputs: [2991 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: MatMul_1858 [MatMul] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2956 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3464 [05/10/2022-20:07:34] [V] [TRT] MatMul_1858 [MatMul] inputs: [2956 -> (-1, -1, 256)[FLOAT]], [3464 -> (256, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3464 for ONNX node: 3464 [05/10/2022-20:07:34] [V] [TRT] Registering layer: MatMul_1858 for ONNX node: MatMul_1858 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2993 for ONNX tensor: 2993 [05/10/2022-20:07:34] [V] [TRT] MatMul_1858 [MatMul] outputs: [2993 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Add_1859 [Add] [05/10/2022-20:07:34] [V] [TRT] Searching for input: encoder.encoders.11.self_attn.linear_v.bias [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2993 [05/10/2022-20:07:34] [V] [TRT] Add_1859 [Add] inputs: [encoder.encoders.11.self_attn.linear_v.bias -> (256)[FLOAT]], [2993 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: encoder.encoders.11.self_attn.linear_v.bias for ONNX node: encoder.encoders.11.self_attn.linear_v.bias [05/10/2022-20:07:34] [V] [TRT] Registering layer: Add_1859 for ONNX node: Add_1859 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2994 for ONNX tensor: 2994 [05/10/2022-20:07:34] [V] [TRT] Add_1859 [Add] outputs: [2994 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Constant_1860 [Constant] [05/10/2022-20:07:34] [V] [TRT] Constant_1860 [Constant] inputs: [05/10/2022-20:07:34] [V] [TRT] Constant_1860 [Constant] outputs: [2998 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Unsqueeze_1861 [Unsqueeze] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2959 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2998 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1861 [Unsqueeze] inputs: [2959 -> ()[INT32]], [2998 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:34] [V] [TRT] Registering layer: Unsqueeze_1861 for ONNX node: Unsqueeze_1861 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 2999 for ONNX tensor: 2999 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1861 [Unsqueeze] outputs: [2999 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Concat_1862 [Concat] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2999 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3465 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3466 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3467 [05/10/2022-20:07:34] [V] [TRT] Concat_1862 [Concat] inputs: [2999 -> (1)[INT32]], [3465 -> (1)[INT32]], [3466 -> (1)[INT32]], [3467 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3465 for ONNX node: 3465 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3466 for ONNX node: 3466 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3467 for ONNX node: 3467 [05/10/2022-20:07:34] [V] [TRT] Registering layer: Concat_1862 for ONNX node: Concat_1862 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3006 for ONNX tensor: 3006 [05/10/2022-20:07:34] [V] [TRT] Concat_1862 [Concat] outputs: [3006 -> (4)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Reshape_1863 [Reshape] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 2994 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3006 [05/10/2022-20:07:34] [V] [TRT] Reshape_1863 [Reshape] inputs: [2994 -> (-1, -1, 256)[FLOAT]], [3006 -> (4)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: Reshape_1863 for ONNX node: Reshape_1863 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3007 for ONNX tensor: 3007 [05/10/2022-20:07:34] [V] [TRT] Reshape_1863 [Reshape] outputs: [3007 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Transpose_1864 [Transpose] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3007 [05/10/2022-20:07:34] [V] [TRT] Transpose_1864 [Transpose] inputs: [3007 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: Transpose_1864 for ONNX node: Transpose_1864 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3008 for ONNX tensor: 3008 [05/10/2022-20:07:34] [V] [TRT] Transpose_1864 [Transpose] outputs: [3008 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Shape_1865 [Shape] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:34] [V] [TRT] Shape_1865 [Shape] inputs: [603 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: Shape_1865 for ONNX node: Shape_1865 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3009 for ONNX tensor: 3009 [05/10/2022-20:07:34] [V] [TRT] Shape_1865 [Shape] outputs: [3009 -> (3)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Constant_1866 [Constant] [05/10/2022-20:07:34] [V] [TRT] Constant_1866 [Constant] inputs: [05/10/2022-20:07:34] [V] [TRT] Constant_1866 [Constant] outputs: [3010 -> ()[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Gather_1867 [Gather] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3009 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3010 [05/10/2022-20:07:34] [V] [TRT] Gather_1867 [Gather] inputs: [3009 -> (3)[INT32]], [3010 -> ()[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3010 for ONNX node: 3010 [05/10/2022-20:07:34] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:34] [V] [TRT] Registering layer: Gather_1867 for ONNX node: Gather_1867 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3011 for ONNX tensor: 3011 [05/10/2022-20:07:34] [V] [TRT] Gather_1867 [Gather] outputs: [3011 -> ()[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: MatMul_1868 [MatMul] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 603 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3468 [05/10/2022-20:07:34] [V] [TRT] MatMul_1868 [MatMul] inputs: [603 -> (1, -1, 256)[FLOAT]], [3468 -> (256, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3468 for ONNX node: 3468 [05/10/2022-20:07:34] [V] [TRT] Registering layer: MatMul_1868 for ONNX node: MatMul_1868 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3013 for ONNX tensor: 3013 [05/10/2022-20:07:34] [V] [TRT] MatMul_1868 [MatMul] outputs: [3013 -> (1, -1, 256)[FLOAT]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Constant_1869 [Constant] [05/10/2022-20:07:34] [V] [TRT] Constant_1869 [Constant] inputs: [05/10/2022-20:07:34] [V] [TRT] Constant_1869 [Constant] outputs: [3017 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Unsqueeze_1870 [Unsqueeze] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3011 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3017 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1870 [Unsqueeze] inputs: [3011 -> ()[INT32]], [3017 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:34] [V] [TRT] Registering layer: Unsqueeze_1870 for ONNX node: Unsqueeze_1870 [05/10/2022-20:07:34] [V] [TRT] Registering tensor: 3018 for ONNX tensor: 3018 [05/10/2022-20:07:34] [V] [TRT] Unsqueeze_1870 [Unsqueeze] outputs: [3018 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Parsing node: Concat_1871 [Concat] [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3018 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3469 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3470 [05/10/2022-20:07:34] [V] [TRT] Searching for input: 3471 [05/10/2022-20:07:34] [V] [TRT] Concat_1871 [Concat] inputs: [3018 -> (1)[INT32]], [3469 -> (1)[INT32]], [3470 -> (1)[INT32]], [3471 -> (1)[INT32]], [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3469 for ONNX node: 3469 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3470 for ONNX node: 3470 [05/10/2022-20:07:34] [V] [TRT] Registering layer: 3471 for ONNX node: 3471 [05/10/2022-20:07:34] [V] [TRT] Registering layer: Concat_1871 for ONNX node: Concat_1871 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3025 for ONNX tensor: 3025 [05/10/2022-20:07:35] [V] [TRT] Concat_1871 [Concat] outputs: [3025 -> (4)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Reshape_1872 [Reshape] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3013 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3025 [05/10/2022-20:07:35] [V] [TRT] Reshape_1872 [Reshape] inputs: [3013 -> (1, -1, 256)[FLOAT]], [3025 -> (4)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Reshape_1872 for ONNX node: Reshape_1872 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3026 for ONNX tensor: 3026 [05/10/2022-20:07:35] [V] [TRT] Reshape_1872 [Reshape] outputs: [3026 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Add_1873 [Add] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 2975 [05/10/2022-20:07:35] [V] [TRT] Searching for input: encoder.encoders.11.self_attn.pos_bias_u [05/10/2022-20:07:35] [V] [TRT] Add_1873 [Add] inputs: [2975 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.11.self_attn.pos_bias_u -> (4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: encoder.encoders.11.self_attn.pos_bias_u for ONNX node: encoder.encoders.11.self_attn.pos_bias_u [05/10/2022-20:07:35] [V] [TRT] Registering layer: Add_1873 for ONNX node: Add_1873 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3027 for ONNX tensor: 3027 [05/10/2022-20:07:35] [V] [TRT] Add_1873 [Add] outputs: [3027 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Transpose_1874 [Transpose] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3027 [05/10/2022-20:07:35] [V] [TRT] Transpose_1874 [Transpose] inputs: [3027 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Transpose_1874 for ONNX node: Transpose_1874 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3028 for ONNX tensor: 3028 [05/10/2022-20:07:35] [V] [TRT] Transpose_1874 [Transpose] outputs: [3028 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Add_1875 [Add] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 2975 [05/10/2022-20:07:35] [V] [TRT] Searching for input: encoder.encoders.11.self_attn.pos_bias_v [05/10/2022-20:07:35] [V] [TRT] Add_1875 [Add] inputs: [2975 -> (-1, -1, 4, 64)[FLOAT]], [encoder.encoders.11.self_attn.pos_bias_v -> (4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: encoder.encoders.11.self_attn.pos_bias_v for ONNX node: encoder.encoders.11.self_attn.pos_bias_v [05/10/2022-20:07:35] [V] [TRT] Registering layer: Add_1875 for ONNX node: Add_1875 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3029 for ONNX tensor: 3029 [05/10/2022-20:07:35] [V] [TRT] Add_1875 [Add] outputs: [3029 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Transpose_1876 [Transpose] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3029 [05/10/2022-20:07:35] [V] [TRT] Transpose_1876 [Transpose] inputs: [3029 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Transpose_1876 for ONNX node: Transpose_1876 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3030 for ONNX tensor: 3030 [05/10/2022-20:07:35] [V] [TRT] Transpose_1876 [Transpose] outputs: [3030 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Transpose_1877 [Transpose] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 2991 [05/10/2022-20:07:35] [V] [TRT] Transpose_1877 [Transpose] inputs: [2991 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Transpose_1877 for ONNX node: Transpose_1877 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3031 for ONNX tensor: 3031 [05/10/2022-20:07:35] [V] [TRT] Transpose_1877 [Transpose] outputs: [3031 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: MatMul_1878 [MatMul] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3028 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3031 [05/10/2022-20:07:35] [V] [TRT] MatMul_1878 [MatMul] inputs: [3028 -> (-1, 4, -1, 64)[FLOAT]], [3031 -> (-1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: MatMul_1878 for ONNX node: MatMul_1878 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3032 for ONNX tensor: 3032 [05/10/2022-20:07:35] [V] [TRT] MatMul_1878 [MatMul] outputs: [3032 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Transpose_1879 [Transpose] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3026 [05/10/2022-20:07:35] [V] [TRT] Transpose_1879 [Transpose] inputs: [3026 -> (1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Transpose_1879 for ONNX node: Transpose_1879 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3033 for ONNX tensor: 3033 [05/10/2022-20:07:35] [V] [TRT] Transpose_1879 [Transpose] outputs: [3033 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: MatMul_1880 [MatMul] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3030 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3033 [05/10/2022-20:07:35] [V] [TRT] MatMul_1880 [MatMul] inputs: [3030 -> (-1, 4, -1, 64)[FLOAT]], [3033 -> (1, 4, 64, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: MatMul_1880 for ONNX node: MatMul_1880 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3034 for ONNX tensor: 3034 [05/10/2022-20:07:35] [V] [TRT] MatMul_1880 [MatMul] outputs: [3034 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Add_1881 [Add] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3032 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3034 [05/10/2022-20:07:35] [V] [TRT] Add_1881 [Add] inputs: [3032 -> (-1, 4, -1, -1)[FLOAT]], [3034 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Add_1881 for ONNX node: Add_1881 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3035 for ONNX tensor: 3035 [05/10/2022-20:07:35] [V] [TRT] Add_1881 [Add] outputs: [3035 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1882 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1882 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1882 [Constant] outputs: [3036 -> ()[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Div_1883 [Div] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3035 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3036 [05/10/2022-20:07:35] [V] [TRT] Div_1883 [Div] inputs: [3035 -> (-1, 4, -1, -1)[FLOAT]], [3036 -> ()[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3036 for ONNX node: 3036 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Div_1883 for ONNX node: Div_1883 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3037 for ONNX tensor: 3037 [05/10/2022-20:07:35] [V] [TRT] Div_1883 [Div] outputs: [3037 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Shape_1884 [Shape] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3008 [05/10/2022-20:07:35] [V] [TRT] Shape_1884 [Shape] inputs: [3008 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Shape_1884 for ONNX node: Shape_1884 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3038 for ONNX tensor: 3038 [05/10/2022-20:07:35] [V] [TRT] Shape_1884 [Shape] outputs: [3038 -> (4)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1885 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1885 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1885 [Constant] outputs: [3039 -> ()[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Gather_1886 [Gather] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3038 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3039 [05/10/2022-20:07:35] [V] [TRT] Gather_1886 [Gather] inputs: [3038 -> (4)[INT32]], [3039 -> ()[INT32]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3039 for ONNX node: 3039 [05/10/2022-20:07:35] [V] [TRT] Using Gather axis: 0 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Gather_1886 for ONNX node: Gather_1886 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3040 for ONNX tensor: 3040 [05/10/2022-20:07:35] [V] [TRT] Gather_1886 [Gather] outputs: [3040 -> ()[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1887 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1887 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1887 [Constant] outputs: [3041 -> (1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Unsqueeze_1888 [Unsqueeze] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3041 [05/10/2022-20:07:35] [V] [TRT] Unsqueeze_1888 [Unsqueeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [3041 -> (1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Original shape: (_, 1, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:35] [V] [TRT] Registering layer: Unsqueeze_1888 for ONNX node: Unsqueeze_1888 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3042 for ONNX tensor: 3042 [05/10/2022-20:07:35] [V] [TRT] Unsqueeze_1888 [Unsqueeze] outputs: [3042 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Cast_1889 [Cast] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3042 [05/10/2022-20:07:35] [V] [TRT] Cast_1889 [Cast] inputs: [3042 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Cast_1889 for ONNX node: Cast_1889 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3043 for ONNX tensor: 3043 [05/10/2022-20:07:35] [V] [TRT] Cast_1889 [Cast] outputs: [3043 -> (-1, 1, 1, -1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1890 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1890 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1890 [Constant] outputs: [3044 -> ()[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Equal_1891 [Equal] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3043 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3044 [05/10/2022-20:07:35] [V] [TRT] Equal_1891 [Equal] inputs: [3043 -> (-1, 1, 1, -1)[INT32]], [3044 -> ()[INT32]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3044 for ONNX node: 3044 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Equal_1891 for ONNX node: Equal_1891 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3045 for ONNX tensor: 3045 [05/10/2022-20:07:35] [V] [TRT] Equal_1891 [Equal] outputs: [3045 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Cast_1892 [Cast] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3045 [05/10/2022-20:07:35] [V] [TRT] Cast_1892 [Cast] inputs: [3045 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Casting to type: bool [05/10/2022-20:07:35] [V] [TRT] Registering layer: Cast_1892 for ONNX node: Cast_1892 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3046 for ONNX tensor: 3046 [05/10/2022-20:07:35] [V] [TRT] Cast_1892 [Cast] outputs: [3046 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1893 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1893 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1893 [Constant] outputs: [3047 -> ()[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Where_1894 [Where] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3046 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3047 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3037 [05/10/2022-20:07:35] [V] [TRT] Where_1894 [Where] inputs: [3046 -> (-1, 1, 1, -1)[BOOL]], [3047 -> ()[FLOAT]], [3037 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3047 for ONNX node: 3047 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Where_1894 for ONNX node: Where_1894 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3048 for ONNX tensor: 3048 [05/10/2022-20:07:35] [V] [TRT] Where_1894 [Where] outputs: [3048 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Softmax_1895 [Softmax] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3048 [05/10/2022-20:07:35] [V] [TRT] Softmax_1895 [Softmax] inputs: [3048 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Softmax_1895 for ONNX node: Softmax_1895 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3049 for ONNX tensor: 3049 [05/10/2022-20:07:35] [V] [TRT] Softmax_1895 [Softmax] outputs: [3049 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Cast_1896 [Cast] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3045 [05/10/2022-20:07:35] [V] [TRT] Cast_1896 [Cast] inputs: [3045 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Casting to type: bool [05/10/2022-20:07:35] [V] [TRT] Registering layer: Cast_1896 for ONNX node: Cast_1896 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3050 for ONNX tensor: 3050 [05/10/2022-20:07:35] [V] [TRT] Cast_1896 [Cast] outputs: [3050 -> (-1, 1, 1, -1)[BOOL]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1897 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1897 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1897 [Constant] outputs: [3051 -> ()[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Where_1898 [Where] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3050 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3051 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3049 [05/10/2022-20:07:35] [V] [TRT] Where_1898 [Where] inputs: [3050 -> (-1, 1, 1, -1)[BOOL]], [3051 -> ()[FLOAT]], [3049 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3051 for ONNX node: 3051 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Where_1898 for ONNX node: Where_1898 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3052 for ONNX tensor: 3052 [05/10/2022-20:07:35] [V] [TRT] Where_1898 [Where] outputs: [3052 -> (-1, 4, -1, -1)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: MatMul_1899 [MatMul] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3052 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3008 [05/10/2022-20:07:35] [V] [TRT] MatMul_1899 [MatMul] inputs: [3052 -> (-1, 4, -1, -1)[FLOAT]], [3008 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: MatMul_1899 for ONNX node: MatMul_1899 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3053 for ONNX tensor: 3053 [05/10/2022-20:07:35] [V] [TRT] MatMul_1899 [MatMul] outputs: [3053 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Transpose_1900 [Transpose] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3053 [05/10/2022-20:07:35] [V] [TRT] Transpose_1900 [Transpose] inputs: [3053 -> (-1, 4, -1, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Transpose_1900 for ONNX node: Transpose_1900 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3054 for ONNX tensor: 3054 [05/10/2022-20:07:35] [V] [TRT] Transpose_1900 [Transpose] outputs: [3054 -> (-1, -1, 4, 64)[FLOAT]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Constant_1901 [Constant] [05/10/2022-20:07:35] [V] [TRT] Constant_1901 [Constant] inputs: [05/10/2022-20:07:35] [V] [TRT] Constant_1901 [Constant] outputs: [3057 -> (1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Unsqueeze_1902 [Unsqueeze] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3040 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3057 [05/10/2022-20:07:35] [V] [TRT] Unsqueeze_1902 [Unsqueeze] inputs: [3040 -> ()[INT32]], [3057 -> (1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Original shape: (), unsqueezing to: (1,) [05/10/2022-20:07:35] [V] [TRT] Registering layer: Unsqueeze_1902 for ONNX node: Unsqueeze_1902 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3058 for ONNX tensor: 3058 [05/10/2022-20:07:35] [V] [TRT] Unsqueeze_1902 [Unsqueeze] outputs: [3058 -> (1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Concat_1903 [Concat] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3058 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3472 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3473 [05/10/2022-20:07:35] [V] [TRT] Concat_1903 [Concat] inputs: [3058 -> (1)[INT32]], [3472 -> (1)[INT32]], [3473 -> (1)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3472 for ONNX node: 3472 [05/10/2022-20:07:35] [V] [TRT] Registering layer: 3473 for ONNX node: 3473 [05/10/2022-20:07:35] [V] [TRT] Registering layer: Concat_1903 for ONNX node: Concat_1903 [05/10/2022-20:07:35] [V] [TRT] Registering tensor: 3063 for ONNX tensor: 3063 [05/10/2022-20:07:35] [V] [TRT] Concat_1903 [Concat] outputs: [3063 -> (3)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Parsing node: Reshape_1904 [Reshape] [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3054 [05/10/2022-20:07:35] [V] [TRT] Searching for input: 3063 [05/10/2022-20:07:35] [V] [TRT] Reshape_1904 [Reshape] inputs: [3054 -> (-1, -1, 4, 64)[FLOAT]], [3063 -> (3)[INT32]], [05/10/2022-20:07:35] [V] [TRT] Registering layer: Reshape_1904 for ONNX node: Reshape_1904 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3064 for ONNX tensor: 3064 [05/10/2022-20:07:36] [V] [TRT] Reshape_1904 [Reshape] outputs: [3064 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: MatMul_1905 [MatMul] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3064 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3474 [05/10/2022-20:07:36] [V] [TRT] MatMul_1905 [MatMul] inputs: [3064 -> (-1, -1, 256)[FLOAT]], [3474 -> (256, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: 3474 for ONNX node: 3474 [05/10/2022-20:07:36] [V] [TRT] Registering layer: MatMul_1905 for ONNX node: MatMul_1905 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3066 for ONNX tensor: 3066 [05/10/2022-20:07:36] [V] [TRT] MatMul_1905 [MatMul] outputs: [3066 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Add_1906 [Add] [05/10/2022-20:07:36] [V] [TRT] Searching for input: encoder.encoders.11.self_attn.linear_out.bias [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3066 [05/10/2022-20:07:36] [V] [TRT] Add_1906 [Add] inputs: [encoder.encoders.11.self_attn.linear_out.bias -> (256)[FLOAT]], [3066 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: encoder.encoders.11.self_attn.linear_out.bias for ONNX node: encoder.encoders.11.self_attn.linear_out.bias [05/10/2022-20:07:36] [V] [TRT] Registering layer: Add_1906 for ONNX node: Add_1906 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3067 for ONNX tensor: 3067 [05/10/2022-20:07:36] [V] [TRT] Add_1906 [Add] outputs: [3067 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Add_1907 [Add] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 2945 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3067 [05/10/2022-20:07:36] [V] [TRT] Add_1907 [Add] inputs: [2945 -> (-1, -1, 256)[FLOAT]], [3067 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Add_1907 for ONNX node: Add_1907 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3068 for ONNX tensor: 3068 [05/10/2022-20:07:36] [V] [TRT] Add_1907 [Add] outputs: [3068 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: ReduceMean_1908 [ReduceMean] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3068 [05/10/2022-20:07:36] [V] [TRT] ReduceMean_1908 [ReduceMean] inputs: [3068 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: ReduceMean_1908 for ONNX node: ReduceMean_1908 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3069 for ONNX tensor: 3069 [05/10/2022-20:07:36] [V] [TRT] ReduceMean_1908 [ReduceMean] outputs: [3069 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Sub_1909 [Sub] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3068 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3069 [05/10/2022-20:07:36] [V] [TRT] Sub_1909 [Sub] inputs: [3068 -> (-1, -1, 256)[FLOAT]], [3069 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Sub_1909 for ONNX node: Sub_1909 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3070 for ONNX tensor: 3070 [05/10/2022-20:07:36] [V] [TRT] Sub_1909 [Sub] outputs: [3070 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Constant_1910 [Constant] [05/10/2022-20:07:36] [V] [TRT] Constant_1910 [Constant] inputs: [05/10/2022-20:07:36] [V] [TRT] Constant_1910 [Constant] outputs: [3071 -> ()[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Pow_1911 [Pow] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3070 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3071 [05/10/2022-20:07:36] [V] [TRT] Pow_1911 [Pow] inputs: [3070 -> (-1, -1, 256)[FLOAT]], [3071 -> ()[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: 3071 for ONNX node: 3071 [05/10/2022-20:07:36] [V] [TRT] Registering layer: Pow_1911 for ONNX node: Pow_1911 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3072 for ONNX tensor: 3072 [05/10/2022-20:07:36] [V] [TRT] Pow_1911 [Pow] outputs: [3072 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: ReduceMean_1912 [ReduceMean] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3072 [05/10/2022-20:07:36] [V] [TRT] ReduceMean_1912 [ReduceMean] inputs: [3072 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: ReduceMean_1912 for ONNX node: ReduceMean_1912 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3073 for ONNX tensor: 3073 [05/10/2022-20:07:36] [V] [TRT] ReduceMean_1912 [ReduceMean] outputs: [3073 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Constant_1913 [Constant] [05/10/2022-20:07:36] [V] [TRT] Constant_1913 [Constant] inputs: [05/10/2022-20:07:36] [V] [TRT] Constant_1913 [Constant] outputs: [3074 -> ()[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Add_1914 [Add] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3073 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3074 [05/10/2022-20:07:36] [V] [TRT] Add_1914 [Add] inputs: [3073 -> (-1, -1, 1)[FLOAT]], [3074 -> ()[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: 3074 for ONNX node: 3074 [05/10/2022-20:07:36] [V] [TRT] Registering layer: Add_1914 for ONNX node: Add_1914 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3075 for ONNX tensor: 3075 [05/10/2022-20:07:36] [V] [TRT] Add_1914 [Add] outputs: [3075 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Sqrt_1915 [Sqrt] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3075 [05/10/2022-20:07:36] [V] [TRT] Sqrt_1915 [Sqrt] inputs: [3075 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Sqrt_1915 for ONNX node: Sqrt_1915 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3076 for ONNX tensor: 3076 [05/10/2022-20:07:36] [V] [TRT] Sqrt_1915 [Sqrt] outputs: [3076 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Div_1916 [Div] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3070 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3076 [05/10/2022-20:07:36] [V] [TRT] Div_1916 [Div] inputs: [3070 -> (-1, -1, 256)[FLOAT]], [3076 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Div_1916 for ONNX node: Div_1916 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3077 for ONNX tensor: 3077 [05/10/2022-20:07:36] [V] [TRT] Div_1916 [Div] outputs: [3077 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Mul_1917 [Mul] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3077 [05/10/2022-20:07:36] [V] [TRT] Searching for input: encoder.encoders.11.norm_conv.weight [05/10/2022-20:07:36] [V] [TRT] Mul_1917 [Mul] inputs: [3077 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_conv.weight -> (256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: encoder.encoders.11.norm_conv.weight for ONNX node: encoder.encoders.11.norm_conv.weight [05/10/2022-20:07:36] [V] [TRT] Registering layer: Mul_1917 for ONNX node: Mul_1917 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3078 for ONNX tensor: 3078 [05/10/2022-20:07:36] [V] [TRT] Mul_1917 [Mul] outputs: [3078 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Add_1918 [Add] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3078 [05/10/2022-20:07:36] [V] [TRT] Searching for input: encoder.encoders.11.norm_conv.bias [05/10/2022-20:07:36] [V] [TRT] Add_1918 [Add] inputs: [3078 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_conv.bias -> (256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: encoder.encoders.11.norm_conv.bias for ONNX node: encoder.encoders.11.norm_conv.bias [05/10/2022-20:07:36] [V] [TRT] Registering layer: Add_1918 for ONNX node: Add_1918 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3079 for ONNX tensor: 3079 [05/10/2022-20:07:36] [V] [TRT] Add_1918 [Add] outputs: [3079 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Transpose_1919 [Transpose] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3079 [05/10/2022-20:07:36] [V] [TRT] Transpose_1919 [Transpose] inputs: [3079 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Transpose_1919 for ONNX node: Transpose_1919 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3080 for ONNX tensor: 3080 [05/10/2022-20:07:36] [V] [TRT] Transpose_1919 [Transpose] outputs: [3080 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Not_1920 [Not] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:36] [V] [TRT] Not_1920 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Not_1920 for ONNX node: Not_1920 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3081 for ONNX tensor: 3081 [05/10/2022-20:07:36] [V] [TRT] Not_1920 [Not] outputs: [3081 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Cast_1921 [Cast] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3081 [05/10/2022-20:07:36] [V] [TRT] Cast_1921 [Cast] inputs: [3081 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:36] [V] [TRT] Casting to type: bool [05/10/2022-20:07:36] [V] [TRT] Registering layer: Cast_1921 for ONNX node: Cast_1921 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3082 for ONNX tensor: 3082 [05/10/2022-20:07:36] [V] [TRT] Cast_1921 [Cast] outputs: [3082 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Constant_1922 [Constant] [05/10/2022-20:07:36] [V] [TRT] Constant_1922 [Constant] inputs: [05/10/2022-20:07:36] [V] [TRT] Constant_1922 [Constant] outputs: [3083 -> ()[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Where_1923 [Where] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3082 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3083 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3080 [05/10/2022-20:07:36] [V] [TRT] Where_1923 [Where] inputs: [3082 -> (-1, 1, -1)[BOOL]], [3083 -> ()[FLOAT]], [3080 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: 3083 for ONNX node: 3083 [05/10/2022-20:07:36] [V] [TRT] Registering layer: Where_1923 for ONNX node: Where_1923 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3084 for ONNX tensor: 3084 [05/10/2022-20:07:36] [V] [TRT] Where_1923 [Where] outputs: [3084 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Conv_1924 [Conv] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3084 [05/10/2022-20:07:36] [V] [TRT] Searching for input: encoder.encoders.11.conv_module.pointwise_conv1.weight [05/10/2022-20:07:36] [V] [TRT] Searching for input: encoder.encoders.11.conv_module.pointwise_conv1.bias [05/10/2022-20:07:36] [V] [TRT] Conv_1924 [Conv] inputs: [3084 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.11.conv_module.pointwise_conv1.weight -> (512, 256, 1)[FLOAT]], [encoder.encoders.11.conv_module.pointwise_conv1.bias -> (512)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:36] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:36] [V] [TRT] Registering layer: Conv_1924 for ONNX node: Conv_1924 [05/10/2022-20:07:36] [V] [TRT] Original shape: (_, 512, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:36] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 512 [05/10/2022-20:07:36] [V] [TRT] Convolution output dimensions: (-1, 512, -1, 1) [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3085 for ONNX tensor: 3085 [05/10/2022-20:07:36] [V] [TRT] Conv_1924 [Conv] outputs: [3085 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Split_1925 [Split] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3085 [05/10/2022-20:07:36] [V] [TRT] Split_1925 [Split] inputs: [3085 -> (-1, 512, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Split_1925 for ONNX node: Split_1925 [05/10/2022-20:07:36] [V] [TRT] Registering layer: Split_1925_13 for ONNX node: Split_1925 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3086 for ONNX tensor: 3086 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3087 for ONNX tensor: 3087 [05/10/2022-20:07:36] [V] [TRT] Split_1925 [Split] outputs: [3086 -> (-1, 256, -1)[FLOAT]], [3087 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Sigmoid_1926 [Sigmoid] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3087 [05/10/2022-20:07:36] [V] [TRT] Sigmoid_1926 [Sigmoid] inputs: [3087 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Sigmoid_1926 for ONNX node: Sigmoid_1926 [05/10/2022-20:07:36] [V] [TRT] Registering tensor: 3088 for ONNX tensor: 3088 [05/10/2022-20:07:36] [V] [TRT] Sigmoid_1926 [Sigmoid] outputs: [3088 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Parsing node: Mul_1927 [Mul] [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3086 [05/10/2022-20:07:36] [V] [TRT] Searching for input: 3088 [05/10/2022-20:07:36] [V] [TRT] Mul_1927 [Mul] inputs: [3086 -> (-1, 256, -1)[FLOAT]], [3088 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:36] [V] [TRT] Registering layer: Mul_1927 for ONNX node: Mul_1927 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3089 for ONNX tensor: 3089 [05/10/2022-20:07:37] [V] [TRT] Mul_1927 [Mul] outputs: [3089 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Conv_1928 [Conv] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3089 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3194 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3195 [05/10/2022-20:07:37] [V] [TRT] Conv_1928 [Conv] inputs: [3089 -> (-1, 256, -1)[FLOAT]], [3194 -> (256, 1, 15)[FLOAT]], [3195 -> (256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:37] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:37] [V] [TRT] Registering layer: Conv_1928 for ONNX node: Conv_1928 [05/10/2022-20:07:37] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:37] [V] [TRT] Using kernel: (15, 1), strides: (1, 1), prepadding: (7, 0), postpadding: (7, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:37] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3193 for ONNX tensor: 3193 [05/10/2022-20:07:37] [V] [TRT] Conv_1928 [Conv] outputs: [3193 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Sigmoid_1929 [Sigmoid] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3193 [05/10/2022-20:07:37] [V] [TRT] Sigmoid_1929 [Sigmoid] inputs: [3193 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Sigmoid_1929 for ONNX node: Sigmoid_1929 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3092 for ONNX tensor: 3092 [05/10/2022-20:07:37] [V] [TRT] Sigmoid_1929 [Sigmoid] outputs: [3092 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Mul_1930 [Mul] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3193 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3092 [05/10/2022-20:07:37] [V] [TRT] Mul_1930 [Mul] inputs: [3193 -> (-1, 256, -1)[FLOAT]], [3092 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Mul_1930 for ONNX node: Mul_1930 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3093 for ONNX tensor: 3093 [05/10/2022-20:07:37] [V] [TRT] Mul_1930 [Mul] outputs: [3093 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Not_1931 [Not] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:37] [V] [TRT] Not_1931 [Not] inputs: [613 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Not_1931 for ONNX node: Not_1931 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3094 for ONNX tensor: 3094 [05/10/2022-20:07:37] [V] [TRT] Not_1931 [Not] outputs: [3094 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Conv_1932 [Conv] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3093 [05/10/2022-20:07:37] [V] [TRT] Searching for input: encoder.encoders.11.conv_module.pointwise_conv2.weight [05/10/2022-20:07:37] [V] [TRT] Searching for input: encoder.encoders.11.conv_module.pointwise_conv2.bias [05/10/2022-20:07:37] [V] [TRT] Conv_1932 [Conv] inputs: [3093 -> (-1, 256, -1)[FLOAT]], [encoder.encoders.11.conv_module.pointwise_conv2.weight -> (256, 256, 1)[FLOAT]], [encoder.encoders.11.conv_module.pointwise_conv2.bias -> (256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Convolution input dimensions: (-1, 256, -1) [05/10/2022-20:07:37] [V] [TRT] Original shape: (_, 256, _), unsqueezing to: (_, _, _, _) [05/10/2022-20:07:37] [V] [TRT] Registering layer: Conv_1932 for ONNX node: Conv_1932 [05/10/2022-20:07:37] [V] [TRT] Original shape: (_, 256, _, 1), squeezing to: (_, _, _) [05/10/2022-20:07:37] [V] [TRT] Using kernel: (1, 1), strides: (1, 1), prepadding: (0, 0), postpadding: (0, 0), dilations: (1, 1), numOutputs: 256 [05/10/2022-20:07:37] [V] [TRT] Convolution output dimensions: (-1, 256, -1, 1) [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3095 for ONNX tensor: 3095 [05/10/2022-20:07:37] [V] [TRT] Conv_1932 [Conv] outputs: [3095 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Cast_1933 [Cast] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3094 [05/10/2022-20:07:37] [V] [TRT] Cast_1933 [Cast] inputs: [3094 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:37] [V] [TRT] Casting to type: bool [05/10/2022-20:07:37] [V] [TRT] Registering layer: Cast_1933 for ONNX node: Cast_1933 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3096 for ONNX tensor: 3096 [05/10/2022-20:07:37] [V] [TRT] Cast_1933 [Cast] outputs: [3096 -> (-1, 1, -1)[BOOL]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Constant_1934 [Constant] [05/10/2022-20:07:37] [V] [TRT] Constant_1934 [Constant] inputs: [05/10/2022-20:07:37] [V] [TRT] Constant_1934 [Constant] outputs: [3097 -> ()[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Where_1935 [Where] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3096 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3097 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3095 [05/10/2022-20:07:37] [V] [TRT] Where_1935 [Where] inputs: [3096 -> (-1, 1, -1)[BOOL]], [3097 -> ()[FLOAT]], [3095 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: 3097 for ONNX node: 3097 [05/10/2022-20:07:37] [V] [TRT] Registering layer: Where_1935 for ONNX node: Where_1935 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3098 for ONNX tensor: 3098 [05/10/2022-20:07:37] [V] [TRT] Where_1935 [Where] outputs: [3098 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Transpose_1936 [Transpose] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3098 [05/10/2022-20:07:37] [V] [TRT] Transpose_1936 [Transpose] inputs: [3098 -> (-1, 256, -1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Transpose_1936 for ONNX node: Transpose_1936 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3099 for ONNX tensor: 3099 [05/10/2022-20:07:37] [V] [TRT] Transpose_1936 [Transpose] outputs: [3099 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Add_1937 [Add] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3068 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3099 [05/10/2022-20:07:37] [V] [TRT] Add_1937 [Add] inputs: [3068 -> (-1, -1, 256)[FLOAT]], [3099 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Add_1937 for ONNX node: Add_1937 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3100 for ONNX tensor: 3100 [05/10/2022-20:07:37] [V] [TRT] Add_1937 [Add] outputs: [3100 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: ReduceMean_1938 [ReduceMean] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3100 [05/10/2022-20:07:37] [V] [TRT] ReduceMean_1938 [ReduceMean] inputs: [3100 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: ReduceMean_1938 for ONNX node: ReduceMean_1938 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3101 for ONNX tensor: 3101 [05/10/2022-20:07:37] [V] [TRT] ReduceMean_1938 [ReduceMean] outputs: [3101 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Sub_1939 [Sub] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3100 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3101 [05/10/2022-20:07:37] [V] [TRT] Sub_1939 [Sub] inputs: [3100 -> (-1, -1, 256)[FLOAT]], [3101 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Sub_1939 for ONNX node: Sub_1939 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3102 for ONNX tensor: 3102 [05/10/2022-20:07:37] [V] [TRT] Sub_1939 [Sub] outputs: [3102 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Constant_1940 [Constant] [05/10/2022-20:07:37] [V] [TRT] Constant_1940 [Constant] inputs: [05/10/2022-20:07:37] [V] [TRT] Constant_1940 [Constant] outputs: [3103 -> ()[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Pow_1941 [Pow] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3102 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3103 [05/10/2022-20:07:37] [V] [TRT] Pow_1941 [Pow] inputs: [3102 -> (-1, -1, 256)[FLOAT]], [3103 -> ()[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: 3103 for ONNX node: 3103 [05/10/2022-20:07:37] [V] [TRT] Registering layer: Pow_1941 for ONNX node: Pow_1941 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3104 for ONNX tensor: 3104 [05/10/2022-20:07:37] [V] [TRT] Pow_1941 [Pow] outputs: [3104 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: ReduceMean_1942 [ReduceMean] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3104 [05/10/2022-20:07:37] [V] [TRT] ReduceMean_1942 [ReduceMean] inputs: [3104 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: ReduceMean_1942 for ONNX node: ReduceMean_1942 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3105 for ONNX tensor: 3105 [05/10/2022-20:07:37] [V] [TRT] ReduceMean_1942 [ReduceMean] outputs: [3105 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Constant_1943 [Constant] [05/10/2022-20:07:37] [V] [TRT] Constant_1943 [Constant] inputs: [05/10/2022-20:07:37] [V] [TRT] Constant_1943 [Constant] outputs: [3106 -> ()[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Add_1944 [Add] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3105 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3106 [05/10/2022-20:07:37] [V] [TRT] Add_1944 [Add] inputs: [3105 -> (-1, -1, 1)[FLOAT]], [3106 -> ()[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: 3106 for ONNX node: 3106 [05/10/2022-20:07:37] [V] [TRT] Registering layer: Add_1944 for ONNX node: Add_1944 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3107 for ONNX tensor: 3107 [05/10/2022-20:07:37] [V] [TRT] Add_1944 [Add] outputs: [3107 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Sqrt_1945 [Sqrt] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3107 [05/10/2022-20:07:37] [V] [TRT] Sqrt_1945 [Sqrt] inputs: [3107 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Sqrt_1945 for ONNX node: Sqrt_1945 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3108 for ONNX tensor: 3108 [05/10/2022-20:07:37] [V] [TRT] Sqrt_1945 [Sqrt] outputs: [3108 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Div_1946 [Div] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3102 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3108 [05/10/2022-20:07:37] [V] [TRT] Div_1946 [Div] inputs: [3102 -> (-1, -1, 256)[FLOAT]], [3108 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: Div_1946 for ONNX node: Div_1946 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3109 for ONNX tensor: 3109 [05/10/2022-20:07:37] [V] [TRT] Div_1946 [Div] outputs: [3109 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Mul_1947 [Mul] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3109 [05/10/2022-20:07:37] [V] [TRT] Searching for input: encoder.encoders.11.norm_ff.weight [05/10/2022-20:07:37] [V] [TRT] Mul_1947 [Mul] inputs: [3109 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_ff.weight -> (256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: encoder.encoders.11.norm_ff.weight for ONNX node: encoder.encoders.11.norm_ff.weight [05/10/2022-20:07:37] [V] [TRT] Registering layer: Mul_1947 for ONNX node: Mul_1947 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3110 for ONNX tensor: 3110 [05/10/2022-20:07:37] [V] [TRT] Mul_1947 [Mul] outputs: [3110 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: Add_1948 [Add] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3110 [05/10/2022-20:07:37] [V] [TRT] Searching for input: encoder.encoders.11.norm_ff.bias [05/10/2022-20:07:37] [V] [TRT] Add_1948 [Add] inputs: [3110 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_ff.bias -> (256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: encoder.encoders.11.norm_ff.bias for ONNX node: encoder.encoders.11.norm_ff.bias [05/10/2022-20:07:37] [V] [TRT] Registering layer: Add_1948 for ONNX node: Add_1948 [05/10/2022-20:07:37] [V] [TRT] Registering tensor: 3111 for ONNX tensor: 3111 [05/10/2022-20:07:37] [V] [TRT] Add_1948 [Add] outputs: [3111 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Parsing node: MatMul_1949 [MatMul] [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3111 [05/10/2022-20:07:37] [V] [TRT] Searching for input: 3475 [05/10/2022-20:07:37] [V] [TRT] MatMul_1949 [MatMul] inputs: [3111 -> (-1, -1, 256)[FLOAT]], [3475 -> (256, 2048)[FLOAT]], [05/10/2022-20:07:37] [V] [TRT] Registering layer: 3475 for ONNX node: 3475 [05/10/2022-20:07:37] [V] [TRT] Registering layer: MatMul_1949 for ONNX node: MatMul_1949 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3113 for ONNX tensor: 3113 [05/10/2022-20:07:38] [V] [TRT] MatMul_1949 [MatMul] outputs: [3113 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Add_1950 [Add] [05/10/2022-20:07:38] [V] [TRT] Searching for input: encoder.encoders.11.feed_forward.w_1.bias [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3113 [05/10/2022-20:07:38] [V] [TRT] Add_1950 [Add] inputs: [encoder.encoders.11.feed_forward.w_1.bias -> (2048)[FLOAT]], [3113 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: encoder.encoders.11.feed_forward.w_1.bias for ONNX node: encoder.encoders.11.feed_forward.w_1.bias [05/10/2022-20:07:38] [V] [TRT] Registering layer: Add_1950 for ONNX node: Add_1950 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3114 for ONNX tensor: 3114 [05/10/2022-20:07:38] [V] [TRT] Add_1950 [Add] outputs: [3114 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Sigmoid_1951 [Sigmoid] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3114 [05/10/2022-20:07:38] [V] [TRT] Sigmoid_1951 [Sigmoid] inputs: [3114 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Sigmoid_1951 for ONNX node: Sigmoid_1951 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3115 for ONNX tensor: 3115 [05/10/2022-20:07:38] [V] [TRT] Sigmoid_1951 [Sigmoid] outputs: [3115 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Mul_1952 [Mul] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3114 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3115 [05/10/2022-20:07:38] [V] [TRT] Mul_1952 [Mul] inputs: [3114 -> (-1, -1, 2048)[FLOAT]], [3115 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Mul_1952 for ONNX node: Mul_1952 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3116 for ONNX tensor: 3116 [05/10/2022-20:07:38] [V] [TRT] Mul_1952 [Mul] outputs: [3116 -> (-1, -1, 2048)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: MatMul_1953 [MatMul] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3116 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3476 [05/10/2022-20:07:38] [V] [TRT] MatMul_1953 [MatMul] inputs: [3116 -> (-1, -1, 2048)[FLOAT]], [3476 -> (2048, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: 3476 for ONNX node: 3476 [05/10/2022-20:07:38] [V] [TRT] Registering layer: MatMul_1953 for ONNX node: MatMul_1953 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3118 for ONNX tensor: 3118 [05/10/2022-20:07:38] [V] [TRT] MatMul_1953 [MatMul] outputs: [3118 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Add_1954 [Add] [05/10/2022-20:07:38] [V] [TRT] Searching for input: encoder.encoders.11.feed_forward.w_2.bias [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3118 [05/10/2022-20:07:38] [V] [TRT] Add_1954 [Add] inputs: [encoder.encoders.11.feed_forward.w_2.bias -> (256)[FLOAT]], [3118 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: encoder.encoders.11.feed_forward.w_2.bias for ONNX node: encoder.encoders.11.feed_forward.w_2.bias [05/10/2022-20:07:38] [V] [TRT] Registering layer: Add_1954 for ONNX node: Add_1954 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3119 for ONNX tensor: 3119 [05/10/2022-20:07:38] [V] [TRT] Add_1954 [Add] outputs: [3119 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Constant_1955 [Constant] [05/10/2022-20:07:38] [V] [TRT] Constant_1955 [Constant] inputs: [05/10/2022-20:07:38] [V] [TRT] Constant_1955 [Constant] outputs: [3120 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Mul_1956 [Mul] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3119 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3120 [05/10/2022-20:07:38] [V] [TRT] Mul_1956 [Mul] inputs: [3119 -> (-1, -1, 256)[FLOAT]], [3120 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: 3120 for ONNX node: 3120 [05/10/2022-20:07:38] [V] [TRT] Registering layer: Mul_1956 for ONNX node: Mul_1956 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3121 for ONNX tensor: 3121 [05/10/2022-20:07:38] [V] [TRT] Mul_1956 [Mul] outputs: [3121 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Add_1957 [Add] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3100 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3121 [05/10/2022-20:07:38] [V] [TRT] Add_1957 [Add] inputs: [3100 -> (-1, -1, 256)[FLOAT]], [3121 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Add_1957 for ONNX node: Add_1957 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3122 for ONNX tensor: 3122 [05/10/2022-20:07:38] [V] [TRT] Add_1957 [Add] outputs: [3122 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: ReduceMean_1958 [ReduceMean] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3122 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1958 [ReduceMean] inputs: [3122 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: ReduceMean_1958 for ONNX node: ReduceMean_1958 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3123 for ONNX tensor: 3123 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1958 [ReduceMean] outputs: [3123 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Sub_1959 [Sub] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3122 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3123 [05/10/2022-20:07:38] [V] [TRT] Sub_1959 [Sub] inputs: [3122 -> (-1, -1, 256)[FLOAT]], [3123 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Sub_1959 for ONNX node: Sub_1959 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3124 for ONNX tensor: 3124 [05/10/2022-20:07:38] [V] [TRT] Sub_1959 [Sub] outputs: [3124 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Constant_1960 [Constant] [05/10/2022-20:07:38] [V] [TRT] Constant_1960 [Constant] inputs: [05/10/2022-20:07:38] [V] [TRT] Constant_1960 [Constant] outputs: [3125 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Pow_1961 [Pow] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3124 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3125 [05/10/2022-20:07:38] [V] [TRT] Pow_1961 [Pow] inputs: [3124 -> (-1, -1, 256)[FLOAT]], [3125 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: 3125 for ONNX node: 3125 [05/10/2022-20:07:38] [V] [TRT] Registering layer: Pow_1961 for ONNX node: Pow_1961 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3126 for ONNX tensor: 3126 [05/10/2022-20:07:38] [V] [TRT] Pow_1961 [Pow] outputs: [3126 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: ReduceMean_1962 [ReduceMean] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3126 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1962 [ReduceMean] inputs: [3126 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: ReduceMean_1962 for ONNX node: ReduceMean_1962 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3127 for ONNX tensor: 3127 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1962 [ReduceMean] outputs: [3127 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Constant_1963 [Constant] [05/10/2022-20:07:38] [V] [TRT] Constant_1963 [Constant] inputs: [05/10/2022-20:07:38] [V] [TRT] Constant_1963 [Constant] outputs: [3128 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Add_1964 [Add] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3127 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3128 [05/10/2022-20:07:38] [V] [TRT] Add_1964 [Add] inputs: [3127 -> (-1, -1, 1)[FLOAT]], [3128 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: 3128 for ONNX node: 3128 [05/10/2022-20:07:38] [V] [TRT] Registering layer: Add_1964 for ONNX node: Add_1964 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3129 for ONNX tensor: 3129 [05/10/2022-20:07:38] [V] [TRT] Add_1964 [Add] outputs: [3129 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Sqrt_1965 [Sqrt] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3129 [05/10/2022-20:07:38] [V] [TRT] Sqrt_1965 [Sqrt] inputs: [3129 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Sqrt_1965 for ONNX node: Sqrt_1965 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3130 for ONNX tensor: 3130 [05/10/2022-20:07:38] [V] [TRT] Sqrt_1965 [Sqrt] outputs: [3130 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Div_1966 [Div] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3124 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3130 [05/10/2022-20:07:38] [V] [TRT] Div_1966 [Div] inputs: [3124 -> (-1, -1, 256)[FLOAT]], [3130 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Div_1966 for ONNX node: Div_1966 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3131 for ONNX tensor: 3131 [05/10/2022-20:07:38] [V] [TRT] Div_1966 [Div] outputs: [3131 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Mul_1967 [Mul] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3131 [05/10/2022-20:07:38] [V] [TRT] Searching for input: encoder.encoders.11.norm_final.weight [05/10/2022-20:07:38] [V] [TRT] Mul_1967 [Mul] inputs: [3131 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_final.weight -> (256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: encoder.encoders.11.norm_final.weight for ONNX node: encoder.encoders.11.norm_final.weight [05/10/2022-20:07:38] [V] [TRT] Registering layer: Mul_1967 for ONNX node: Mul_1967 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3132 for ONNX tensor: 3132 [05/10/2022-20:07:38] [V] [TRT] Mul_1967 [Mul] outputs: [3132 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Add_1968 [Add] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3132 [05/10/2022-20:07:38] [V] [TRT] Searching for input: encoder.encoders.11.norm_final.bias [05/10/2022-20:07:38] [V] [TRT] Add_1968 [Add] inputs: [3132 -> (-1, -1, 256)[FLOAT]], [encoder.encoders.11.norm_final.bias -> (256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: encoder.encoders.11.norm_final.bias for ONNX node: encoder.encoders.11.norm_final.bias [05/10/2022-20:07:38] [V] [TRT] Registering layer: Add_1968 for ONNX node: Add_1968 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3133 for ONNX tensor: 3133 [05/10/2022-20:07:38] [V] [TRT] Add_1968 [Add] outputs: [3133 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: ReduceMean_1969 [ReduceMean] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3133 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1969 [ReduceMean] inputs: [3133 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: ReduceMean_1969 for ONNX node: ReduceMean_1969 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3134 for ONNX tensor: 3134 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1969 [ReduceMean] outputs: [3134 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Sub_1970 [Sub] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3133 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3134 [05/10/2022-20:07:38] [V] [TRT] Sub_1970 [Sub] inputs: [3133 -> (-1, -1, 256)[FLOAT]], [3134 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Sub_1970 for ONNX node: Sub_1970 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3135 for ONNX tensor: 3135 [05/10/2022-20:07:38] [V] [TRT] Sub_1970 [Sub] outputs: [3135 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Constant_1971 [Constant] [05/10/2022-20:07:38] [V] [TRT] Constant_1971 [Constant] inputs: [05/10/2022-20:07:38] [V] [TRT] Constant_1971 [Constant] outputs: [3136 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Pow_1972 [Pow] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3135 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3136 [05/10/2022-20:07:38] [V] [TRT] Pow_1972 [Pow] inputs: [3135 -> (-1, -1, 256)[FLOAT]], [3136 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: 3136 for ONNX node: 3136 [05/10/2022-20:07:38] [V] [TRT] Registering layer: Pow_1972 for ONNX node: Pow_1972 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3137 for ONNX tensor: 3137 [05/10/2022-20:07:38] [V] [TRT] Pow_1972 [Pow] outputs: [3137 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: ReduceMean_1973 [ReduceMean] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3137 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1973 [ReduceMean] inputs: [3137 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: ReduceMean_1973 for ONNX node: ReduceMean_1973 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3138 for ONNX tensor: 3138 [05/10/2022-20:07:38] [V] [TRT] ReduceMean_1973 [ReduceMean] outputs: [3138 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Constant_1974 [Constant] [05/10/2022-20:07:38] [V] [TRT] Constant_1974 [Constant] inputs: [05/10/2022-20:07:38] [V] [TRT] Constant_1974 [Constant] outputs: [3139 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Add_1975 [Add] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3138 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3139 [05/10/2022-20:07:38] [V] [TRT] Add_1975 [Add] inputs: [3138 -> (-1, -1, 1)[FLOAT]], [3139 -> ()[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: 3139 for ONNX node: 3139 [05/10/2022-20:07:38] [V] [TRT] Registering layer: Add_1975 for ONNX node: Add_1975 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3140 for ONNX tensor: 3140 [05/10/2022-20:07:38] [V] [TRT] Add_1975 [Add] outputs: [3140 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Sqrt_1976 [Sqrt] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3140 [05/10/2022-20:07:38] [V] [TRT] Sqrt_1976 [Sqrt] inputs: [3140 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Sqrt_1976 for ONNX node: Sqrt_1976 [05/10/2022-20:07:38] [V] [TRT] Registering tensor: 3141 for ONNX tensor: 3141 [05/10/2022-20:07:38] [V] [TRT] Sqrt_1976 [Sqrt] outputs: [3141 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Parsing node: Div_1977 [Div] [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3135 [05/10/2022-20:07:38] [V] [TRT] Searching for input: 3141 [05/10/2022-20:07:38] [V] [TRT] Div_1977 [Div] inputs: [3135 -> (-1, -1, 256)[FLOAT]], [3141 -> (-1, -1, 1)[FLOAT]], [05/10/2022-20:07:38] [V] [TRT] Registering layer: Div_1977 for ONNX node: Div_1977 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3142 for ONNX tensor: 3142 [05/10/2022-20:07:39] [V] [TRT] Div_1977 [Div] outputs: [3142 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Mul_1978 [Mul] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3142 [05/10/2022-20:07:39] [V] [TRT] Searching for input: encoder.after_norm.weight [05/10/2022-20:07:39] [V] [TRT] Mul_1978 [Mul] inputs: [3142 -> (-1, -1, 256)[FLOAT]], [encoder.after_norm.weight -> (256)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: encoder.after_norm.weight for ONNX node: encoder.after_norm.weight [05/10/2022-20:07:39] [V] [TRT] Registering layer: Mul_1978 for ONNX node: Mul_1978 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3143 for ONNX tensor: 3143 [05/10/2022-20:07:39] [V] [TRT] Mul_1978 [Mul] outputs: [3143 -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Add_1979 [Add] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3143 [05/10/2022-20:07:39] [V] [TRT] Searching for input: encoder.after_norm.bias [05/10/2022-20:07:39] [V] [TRT] Add_1979 [Add] inputs: [3143 -> (-1, -1, 256)[FLOAT]], [encoder.after_norm.bias -> (256)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: encoder.after_norm.bias for ONNX node: encoder.after_norm.bias [05/10/2022-20:07:39] [V] [TRT] Registering layer: Add_1979 for ONNX node: Add_1979 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: encoder_out_14 for ONNX tensor: encoder_out [05/10/2022-20:07:39] [V] [TRT] Add_1979 [Add] outputs: [encoder_out -> (-1, -1, 256)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Constant_1980 [Constant] [05/10/2022-20:07:39] [V] [TRT] Constant_1980 [Constant] inputs: [05/10/2022-20:07:39] [V] [TRT] Constant_1980 [Constant] outputs: [3145 -> (1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Squeeze_1981 [Squeeze] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 613 [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3145 [05/10/2022-20:07:39] [V] [TRT] Squeeze_1981 [Squeeze] inputs: [613 -> (-1, 1, -1)[BOOL]], [3145 -> (1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Original shape: (_, 1, _), squeezing to: (_, _) [05/10/2022-20:07:39] [V] [TRT] Registering layer: Squeeze_1981 for ONNX node: Squeeze_1981 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3146 for ONNX tensor: 3146 [05/10/2022-20:07:39] [V] [TRT] Squeeze_1981 [Squeeze] outputs: [3146 -> (-1, -1)[BOOL]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Constant_1982 [Constant] [05/10/2022-20:07:39] [V] [TRT] Constant_1982 [Constant] inputs: [05/10/2022-20:07:39] [V] [TRT] Constant_1982 [Constant] outputs: [3147 -> (1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Cast_1983 [Cast] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3146 [05/10/2022-20:07:39] [V] [TRT] Cast_1983 [Cast] inputs: [3146 -> (-1, -1)[BOOL]], [05/10/2022-20:07:39] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:39] [V] [TRT] Registering layer: Cast_1983 for ONNX node: Cast_1983 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3148 for ONNX tensor: 3148 [05/10/2022-20:07:39] [V] [TRT] Cast_1983 [Cast] outputs: [3148 -> (-1, -1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: ReduceSum_1984 [ReduceSum] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3148 [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3147 [05/10/2022-20:07:39] [V] [TRT] ReduceSum_1984 [ReduceSum] inputs: [3148 -> (-1, -1)[INT32]], [3147 -> (1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: ReduceSum_1984 for ONNX node: ReduceSum_1984 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3149 for ONNX tensor: 3149 [05/10/2022-20:07:39] [V] [TRT] ReduceSum_1984 [ReduceSum] outputs: [3149 -> (-1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: MatMul_1985 [MatMul] [05/10/2022-20:07:39] [V] [TRT] Searching for input: encoder_out [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3477 [05/10/2022-20:07:39] [V] [TRT] MatMul_1985 [MatMul] inputs: [encoder_out -> (-1, -1, 256)[FLOAT]], [3477 -> (256, 4233)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: 3477 for ONNX node: 3477 [05/10/2022-20:07:39] [V] [TRT] Registering layer: MatMul_1985 for ONNX node: MatMul_1985 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3151 for ONNX tensor: 3151 [05/10/2022-20:07:39] [V] [TRT] MatMul_1985 [MatMul] outputs: [3151 -> (-1, -1, 4233)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Add_1986 [Add] [05/10/2022-20:07:39] [V] [TRT] Searching for input: ctc.ctc_lo.bias [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3151 [05/10/2022-20:07:39] [V] [TRT] Add_1986 [Add] inputs: [ctc.ctc_lo.bias -> (4233)[FLOAT]], [3151 -> (-1, -1, 4233)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: ctc.ctc_lo.bias for ONNX node: ctc.ctc_lo.bias [05/10/2022-20:07:39] [V] [TRT] Registering layer: Add_1986 for ONNX node: Add_1986 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: 3152 for ONNX tensor: 3152 [05/10/2022-20:07:39] [V] [TRT] Add_1986 [Add] outputs: [3152 -> (-1, -1, 4233)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: LogSoftmax_1987 [LogSoftmax] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3152 [05/10/2022-20:07:39] [V] [TRT] LogSoftmax_1987 [LogSoftmax] inputs: [3152 -> (-1, -1, 4233)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: LogSoftmax_1987 for ONNX node: LogSoftmax_1987 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: ctc_log_probs_15 for ONNX tensor: ctc_log_probs [05/10/2022-20:07:39] [V] [TRT] LogSoftmax_1987 [LogSoftmax] outputs: [ctc_log_probs -> (-1, -1, 4233)[FLOAT]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: Cast_1988 [Cast] [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3149 [05/10/2022-20:07:39] [V] [TRT] Cast_1988 [Cast] inputs: [3149 -> (-1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Casting to type: int32 [05/10/2022-20:07:39] [V] [TRT] Registering layer: Cast_1988 for ONNX node: Cast_1988 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: encoder_out_lens_16 for ONNX tensor: encoder_out_lens [05/10/2022-20:07:39] [V] [TRT] Cast_1988 [Cast] outputs: [encoder_out_lens -> (-1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Parsing node: TopK_1989 [TopK] [05/10/2022-20:07:39] [V] [TRT] Searching for input: ctc_log_probs [05/10/2022-20:07:39] [V] [TRT] Searching for input: 3478 [05/10/2022-20:07:39] [V] [TRT] TopK_1989 [TopK] inputs: [ctc_log_probs -> (-1, -1, 4233)[FLOAT]], [3478 -> (1)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Registering layer: TopK_1989 for ONNX node: TopK_1989 [05/10/2022-20:07:39] [V] [TRT] Registering tensor: beam_log_probs_17 for ONNX tensor: beam_log_probs [05/10/2022-20:07:39] [V] [TRT] Registering tensor: beam_log_probs_idx_18 for ONNX tensor: beam_log_probs_idx [05/10/2022-20:07:39] [V] [TRT] TopK_1989 [TopK] outputs: [beam_log_probs -> (-1, -1, 10)[FLOAT]], [beam_log_probs_idx -> (-1, -1, 10)[INT32]], [05/10/2022-20:07:39] [V] [TRT] Marking encoder_out_14 as output: encoder_out [05/10/2022-20:07:39] [V] [TRT] Marking encoder_out_lens_16 as output: encoder_out_lens [05/10/2022-20:07:39] [V] [TRT] Marking ctc_log_probs_15 as output: ctc_log_probs [05/10/2022-20:07:39] [V] [TRT] Marking beam_log_probs_17 as output: beam_log_probs [05/10/2022-20:07:39] [V] [TRT] Marking beam_log_probs_idx_18 as output: beam_log_probs_idx [05/10/2022-20:07:39] [I] Finish parsing network model &&&& FAILED TensorRT.trtexec [TensorRT v8204] # /data/wangsenhao/tensorRT/TensorRT-8.2.4.2/bin/trtexec --onnx=encoder.onnx --minShapes=speech:1x1x80,speech_lengths:1 --optShapes=speech:4x2x80,speech_lengths:4 --maxShapes=speech:16x1x28x28,speech_lengths:16 --workspace=1024 --saveEngine=encoder.plan --shapes=speech:4x2x80,speech_lengths:4 --verbose