trtuser@61d4db72c318:/workspace/TensorRT/build/out$ ./trtexec --onnx=/workspace/models/distilbert_dot_tas_b.onnx --saveEngine=engine.trt --explicitBatch --verbose --workspace=4096
&&&& RUNNING TensorRT.trtexec [TensorRT v8001] # ./trtexec --onnx=/workspace/models/distilbert_dot_tas_b.onnx --saveEngine=engine.trt --explicitBatch --verbose --workspace=4096
[07/30/2021-18:56:38] [I] === Model Options ===
[07/30/2021-18:56:38] [I] Format: ONNX
[07/30/2021-18:56:38] [I] Model: /workspace/models/distilbert_dot_tas_b.onnx
[07/30/2021-18:56:38] [I] Output:
[07/30/2021-18:56:38] [I] === Build Options ===
[07/30/2021-18:56:38] [I] Max batch: explicit
[07/30/2021-18:56:38] [I] Workspace: 4096 MiB
[07/30/2021-18:56:38] [I] minTiming: 1
[07/30/2021-18:56:38] [I] avgTiming: 8
[07/30/2021-18:56:38] [I] Precision: FP32
[07/30/2021-18:56:38] [I] Calibration: 
[07/30/2021-18:56:38] [I] Refit: Disabled
[07/30/2021-18:56:38] [I] Sparsity: Disabled
[07/30/2021-18:56:38] [I] Safe mode: Disabled
[07/30/2021-18:56:38] [I] Save engine: engine.trt
[07/30/2021-18:56:38] [I] Load engine: 
[07/30/2021-18:56:38] [I] NVTX verbosity: 0
[07/30/2021-18:56:38] [I] Tactic sources: Using default tactic sources
[07/30/2021-18:56:38] [I] timingCacheMode: local
[07/30/2021-18:56:38] [I] timingCacheFile: 
[07/30/2021-18:56:38] [I] Input(s)s format: fp32:CHW
[07/30/2021-18:56:38] [I] Output(s)s format: fp32:CHW
[07/30/2021-18:56:38] [I] Input build shapes: model
[07/30/2021-18:56:38] [I] Input calibration shapes: model
[07/30/2021-18:56:38] [I] === System Options ===
[07/30/2021-18:56:38] [I] Device: 0
[07/30/2021-18:56:38] [I] DLACore: 
[07/30/2021-18:56:38] [I] Plugins:
[07/30/2021-18:56:38] [I] === Inference Options ===
[07/30/2021-18:56:38] [I] Batch: Explicit
[07/30/2021-18:56:38] [I] Input inference shapes: model
[07/30/2021-18:56:38] [I] Iterations: 10
[07/30/2021-18:56:38] [I] Duration: 3s (+ 200ms warm up)
[07/30/2021-18:56:38] [I] Sleep time: 0ms
[07/30/2021-18:56:38] [I] Streams: 1
[07/30/2021-18:56:38] [I] ExposeDMA: Disabled
[07/30/2021-18:56:38] [I] Data transfers: Enabled
[07/30/2021-18:56:38] [I] Spin-wait: Disabled
[07/30/2021-18:56:38] [I] Multithreading: Disabled
[07/30/2021-18:56:38] [I] CUDA Graph: Disabled
[07/30/2021-18:56:38] [I] Separate profiling: Disabled
[07/30/2021-18:56:38] [I] Time Deserialize: Disabled
[07/30/2021-18:56:38] [I] Time Refit: Disabled
[07/30/2021-18:56:38] [I] Skip inference: Disabled
[07/30/2021-18:56:38] [I] Inputs:
[07/30/2021-18:56:38] [I] === Reporting Options ===
[07/30/2021-18:56:38] [I] Verbose: Enabled
[07/30/2021-18:56:38] [I] Averages: 10 inferences
[07/30/2021-18:56:38] [I] Percentile: 99
[07/30/2021-18:56:38] [I] Dump refittable layers:Disabled
[07/30/2021-18:56:38] [I] Dump output: Disabled
[07/30/2021-18:56:38] [I] Profile: Disabled
[07/30/2021-18:56:38] [I] Export timing to JSON file: 
[07/30/2021-18:56:38] [I] Export output to JSON file: 
[07/30/2021-18:56:38] [I] Export profile to JSON file: 
[07/30/2021-18:56:38] [I] 
[07/30/2021-18:56:38] [I] === Device Information ===
[07/30/2021-18:56:38] [I] Selected Device: NVIDIA GeForce RTX 3080 Laptop GPU
[07/30/2021-18:56:38] [I] Compute Capability: 8.6
[07/30/2021-18:56:38] [I] SMs: 48
[07/30/2021-18:56:38] [I] Compute Clock Rate: 1.245 GHz
[07/30/2021-18:56:38] [I] Device Global Memory: 16122 MiB
[07/30/2021-18:56:38] [I] Shared Memory per SM: 100 KiB
[07/30/2021-18:56:38] [I] Memory Bus Width: 256 bits (ECC disabled)
[07/30/2021-18:56:38] [I] Memory Clock Rate: 6.001 GHz
[07/30/2021-18:56:38] [I] 
[07/30/2021-18:56:38] [I] TensorRT version: 8001
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::BatchTilePlugin_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::CoordConvAC version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::CropAndResize version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::CropAndResizeDynamic version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::GenerateDetection_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::MultilevelCropAndResize_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::MultilevelProposeROI_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::NMSDynamic_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::Proposal version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::ProposalDynamic version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::Region_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::ScatterND version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1
[07/30/2021-18:56:38] [V] [TRT] Registered plugin creator - ::Split version 1
[07/30/2021-18:56:39] [I] [TRT] [MemUsageChange] Init CUDA: CPU +533, GPU +0, now: CPU 540, GPU 1286 (MiB)
[07/30/2021-18:56:39] [I] Start parsing network model
[07/30/2021-18:56:39] [I] [TRT] ----------------------------------------------------------------
[07/30/2021-18:56:39] [I] [TRT] Input filename:   /workspace/models/distilbert_dot_tas_b.onnx
[07/30/2021-18:56:39] [I] [TRT] ONNX IR version:  0.0.6
[07/30/2021-18:56:39] [I] [TRT] Opset version:    13
[07/30/2021-18:56:39] [I] [TRT] Producer name:    pytorch
[07/30/2021-18:56:39] [I] [TRT] Producer version: 1.9
[07/30/2021-18:56:39] [I] [TRT] Domain:           
[07/30/2021-18:56:39] [I] [TRT] Model version:    0
[07/30/2021-18:56:39] [I] [TRT] Doc string:       
[07/30/2021-18:56:39] [I] [TRT] ----------------------------------------------------------------
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::BatchTilePlugin_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::CoordConvAC version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::CropAndResizeDynamic version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::GenerateDetection_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::MultilevelCropAndResize_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::MultilevelProposeROI_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::NMSDynamic_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::Proposal version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::ProposalDynamic version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::ScatterND version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1
[07/30/2021-18:56:39] [V] [TRT] Plugin creator already registered - ::Split version 1
[07/30/2021-18:56:39] [V] [TRT] Adding network input: input.1 with dtype: int32, dimensions: (32, 512)
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: input.1 for ONNX tensor: input.1
[07/30/2021-18:56:39] [V] [TRT] Adding network input: 1 with dtype: int32, dimensions: (32, 512)
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 1 for ONNX tensor: 1
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: embeddings.word_embeddings.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: embeddings.position_embeddings.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: embeddings.LayerNorm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: embeddings.LayerNorm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.0.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.1.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.2.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.3.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.4.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: transformer.layer.5.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 937
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 938
[07/30/2021-18:56:39] [W] [TRT] /workspace/TensorRT/parsers/onnx/onnx2trt_utils.cpp:362: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 939
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 940
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 941
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 942
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 943
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 944
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 945
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 946
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 947
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 948
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 949
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 950
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 951
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 952
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 953
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 954
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 955
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 956
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 957
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 958
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 959
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 960
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 961
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 962
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 963
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 964
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 965
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 966
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 967
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 968
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 969
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 970
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 971
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 972
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 973
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 974
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 975
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 976
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 977
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 978
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 979
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 980
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 981
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 982
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 983
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 984
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 985
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 986
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 987
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 988
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 989
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 990
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 991
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 992
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 993
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 994
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 995
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 996
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 997
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 998
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 999
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1000
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1001
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1002
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1003
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1004
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1005
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1006
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1007
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1008
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1009
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1010
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1011
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1012
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1013
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1014
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1015
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1016
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1017
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1018
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1019
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1020
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1021
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1022
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1023
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1024
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1025
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1026
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1027
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1028
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1029
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1030
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1031
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1032
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1033
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1034
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1035
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1036
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1037
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1038
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1039
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1040
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1041
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1042
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1043
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1044
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1045
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1046
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1047
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1048
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1049
[07/30/2021-18:56:39] [V] [TRT] Importing initializer: 1050
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_0 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: input.1
[07/30/2021-18:56:39] [V] [TRT] Shape_0 [Shape] inputs: [input.1 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_0 for ONNX node: Shape_0
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 102 for ONNX tensor: 102
[07/30/2021-18:56:39] [V] [TRT] Shape_0 [Shape] outputs: [102 -> (2)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_1 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_1 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_1 [Constant] outputs: [103 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_2 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 102
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 103
[07/30/2021-18:56:39] [V] [TRT] Gather_2 [Gather] inputs: [102 -> (2)[INT32]], [103 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 103 for ONNX node: 103
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_2 for ONNX node: Gather_2
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 104 for ONNX tensor: 104
[07/30/2021-18:56:39] [V] [TRT] Gather_2 [Gather] outputs: [104 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_3 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 104
[07/30/2021-18:56:39] [V] [TRT] Cast_3 [Cast] inputs: [104 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_3 for ONNX node: Cast_3
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 105 for ONNX tensor: 105
[07/30/2021-18:56:39] [V] [TRT] Cast_3 [Cast] outputs: [105 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_4 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_4 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_4 [Constant] outputs: [106 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_5 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_5 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_5 [Constant] outputs: [107 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Range_6 [Range]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 106
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 105
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 107
[07/30/2021-18:56:39] [V] [TRT] Range_6 [Range] inputs: [106 -> ()[INT32]], [105 -> ()[INT32]], [107 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Range_6 for ONNX node: Range_6
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 108 for ONNX tensor: 108
[07/30/2021-18:56:39] [V] [TRT] Range_6 [Range] outputs: [108 -> (512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_7 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_7 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_7 [Constant] outputs: [109 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_8 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 108
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 109
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_8 [Unsqueeze] inputs: [108 -> (512)[INT32]], [109 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (512,), unsqueezing to: (1, 512)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_8 for ONNX node: Unsqueeze_8
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 110 for ONNX tensor: 110
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_8 [Unsqueeze] outputs: [110 -> (1, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_9 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: input.1
[07/30/2021-18:56:39] [V] [TRT] Shape_9 [Shape] inputs: [input.1 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_9 for ONNX node: Shape_9
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 111 for ONNX tensor: 111
[07/30/2021-18:56:39] [V] [TRT] Shape_9 [Shape] outputs: [111 -> (2)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Expand_10 [Expand]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 110
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 111
[07/30/2021-18:56:39] [V] [TRT] Expand_10 [Expand] inputs: [110 -> (1, 512)[INT32]], [111 -> (2)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Expand_10 for ONNX node: Expand_10
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 112 for ONNX tensor: 112
[07/30/2021-18:56:39] [V] [TRT] Expand_10 [Expand] outputs: [112 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_11 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: embeddings.word_embeddings.weight
[07/30/2021-18:56:39] [V] [TRT] Searching for input: input.1
[07/30/2021-18:56:39] [V] [TRT] Gather_11 [Gather] inputs: [embeddings.word_embeddings.weight -> (30522, 768)[FLOAT]], [input.1 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: embeddings.word_embeddings.weight for ONNX node: embeddings.word_embeddings.weight
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_11 for ONNX node: Gather_11
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 113 for ONNX tensor: 113
[07/30/2021-18:56:39] [V] [TRT] Gather_11 [Gather] outputs: [113 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_12 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: embeddings.position_embeddings.weight
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 112
[07/30/2021-18:56:39] [V] [TRT] Gather_12 [Gather] inputs: [embeddings.position_embeddings.weight -> (512, 768)[FLOAT]], [112 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: embeddings.position_embeddings.weight for ONNX node: embeddings.position_embeddings.weight
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_12 for ONNX node: Gather_12
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 114 for ONNX tensor: 114
[07/30/2021-18:56:39] [V] [TRT] Gather_12 [Gather] outputs: [114 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_13 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 113
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 114
[07/30/2021-18:56:39] [V] [TRT] Add_13 [Add] inputs: [113 -> (32, 512, 768)[FLOAT]], [114 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_13 for ONNX node: Add_13
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 115 for ONNX tensor: 115
[07/30/2021-18:56:39] [V] [TRT] Add_13 [Add] outputs: [115 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_14 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 115
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_14 [ReduceMean] inputs: [115 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_14 for ONNX node: ReduceMean_14
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 116 for ONNX tensor: 116
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_14 [ReduceMean] outputs: [116 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_15 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 115
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 116
[07/30/2021-18:56:39] [V] [TRT] Sub_15 [Sub] inputs: [115 -> (32, 512, 768)[FLOAT]], [116 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_15 for ONNX node: Sub_15
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 117 for ONNX tensor: 117
[07/30/2021-18:56:39] [V] [TRT] Sub_15 [Sub] outputs: [117 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_16 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_16 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_16 [Constant] outputs: [118 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_17 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 117
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 118
[07/30/2021-18:56:39] [V] [TRT] Pow_17 [Pow] inputs: [117 -> (32, 512, 768)[FLOAT]], [118 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 118 for ONNX node: 118
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_17 for ONNX node: Pow_17
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 119 for ONNX tensor: 119
[07/30/2021-18:56:39] [V] [TRT] Pow_17 [Pow] outputs: [119 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_18 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 119
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_18 [ReduceMean] inputs: [119 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_18 for ONNX node: ReduceMean_18
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 120 for ONNX tensor: 120
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_18 [ReduceMean] outputs: [120 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_19 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_19 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_19 [Constant] outputs: [121 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_20 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 120
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 121
[07/30/2021-18:56:39] [V] [TRT] Add_20 [Add] inputs: [120 -> (32, 512, 1)[FLOAT]], [121 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 121 for ONNX node: 121
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_20 for ONNX node: Add_20
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 122 for ONNX tensor: 122
[07/30/2021-18:56:39] [V] [TRT] Add_20 [Add] outputs: [122 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_21 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 122
[07/30/2021-18:56:39] [V] [TRT] Sqrt_21 [Sqrt] inputs: [122 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_21 for ONNX node: Sqrt_21
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 123 for ONNX tensor: 123
[07/30/2021-18:56:39] [V] [TRT] Sqrt_21 [Sqrt] outputs: [123 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_22 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 117
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 123
[07/30/2021-18:56:39] [V] [TRT] Div_22 [Div] inputs: [117 -> (32, 512, 768)[FLOAT]], [123 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_22 for ONNX node: Div_22
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 124 for ONNX tensor: 124
[07/30/2021-18:56:39] [V] [TRT] Div_22 [Div] outputs: [124 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_23 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 124
[07/30/2021-18:56:39] [V] [TRT] Searching for input: embeddings.LayerNorm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_23 [Mul] inputs: [124 -> (32, 512, 768)[FLOAT]], [embeddings.LayerNorm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: embeddings.LayerNorm.weight for ONNX node: embeddings.LayerNorm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_23 for ONNX node: Mul_23
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 125 for ONNX tensor: 125
[07/30/2021-18:56:39] [V] [TRT] Mul_23 [Mul] outputs: [125 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_24 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 125
[07/30/2021-18:56:39] [V] [TRT] Searching for input: embeddings.LayerNorm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_24 [Add] inputs: [125 -> (32, 512, 768)[FLOAT]], [embeddings.LayerNorm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: embeddings.LayerNorm.bias for ONNX node: embeddings.LayerNorm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_24 for ONNX node: Add_24
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 126 for ONNX tensor: 126
[07/30/2021-18:56:39] [V] [TRT] Add_24 [Add] outputs: [126 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_25 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 126
[07/30/2021-18:56:39] [V] [TRT] Shape_25 [Shape] inputs: [126 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_25 for ONNX node: Shape_25
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 127 for ONNX tensor: 127
[07/30/2021-18:56:39] [V] [TRT] Shape_25 [Shape] outputs: [127 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_26 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_26 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_26 [Constant] outputs: [128 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_27 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 127
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 128
[07/30/2021-18:56:39] [V] [TRT] Gather_27 [Gather] inputs: [127 -> (3)[INT32]], [128 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 128 for ONNX node: 128
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_27 for ONNX node: Gather_27
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 129 for ONNX tensor: 129
[07/30/2021-18:56:39] [V] [TRT] Gather_27 [Gather] outputs: [129 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_28 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 126
[07/30/2021-18:56:39] [V] [TRT] Shape_28 [Shape] inputs: [126 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_28 for ONNX node: Shape_28
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 130 for ONNX tensor: 130
[07/30/2021-18:56:39] [V] [TRT] Shape_28 [Shape] outputs: [130 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_29 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_29 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_29 [Constant] outputs: [131 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_30 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 130
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 131
[07/30/2021-18:56:39] [V] [TRT] Gather_30 [Gather] inputs: [130 -> (3)[INT32]], [131 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 131 for ONNX node: 131
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_30 for ONNX node: Gather_30
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 132 for ONNX tensor: 132
[07/30/2021-18:56:39] [V] [TRT] Gather_30 [Gather] outputs: [132 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_31 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 126
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 937
[07/30/2021-18:56:39] [V] [TRT] MatMul_31 [MatMul] inputs: [126 -> (32, 512, 768)[FLOAT]], [937 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 937 for ONNX node: 937
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_31 for ONNX node: MatMul_31
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 134 for ONNX tensor: 134
[07/30/2021-18:56:39] [V] [TRT] MatMul_31 [MatMul] outputs: [134 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_32 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 134
[07/30/2021-18:56:39] [V] [TRT] Add_32 [Add] inputs: [transformer.layer.0.attention.q_lin.bias -> (768)[FLOAT]], [134 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.attention.q_lin.bias for ONNX node: transformer.layer.0.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_32 for ONNX node: Add_32
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 135 for ONNX tensor: 135
[07/30/2021-18:56:39] [V] [TRT] Add_32 [Add] outputs: [135 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_33 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_33 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_33 [Constant] outputs: [139 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_34 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 129
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 139
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_34 [Unsqueeze] inputs: [129 -> ()[INT32]], [139 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_34 for ONNX node: Unsqueeze_34
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 140 for ONNX tensor: 140
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_34 [Unsqueeze] outputs: [140 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_35 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 140
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 938
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 939
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 940
[07/30/2021-18:56:39] [V] [TRT] Concat_35 [Concat] inputs: [140 -> (1)[INT32]], [938 -> (1)[INT32]], [939 -> (1)[INT32]], [940 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 938 for ONNX node: 938
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 939 for ONNX node: 939
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 940 for ONNX node: 940
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_35 for ONNX node: Concat_35
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 147 for ONNX tensor: 147
[07/30/2021-18:56:39] [V] [TRT] Concat_35 [Concat] outputs: [147 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_36 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 135
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 147
[07/30/2021-18:56:39] [V] [TRT] Reshape_36 [Reshape] inputs: [135 -> (32, 512, 768)[FLOAT]], [147 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_36 for ONNX node: Reshape_36
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 148 for ONNX tensor: 148
[07/30/2021-18:56:39] [V] [TRT] Reshape_36 [Reshape] outputs: [148 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_37 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 148
[07/30/2021-18:56:39] [V] [TRT] Transpose_37 [Transpose] inputs: [148 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_37 for ONNX node: Transpose_37
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 149 for ONNX tensor: 149
[07/30/2021-18:56:39] [V] [TRT] Transpose_37 [Transpose] outputs: [149 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_38 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 126
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 941
[07/30/2021-18:56:39] [V] [TRT] MatMul_38 [MatMul] inputs: [126 -> (32, 512, 768)[FLOAT]], [941 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 941 for ONNX node: 941
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_38 for ONNX node: MatMul_38
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 151 for ONNX tensor: 151
[07/30/2021-18:56:39] [V] [TRT] MatMul_38 [MatMul] outputs: [151 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_39 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 151
[07/30/2021-18:56:39] [V] [TRT] Add_39 [Add] inputs: [transformer.layer.0.attention.k_lin.bias -> (768)[FLOAT]], [151 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.attention.k_lin.bias for ONNX node: transformer.layer.0.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_39 for ONNX node: Add_39
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 152 for ONNX tensor: 152
[07/30/2021-18:56:39] [V] [TRT] Add_39 [Add] outputs: [152 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_40 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_40 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_40 [Constant] outputs: [156 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_41 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 129
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 156
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_41 [Unsqueeze] inputs: [129 -> ()[INT32]], [156 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_41 for ONNX node: Unsqueeze_41
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 157 for ONNX tensor: 157
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_41 [Unsqueeze] outputs: [157 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_42 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 157
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 942
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 943
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 944
[07/30/2021-18:56:39] [V] [TRT] Concat_42 [Concat] inputs: [157 -> (1)[INT32]], [942 -> (1)[INT32]], [943 -> (1)[INT32]], [944 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 942 for ONNX node: 942
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 943 for ONNX node: 943
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 944 for ONNX node: 944
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_42 for ONNX node: Concat_42
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 164 for ONNX tensor: 164
[07/30/2021-18:56:39] [V] [TRT] Concat_42 [Concat] outputs: [164 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_43 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 152
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 164
[07/30/2021-18:56:39] [V] [TRT] Reshape_43 [Reshape] inputs: [152 -> (32, 512, 768)[FLOAT]], [164 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_43 for ONNX node: Reshape_43
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 165 for ONNX tensor: 165
[07/30/2021-18:56:39] [V] [TRT] Reshape_43 [Reshape] outputs: [165 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_44 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 126
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 945
[07/30/2021-18:56:39] [V] [TRT] MatMul_44 [MatMul] inputs: [126 -> (32, 512, 768)[FLOAT]], [945 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 945 for ONNX node: 945
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_44 for ONNX node: MatMul_44
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 167 for ONNX tensor: 167
[07/30/2021-18:56:39] [V] [TRT] MatMul_44 [MatMul] outputs: [167 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_45 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 167
[07/30/2021-18:56:39] [V] [TRT] Add_45 [Add] inputs: [transformer.layer.0.attention.v_lin.bias -> (768)[FLOAT]], [167 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.attention.v_lin.bias for ONNX node: transformer.layer.0.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_45 for ONNX node: Add_45
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 168 for ONNX tensor: 168
[07/30/2021-18:56:39] [V] [TRT] Add_45 [Add] outputs: [168 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_46 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_46 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_46 [Constant] outputs: [172 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_47 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 129
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 172
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_47 [Unsqueeze] inputs: [129 -> ()[INT32]], [172 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_47 for ONNX node: Unsqueeze_47
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 173 for ONNX tensor: 173
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_47 [Unsqueeze] outputs: [173 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_48 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 173
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 946
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 947
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 948
[07/30/2021-18:56:39] [V] [TRT] Concat_48 [Concat] inputs: [173 -> (1)[INT32]], [946 -> (1)[INT32]], [947 -> (1)[INT32]], [948 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 946 for ONNX node: 946
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 947 for ONNX node: 947
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 948 for ONNX node: 948
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_48 for ONNX node: Concat_48
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 180 for ONNX tensor: 180
[07/30/2021-18:56:39] [V] [TRT] Concat_48 [Concat] outputs: [180 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_49 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 168
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 180
[07/30/2021-18:56:39] [V] [TRT] Reshape_49 [Reshape] inputs: [168 -> (32, 512, 768)[FLOAT]], [180 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_49 for ONNX node: Reshape_49
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 181 for ONNX tensor: 181
[07/30/2021-18:56:39] [V] [TRT] Reshape_49 [Reshape] outputs: [181 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_50 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 181
[07/30/2021-18:56:39] [V] [TRT] Transpose_50 [Transpose] inputs: [181 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_50 for ONNX node: Transpose_50
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 182 for ONNX tensor: 182
[07/30/2021-18:56:39] [V] [TRT] Transpose_50 [Transpose] outputs: [182 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_51 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_51 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_51 [Constant] outputs: [183 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_52 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 149
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 183
[07/30/2021-18:56:39] [V] [TRT] Div_52 [Div] inputs: [149 -> (32, 12, 512, 64)[FLOAT]], [183 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 183 for ONNX node: 183
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_52 for ONNX node: Div_52
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 184 for ONNX tensor: 184
[07/30/2021-18:56:39] [V] [TRT] Div_52 [Div] outputs: [184 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_53 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 165
[07/30/2021-18:56:39] [V] [TRT] Transpose_53 [Transpose] inputs: [165 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_53 for ONNX node: Transpose_53
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 185 for ONNX tensor: 185
[07/30/2021-18:56:39] [V] [TRT] Transpose_53 [Transpose] outputs: [185 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_54 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 184
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 185
[07/30/2021-18:56:39] [V] [TRT] MatMul_54 [MatMul] inputs: [184 -> (32, 12, 512, 64)[FLOAT]], [185 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_54 for ONNX node: MatMul_54
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 186 for ONNX tensor: 186
[07/30/2021-18:56:39] [V] [TRT] MatMul_54 [MatMul] outputs: [186 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_55 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_55 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_55 [Constant] outputs: [187 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Equal_56 [Equal]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 187
[07/30/2021-18:56:39] [V] [TRT] Equal_56 [Equal] inputs: [1 -> (32, 512)[INT32]], [187 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 187 for ONNX node: 187
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Equal_56 for ONNX node: Equal_56
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 188 for ONNX tensor: 188
[07/30/2021-18:56:39] [V] [TRT] Equal_56 [Equal] outputs: [188 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_57 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 188
[07/30/2021-18:56:39] [V] [TRT] Cast_57 [Cast] inputs: [188 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_57 for ONNX node: Cast_57
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 189 for ONNX tensor: 189
[07/30/2021-18:56:39] [V] [TRT] Cast_57 [Cast] outputs: [189 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_58 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_58 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_58 [Constant] outputs: [192 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_59 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 129
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 192
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_59 [Unsqueeze] inputs: [129 -> ()[INT32]], [192 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_59 for ONNX node: Unsqueeze_59
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 193 for ONNX tensor: 193
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_59 [Unsqueeze] outputs: [193 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_60 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_60 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_60 [Constant] outputs: [198 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_61 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 132
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 198
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_61 [Unsqueeze] inputs: [132 -> ()[INT32]], [198 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_61 for ONNX node: Unsqueeze_61
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 199 for ONNX tensor: 199
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_61 [Unsqueeze] outputs: [199 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_62 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 193
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 949
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 950
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 199
[07/30/2021-18:56:39] [V] [TRT] Concat_62 [Concat] inputs: [193 -> (1)[INT32]], [949 -> (1)[INT32]], [950 -> (1)[INT32]], [199 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 949 for ONNX node: 949
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 950 for ONNX node: 950
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_62 for ONNX node: Concat_62
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 200 for ONNX tensor: 200
[07/30/2021-18:56:39] [V] [TRT] Concat_62 [Concat] outputs: [200 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_63 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 189
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 200
[07/30/2021-18:56:39] [V] [TRT] Reshape_63 [Reshape] inputs: [189 -> (32, 512)[INT32]], [200 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_63 for ONNX node: Reshape_63
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 201 for ONNX tensor: 201
[07/30/2021-18:56:39] [V] [TRT] Reshape_63 [Reshape] outputs: [201 -> (32, 1, 1, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_64 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 186
[07/30/2021-18:56:39] [V] [TRT] Shape_64 [Shape] inputs: [186 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_64 for ONNX node: Shape_64
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 202 for ONNX tensor: 202
[07/30/2021-18:56:39] [V] [TRT] Shape_64 [Shape] outputs: [202 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Expand_65 [Expand]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 201
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 202
[07/30/2021-18:56:39] [V] [TRT] Expand_65 [Expand] inputs: [201 -> (32, 1, 1, 512)[INT32]], [202 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Expand_65 for ONNX node: Expand_65
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 203 for ONNX tensor: 203
[07/30/2021-18:56:39] [V] [TRT] Expand_65 [Expand] outputs: [203 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_66 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 203
[07/30/2021-18:56:39] [V] [TRT] Cast_66 [Cast] inputs: [203 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_66 for ONNX node: Cast_66
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 204 for ONNX tensor: 204
[07/30/2021-18:56:39] [V] [TRT] Cast_66 [Cast] outputs: [204 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_67 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 204
[07/30/2021-18:56:39] [V] [TRT] Cast_67 [Cast] inputs: [204 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_67 for ONNX node: Cast_67
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 205 for ONNX tensor: 205
[07/30/2021-18:56:39] [V] [TRT] Cast_67 [Cast] outputs: [205 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_68 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_68 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_68 [Constant] outputs: [206 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Where_69 [Where]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 205
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 206
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 186
[07/30/2021-18:56:39] [V] [TRT] Where_69 [Where] inputs: [205 -> (32, 12, 512, 512)[BOOL]], [206 -> ()[FLOAT]], [186 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 206 for ONNX node: 206
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Where_69 for ONNX node: Where_69
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 207 for ONNX tensor: 207
[07/30/2021-18:56:39] [V] [TRT] Where_69 [Where] outputs: [207 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Softmax_70 [Softmax]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 207
[07/30/2021-18:56:39] [V] [TRT] Softmax_70 [Softmax] inputs: [207 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Softmax_70 for ONNX node: Softmax_70
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 208 for ONNX tensor: 208
[07/30/2021-18:56:39] [V] [TRT] Softmax_70 [Softmax] outputs: [208 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_71 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 208
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 182
[07/30/2021-18:56:39] [V] [TRT] MatMul_71 [MatMul] inputs: [208 -> (32, 12, 512, 512)[FLOAT]], [182 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_71 for ONNX node: MatMul_71
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 209 for ONNX tensor: 209
[07/30/2021-18:56:39] [V] [TRT] MatMul_71 [MatMul] outputs: [209 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_72 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 209
[07/30/2021-18:56:39] [V] [TRT] Transpose_72 [Transpose] inputs: [209 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_72 for ONNX node: Transpose_72
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 210 for ONNX tensor: 210
[07/30/2021-18:56:39] [V] [TRT] Transpose_72 [Transpose] outputs: [210 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_73 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_73 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_73 [Constant] outputs: [213 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_74 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 129
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 213
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_74 [Unsqueeze] inputs: [129 -> ()[INT32]], [213 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_74 for ONNX node: Unsqueeze_74
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 214 for ONNX tensor: 214
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_74 [Unsqueeze] outputs: [214 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_75 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 214
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 951
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 952
[07/30/2021-18:56:39] [V] [TRT] Concat_75 [Concat] inputs: [214 -> (1)[INT32]], [951 -> (1)[INT32]], [952 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 951 for ONNX node: 951
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 952 for ONNX node: 952
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_75 for ONNX node: Concat_75
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 219 for ONNX tensor: 219
[07/30/2021-18:56:39] [V] [TRT] Concat_75 [Concat] outputs: [219 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_76 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 210
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 219
[07/30/2021-18:56:39] [V] [TRT] Reshape_76 [Reshape] inputs: [210 -> (32, 512, 12, 64)[FLOAT]], [219 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_76 for ONNX node: Reshape_76
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 220 for ONNX tensor: 220
[07/30/2021-18:56:39] [V] [TRT] Reshape_76 [Reshape] outputs: [220 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_77 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 220
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 953
[07/30/2021-18:56:39] [V] [TRT] MatMul_77 [MatMul] inputs: [220 -> (32, 512, 768)[FLOAT]], [953 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 953 for ONNX node: 953
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_77 for ONNX node: MatMul_77
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 222 for ONNX tensor: 222
[07/30/2021-18:56:39] [V] [TRT] MatMul_77 [MatMul] outputs: [222 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_78 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 222
[07/30/2021-18:56:39] [V] [TRT] Add_78 [Add] inputs: [transformer.layer.0.attention.out_lin.bias -> (768)[FLOAT]], [222 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.attention.out_lin.bias for ONNX node: transformer.layer.0.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_78 for ONNX node: Add_78
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 223 for ONNX tensor: 223
[07/30/2021-18:56:39] [V] [TRT] Add_78 [Add] outputs: [223 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_79 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 223
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 126
[07/30/2021-18:56:39] [V] [TRT] Add_79 [Add] inputs: [223 -> (32, 512, 768)[FLOAT]], [126 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_79 for ONNX node: Add_79
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 224 for ONNX tensor: 224
[07/30/2021-18:56:39] [V] [TRT] Add_79 [Add] outputs: [224 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_80 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 224
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_80 [ReduceMean] inputs: [224 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_80 for ONNX node: ReduceMean_80
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 225 for ONNX tensor: 225
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_80 [ReduceMean] outputs: [225 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_81 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 224
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 225
[07/30/2021-18:56:39] [V] [TRT] Sub_81 [Sub] inputs: [224 -> (32, 512, 768)[FLOAT]], [225 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_81 for ONNX node: Sub_81
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 226 for ONNX tensor: 226
[07/30/2021-18:56:39] [V] [TRT] Sub_81 [Sub] outputs: [226 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_82 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_82 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_82 [Constant] outputs: [227 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_83 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 226
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 227
[07/30/2021-18:56:39] [V] [TRT] Pow_83 [Pow] inputs: [226 -> (32, 512, 768)[FLOAT]], [227 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 227 for ONNX node: 227
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_83 for ONNX node: Pow_83
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 228 for ONNX tensor: 228
[07/30/2021-18:56:39] [V] [TRT] Pow_83 [Pow] outputs: [228 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_84 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 228
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_84 [ReduceMean] inputs: [228 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_84 for ONNX node: ReduceMean_84
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 229 for ONNX tensor: 229
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_84 [ReduceMean] outputs: [229 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_85 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_85 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_85 [Constant] outputs: [230 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_86 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 229
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 230
[07/30/2021-18:56:39] [V] [TRT] Add_86 [Add] inputs: [229 -> (32, 512, 1)[FLOAT]], [230 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 230 for ONNX node: 230
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_86 for ONNX node: Add_86
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 231 for ONNX tensor: 231
[07/30/2021-18:56:39] [V] [TRT] Add_86 [Add] outputs: [231 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_87 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 231
[07/30/2021-18:56:39] [V] [TRT] Sqrt_87 [Sqrt] inputs: [231 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_87 for ONNX node: Sqrt_87
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 232 for ONNX tensor: 232
[07/30/2021-18:56:39] [V] [TRT] Sqrt_87 [Sqrt] outputs: [232 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_88 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 226
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 232
[07/30/2021-18:56:39] [V] [TRT] Div_88 [Div] inputs: [226 -> (32, 512, 768)[FLOAT]], [232 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_88 for ONNX node: Div_88
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 233 for ONNX tensor: 233
[07/30/2021-18:56:39] [V] [TRT] Div_88 [Div] outputs: [233 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_89 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 233
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_89 [Mul] inputs: [233 -> (32, 512, 768)[FLOAT]], [transformer.layer.0.sa_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.sa_layer_norm.weight for ONNX node: transformer.layer.0.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_89 for ONNX node: Mul_89
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 234 for ONNX tensor: 234
[07/30/2021-18:56:39] [V] [TRT] Mul_89 [Mul] outputs: [234 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_90 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 234
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_90 [Add] inputs: [234 -> (32, 512, 768)[FLOAT]], [transformer.layer.0.sa_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.sa_layer_norm.bias for ONNX node: transformer.layer.0.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_90 for ONNX node: Add_90
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 235 for ONNX tensor: 235
[07/30/2021-18:56:39] [V] [TRT] Add_90 [Add] outputs: [235 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_91 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 235
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 954
[07/30/2021-18:56:39] [V] [TRT] MatMul_91 [MatMul] inputs: [235 -> (32, 512, 768)[FLOAT]], [954 -> (768, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 954 for ONNX node: 954
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_91 for ONNX node: MatMul_91
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 237 for ONNX tensor: 237
[07/30/2021-18:56:39] [V] [TRT] MatMul_91 [MatMul] outputs: [237 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_92 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 237
[07/30/2021-18:56:39] [V] [TRT] Add_92 [Add] inputs: [transformer.layer.0.ffn.lin1.bias -> (3072)[FLOAT]], [237 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.ffn.lin1.bias for ONNX node: transformer.layer.0.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_92 for ONNX node: Add_92
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 238 for ONNX tensor: 238
[07/30/2021-18:56:39] [V] [TRT] Add_92 [Add] outputs: [238 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_93 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_93 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_93 [Constant] outputs: [239 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_94 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 238
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 239
[07/30/2021-18:56:39] [V] [TRT] Div_94 [Div] inputs: [238 -> (32, 512, 3072)[FLOAT]], [239 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 239 for ONNX node: 239
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_94 for ONNX node: Div_94
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 240 for ONNX tensor: 240
[07/30/2021-18:56:39] [V] [TRT] Div_94 [Div] outputs: [240 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Erf_95 [Erf]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 240
[07/30/2021-18:56:39] [V] [TRT] Erf_95 [Erf] inputs: [240 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Erf_95 for ONNX node: Erf_95
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 241 for ONNX tensor: 241
[07/30/2021-18:56:39] [V] [TRT] Erf_95 [Erf] outputs: [241 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_96 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_96 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_96 [Constant] outputs: [242 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_97 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 241
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 242
[07/30/2021-18:56:39] [V] [TRT] Add_97 [Add] inputs: [241 -> (32, 512, 3072)[FLOAT]], [242 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 242 for ONNX node: 242
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_97 for ONNX node: Add_97
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 243 for ONNX tensor: 243
[07/30/2021-18:56:39] [V] [TRT] Add_97 [Add] outputs: [243 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_98 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 238
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 243
[07/30/2021-18:56:39] [V] [TRT] Mul_98 [Mul] inputs: [238 -> (32, 512, 3072)[FLOAT]], [243 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_98 for ONNX node: Mul_98
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 244 for ONNX tensor: 244
[07/30/2021-18:56:39] [V] [TRT] Mul_98 [Mul] outputs: [244 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_99 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_99 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_99 [Constant] outputs: [245 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_100 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 244
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 245
[07/30/2021-18:56:39] [V] [TRT] Mul_100 [Mul] inputs: [244 -> (32, 512, 3072)[FLOAT]], [245 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 245 for ONNX node: 245
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_100 for ONNX node: Mul_100
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 246 for ONNX tensor: 246
[07/30/2021-18:56:39] [V] [TRT] Mul_100 [Mul] outputs: [246 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_101 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 246
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 955
[07/30/2021-18:56:39] [V] [TRT] MatMul_101 [MatMul] inputs: [246 -> (32, 512, 3072)[FLOAT]], [955 -> (3072, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 955 for ONNX node: 955
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_101 for ONNX node: MatMul_101
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 248 for ONNX tensor: 248
[07/30/2021-18:56:39] [V] [TRT] MatMul_101 [MatMul] outputs: [248 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_102 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 248
[07/30/2021-18:56:39] [V] [TRT] Add_102 [Add] inputs: [transformer.layer.0.ffn.lin2.bias -> (768)[FLOAT]], [248 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.ffn.lin2.bias for ONNX node: transformer.layer.0.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_102 for ONNX node: Add_102
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 249 for ONNX tensor: 249
[07/30/2021-18:56:39] [V] [TRT] Add_102 [Add] outputs: [249 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_103 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 249
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 235
[07/30/2021-18:56:39] [V] [TRT] Add_103 [Add] inputs: [249 -> (32, 512, 768)[FLOAT]], [235 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_103 for ONNX node: Add_103
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 250 for ONNX tensor: 250
[07/30/2021-18:56:39] [V] [TRT] Add_103 [Add] outputs: [250 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_104 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 250
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_104 [ReduceMean] inputs: [250 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_104 for ONNX node: ReduceMean_104
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 251 for ONNX tensor: 251
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_104 [ReduceMean] outputs: [251 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_105 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 250
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 251
[07/30/2021-18:56:39] [V] [TRT] Sub_105 [Sub] inputs: [250 -> (32, 512, 768)[FLOAT]], [251 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_105 for ONNX node: Sub_105
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 252 for ONNX tensor: 252
[07/30/2021-18:56:39] [V] [TRT] Sub_105 [Sub] outputs: [252 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_106 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_106 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_106 [Constant] outputs: [253 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_107 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 252
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 253
[07/30/2021-18:56:39] [V] [TRT] Pow_107 [Pow] inputs: [252 -> (32, 512, 768)[FLOAT]], [253 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 253 for ONNX node: 253
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_107 for ONNX node: Pow_107
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 254 for ONNX tensor: 254
[07/30/2021-18:56:39] [V] [TRT] Pow_107 [Pow] outputs: [254 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_108 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 254
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_108 [ReduceMean] inputs: [254 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_108 for ONNX node: ReduceMean_108
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 255 for ONNX tensor: 255
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_108 [ReduceMean] outputs: [255 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_109 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_109 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_109 [Constant] outputs: [256 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_110 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 255
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 256
[07/30/2021-18:56:39] [V] [TRT] Add_110 [Add] inputs: [255 -> (32, 512, 1)[FLOAT]], [256 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 256 for ONNX node: 256
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_110 for ONNX node: Add_110
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 257 for ONNX tensor: 257
[07/30/2021-18:56:39] [V] [TRT] Add_110 [Add] outputs: [257 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_111 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 257
[07/30/2021-18:56:39] [V] [TRT] Sqrt_111 [Sqrt] inputs: [257 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_111 for ONNX node: Sqrt_111
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 258 for ONNX tensor: 258
[07/30/2021-18:56:39] [V] [TRT] Sqrt_111 [Sqrt] outputs: [258 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_112 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 252
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 258
[07/30/2021-18:56:39] [V] [TRT] Div_112 [Div] inputs: [252 -> (32, 512, 768)[FLOAT]], [258 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_112 for ONNX node: Div_112
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 259 for ONNX tensor: 259
[07/30/2021-18:56:39] [V] [TRT] Div_112 [Div] outputs: [259 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_113 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 259
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_113 [Mul] inputs: [259 -> (32, 512, 768)[FLOAT]], [transformer.layer.0.output_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.output_layer_norm.weight for ONNX node: transformer.layer.0.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_113 for ONNX node: Mul_113
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 260 for ONNX tensor: 260
[07/30/2021-18:56:39] [V] [TRT] Mul_113 [Mul] outputs: [260 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_114 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 260
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.0.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_114 [Add] inputs: [260 -> (32, 512, 768)[FLOAT]], [transformer.layer.0.output_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.0.output_layer_norm.bias for ONNX node: transformer.layer.0.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_114 for ONNX node: Add_114
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 261 for ONNX tensor: 261
[07/30/2021-18:56:39] [V] [TRT] Add_114 [Add] outputs: [261 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_115 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 261
[07/30/2021-18:56:39] [V] [TRT] Shape_115 [Shape] inputs: [261 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_115 for ONNX node: Shape_115
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 262 for ONNX tensor: 262
[07/30/2021-18:56:39] [V] [TRT] Shape_115 [Shape] outputs: [262 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_116 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_116 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_116 [Constant] outputs: [263 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_117 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 262
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 263
[07/30/2021-18:56:39] [V] [TRT] Gather_117 [Gather] inputs: [262 -> (3)[INT32]], [263 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 263 for ONNX node: 263
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_117 for ONNX node: Gather_117
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 264 for ONNX tensor: 264
[07/30/2021-18:56:39] [V] [TRT] Gather_117 [Gather] outputs: [264 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_118 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 261
[07/30/2021-18:56:39] [V] [TRT] Shape_118 [Shape] inputs: [261 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_118 for ONNX node: Shape_118
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 265 for ONNX tensor: 265
[07/30/2021-18:56:39] [V] [TRT] Shape_118 [Shape] outputs: [265 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_119 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_119 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_119 [Constant] outputs: [266 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_120 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 265
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 266
[07/30/2021-18:56:39] [V] [TRT] Gather_120 [Gather] inputs: [265 -> (3)[INT32]], [266 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 266 for ONNX node: 266
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_120 for ONNX node: Gather_120
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 267 for ONNX tensor: 267
[07/30/2021-18:56:39] [V] [TRT] Gather_120 [Gather] outputs: [267 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_121 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 261
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 956
[07/30/2021-18:56:39] [V] [TRT] MatMul_121 [MatMul] inputs: [261 -> (32, 512, 768)[FLOAT]], [956 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 956 for ONNX node: 956
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_121 for ONNX node: MatMul_121
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 269 for ONNX tensor: 269
[07/30/2021-18:56:39] [V] [TRT] MatMul_121 [MatMul] outputs: [269 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_122 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 269
[07/30/2021-18:56:39] [V] [TRT] Add_122 [Add] inputs: [transformer.layer.1.attention.q_lin.bias -> (768)[FLOAT]], [269 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.attention.q_lin.bias for ONNX node: transformer.layer.1.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_122 for ONNX node: Add_122
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 270 for ONNX tensor: 270
[07/30/2021-18:56:39] [V] [TRT] Add_122 [Add] outputs: [270 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_123 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_123 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_123 [Constant] outputs: [274 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_124 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 264
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 274
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_124 [Unsqueeze] inputs: [264 -> ()[INT32]], [274 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_124 for ONNX node: Unsqueeze_124
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 275 for ONNX tensor: 275
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_124 [Unsqueeze] outputs: [275 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_125 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 275
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 957
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 958
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 959
[07/30/2021-18:56:39] [V] [TRT] Concat_125 [Concat] inputs: [275 -> (1)[INT32]], [957 -> (1)[INT32]], [958 -> (1)[INT32]], [959 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 957 for ONNX node: 957
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 958 for ONNX node: 958
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 959 for ONNX node: 959
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_125 for ONNX node: Concat_125
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 282 for ONNX tensor: 282
[07/30/2021-18:56:39] [V] [TRT] Concat_125 [Concat] outputs: [282 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_126 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 270
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 282
[07/30/2021-18:56:39] [V] [TRT] Reshape_126 [Reshape] inputs: [270 -> (32, 512, 768)[FLOAT]], [282 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_126 for ONNX node: Reshape_126
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 283 for ONNX tensor: 283
[07/30/2021-18:56:39] [V] [TRT] Reshape_126 [Reshape] outputs: [283 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_127 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 283
[07/30/2021-18:56:39] [V] [TRT] Transpose_127 [Transpose] inputs: [283 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_127 for ONNX node: Transpose_127
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 284 for ONNX tensor: 284
[07/30/2021-18:56:39] [V] [TRT] Transpose_127 [Transpose] outputs: [284 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_128 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 261
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 960
[07/30/2021-18:56:39] [V] [TRT] MatMul_128 [MatMul] inputs: [261 -> (32, 512, 768)[FLOAT]], [960 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 960 for ONNX node: 960
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_128 for ONNX node: MatMul_128
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 286 for ONNX tensor: 286
[07/30/2021-18:56:39] [V] [TRT] MatMul_128 [MatMul] outputs: [286 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_129 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 286
[07/30/2021-18:56:39] [V] [TRT] Add_129 [Add] inputs: [transformer.layer.1.attention.k_lin.bias -> (768)[FLOAT]], [286 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.attention.k_lin.bias for ONNX node: transformer.layer.1.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_129 for ONNX node: Add_129
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 287 for ONNX tensor: 287
[07/30/2021-18:56:39] [V] [TRT] Add_129 [Add] outputs: [287 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_130 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_130 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_130 [Constant] outputs: [291 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_131 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 264
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 291
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_131 [Unsqueeze] inputs: [264 -> ()[INT32]], [291 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_131 for ONNX node: Unsqueeze_131
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 292 for ONNX tensor: 292
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_131 [Unsqueeze] outputs: [292 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_132 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 292
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 961
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 962
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 963
[07/30/2021-18:56:39] [V] [TRT] Concat_132 [Concat] inputs: [292 -> (1)[INT32]], [961 -> (1)[INT32]], [962 -> (1)[INT32]], [963 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 961 for ONNX node: 961
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 962 for ONNX node: 962
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 963 for ONNX node: 963
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_132 for ONNX node: Concat_132
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 299 for ONNX tensor: 299
[07/30/2021-18:56:39] [V] [TRT] Concat_132 [Concat] outputs: [299 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_133 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 287
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 299
[07/30/2021-18:56:39] [V] [TRT] Reshape_133 [Reshape] inputs: [287 -> (32, 512, 768)[FLOAT]], [299 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_133 for ONNX node: Reshape_133
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 300 for ONNX tensor: 300
[07/30/2021-18:56:39] [V] [TRT] Reshape_133 [Reshape] outputs: [300 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_134 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 261
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 964
[07/30/2021-18:56:39] [V] [TRT] MatMul_134 [MatMul] inputs: [261 -> (32, 512, 768)[FLOAT]], [964 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 964 for ONNX node: 964
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_134 for ONNX node: MatMul_134
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 302 for ONNX tensor: 302
[07/30/2021-18:56:39] [V] [TRT] MatMul_134 [MatMul] outputs: [302 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_135 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 302
[07/30/2021-18:56:39] [V] [TRT] Add_135 [Add] inputs: [transformer.layer.1.attention.v_lin.bias -> (768)[FLOAT]], [302 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.attention.v_lin.bias for ONNX node: transformer.layer.1.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_135 for ONNX node: Add_135
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 303 for ONNX tensor: 303
[07/30/2021-18:56:39] [V] [TRT] Add_135 [Add] outputs: [303 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_136 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_136 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_136 [Constant] outputs: [307 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_137 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 264
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 307
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_137 [Unsqueeze] inputs: [264 -> ()[INT32]], [307 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_137 for ONNX node: Unsqueeze_137
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 308 for ONNX tensor: 308
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_137 [Unsqueeze] outputs: [308 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_138 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 308
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 965
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 966
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 967
[07/30/2021-18:56:39] [V] [TRT] Concat_138 [Concat] inputs: [308 -> (1)[INT32]], [965 -> (1)[INT32]], [966 -> (1)[INT32]], [967 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 965 for ONNX node: 965
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 966 for ONNX node: 966
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 967 for ONNX node: 967
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_138 for ONNX node: Concat_138
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 315 for ONNX tensor: 315
[07/30/2021-18:56:39] [V] [TRT] Concat_138 [Concat] outputs: [315 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_139 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 303
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 315
[07/30/2021-18:56:39] [V] [TRT] Reshape_139 [Reshape] inputs: [303 -> (32, 512, 768)[FLOAT]], [315 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_139 for ONNX node: Reshape_139
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 316 for ONNX tensor: 316
[07/30/2021-18:56:39] [V] [TRT] Reshape_139 [Reshape] outputs: [316 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_140 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 316
[07/30/2021-18:56:39] [V] [TRT] Transpose_140 [Transpose] inputs: [316 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_140 for ONNX node: Transpose_140
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 317 for ONNX tensor: 317
[07/30/2021-18:56:39] [V] [TRT] Transpose_140 [Transpose] outputs: [317 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_141 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_141 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_141 [Constant] outputs: [318 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_142 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 284
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 318
[07/30/2021-18:56:39] [V] [TRT] Div_142 [Div] inputs: [284 -> (32, 12, 512, 64)[FLOAT]], [318 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 318 for ONNX node: 318
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_142 for ONNX node: Div_142
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 319 for ONNX tensor: 319
[07/30/2021-18:56:39] [V] [TRT] Div_142 [Div] outputs: [319 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_143 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 300
[07/30/2021-18:56:39] [V] [TRT] Transpose_143 [Transpose] inputs: [300 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_143 for ONNX node: Transpose_143
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 320 for ONNX tensor: 320
[07/30/2021-18:56:39] [V] [TRT] Transpose_143 [Transpose] outputs: [320 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_144 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 319
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 320
[07/30/2021-18:56:39] [V] [TRT] MatMul_144 [MatMul] inputs: [319 -> (32, 12, 512, 64)[FLOAT]], [320 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_144 for ONNX node: MatMul_144
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 321 for ONNX tensor: 321
[07/30/2021-18:56:39] [V] [TRT] MatMul_144 [MatMul] outputs: [321 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_145 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_145 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_145 [Constant] outputs: [322 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Equal_146 [Equal]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 322
[07/30/2021-18:56:39] [V] [TRT] Equal_146 [Equal] inputs: [1 -> (32, 512)[INT32]], [322 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 322 for ONNX node: 322
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Equal_146 for ONNX node: Equal_146
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 323 for ONNX tensor: 323
[07/30/2021-18:56:39] [V] [TRT] Equal_146 [Equal] outputs: [323 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_147 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 323
[07/30/2021-18:56:39] [V] [TRT] Cast_147 [Cast] inputs: [323 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_147 for ONNX node: Cast_147
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 324 for ONNX tensor: 324
[07/30/2021-18:56:39] [V] [TRT] Cast_147 [Cast] outputs: [324 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_148 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_148 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_148 [Constant] outputs: [327 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_149 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 264
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 327
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_149 [Unsqueeze] inputs: [264 -> ()[INT32]], [327 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_149 for ONNX node: Unsqueeze_149
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 328 for ONNX tensor: 328
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_149 [Unsqueeze] outputs: [328 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_150 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_150 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_150 [Constant] outputs: [333 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_151 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 267
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 333
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_151 [Unsqueeze] inputs: [267 -> ()[INT32]], [333 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_151 for ONNX node: Unsqueeze_151
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 334 for ONNX tensor: 334
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_151 [Unsqueeze] outputs: [334 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_152 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 328
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 968
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 969
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 334
[07/30/2021-18:56:39] [V] [TRT] Concat_152 [Concat] inputs: [328 -> (1)[INT32]], [968 -> (1)[INT32]], [969 -> (1)[INT32]], [334 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 968 for ONNX node: 968
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 969 for ONNX node: 969
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_152 for ONNX node: Concat_152
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 335 for ONNX tensor: 335
[07/30/2021-18:56:39] [V] [TRT] Concat_152 [Concat] outputs: [335 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_153 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 324
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 335
[07/30/2021-18:56:39] [V] [TRT] Reshape_153 [Reshape] inputs: [324 -> (32, 512)[INT32]], [335 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_153 for ONNX node: Reshape_153
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 336 for ONNX tensor: 336
[07/30/2021-18:56:39] [V] [TRT] Reshape_153 [Reshape] outputs: [336 -> (32, 1, 1, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_154 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 321
[07/30/2021-18:56:39] [V] [TRT] Shape_154 [Shape] inputs: [321 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_154 for ONNX node: Shape_154
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 337 for ONNX tensor: 337
[07/30/2021-18:56:39] [V] [TRT] Shape_154 [Shape] outputs: [337 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Expand_155 [Expand]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 336
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 337
[07/30/2021-18:56:39] [V] [TRT] Expand_155 [Expand] inputs: [336 -> (32, 1, 1, 512)[INT32]], [337 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Expand_155 for ONNX node: Expand_155
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 338 for ONNX tensor: 338
[07/30/2021-18:56:39] [V] [TRT] Expand_155 [Expand] outputs: [338 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_156 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 338
[07/30/2021-18:56:39] [V] [TRT] Cast_156 [Cast] inputs: [338 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_156 for ONNX node: Cast_156
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 339 for ONNX tensor: 339
[07/30/2021-18:56:39] [V] [TRT] Cast_156 [Cast] outputs: [339 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_157 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 339
[07/30/2021-18:56:39] [V] [TRT] Cast_157 [Cast] inputs: [339 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_157 for ONNX node: Cast_157
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 340 for ONNX tensor: 340
[07/30/2021-18:56:39] [V] [TRT] Cast_157 [Cast] outputs: [340 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_158 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_158 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_158 [Constant] outputs: [341 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Where_159 [Where]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 340
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 341
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 321
[07/30/2021-18:56:39] [V] [TRT] Where_159 [Where] inputs: [340 -> (32, 12, 512, 512)[BOOL]], [341 -> ()[FLOAT]], [321 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 341 for ONNX node: 341
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Where_159 for ONNX node: Where_159
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 342 for ONNX tensor: 342
[07/30/2021-18:56:39] [V] [TRT] Where_159 [Where] outputs: [342 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Softmax_160 [Softmax]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 342
[07/30/2021-18:56:39] [V] [TRT] Softmax_160 [Softmax] inputs: [342 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Softmax_160 for ONNX node: Softmax_160
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 343 for ONNX tensor: 343
[07/30/2021-18:56:39] [V] [TRT] Softmax_160 [Softmax] outputs: [343 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_161 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 343
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 317
[07/30/2021-18:56:39] [V] [TRT] MatMul_161 [MatMul] inputs: [343 -> (32, 12, 512, 512)[FLOAT]], [317 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_161 for ONNX node: MatMul_161
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 344 for ONNX tensor: 344
[07/30/2021-18:56:39] [V] [TRT] MatMul_161 [MatMul] outputs: [344 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_162 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 344
[07/30/2021-18:56:39] [V] [TRT] Transpose_162 [Transpose] inputs: [344 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_162 for ONNX node: Transpose_162
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 345 for ONNX tensor: 345
[07/30/2021-18:56:39] [V] [TRT] Transpose_162 [Transpose] outputs: [345 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_163 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_163 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_163 [Constant] outputs: [348 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_164 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 264
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 348
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_164 [Unsqueeze] inputs: [264 -> ()[INT32]], [348 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_164 for ONNX node: Unsqueeze_164
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 349 for ONNX tensor: 349
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_164 [Unsqueeze] outputs: [349 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_165 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 349
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 970
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 971
[07/30/2021-18:56:39] [V] [TRT] Concat_165 [Concat] inputs: [349 -> (1)[INT32]], [970 -> (1)[INT32]], [971 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 970 for ONNX node: 970
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 971 for ONNX node: 971
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_165 for ONNX node: Concat_165
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 354 for ONNX tensor: 354
[07/30/2021-18:56:39] [V] [TRT] Concat_165 [Concat] outputs: [354 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_166 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 345
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 354
[07/30/2021-18:56:39] [V] [TRT] Reshape_166 [Reshape] inputs: [345 -> (32, 512, 12, 64)[FLOAT]], [354 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_166 for ONNX node: Reshape_166
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 355 for ONNX tensor: 355
[07/30/2021-18:56:39] [V] [TRT] Reshape_166 [Reshape] outputs: [355 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_167 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 355
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 972
[07/30/2021-18:56:39] [V] [TRT] MatMul_167 [MatMul] inputs: [355 -> (32, 512, 768)[FLOAT]], [972 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 972 for ONNX node: 972
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_167 for ONNX node: MatMul_167
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 357 for ONNX tensor: 357
[07/30/2021-18:56:39] [V] [TRT] MatMul_167 [MatMul] outputs: [357 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_168 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 357
[07/30/2021-18:56:39] [V] [TRT] Add_168 [Add] inputs: [transformer.layer.1.attention.out_lin.bias -> (768)[FLOAT]], [357 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.attention.out_lin.bias for ONNX node: transformer.layer.1.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_168 for ONNX node: Add_168
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 358 for ONNX tensor: 358
[07/30/2021-18:56:39] [V] [TRT] Add_168 [Add] outputs: [358 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_169 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 358
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 261
[07/30/2021-18:56:39] [V] [TRT] Add_169 [Add] inputs: [358 -> (32, 512, 768)[FLOAT]], [261 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_169 for ONNX node: Add_169
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 359 for ONNX tensor: 359
[07/30/2021-18:56:39] [V] [TRT] Add_169 [Add] outputs: [359 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_170 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 359
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_170 [ReduceMean] inputs: [359 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_170 for ONNX node: ReduceMean_170
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 360 for ONNX tensor: 360
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_170 [ReduceMean] outputs: [360 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_171 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 359
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 360
[07/30/2021-18:56:39] [V] [TRT] Sub_171 [Sub] inputs: [359 -> (32, 512, 768)[FLOAT]], [360 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_171 for ONNX node: Sub_171
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 361 for ONNX tensor: 361
[07/30/2021-18:56:39] [V] [TRT] Sub_171 [Sub] outputs: [361 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_172 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_172 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_172 [Constant] outputs: [362 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_173 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 361
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 362
[07/30/2021-18:56:39] [V] [TRT] Pow_173 [Pow] inputs: [361 -> (32, 512, 768)[FLOAT]], [362 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 362 for ONNX node: 362
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_173 for ONNX node: Pow_173
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 363 for ONNX tensor: 363
[07/30/2021-18:56:39] [V] [TRT] Pow_173 [Pow] outputs: [363 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_174 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 363
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_174 [ReduceMean] inputs: [363 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_174 for ONNX node: ReduceMean_174
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 364 for ONNX tensor: 364
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_174 [ReduceMean] outputs: [364 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_175 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_175 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_175 [Constant] outputs: [365 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_176 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 364
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 365
[07/30/2021-18:56:39] [V] [TRT] Add_176 [Add] inputs: [364 -> (32, 512, 1)[FLOAT]], [365 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 365 for ONNX node: 365
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_176 for ONNX node: Add_176
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 366 for ONNX tensor: 366
[07/30/2021-18:56:39] [V] [TRT] Add_176 [Add] outputs: [366 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_177 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 366
[07/30/2021-18:56:39] [V] [TRT] Sqrt_177 [Sqrt] inputs: [366 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_177 for ONNX node: Sqrt_177
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 367 for ONNX tensor: 367
[07/30/2021-18:56:39] [V] [TRT] Sqrt_177 [Sqrt] outputs: [367 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_178 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 361
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 367
[07/30/2021-18:56:39] [V] [TRT] Div_178 [Div] inputs: [361 -> (32, 512, 768)[FLOAT]], [367 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_178 for ONNX node: Div_178
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 368 for ONNX tensor: 368
[07/30/2021-18:56:39] [V] [TRT] Div_178 [Div] outputs: [368 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_179 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 368
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_179 [Mul] inputs: [368 -> (32, 512, 768)[FLOAT]], [transformer.layer.1.sa_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.sa_layer_norm.weight for ONNX node: transformer.layer.1.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_179 for ONNX node: Mul_179
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 369 for ONNX tensor: 369
[07/30/2021-18:56:39] [V] [TRT] Mul_179 [Mul] outputs: [369 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_180 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 369
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_180 [Add] inputs: [369 -> (32, 512, 768)[FLOAT]], [transformer.layer.1.sa_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.sa_layer_norm.bias for ONNX node: transformer.layer.1.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_180 for ONNX node: Add_180
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 370 for ONNX tensor: 370
[07/30/2021-18:56:39] [V] [TRT] Add_180 [Add] outputs: [370 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_181 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 370
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 973
[07/30/2021-18:56:39] [V] [TRT] MatMul_181 [MatMul] inputs: [370 -> (32, 512, 768)[FLOAT]], [973 -> (768, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 973 for ONNX node: 973
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_181 for ONNX node: MatMul_181
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 372 for ONNX tensor: 372
[07/30/2021-18:56:39] [V] [TRT] MatMul_181 [MatMul] outputs: [372 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_182 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 372
[07/30/2021-18:56:39] [V] [TRT] Add_182 [Add] inputs: [transformer.layer.1.ffn.lin1.bias -> (3072)[FLOAT]], [372 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.ffn.lin1.bias for ONNX node: transformer.layer.1.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_182 for ONNX node: Add_182
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 373 for ONNX tensor: 373
[07/30/2021-18:56:39] [V] [TRT] Add_182 [Add] outputs: [373 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_183 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_183 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_183 [Constant] outputs: [374 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_184 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 373
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 374
[07/30/2021-18:56:39] [V] [TRT] Div_184 [Div] inputs: [373 -> (32, 512, 3072)[FLOAT]], [374 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 374 for ONNX node: 374
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_184 for ONNX node: Div_184
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 375 for ONNX tensor: 375
[07/30/2021-18:56:39] [V] [TRT] Div_184 [Div] outputs: [375 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Erf_185 [Erf]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 375
[07/30/2021-18:56:39] [V] [TRT] Erf_185 [Erf] inputs: [375 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Erf_185 for ONNX node: Erf_185
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 376 for ONNX tensor: 376
[07/30/2021-18:56:39] [V] [TRT] Erf_185 [Erf] outputs: [376 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_186 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_186 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_186 [Constant] outputs: [377 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_187 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 376
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 377
[07/30/2021-18:56:39] [V] [TRT] Add_187 [Add] inputs: [376 -> (32, 512, 3072)[FLOAT]], [377 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 377 for ONNX node: 377
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_187 for ONNX node: Add_187
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 378 for ONNX tensor: 378
[07/30/2021-18:56:39] [V] [TRT] Add_187 [Add] outputs: [378 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_188 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 373
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 378
[07/30/2021-18:56:39] [V] [TRT] Mul_188 [Mul] inputs: [373 -> (32, 512, 3072)[FLOAT]], [378 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_188 for ONNX node: Mul_188
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 379 for ONNX tensor: 379
[07/30/2021-18:56:39] [V] [TRT] Mul_188 [Mul] outputs: [379 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_189 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_189 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_189 [Constant] outputs: [380 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_190 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 379
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 380
[07/30/2021-18:56:39] [V] [TRT] Mul_190 [Mul] inputs: [379 -> (32, 512, 3072)[FLOAT]], [380 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 380 for ONNX node: 380
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_190 for ONNX node: Mul_190
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 381 for ONNX tensor: 381
[07/30/2021-18:56:39] [V] [TRT] Mul_190 [Mul] outputs: [381 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_191 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 381
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 974
[07/30/2021-18:56:39] [V] [TRT] MatMul_191 [MatMul] inputs: [381 -> (32, 512, 3072)[FLOAT]], [974 -> (3072, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 974 for ONNX node: 974
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_191 for ONNX node: MatMul_191
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 383 for ONNX tensor: 383
[07/30/2021-18:56:39] [V] [TRT] MatMul_191 [MatMul] outputs: [383 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_192 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 383
[07/30/2021-18:56:39] [V] [TRT] Add_192 [Add] inputs: [transformer.layer.1.ffn.lin2.bias -> (768)[FLOAT]], [383 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.ffn.lin2.bias for ONNX node: transformer.layer.1.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_192 for ONNX node: Add_192
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 384 for ONNX tensor: 384
[07/30/2021-18:56:39] [V] [TRT] Add_192 [Add] outputs: [384 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_193 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 384
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 370
[07/30/2021-18:56:39] [V] [TRT] Add_193 [Add] inputs: [384 -> (32, 512, 768)[FLOAT]], [370 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_193 for ONNX node: Add_193
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 385 for ONNX tensor: 385
[07/30/2021-18:56:39] [V] [TRT] Add_193 [Add] outputs: [385 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_194 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 385
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_194 [ReduceMean] inputs: [385 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_194 for ONNX node: ReduceMean_194
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 386 for ONNX tensor: 386
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_194 [ReduceMean] outputs: [386 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_195 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 385
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 386
[07/30/2021-18:56:39] [V] [TRT] Sub_195 [Sub] inputs: [385 -> (32, 512, 768)[FLOAT]], [386 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_195 for ONNX node: Sub_195
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 387 for ONNX tensor: 387
[07/30/2021-18:56:39] [V] [TRT] Sub_195 [Sub] outputs: [387 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_196 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_196 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_196 [Constant] outputs: [388 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_197 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 387
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 388
[07/30/2021-18:56:39] [V] [TRT] Pow_197 [Pow] inputs: [387 -> (32, 512, 768)[FLOAT]], [388 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 388 for ONNX node: 388
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_197 for ONNX node: Pow_197
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 389 for ONNX tensor: 389
[07/30/2021-18:56:39] [V] [TRT] Pow_197 [Pow] outputs: [389 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_198 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 389
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_198 [ReduceMean] inputs: [389 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_198 for ONNX node: ReduceMean_198
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 390 for ONNX tensor: 390
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_198 [ReduceMean] outputs: [390 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_199 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_199 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_199 [Constant] outputs: [391 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_200 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 390
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 391
[07/30/2021-18:56:39] [V] [TRT] Add_200 [Add] inputs: [390 -> (32, 512, 1)[FLOAT]], [391 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 391 for ONNX node: 391
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_200 for ONNX node: Add_200
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 392 for ONNX tensor: 392
[07/30/2021-18:56:39] [V] [TRT] Add_200 [Add] outputs: [392 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_201 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 392
[07/30/2021-18:56:39] [V] [TRT] Sqrt_201 [Sqrt] inputs: [392 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_201 for ONNX node: Sqrt_201
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 393 for ONNX tensor: 393
[07/30/2021-18:56:39] [V] [TRT] Sqrt_201 [Sqrt] outputs: [393 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_202 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 387
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 393
[07/30/2021-18:56:39] [V] [TRT] Div_202 [Div] inputs: [387 -> (32, 512, 768)[FLOAT]], [393 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_202 for ONNX node: Div_202
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 394 for ONNX tensor: 394
[07/30/2021-18:56:39] [V] [TRT] Div_202 [Div] outputs: [394 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_203 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 394
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_203 [Mul] inputs: [394 -> (32, 512, 768)[FLOAT]], [transformer.layer.1.output_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.output_layer_norm.weight for ONNX node: transformer.layer.1.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_203 for ONNX node: Mul_203
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 395 for ONNX tensor: 395
[07/30/2021-18:56:39] [V] [TRT] Mul_203 [Mul] outputs: [395 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_204 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 395
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.1.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_204 [Add] inputs: [395 -> (32, 512, 768)[FLOAT]], [transformer.layer.1.output_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.1.output_layer_norm.bias for ONNX node: transformer.layer.1.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_204 for ONNX node: Add_204
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 396 for ONNX tensor: 396
[07/30/2021-18:56:39] [V] [TRT] Add_204 [Add] outputs: [396 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_205 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 396
[07/30/2021-18:56:39] [V] [TRT] Shape_205 [Shape] inputs: [396 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_205 for ONNX node: Shape_205
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 397 for ONNX tensor: 397
[07/30/2021-18:56:39] [V] [TRT] Shape_205 [Shape] outputs: [397 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_206 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_206 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_206 [Constant] outputs: [398 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_207 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 397
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 398
[07/30/2021-18:56:39] [V] [TRT] Gather_207 [Gather] inputs: [397 -> (3)[INT32]], [398 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 398 for ONNX node: 398
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_207 for ONNX node: Gather_207
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 399 for ONNX tensor: 399
[07/30/2021-18:56:39] [V] [TRT] Gather_207 [Gather] outputs: [399 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_208 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 396
[07/30/2021-18:56:39] [V] [TRT] Shape_208 [Shape] inputs: [396 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_208 for ONNX node: Shape_208
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 400 for ONNX tensor: 400
[07/30/2021-18:56:39] [V] [TRT] Shape_208 [Shape] outputs: [400 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_209 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_209 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_209 [Constant] outputs: [401 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_210 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 400
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 401
[07/30/2021-18:56:39] [V] [TRT] Gather_210 [Gather] inputs: [400 -> (3)[INT32]], [401 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 401 for ONNX node: 401
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_210 for ONNX node: Gather_210
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 402 for ONNX tensor: 402
[07/30/2021-18:56:39] [V] [TRT] Gather_210 [Gather] outputs: [402 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_211 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 396
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 975
[07/30/2021-18:56:39] [V] [TRT] MatMul_211 [MatMul] inputs: [396 -> (32, 512, 768)[FLOAT]], [975 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 975 for ONNX node: 975
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_211 for ONNX node: MatMul_211
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 404 for ONNX tensor: 404
[07/30/2021-18:56:39] [V] [TRT] MatMul_211 [MatMul] outputs: [404 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_212 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 404
[07/30/2021-18:56:39] [V] [TRT] Add_212 [Add] inputs: [transformer.layer.2.attention.q_lin.bias -> (768)[FLOAT]], [404 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.attention.q_lin.bias for ONNX node: transformer.layer.2.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_212 for ONNX node: Add_212
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 405 for ONNX tensor: 405
[07/30/2021-18:56:39] [V] [TRT] Add_212 [Add] outputs: [405 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_213 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_213 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_213 [Constant] outputs: [409 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_214 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 399
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 409
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_214 [Unsqueeze] inputs: [399 -> ()[INT32]], [409 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_214 for ONNX node: Unsqueeze_214
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 410 for ONNX tensor: 410
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_214 [Unsqueeze] outputs: [410 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_215 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 410
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 976
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 977
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 978
[07/30/2021-18:56:39] [V] [TRT] Concat_215 [Concat] inputs: [410 -> (1)[INT32]], [976 -> (1)[INT32]], [977 -> (1)[INT32]], [978 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 976 for ONNX node: 976
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 977 for ONNX node: 977
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 978 for ONNX node: 978
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_215 for ONNX node: Concat_215
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 417 for ONNX tensor: 417
[07/30/2021-18:56:39] [V] [TRT] Concat_215 [Concat] outputs: [417 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_216 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 405
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 417
[07/30/2021-18:56:39] [V] [TRT] Reshape_216 [Reshape] inputs: [405 -> (32, 512, 768)[FLOAT]], [417 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_216 for ONNX node: Reshape_216
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 418 for ONNX tensor: 418
[07/30/2021-18:56:39] [V] [TRT] Reshape_216 [Reshape] outputs: [418 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_217 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 418
[07/30/2021-18:56:39] [V] [TRT] Transpose_217 [Transpose] inputs: [418 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_217 for ONNX node: Transpose_217
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 419 for ONNX tensor: 419
[07/30/2021-18:56:39] [V] [TRT] Transpose_217 [Transpose] outputs: [419 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_218 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 396
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 979
[07/30/2021-18:56:39] [V] [TRT] MatMul_218 [MatMul] inputs: [396 -> (32, 512, 768)[FLOAT]], [979 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 979 for ONNX node: 979
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_218 for ONNX node: MatMul_218
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 421 for ONNX tensor: 421
[07/30/2021-18:56:39] [V] [TRT] MatMul_218 [MatMul] outputs: [421 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_219 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 421
[07/30/2021-18:56:39] [V] [TRT] Add_219 [Add] inputs: [transformer.layer.2.attention.k_lin.bias -> (768)[FLOAT]], [421 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.attention.k_lin.bias for ONNX node: transformer.layer.2.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_219 for ONNX node: Add_219
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 422 for ONNX tensor: 422
[07/30/2021-18:56:39] [V] [TRT] Add_219 [Add] outputs: [422 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_220 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_220 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_220 [Constant] outputs: [426 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_221 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 399
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 426
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_221 [Unsqueeze] inputs: [399 -> ()[INT32]], [426 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_221 for ONNX node: Unsqueeze_221
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 427 for ONNX tensor: 427
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_221 [Unsqueeze] outputs: [427 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_222 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 427
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 980
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 981
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 982
[07/30/2021-18:56:39] [V] [TRT] Concat_222 [Concat] inputs: [427 -> (1)[INT32]], [980 -> (1)[INT32]], [981 -> (1)[INT32]], [982 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 980 for ONNX node: 980
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 981 for ONNX node: 981
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 982 for ONNX node: 982
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_222 for ONNX node: Concat_222
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 434 for ONNX tensor: 434
[07/30/2021-18:56:39] [V] [TRT] Concat_222 [Concat] outputs: [434 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_223 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 422
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 434
[07/30/2021-18:56:39] [V] [TRT] Reshape_223 [Reshape] inputs: [422 -> (32, 512, 768)[FLOAT]], [434 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_223 for ONNX node: Reshape_223
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 435 for ONNX tensor: 435
[07/30/2021-18:56:39] [V] [TRT] Reshape_223 [Reshape] outputs: [435 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_224 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 396
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 983
[07/30/2021-18:56:39] [V] [TRT] MatMul_224 [MatMul] inputs: [396 -> (32, 512, 768)[FLOAT]], [983 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 983 for ONNX node: 983
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_224 for ONNX node: MatMul_224
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 437 for ONNX tensor: 437
[07/30/2021-18:56:39] [V] [TRT] MatMul_224 [MatMul] outputs: [437 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_225 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 437
[07/30/2021-18:56:39] [V] [TRT] Add_225 [Add] inputs: [transformer.layer.2.attention.v_lin.bias -> (768)[FLOAT]], [437 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.attention.v_lin.bias for ONNX node: transformer.layer.2.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_225 for ONNX node: Add_225
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 438 for ONNX tensor: 438
[07/30/2021-18:56:39] [V] [TRT] Add_225 [Add] outputs: [438 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_226 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_226 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_226 [Constant] outputs: [442 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_227 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 399
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 442
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_227 [Unsqueeze] inputs: [399 -> ()[INT32]], [442 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_227 for ONNX node: Unsqueeze_227
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 443 for ONNX tensor: 443
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_227 [Unsqueeze] outputs: [443 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_228 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 443
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 984
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 985
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 986
[07/30/2021-18:56:39] [V] [TRT] Concat_228 [Concat] inputs: [443 -> (1)[INT32]], [984 -> (1)[INT32]], [985 -> (1)[INT32]], [986 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 984 for ONNX node: 984
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 985 for ONNX node: 985
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 986 for ONNX node: 986
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_228 for ONNX node: Concat_228
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 450 for ONNX tensor: 450
[07/30/2021-18:56:39] [V] [TRT] Concat_228 [Concat] outputs: [450 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_229 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 438
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 450
[07/30/2021-18:56:39] [V] [TRT] Reshape_229 [Reshape] inputs: [438 -> (32, 512, 768)[FLOAT]], [450 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_229 for ONNX node: Reshape_229
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 451 for ONNX tensor: 451
[07/30/2021-18:56:39] [V] [TRT] Reshape_229 [Reshape] outputs: [451 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_230 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 451
[07/30/2021-18:56:39] [V] [TRT] Transpose_230 [Transpose] inputs: [451 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_230 for ONNX node: Transpose_230
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 452 for ONNX tensor: 452
[07/30/2021-18:56:39] [V] [TRT] Transpose_230 [Transpose] outputs: [452 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_231 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_231 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_231 [Constant] outputs: [453 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_232 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 419
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 453
[07/30/2021-18:56:39] [V] [TRT] Div_232 [Div] inputs: [419 -> (32, 12, 512, 64)[FLOAT]], [453 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 453 for ONNX node: 453
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_232 for ONNX node: Div_232
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 454 for ONNX tensor: 454
[07/30/2021-18:56:39] [V] [TRT] Div_232 [Div] outputs: [454 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_233 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 435
[07/30/2021-18:56:39] [V] [TRT] Transpose_233 [Transpose] inputs: [435 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_233 for ONNX node: Transpose_233
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 455 for ONNX tensor: 455
[07/30/2021-18:56:39] [V] [TRT] Transpose_233 [Transpose] outputs: [455 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_234 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 454
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 455
[07/30/2021-18:56:39] [V] [TRT] MatMul_234 [MatMul] inputs: [454 -> (32, 12, 512, 64)[FLOAT]], [455 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_234 for ONNX node: MatMul_234
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 456 for ONNX tensor: 456
[07/30/2021-18:56:39] [V] [TRT] MatMul_234 [MatMul] outputs: [456 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_235 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_235 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_235 [Constant] outputs: [457 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Equal_236 [Equal]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 457
[07/30/2021-18:56:39] [V] [TRT] Equal_236 [Equal] inputs: [1 -> (32, 512)[INT32]], [457 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 457 for ONNX node: 457
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Equal_236 for ONNX node: Equal_236
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 458 for ONNX tensor: 458
[07/30/2021-18:56:39] [V] [TRT] Equal_236 [Equal] outputs: [458 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_237 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 458
[07/30/2021-18:56:39] [V] [TRT] Cast_237 [Cast] inputs: [458 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_237 for ONNX node: Cast_237
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 459 for ONNX tensor: 459
[07/30/2021-18:56:39] [V] [TRT] Cast_237 [Cast] outputs: [459 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_238 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_238 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_238 [Constant] outputs: [462 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_239 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 399
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 462
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_239 [Unsqueeze] inputs: [399 -> ()[INT32]], [462 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_239 for ONNX node: Unsqueeze_239
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 463 for ONNX tensor: 463
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_239 [Unsqueeze] outputs: [463 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_240 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_240 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_240 [Constant] outputs: [468 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_241 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 402
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 468
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_241 [Unsqueeze] inputs: [402 -> ()[INT32]], [468 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_241 for ONNX node: Unsqueeze_241
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 469 for ONNX tensor: 469
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_241 [Unsqueeze] outputs: [469 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_242 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 463
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 987
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 988
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 469
[07/30/2021-18:56:39] [V] [TRT] Concat_242 [Concat] inputs: [463 -> (1)[INT32]], [987 -> (1)[INT32]], [988 -> (1)[INT32]], [469 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 987 for ONNX node: 987
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 988 for ONNX node: 988
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_242 for ONNX node: Concat_242
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 470 for ONNX tensor: 470
[07/30/2021-18:56:39] [V] [TRT] Concat_242 [Concat] outputs: [470 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_243 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 459
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 470
[07/30/2021-18:56:39] [V] [TRT] Reshape_243 [Reshape] inputs: [459 -> (32, 512)[INT32]], [470 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_243 for ONNX node: Reshape_243
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 471 for ONNX tensor: 471
[07/30/2021-18:56:39] [V] [TRT] Reshape_243 [Reshape] outputs: [471 -> (32, 1, 1, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_244 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 456
[07/30/2021-18:56:39] [V] [TRT] Shape_244 [Shape] inputs: [456 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_244 for ONNX node: Shape_244
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 472 for ONNX tensor: 472
[07/30/2021-18:56:39] [V] [TRT] Shape_244 [Shape] outputs: [472 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Expand_245 [Expand]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 471
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 472
[07/30/2021-18:56:39] [V] [TRT] Expand_245 [Expand] inputs: [471 -> (32, 1, 1, 512)[INT32]], [472 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Expand_245 for ONNX node: Expand_245
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 473 for ONNX tensor: 473
[07/30/2021-18:56:39] [V] [TRT] Expand_245 [Expand] outputs: [473 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_246 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 473
[07/30/2021-18:56:39] [V] [TRT] Cast_246 [Cast] inputs: [473 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_246 for ONNX node: Cast_246
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 474 for ONNX tensor: 474
[07/30/2021-18:56:39] [V] [TRT] Cast_246 [Cast] outputs: [474 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_247 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 474
[07/30/2021-18:56:39] [V] [TRT] Cast_247 [Cast] inputs: [474 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_247 for ONNX node: Cast_247
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 475 for ONNX tensor: 475
[07/30/2021-18:56:39] [V] [TRT] Cast_247 [Cast] outputs: [475 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_248 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_248 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_248 [Constant] outputs: [476 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Where_249 [Where]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 475
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 476
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 456
[07/30/2021-18:56:39] [V] [TRT] Where_249 [Where] inputs: [475 -> (32, 12, 512, 512)[BOOL]], [476 -> ()[FLOAT]], [456 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 476 for ONNX node: 476
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Where_249 for ONNX node: Where_249
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 477 for ONNX tensor: 477
[07/30/2021-18:56:39] [V] [TRT] Where_249 [Where] outputs: [477 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Softmax_250 [Softmax]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 477
[07/30/2021-18:56:39] [V] [TRT] Softmax_250 [Softmax] inputs: [477 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Softmax_250 for ONNX node: Softmax_250
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 478 for ONNX tensor: 478
[07/30/2021-18:56:39] [V] [TRT] Softmax_250 [Softmax] outputs: [478 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_251 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 478
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 452
[07/30/2021-18:56:39] [V] [TRT] MatMul_251 [MatMul] inputs: [478 -> (32, 12, 512, 512)[FLOAT]], [452 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_251 for ONNX node: MatMul_251
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 479 for ONNX tensor: 479
[07/30/2021-18:56:39] [V] [TRT] MatMul_251 [MatMul] outputs: [479 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_252 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 479
[07/30/2021-18:56:39] [V] [TRT] Transpose_252 [Transpose] inputs: [479 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_252 for ONNX node: Transpose_252
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 480 for ONNX tensor: 480
[07/30/2021-18:56:39] [V] [TRT] Transpose_252 [Transpose] outputs: [480 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_253 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_253 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_253 [Constant] outputs: [483 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_254 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 399
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 483
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_254 [Unsqueeze] inputs: [399 -> ()[INT32]], [483 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_254 for ONNX node: Unsqueeze_254
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 484 for ONNX tensor: 484
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_254 [Unsqueeze] outputs: [484 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_255 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 484
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 989
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 990
[07/30/2021-18:56:39] [V] [TRT] Concat_255 [Concat] inputs: [484 -> (1)[INT32]], [989 -> (1)[INT32]], [990 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 989 for ONNX node: 989
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 990 for ONNX node: 990
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_255 for ONNX node: Concat_255
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 489 for ONNX tensor: 489
[07/30/2021-18:56:39] [V] [TRT] Concat_255 [Concat] outputs: [489 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_256 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 480
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 489
[07/30/2021-18:56:39] [V] [TRT] Reshape_256 [Reshape] inputs: [480 -> (32, 512, 12, 64)[FLOAT]], [489 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_256 for ONNX node: Reshape_256
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 490 for ONNX tensor: 490
[07/30/2021-18:56:39] [V] [TRT] Reshape_256 [Reshape] outputs: [490 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_257 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 490
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 991
[07/30/2021-18:56:39] [V] [TRT] MatMul_257 [MatMul] inputs: [490 -> (32, 512, 768)[FLOAT]], [991 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 991 for ONNX node: 991
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_257 for ONNX node: MatMul_257
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 492 for ONNX tensor: 492
[07/30/2021-18:56:39] [V] [TRT] MatMul_257 [MatMul] outputs: [492 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_258 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 492
[07/30/2021-18:56:39] [V] [TRT] Add_258 [Add] inputs: [transformer.layer.2.attention.out_lin.bias -> (768)[FLOAT]], [492 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.attention.out_lin.bias for ONNX node: transformer.layer.2.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_258 for ONNX node: Add_258
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 493 for ONNX tensor: 493
[07/30/2021-18:56:39] [V] [TRT] Add_258 [Add] outputs: [493 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_259 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 493
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 396
[07/30/2021-18:56:39] [V] [TRT] Add_259 [Add] inputs: [493 -> (32, 512, 768)[FLOAT]], [396 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_259 for ONNX node: Add_259
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 494 for ONNX tensor: 494
[07/30/2021-18:56:39] [V] [TRT] Add_259 [Add] outputs: [494 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_260 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 494
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_260 [ReduceMean] inputs: [494 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_260 for ONNX node: ReduceMean_260
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 495 for ONNX tensor: 495
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_260 [ReduceMean] outputs: [495 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_261 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 494
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 495
[07/30/2021-18:56:39] [V] [TRT] Sub_261 [Sub] inputs: [494 -> (32, 512, 768)[FLOAT]], [495 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_261 for ONNX node: Sub_261
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 496 for ONNX tensor: 496
[07/30/2021-18:56:39] [V] [TRT] Sub_261 [Sub] outputs: [496 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_262 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_262 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_262 [Constant] outputs: [497 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_263 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 496
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 497
[07/30/2021-18:56:39] [V] [TRT] Pow_263 [Pow] inputs: [496 -> (32, 512, 768)[FLOAT]], [497 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 497 for ONNX node: 497
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_263 for ONNX node: Pow_263
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 498 for ONNX tensor: 498
[07/30/2021-18:56:39] [V] [TRT] Pow_263 [Pow] outputs: [498 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_264 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 498
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_264 [ReduceMean] inputs: [498 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_264 for ONNX node: ReduceMean_264
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 499 for ONNX tensor: 499
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_264 [ReduceMean] outputs: [499 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_265 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_265 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_265 [Constant] outputs: [500 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_266 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 499
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 500
[07/30/2021-18:56:39] [V] [TRT] Add_266 [Add] inputs: [499 -> (32, 512, 1)[FLOAT]], [500 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 500 for ONNX node: 500
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_266 for ONNX node: Add_266
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 501 for ONNX tensor: 501
[07/30/2021-18:56:39] [V] [TRT] Add_266 [Add] outputs: [501 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_267 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 501
[07/30/2021-18:56:39] [V] [TRT] Sqrt_267 [Sqrt] inputs: [501 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_267 for ONNX node: Sqrt_267
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 502 for ONNX tensor: 502
[07/30/2021-18:56:39] [V] [TRT] Sqrt_267 [Sqrt] outputs: [502 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_268 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 496
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 502
[07/30/2021-18:56:39] [V] [TRT] Div_268 [Div] inputs: [496 -> (32, 512, 768)[FLOAT]], [502 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_268 for ONNX node: Div_268
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 503 for ONNX tensor: 503
[07/30/2021-18:56:39] [V] [TRT] Div_268 [Div] outputs: [503 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_269 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 503
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_269 [Mul] inputs: [503 -> (32, 512, 768)[FLOAT]], [transformer.layer.2.sa_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.sa_layer_norm.weight for ONNX node: transformer.layer.2.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_269 for ONNX node: Mul_269
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 504 for ONNX tensor: 504
[07/30/2021-18:56:39] [V] [TRT] Mul_269 [Mul] outputs: [504 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_270 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 504
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_270 [Add] inputs: [504 -> (32, 512, 768)[FLOAT]], [transformer.layer.2.sa_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.sa_layer_norm.bias for ONNX node: transformer.layer.2.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_270 for ONNX node: Add_270
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 505 for ONNX tensor: 505
[07/30/2021-18:56:39] [V] [TRT] Add_270 [Add] outputs: [505 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_271 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 505
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 992
[07/30/2021-18:56:39] [V] [TRT] MatMul_271 [MatMul] inputs: [505 -> (32, 512, 768)[FLOAT]], [992 -> (768, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 992 for ONNX node: 992
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_271 for ONNX node: MatMul_271
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 507 for ONNX tensor: 507
[07/30/2021-18:56:39] [V] [TRT] MatMul_271 [MatMul] outputs: [507 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_272 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 507
[07/30/2021-18:56:39] [V] [TRT] Add_272 [Add] inputs: [transformer.layer.2.ffn.lin1.bias -> (3072)[FLOAT]], [507 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.ffn.lin1.bias for ONNX node: transformer.layer.2.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_272 for ONNX node: Add_272
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 508 for ONNX tensor: 508
[07/30/2021-18:56:39] [V] [TRT] Add_272 [Add] outputs: [508 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_273 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_273 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_273 [Constant] outputs: [509 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_274 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 508
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 509
[07/30/2021-18:56:39] [V] [TRT] Div_274 [Div] inputs: [508 -> (32, 512, 3072)[FLOAT]], [509 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 509 for ONNX node: 509
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_274 for ONNX node: Div_274
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 510 for ONNX tensor: 510
[07/30/2021-18:56:39] [V] [TRT] Div_274 [Div] outputs: [510 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Erf_275 [Erf]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 510
[07/30/2021-18:56:39] [V] [TRT] Erf_275 [Erf] inputs: [510 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Erf_275 for ONNX node: Erf_275
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 511 for ONNX tensor: 511
[07/30/2021-18:56:39] [V] [TRT] Erf_275 [Erf] outputs: [511 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_276 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_276 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_276 [Constant] outputs: [512 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_277 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 511
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 512
[07/30/2021-18:56:39] [V] [TRT] Add_277 [Add] inputs: [511 -> (32, 512, 3072)[FLOAT]], [512 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 512 for ONNX node: 512
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_277 for ONNX node: Add_277
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 513 for ONNX tensor: 513
[07/30/2021-18:56:39] [V] [TRT] Add_277 [Add] outputs: [513 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_278 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 508
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 513
[07/30/2021-18:56:39] [V] [TRT] Mul_278 [Mul] inputs: [508 -> (32, 512, 3072)[FLOAT]], [513 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_278 for ONNX node: Mul_278
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 514 for ONNX tensor: 514
[07/30/2021-18:56:39] [V] [TRT] Mul_278 [Mul] outputs: [514 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_279 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_279 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_279 [Constant] outputs: [515 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_280 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 514
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 515
[07/30/2021-18:56:39] [V] [TRT] Mul_280 [Mul] inputs: [514 -> (32, 512, 3072)[FLOAT]], [515 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 515 for ONNX node: 515
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_280 for ONNX node: Mul_280
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 516 for ONNX tensor: 516
[07/30/2021-18:56:39] [V] [TRT] Mul_280 [Mul] outputs: [516 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_281 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 516
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 993
[07/30/2021-18:56:39] [V] [TRT] MatMul_281 [MatMul] inputs: [516 -> (32, 512, 3072)[FLOAT]], [993 -> (3072, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 993 for ONNX node: 993
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_281 for ONNX node: MatMul_281
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 518 for ONNX tensor: 518
[07/30/2021-18:56:39] [V] [TRT] MatMul_281 [MatMul] outputs: [518 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_282 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 518
[07/30/2021-18:56:39] [V] [TRT] Add_282 [Add] inputs: [transformer.layer.2.ffn.lin2.bias -> (768)[FLOAT]], [518 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.ffn.lin2.bias for ONNX node: transformer.layer.2.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_282 for ONNX node: Add_282
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 519 for ONNX tensor: 519
[07/30/2021-18:56:39] [V] [TRT] Add_282 [Add] outputs: [519 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_283 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 519
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 505
[07/30/2021-18:56:39] [V] [TRT] Add_283 [Add] inputs: [519 -> (32, 512, 768)[FLOAT]], [505 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_283 for ONNX node: Add_283
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 520 for ONNX tensor: 520
[07/30/2021-18:56:39] [V] [TRT] Add_283 [Add] outputs: [520 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_284 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 520
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_284 [ReduceMean] inputs: [520 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_284 for ONNX node: ReduceMean_284
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 521 for ONNX tensor: 521
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_284 [ReduceMean] outputs: [521 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_285 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 520
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 521
[07/30/2021-18:56:39] [V] [TRT] Sub_285 [Sub] inputs: [520 -> (32, 512, 768)[FLOAT]], [521 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_285 for ONNX node: Sub_285
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 522 for ONNX tensor: 522
[07/30/2021-18:56:39] [V] [TRT] Sub_285 [Sub] outputs: [522 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_286 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_286 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_286 [Constant] outputs: [523 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_287 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 522
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 523
[07/30/2021-18:56:39] [V] [TRT] Pow_287 [Pow] inputs: [522 -> (32, 512, 768)[FLOAT]], [523 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 523 for ONNX node: 523
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_287 for ONNX node: Pow_287
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 524 for ONNX tensor: 524
[07/30/2021-18:56:39] [V] [TRT] Pow_287 [Pow] outputs: [524 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_288 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 524
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_288 [ReduceMean] inputs: [524 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_288 for ONNX node: ReduceMean_288
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 525 for ONNX tensor: 525
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_288 [ReduceMean] outputs: [525 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_289 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_289 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_289 [Constant] outputs: [526 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_290 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 525
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 526
[07/30/2021-18:56:39] [V] [TRT] Add_290 [Add] inputs: [525 -> (32, 512, 1)[FLOAT]], [526 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 526 for ONNX node: 526
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_290 for ONNX node: Add_290
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 527 for ONNX tensor: 527
[07/30/2021-18:56:39] [V] [TRT] Add_290 [Add] outputs: [527 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_291 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 527
[07/30/2021-18:56:39] [V] [TRT] Sqrt_291 [Sqrt] inputs: [527 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_291 for ONNX node: Sqrt_291
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 528 for ONNX tensor: 528
[07/30/2021-18:56:39] [V] [TRT] Sqrt_291 [Sqrt] outputs: [528 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_292 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 522
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 528
[07/30/2021-18:56:39] [V] [TRT] Div_292 [Div] inputs: [522 -> (32, 512, 768)[FLOAT]], [528 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_292 for ONNX node: Div_292
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 529 for ONNX tensor: 529
[07/30/2021-18:56:39] [V] [TRT] Div_292 [Div] outputs: [529 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_293 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 529
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_293 [Mul] inputs: [529 -> (32, 512, 768)[FLOAT]], [transformer.layer.2.output_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.output_layer_norm.weight for ONNX node: transformer.layer.2.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_293 for ONNX node: Mul_293
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 530 for ONNX tensor: 530
[07/30/2021-18:56:39] [V] [TRT] Mul_293 [Mul] outputs: [530 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_294 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 530
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.2.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_294 [Add] inputs: [530 -> (32, 512, 768)[FLOAT]], [transformer.layer.2.output_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.2.output_layer_norm.bias for ONNX node: transformer.layer.2.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_294 for ONNX node: Add_294
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 531 for ONNX tensor: 531
[07/30/2021-18:56:39] [V] [TRT] Add_294 [Add] outputs: [531 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_295 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 531
[07/30/2021-18:56:39] [V] [TRT] Shape_295 [Shape] inputs: [531 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_295 for ONNX node: Shape_295
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 532 for ONNX tensor: 532
[07/30/2021-18:56:39] [V] [TRT] Shape_295 [Shape] outputs: [532 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_296 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_296 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_296 [Constant] outputs: [533 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_297 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 532
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 533
[07/30/2021-18:56:39] [V] [TRT] Gather_297 [Gather] inputs: [532 -> (3)[INT32]], [533 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 533 for ONNX node: 533
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_297 for ONNX node: Gather_297
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 534 for ONNX tensor: 534
[07/30/2021-18:56:39] [V] [TRT] Gather_297 [Gather] outputs: [534 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_298 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 531
[07/30/2021-18:56:39] [V] [TRT] Shape_298 [Shape] inputs: [531 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_298 for ONNX node: Shape_298
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 535 for ONNX tensor: 535
[07/30/2021-18:56:39] [V] [TRT] Shape_298 [Shape] outputs: [535 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_299 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_299 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_299 [Constant] outputs: [536 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_300 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 535
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 536
[07/30/2021-18:56:39] [V] [TRT] Gather_300 [Gather] inputs: [535 -> (3)[INT32]], [536 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 536 for ONNX node: 536
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_300 for ONNX node: Gather_300
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 537 for ONNX tensor: 537
[07/30/2021-18:56:39] [V] [TRT] Gather_300 [Gather] outputs: [537 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_301 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 531
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 994
[07/30/2021-18:56:39] [V] [TRT] MatMul_301 [MatMul] inputs: [531 -> (32, 512, 768)[FLOAT]], [994 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 994 for ONNX node: 994
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_301 for ONNX node: MatMul_301
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 539 for ONNX tensor: 539
[07/30/2021-18:56:39] [V] [TRT] MatMul_301 [MatMul] outputs: [539 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_302 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 539
[07/30/2021-18:56:39] [V] [TRT] Add_302 [Add] inputs: [transformer.layer.3.attention.q_lin.bias -> (768)[FLOAT]], [539 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.attention.q_lin.bias for ONNX node: transformer.layer.3.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_302 for ONNX node: Add_302
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 540 for ONNX tensor: 540
[07/30/2021-18:56:39] [V] [TRT] Add_302 [Add] outputs: [540 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_303 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_303 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_303 [Constant] outputs: [544 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_304 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 534
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 544
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_304 [Unsqueeze] inputs: [534 -> ()[INT32]], [544 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_304 for ONNX node: Unsqueeze_304
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 545 for ONNX tensor: 545
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_304 [Unsqueeze] outputs: [545 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_305 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 545
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 995
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 996
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 997
[07/30/2021-18:56:39] [V] [TRT] Concat_305 [Concat] inputs: [545 -> (1)[INT32]], [995 -> (1)[INT32]], [996 -> (1)[INT32]], [997 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 995 for ONNX node: 995
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 996 for ONNX node: 996
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 997 for ONNX node: 997
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_305 for ONNX node: Concat_305
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 552 for ONNX tensor: 552
[07/30/2021-18:56:39] [V] [TRT] Concat_305 [Concat] outputs: [552 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_306 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 540
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 552
[07/30/2021-18:56:39] [V] [TRT] Reshape_306 [Reshape] inputs: [540 -> (32, 512, 768)[FLOAT]], [552 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_306 for ONNX node: Reshape_306
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 553 for ONNX tensor: 553
[07/30/2021-18:56:39] [V] [TRT] Reshape_306 [Reshape] outputs: [553 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_307 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 553
[07/30/2021-18:56:39] [V] [TRT] Transpose_307 [Transpose] inputs: [553 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_307 for ONNX node: Transpose_307
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 554 for ONNX tensor: 554
[07/30/2021-18:56:39] [V] [TRT] Transpose_307 [Transpose] outputs: [554 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_308 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 531
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 998
[07/30/2021-18:56:39] [V] [TRT] MatMul_308 [MatMul] inputs: [531 -> (32, 512, 768)[FLOAT]], [998 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 998 for ONNX node: 998
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_308 for ONNX node: MatMul_308
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 556 for ONNX tensor: 556
[07/30/2021-18:56:39] [V] [TRT] MatMul_308 [MatMul] outputs: [556 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_309 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 556
[07/30/2021-18:56:39] [V] [TRT] Add_309 [Add] inputs: [transformer.layer.3.attention.k_lin.bias -> (768)[FLOAT]], [556 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.attention.k_lin.bias for ONNX node: transformer.layer.3.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_309 for ONNX node: Add_309
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 557 for ONNX tensor: 557
[07/30/2021-18:56:39] [V] [TRT] Add_309 [Add] outputs: [557 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_310 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_310 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_310 [Constant] outputs: [561 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_311 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 534
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 561
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_311 [Unsqueeze] inputs: [534 -> ()[INT32]], [561 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_311 for ONNX node: Unsqueeze_311
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 562 for ONNX tensor: 562
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_311 [Unsqueeze] outputs: [562 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_312 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 562
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 999
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1000
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1001
[07/30/2021-18:56:39] [V] [TRT] Concat_312 [Concat] inputs: [562 -> (1)[INT32]], [999 -> (1)[INT32]], [1000 -> (1)[INT32]], [1001 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 999 for ONNX node: 999
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1000 for ONNX node: 1000
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1001 for ONNX node: 1001
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_312 for ONNX node: Concat_312
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 569 for ONNX tensor: 569
[07/30/2021-18:56:39] [V] [TRT] Concat_312 [Concat] outputs: [569 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_313 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 557
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 569
[07/30/2021-18:56:39] [V] [TRT] Reshape_313 [Reshape] inputs: [557 -> (32, 512, 768)[FLOAT]], [569 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_313 for ONNX node: Reshape_313
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 570 for ONNX tensor: 570
[07/30/2021-18:56:39] [V] [TRT] Reshape_313 [Reshape] outputs: [570 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_314 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 531
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1002
[07/30/2021-18:56:39] [V] [TRT] MatMul_314 [MatMul] inputs: [531 -> (32, 512, 768)[FLOAT]], [1002 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1002 for ONNX node: 1002
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_314 for ONNX node: MatMul_314
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 572 for ONNX tensor: 572
[07/30/2021-18:56:39] [V] [TRT] MatMul_314 [MatMul] outputs: [572 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_315 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 572
[07/30/2021-18:56:39] [V] [TRT] Add_315 [Add] inputs: [transformer.layer.3.attention.v_lin.bias -> (768)[FLOAT]], [572 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.attention.v_lin.bias for ONNX node: transformer.layer.3.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_315 for ONNX node: Add_315
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 573 for ONNX tensor: 573
[07/30/2021-18:56:39] [V] [TRT] Add_315 [Add] outputs: [573 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_316 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_316 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_316 [Constant] outputs: [577 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_317 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 534
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 577
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_317 [Unsqueeze] inputs: [534 -> ()[INT32]], [577 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_317 for ONNX node: Unsqueeze_317
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 578 for ONNX tensor: 578
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_317 [Unsqueeze] outputs: [578 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_318 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 578
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1003
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1004
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1005
[07/30/2021-18:56:39] [V] [TRT] Concat_318 [Concat] inputs: [578 -> (1)[INT32]], [1003 -> (1)[INT32]], [1004 -> (1)[INT32]], [1005 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1003 for ONNX node: 1003
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1004 for ONNX node: 1004
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1005 for ONNX node: 1005
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_318 for ONNX node: Concat_318
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 585 for ONNX tensor: 585
[07/30/2021-18:56:39] [V] [TRT] Concat_318 [Concat] outputs: [585 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_319 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 573
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 585
[07/30/2021-18:56:39] [V] [TRT] Reshape_319 [Reshape] inputs: [573 -> (32, 512, 768)[FLOAT]], [585 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_319 for ONNX node: Reshape_319
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 586 for ONNX tensor: 586
[07/30/2021-18:56:39] [V] [TRT] Reshape_319 [Reshape] outputs: [586 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_320 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 586
[07/30/2021-18:56:39] [V] [TRT] Transpose_320 [Transpose] inputs: [586 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_320 for ONNX node: Transpose_320
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 587 for ONNX tensor: 587
[07/30/2021-18:56:39] [V] [TRT] Transpose_320 [Transpose] outputs: [587 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_321 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_321 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_321 [Constant] outputs: [588 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_322 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 554
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 588
[07/30/2021-18:56:39] [V] [TRT] Div_322 [Div] inputs: [554 -> (32, 12, 512, 64)[FLOAT]], [588 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 588 for ONNX node: 588
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_322 for ONNX node: Div_322
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 589 for ONNX tensor: 589
[07/30/2021-18:56:39] [V] [TRT] Div_322 [Div] outputs: [589 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_323 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 570
[07/30/2021-18:56:39] [V] [TRT] Transpose_323 [Transpose] inputs: [570 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_323 for ONNX node: Transpose_323
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 590 for ONNX tensor: 590
[07/30/2021-18:56:39] [V] [TRT] Transpose_323 [Transpose] outputs: [590 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_324 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 589
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 590
[07/30/2021-18:56:39] [V] [TRT] MatMul_324 [MatMul] inputs: [589 -> (32, 12, 512, 64)[FLOAT]], [590 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_324 for ONNX node: MatMul_324
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 591 for ONNX tensor: 591
[07/30/2021-18:56:39] [V] [TRT] MatMul_324 [MatMul] outputs: [591 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_325 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_325 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_325 [Constant] outputs: [592 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Equal_326 [Equal]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 592
[07/30/2021-18:56:39] [V] [TRT] Equal_326 [Equal] inputs: [1 -> (32, 512)[INT32]], [592 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 592 for ONNX node: 592
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Equal_326 for ONNX node: Equal_326
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 593 for ONNX tensor: 593
[07/30/2021-18:56:39] [V] [TRT] Equal_326 [Equal] outputs: [593 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_327 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 593
[07/30/2021-18:56:39] [V] [TRT] Cast_327 [Cast] inputs: [593 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_327 for ONNX node: Cast_327
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 594 for ONNX tensor: 594
[07/30/2021-18:56:39] [V] [TRT] Cast_327 [Cast] outputs: [594 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_328 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_328 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_328 [Constant] outputs: [597 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_329 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 534
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 597
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_329 [Unsqueeze] inputs: [534 -> ()[INT32]], [597 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_329 for ONNX node: Unsqueeze_329
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 598 for ONNX tensor: 598
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_329 [Unsqueeze] outputs: [598 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_330 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_330 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_330 [Constant] outputs: [603 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_331 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 537
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 603
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_331 [Unsqueeze] inputs: [537 -> ()[INT32]], [603 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_331 for ONNX node: Unsqueeze_331
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 604 for ONNX tensor: 604
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_331 [Unsqueeze] outputs: [604 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_332 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 598
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1006
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1007
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 604
[07/30/2021-18:56:39] [V] [TRT] Concat_332 [Concat] inputs: [598 -> (1)[INT32]], [1006 -> (1)[INT32]], [1007 -> (1)[INT32]], [604 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1006 for ONNX node: 1006
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1007 for ONNX node: 1007
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_332 for ONNX node: Concat_332
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 605 for ONNX tensor: 605
[07/30/2021-18:56:39] [V] [TRT] Concat_332 [Concat] outputs: [605 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_333 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 594
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 605
[07/30/2021-18:56:39] [V] [TRT] Reshape_333 [Reshape] inputs: [594 -> (32, 512)[INT32]], [605 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_333 for ONNX node: Reshape_333
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 606 for ONNX tensor: 606
[07/30/2021-18:56:39] [V] [TRT] Reshape_333 [Reshape] outputs: [606 -> (32, 1, 1, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_334 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 591
[07/30/2021-18:56:39] [V] [TRT] Shape_334 [Shape] inputs: [591 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_334 for ONNX node: Shape_334
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 607 for ONNX tensor: 607
[07/30/2021-18:56:39] [V] [TRT] Shape_334 [Shape] outputs: [607 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Expand_335 [Expand]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 606
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 607
[07/30/2021-18:56:39] [V] [TRT] Expand_335 [Expand] inputs: [606 -> (32, 1, 1, 512)[INT32]], [607 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Expand_335 for ONNX node: Expand_335
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 608 for ONNX tensor: 608
[07/30/2021-18:56:39] [V] [TRT] Expand_335 [Expand] outputs: [608 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_336 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 608
[07/30/2021-18:56:39] [V] [TRT] Cast_336 [Cast] inputs: [608 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_336 for ONNX node: Cast_336
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 609 for ONNX tensor: 609
[07/30/2021-18:56:39] [V] [TRT] Cast_336 [Cast] outputs: [609 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_337 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 609
[07/30/2021-18:56:39] [V] [TRT] Cast_337 [Cast] inputs: [609 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_337 for ONNX node: Cast_337
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 610 for ONNX tensor: 610
[07/30/2021-18:56:39] [V] [TRT] Cast_337 [Cast] outputs: [610 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_338 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_338 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_338 [Constant] outputs: [611 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Where_339 [Where]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 610
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 611
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 591
[07/30/2021-18:56:39] [V] [TRT] Where_339 [Where] inputs: [610 -> (32, 12, 512, 512)[BOOL]], [611 -> ()[FLOAT]], [591 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 611 for ONNX node: 611
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Where_339 for ONNX node: Where_339
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 612 for ONNX tensor: 612
[07/30/2021-18:56:39] [V] [TRT] Where_339 [Where] outputs: [612 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Softmax_340 [Softmax]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 612
[07/30/2021-18:56:39] [V] [TRT] Softmax_340 [Softmax] inputs: [612 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Softmax_340 for ONNX node: Softmax_340
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 613 for ONNX tensor: 613
[07/30/2021-18:56:39] [V] [TRT] Softmax_340 [Softmax] outputs: [613 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_341 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 613
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 587
[07/30/2021-18:56:39] [V] [TRT] MatMul_341 [MatMul] inputs: [613 -> (32, 12, 512, 512)[FLOAT]], [587 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_341 for ONNX node: MatMul_341
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 614 for ONNX tensor: 614
[07/30/2021-18:56:39] [V] [TRT] MatMul_341 [MatMul] outputs: [614 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_342 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 614
[07/30/2021-18:56:39] [V] [TRT] Transpose_342 [Transpose] inputs: [614 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_342 for ONNX node: Transpose_342
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 615 for ONNX tensor: 615
[07/30/2021-18:56:39] [V] [TRT] Transpose_342 [Transpose] outputs: [615 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_343 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_343 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_343 [Constant] outputs: [618 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_344 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 534
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 618
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_344 [Unsqueeze] inputs: [534 -> ()[INT32]], [618 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_344 for ONNX node: Unsqueeze_344
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 619 for ONNX tensor: 619
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_344 [Unsqueeze] outputs: [619 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_345 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 619
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1008
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1009
[07/30/2021-18:56:39] [V] [TRT] Concat_345 [Concat] inputs: [619 -> (1)[INT32]], [1008 -> (1)[INT32]], [1009 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1008 for ONNX node: 1008
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1009 for ONNX node: 1009
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_345 for ONNX node: Concat_345
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 624 for ONNX tensor: 624
[07/30/2021-18:56:39] [V] [TRT] Concat_345 [Concat] outputs: [624 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_346 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 615
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 624
[07/30/2021-18:56:39] [V] [TRT] Reshape_346 [Reshape] inputs: [615 -> (32, 512, 12, 64)[FLOAT]], [624 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_346 for ONNX node: Reshape_346
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 625 for ONNX tensor: 625
[07/30/2021-18:56:39] [V] [TRT] Reshape_346 [Reshape] outputs: [625 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_347 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 625
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1010
[07/30/2021-18:56:39] [V] [TRT] MatMul_347 [MatMul] inputs: [625 -> (32, 512, 768)[FLOAT]], [1010 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1010 for ONNX node: 1010
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_347 for ONNX node: MatMul_347
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 627 for ONNX tensor: 627
[07/30/2021-18:56:39] [V] [TRT] MatMul_347 [MatMul] outputs: [627 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_348 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 627
[07/30/2021-18:56:39] [V] [TRT] Add_348 [Add] inputs: [transformer.layer.3.attention.out_lin.bias -> (768)[FLOAT]], [627 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.attention.out_lin.bias for ONNX node: transformer.layer.3.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_348 for ONNX node: Add_348
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 628 for ONNX tensor: 628
[07/30/2021-18:56:39] [V] [TRT] Add_348 [Add] outputs: [628 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_349 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 628
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 531
[07/30/2021-18:56:39] [V] [TRT] Add_349 [Add] inputs: [628 -> (32, 512, 768)[FLOAT]], [531 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_349 for ONNX node: Add_349
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 629 for ONNX tensor: 629
[07/30/2021-18:56:39] [V] [TRT] Add_349 [Add] outputs: [629 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_350 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 629
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_350 [ReduceMean] inputs: [629 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_350 for ONNX node: ReduceMean_350
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 630 for ONNX tensor: 630
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_350 [ReduceMean] outputs: [630 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_351 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 629
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 630
[07/30/2021-18:56:39] [V] [TRT] Sub_351 [Sub] inputs: [629 -> (32, 512, 768)[FLOAT]], [630 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_351 for ONNX node: Sub_351
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 631 for ONNX tensor: 631
[07/30/2021-18:56:39] [V] [TRT] Sub_351 [Sub] outputs: [631 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_352 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_352 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_352 [Constant] outputs: [632 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_353 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 631
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 632
[07/30/2021-18:56:39] [V] [TRT] Pow_353 [Pow] inputs: [631 -> (32, 512, 768)[FLOAT]], [632 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 632 for ONNX node: 632
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_353 for ONNX node: Pow_353
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 633 for ONNX tensor: 633
[07/30/2021-18:56:39] [V] [TRT] Pow_353 [Pow] outputs: [633 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_354 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 633
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_354 [ReduceMean] inputs: [633 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_354 for ONNX node: ReduceMean_354
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 634 for ONNX tensor: 634
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_354 [ReduceMean] outputs: [634 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_355 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_355 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_355 [Constant] outputs: [635 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_356 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 634
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 635
[07/30/2021-18:56:39] [V] [TRT] Add_356 [Add] inputs: [634 -> (32, 512, 1)[FLOAT]], [635 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 635 for ONNX node: 635
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_356 for ONNX node: Add_356
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 636 for ONNX tensor: 636
[07/30/2021-18:56:39] [V] [TRT] Add_356 [Add] outputs: [636 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_357 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 636
[07/30/2021-18:56:39] [V] [TRT] Sqrt_357 [Sqrt] inputs: [636 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_357 for ONNX node: Sqrt_357
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 637 for ONNX tensor: 637
[07/30/2021-18:56:39] [V] [TRT] Sqrt_357 [Sqrt] outputs: [637 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_358 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 631
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 637
[07/30/2021-18:56:39] [V] [TRT] Div_358 [Div] inputs: [631 -> (32, 512, 768)[FLOAT]], [637 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_358 for ONNX node: Div_358
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 638 for ONNX tensor: 638
[07/30/2021-18:56:39] [V] [TRT] Div_358 [Div] outputs: [638 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_359 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 638
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_359 [Mul] inputs: [638 -> (32, 512, 768)[FLOAT]], [transformer.layer.3.sa_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.sa_layer_norm.weight for ONNX node: transformer.layer.3.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_359 for ONNX node: Mul_359
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 639 for ONNX tensor: 639
[07/30/2021-18:56:39] [V] [TRT] Mul_359 [Mul] outputs: [639 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_360 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 639
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_360 [Add] inputs: [639 -> (32, 512, 768)[FLOAT]], [transformer.layer.3.sa_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.sa_layer_norm.bias for ONNX node: transformer.layer.3.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_360 for ONNX node: Add_360
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 640 for ONNX tensor: 640
[07/30/2021-18:56:39] [V] [TRT] Add_360 [Add] outputs: [640 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_361 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 640
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1011
[07/30/2021-18:56:39] [V] [TRT] MatMul_361 [MatMul] inputs: [640 -> (32, 512, 768)[FLOAT]], [1011 -> (768, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1011 for ONNX node: 1011
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_361 for ONNX node: MatMul_361
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 642 for ONNX tensor: 642
[07/30/2021-18:56:39] [V] [TRT] MatMul_361 [MatMul] outputs: [642 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_362 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 642
[07/30/2021-18:56:39] [V] [TRT] Add_362 [Add] inputs: [transformer.layer.3.ffn.lin1.bias -> (3072)[FLOAT]], [642 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.ffn.lin1.bias for ONNX node: transformer.layer.3.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_362 for ONNX node: Add_362
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 643 for ONNX tensor: 643
[07/30/2021-18:56:39] [V] [TRT] Add_362 [Add] outputs: [643 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_363 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_363 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_363 [Constant] outputs: [644 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_364 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 643
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 644
[07/30/2021-18:56:39] [V] [TRT] Div_364 [Div] inputs: [643 -> (32, 512, 3072)[FLOAT]], [644 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 644 for ONNX node: 644
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_364 for ONNX node: Div_364
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 645 for ONNX tensor: 645
[07/30/2021-18:56:39] [V] [TRT] Div_364 [Div] outputs: [645 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Erf_365 [Erf]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 645
[07/30/2021-18:56:39] [V] [TRT] Erf_365 [Erf] inputs: [645 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Erf_365 for ONNX node: Erf_365
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 646 for ONNX tensor: 646
[07/30/2021-18:56:39] [V] [TRT] Erf_365 [Erf] outputs: [646 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_366 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_366 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_366 [Constant] outputs: [647 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_367 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 646
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 647
[07/30/2021-18:56:39] [V] [TRT] Add_367 [Add] inputs: [646 -> (32, 512, 3072)[FLOAT]], [647 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 647 for ONNX node: 647
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_367 for ONNX node: Add_367
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 648 for ONNX tensor: 648
[07/30/2021-18:56:39] [V] [TRT] Add_367 [Add] outputs: [648 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_368 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 643
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 648
[07/30/2021-18:56:39] [V] [TRT] Mul_368 [Mul] inputs: [643 -> (32, 512, 3072)[FLOAT]], [648 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_368 for ONNX node: Mul_368
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 649 for ONNX tensor: 649
[07/30/2021-18:56:39] [V] [TRT] Mul_368 [Mul] outputs: [649 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_369 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_369 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_369 [Constant] outputs: [650 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_370 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 649
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 650
[07/30/2021-18:56:39] [V] [TRT] Mul_370 [Mul] inputs: [649 -> (32, 512, 3072)[FLOAT]], [650 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 650 for ONNX node: 650
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_370 for ONNX node: Mul_370
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 651 for ONNX tensor: 651
[07/30/2021-18:56:39] [V] [TRT] Mul_370 [Mul] outputs: [651 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_371 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 651
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1012
[07/30/2021-18:56:39] [V] [TRT] MatMul_371 [MatMul] inputs: [651 -> (32, 512, 3072)[FLOAT]], [1012 -> (3072, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1012 for ONNX node: 1012
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_371 for ONNX node: MatMul_371
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 653 for ONNX tensor: 653
[07/30/2021-18:56:39] [V] [TRT] MatMul_371 [MatMul] outputs: [653 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_372 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 653
[07/30/2021-18:56:39] [V] [TRT] Add_372 [Add] inputs: [transformer.layer.3.ffn.lin2.bias -> (768)[FLOAT]], [653 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.ffn.lin2.bias for ONNX node: transformer.layer.3.ffn.lin2.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_372 for ONNX node: Add_372
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 654 for ONNX tensor: 654
[07/30/2021-18:56:39] [V] [TRT] Add_372 [Add] outputs: [654 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_373 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 654
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 640
[07/30/2021-18:56:39] [V] [TRT] Add_373 [Add] inputs: [654 -> (32, 512, 768)[FLOAT]], [640 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_373 for ONNX node: Add_373
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 655 for ONNX tensor: 655
[07/30/2021-18:56:39] [V] [TRT] Add_373 [Add] outputs: [655 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_374 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 655
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_374 [ReduceMean] inputs: [655 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_374 for ONNX node: ReduceMean_374
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 656 for ONNX tensor: 656
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_374 [ReduceMean] outputs: [656 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_375 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 655
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 656
[07/30/2021-18:56:39] [V] [TRT] Sub_375 [Sub] inputs: [655 -> (32, 512, 768)[FLOAT]], [656 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_375 for ONNX node: Sub_375
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 657 for ONNX tensor: 657
[07/30/2021-18:56:39] [V] [TRT] Sub_375 [Sub] outputs: [657 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_376 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_376 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_376 [Constant] outputs: [658 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_377 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 657
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 658
[07/30/2021-18:56:39] [V] [TRT] Pow_377 [Pow] inputs: [657 -> (32, 512, 768)[FLOAT]], [658 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 658 for ONNX node: 658
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_377 for ONNX node: Pow_377
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 659 for ONNX tensor: 659
[07/30/2021-18:56:39] [V] [TRT] Pow_377 [Pow] outputs: [659 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_378 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 659
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_378 [ReduceMean] inputs: [659 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_378 for ONNX node: ReduceMean_378
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 660 for ONNX tensor: 660
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_378 [ReduceMean] outputs: [660 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_379 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_379 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_379 [Constant] outputs: [661 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_380 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 660
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 661
[07/30/2021-18:56:39] [V] [TRT] Add_380 [Add] inputs: [660 -> (32, 512, 1)[FLOAT]], [661 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 661 for ONNX node: 661
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_380 for ONNX node: Add_380
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 662 for ONNX tensor: 662
[07/30/2021-18:56:39] [V] [TRT] Add_380 [Add] outputs: [662 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_381 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 662
[07/30/2021-18:56:39] [V] [TRT] Sqrt_381 [Sqrt] inputs: [662 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_381 for ONNX node: Sqrt_381
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 663 for ONNX tensor: 663
[07/30/2021-18:56:39] [V] [TRT] Sqrt_381 [Sqrt] outputs: [663 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_382 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 657
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 663
[07/30/2021-18:56:39] [V] [TRT] Div_382 [Div] inputs: [657 -> (32, 512, 768)[FLOAT]], [663 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_382 for ONNX node: Div_382
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 664 for ONNX tensor: 664
[07/30/2021-18:56:39] [V] [TRT] Div_382 [Div] outputs: [664 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_383 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 664
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_383 [Mul] inputs: [664 -> (32, 512, 768)[FLOAT]], [transformer.layer.3.output_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.output_layer_norm.weight for ONNX node: transformer.layer.3.output_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_383 for ONNX node: Mul_383
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 665 for ONNX tensor: 665
[07/30/2021-18:56:39] [V] [TRT] Mul_383 [Mul] outputs: [665 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_384 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 665
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.3.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_384 [Add] inputs: [665 -> (32, 512, 768)[FLOAT]], [transformer.layer.3.output_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.3.output_layer_norm.bias for ONNX node: transformer.layer.3.output_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_384 for ONNX node: Add_384
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 666 for ONNX tensor: 666
[07/30/2021-18:56:39] [V] [TRT] Add_384 [Add] outputs: [666 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_385 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 666
[07/30/2021-18:56:39] [V] [TRT] Shape_385 [Shape] inputs: [666 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_385 for ONNX node: Shape_385
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 667 for ONNX tensor: 667
[07/30/2021-18:56:39] [V] [TRT] Shape_385 [Shape] outputs: [667 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_386 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_386 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_386 [Constant] outputs: [668 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_387 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 667
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 668
[07/30/2021-18:56:39] [V] [TRT] Gather_387 [Gather] inputs: [667 -> (3)[INT32]], [668 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 668 for ONNX node: 668
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_387 for ONNX node: Gather_387
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 669 for ONNX tensor: 669
[07/30/2021-18:56:39] [V] [TRT] Gather_387 [Gather] outputs: [669 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_388 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 666
[07/30/2021-18:56:39] [V] [TRT] Shape_388 [Shape] inputs: [666 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_388 for ONNX node: Shape_388
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 670 for ONNX tensor: 670
[07/30/2021-18:56:39] [V] [TRT] Shape_388 [Shape] outputs: [670 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_389 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_389 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_389 [Constant] outputs: [671 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Gather_390 [Gather]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 670
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 671
[07/30/2021-18:56:39] [V] [TRT] Gather_390 [Gather] inputs: [670 -> (3)[INT32]], [671 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 671 for ONNX node: 671
[07/30/2021-18:56:39] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Gather_390 for ONNX node: Gather_390
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 672 for ONNX tensor: 672
[07/30/2021-18:56:39] [V] [TRT] Gather_390 [Gather] outputs: [672 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_391 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 666
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1013
[07/30/2021-18:56:39] [V] [TRT] MatMul_391 [MatMul] inputs: [666 -> (32, 512, 768)[FLOAT]], [1013 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1013 for ONNX node: 1013
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_391 for ONNX node: MatMul_391
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 674 for ONNX tensor: 674
[07/30/2021-18:56:39] [V] [TRT] MatMul_391 [MatMul] outputs: [674 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_392 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 674
[07/30/2021-18:56:39] [V] [TRT] Add_392 [Add] inputs: [transformer.layer.4.attention.q_lin.bias -> (768)[FLOAT]], [674 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.attention.q_lin.bias for ONNX node: transformer.layer.4.attention.q_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_392 for ONNX node: Add_392
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 675 for ONNX tensor: 675
[07/30/2021-18:56:39] [V] [TRT] Add_392 [Add] outputs: [675 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_393 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_393 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_393 [Constant] outputs: [679 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_394 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 669
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 679
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_394 [Unsqueeze] inputs: [669 -> ()[INT32]], [679 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_394 for ONNX node: Unsqueeze_394
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 680 for ONNX tensor: 680
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_394 [Unsqueeze] outputs: [680 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_395 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 680
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1014
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1015
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1016
[07/30/2021-18:56:39] [V] [TRT] Concat_395 [Concat] inputs: [680 -> (1)[INT32]], [1014 -> (1)[INT32]], [1015 -> (1)[INT32]], [1016 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1014 for ONNX node: 1014
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1015 for ONNX node: 1015
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1016 for ONNX node: 1016
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_395 for ONNX node: Concat_395
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 687 for ONNX tensor: 687
[07/30/2021-18:56:39] [V] [TRT] Concat_395 [Concat] outputs: [687 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_396 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 675
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 687
[07/30/2021-18:56:39] [V] [TRT] Reshape_396 [Reshape] inputs: [675 -> (32, 512, 768)[FLOAT]], [687 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_396 for ONNX node: Reshape_396
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 688 for ONNX tensor: 688
[07/30/2021-18:56:39] [V] [TRT] Reshape_396 [Reshape] outputs: [688 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_397 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 688
[07/30/2021-18:56:39] [V] [TRT] Transpose_397 [Transpose] inputs: [688 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_397 for ONNX node: Transpose_397
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 689 for ONNX tensor: 689
[07/30/2021-18:56:39] [V] [TRT] Transpose_397 [Transpose] outputs: [689 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_398 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 666
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1017
[07/30/2021-18:56:39] [V] [TRT] MatMul_398 [MatMul] inputs: [666 -> (32, 512, 768)[FLOAT]], [1017 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1017 for ONNX node: 1017
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_398 for ONNX node: MatMul_398
[07/30/2021-18:56:39] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 691 for ONNX tensor: 691
[07/30/2021-18:56:39] [V] [TRT] MatMul_398 [MatMul] outputs: [691 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_399 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 691
[07/30/2021-18:56:39] [V] [TRT] Add_399 [Add] inputs: [transformer.layer.4.attention.k_lin.bias -> (768)[FLOAT]], [691 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.attention.k_lin.bias for ONNX node: transformer.layer.4.attention.k_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_399 for ONNX node: Add_399
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 692 for ONNX tensor: 692
[07/30/2021-18:56:39] [V] [TRT] Add_399 [Add] outputs: [692 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_400 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_400 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_400 [Constant] outputs: [696 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_401 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 669
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 696
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_401 [Unsqueeze] inputs: [669 -> ()[INT32]], [696 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_401 for ONNX node: Unsqueeze_401
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 697 for ONNX tensor: 697
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_401 [Unsqueeze] outputs: [697 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_402 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 697
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1018
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1019
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1020
[07/30/2021-18:56:39] [V] [TRT] Concat_402 [Concat] inputs: [697 -> (1)[INT32]], [1018 -> (1)[INT32]], [1019 -> (1)[INT32]], [1020 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1018 for ONNX node: 1018
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1019 for ONNX node: 1019
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1020 for ONNX node: 1020
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_402 for ONNX node: Concat_402
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 704 for ONNX tensor: 704
[07/30/2021-18:56:39] [V] [TRT] Concat_402 [Concat] outputs: [704 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_403 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 692
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 704
[07/30/2021-18:56:39] [V] [TRT] Reshape_403 [Reshape] inputs: [692 -> (32, 512, 768)[FLOAT]], [704 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_403 for ONNX node: Reshape_403
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 705 for ONNX tensor: 705
[07/30/2021-18:56:39] [V] [TRT] Reshape_403 [Reshape] outputs: [705 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_404 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 666
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1021
[07/30/2021-18:56:39] [V] [TRT] MatMul_404 [MatMul] inputs: [666 -> (32, 512, 768)[FLOAT]], [1021 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1021 for ONNX node: 1021
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_404 for ONNX node: MatMul_404
[07/30/2021-18:56:39] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 707 for ONNX tensor: 707
[07/30/2021-18:56:39] [V] [TRT] MatMul_404 [MatMul] outputs: [707 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_405 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 707
[07/30/2021-18:56:39] [V] [TRT] Add_405 [Add] inputs: [transformer.layer.4.attention.v_lin.bias -> (768)[FLOAT]], [707 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.attention.v_lin.bias for ONNX node: transformer.layer.4.attention.v_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_405 for ONNX node: Add_405
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 708 for ONNX tensor: 708
[07/30/2021-18:56:39] [V] [TRT] Add_405 [Add] outputs: [708 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_406 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_406 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_406 [Constant] outputs: [712 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_407 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 669
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 712
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_407 [Unsqueeze] inputs: [669 -> ()[INT32]], [712 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_407 for ONNX node: Unsqueeze_407
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 713 for ONNX tensor: 713
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_407 [Unsqueeze] outputs: [713 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_408 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 713
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1022
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1023
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1024
[07/30/2021-18:56:39] [V] [TRT] Concat_408 [Concat] inputs: [713 -> (1)[INT32]], [1022 -> (1)[INT32]], [1023 -> (1)[INT32]], [1024 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1022 for ONNX node: 1022
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1023 for ONNX node: 1023
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1024 for ONNX node: 1024
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_408 for ONNX node: Concat_408
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 720 for ONNX tensor: 720
[07/30/2021-18:56:39] [V] [TRT] Concat_408 [Concat] outputs: [720 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_409 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 708
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 720
[07/30/2021-18:56:39] [V] [TRT] Reshape_409 [Reshape] inputs: [708 -> (32, 512, 768)[FLOAT]], [720 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_409 for ONNX node: Reshape_409
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 721 for ONNX tensor: 721
[07/30/2021-18:56:39] [V] [TRT] Reshape_409 [Reshape] outputs: [721 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_410 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 721
[07/30/2021-18:56:39] [V] [TRT] Transpose_410 [Transpose] inputs: [721 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_410 for ONNX node: Transpose_410
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 722 for ONNX tensor: 722
[07/30/2021-18:56:39] [V] [TRT] Transpose_410 [Transpose] outputs: [722 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_411 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_411 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_411 [Constant] outputs: [723 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_412 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 689
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 723
[07/30/2021-18:56:39] [V] [TRT] Div_412 [Div] inputs: [689 -> (32, 12, 512, 64)[FLOAT]], [723 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 723 for ONNX node: 723
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_412 for ONNX node: Div_412
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 724 for ONNX tensor: 724
[07/30/2021-18:56:39] [V] [TRT] Div_412 [Div] outputs: [724 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_413 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 705
[07/30/2021-18:56:39] [V] [TRT] Transpose_413 [Transpose] inputs: [705 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_413 for ONNX node: Transpose_413
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 725 for ONNX tensor: 725
[07/30/2021-18:56:39] [V] [TRT] Transpose_413 [Transpose] outputs: [725 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_414 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 724
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 725
[07/30/2021-18:56:39] [V] [TRT] MatMul_414 [MatMul] inputs: [724 -> (32, 12, 512, 64)[FLOAT]], [725 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_414 for ONNX node: MatMul_414
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 726 for ONNX tensor: 726
[07/30/2021-18:56:39] [V] [TRT] MatMul_414 [MatMul] outputs: [726 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_415 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_415 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_415 [Constant] outputs: [727 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Equal_416 [Equal]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 727
[07/30/2021-18:56:39] [V] [TRT] Equal_416 [Equal] inputs: [1 -> (32, 512)[INT32]], [727 -> ()[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 727 for ONNX node: 727
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Equal_416 for ONNX node: Equal_416
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 728 for ONNX tensor: 728
[07/30/2021-18:56:39] [V] [TRT] Equal_416 [Equal] outputs: [728 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_417 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 728
[07/30/2021-18:56:39] [V] [TRT] Cast_417 [Cast] inputs: [728 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_417 for ONNX node: Cast_417
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 729 for ONNX tensor: 729
[07/30/2021-18:56:39] [V] [TRT] Cast_417 [Cast] outputs: [729 -> (32, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_418 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_418 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_418 [Constant] outputs: [732 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_419 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 669
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 732
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_419 [Unsqueeze] inputs: [669 -> ()[INT32]], [732 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_419 for ONNX node: Unsqueeze_419
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 733 for ONNX tensor: 733
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_419 [Unsqueeze] outputs: [733 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_420 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_420 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_420 [Constant] outputs: [738 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_421 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 672
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 738
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_421 [Unsqueeze] inputs: [672 -> ()[INT32]], [738 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_421 for ONNX node: Unsqueeze_421
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 739 for ONNX tensor: 739
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_421 [Unsqueeze] outputs: [739 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_422 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 733
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1025
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1026
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 739
[07/30/2021-18:56:39] [V] [TRT] Concat_422 [Concat] inputs: [733 -> (1)[INT32]], [1025 -> (1)[INT32]], [1026 -> (1)[INT32]], [739 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1025 for ONNX node: 1025
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1026 for ONNX node: 1026
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_422 for ONNX node: Concat_422
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 740 for ONNX tensor: 740
[07/30/2021-18:56:39] [V] [TRT] Concat_422 [Concat] outputs: [740 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_423 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 729
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 740
[07/30/2021-18:56:39] [V] [TRT] Reshape_423 [Reshape] inputs: [729 -> (32, 512)[INT32]], [740 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_423 for ONNX node: Reshape_423
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 741 for ONNX tensor: 741
[07/30/2021-18:56:39] [V] [TRT] Reshape_423 [Reshape] outputs: [741 -> (32, 1, 1, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Shape_424 [Shape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 726
[07/30/2021-18:56:39] [V] [TRT] Shape_424 [Shape] inputs: [726 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Shape_424 for ONNX node: Shape_424
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 742 for ONNX tensor: 742
[07/30/2021-18:56:39] [V] [TRT] Shape_424 [Shape] outputs: [742 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Expand_425 [Expand]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 741
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 742
[07/30/2021-18:56:39] [V] [TRT] Expand_425 [Expand] inputs: [741 -> (32, 1, 1, 512)[INT32]], [742 -> (4)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Expand_425 for ONNX node: Expand_425
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 743 for ONNX tensor: 743
[07/30/2021-18:56:39] [V] [TRT] Expand_425 [Expand] outputs: [743 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_426 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 743
[07/30/2021-18:56:39] [V] [TRT] Cast_426 [Cast] inputs: [743 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_426 for ONNX node: Cast_426
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 744 for ONNX tensor: 744
[07/30/2021-18:56:39] [V] [TRT] Cast_426 [Cast] outputs: [744 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Cast_427 [Cast]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 744
[07/30/2021-18:56:39] [V] [TRT] Cast_427 [Cast] inputs: [744 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Cast_427 for ONNX node: Cast_427
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 745 for ONNX tensor: 745
[07/30/2021-18:56:39] [V] [TRT] Cast_427 [Cast] outputs: [745 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_428 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_428 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_428 [Constant] outputs: [746 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Where_429 [Where]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 745
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 746
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 726
[07/30/2021-18:56:39] [V] [TRT] Where_429 [Where] inputs: [745 -> (32, 12, 512, 512)[BOOL]], [746 -> ()[FLOAT]], [726 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 746 for ONNX node: 746
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Where_429 for ONNX node: Where_429
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 747 for ONNX tensor: 747
[07/30/2021-18:56:39] [V] [TRT] Where_429 [Where] outputs: [747 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Softmax_430 [Softmax]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 747
[07/30/2021-18:56:39] [V] [TRT] Softmax_430 [Softmax] inputs: [747 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Softmax_430 for ONNX node: Softmax_430
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 748 for ONNX tensor: 748
[07/30/2021-18:56:39] [V] [TRT] Softmax_430 [Softmax] outputs: [748 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_431 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 748
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 722
[07/30/2021-18:56:39] [V] [TRT] MatMul_431 [MatMul] inputs: [748 -> (32, 12, 512, 512)[FLOAT]], [722 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_431 for ONNX node: MatMul_431
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 749 for ONNX tensor: 749
[07/30/2021-18:56:39] [V] [TRT] MatMul_431 [MatMul] outputs: [749 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Transpose_432 [Transpose]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 749
[07/30/2021-18:56:39] [V] [TRT] Transpose_432 [Transpose] inputs: [749 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Transpose_432 for ONNX node: Transpose_432
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 750 for ONNX tensor: 750
[07/30/2021-18:56:39] [V] [TRT] Transpose_432 [Transpose] outputs: [750 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_433 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_433 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_433 [Constant] outputs: [753 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Unsqueeze_434 [Unsqueeze]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 669
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 753
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_434 [Unsqueeze] inputs: [669 -> ()[INT32]], [753 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Unsqueeze_434 for ONNX node: Unsqueeze_434
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 754 for ONNX tensor: 754
[07/30/2021-18:56:39] [V] [TRT] Unsqueeze_434 [Unsqueeze] outputs: [754 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Concat_435 [Concat]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 754
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1027
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1028
[07/30/2021-18:56:39] [V] [TRT] Concat_435 [Concat] inputs: [754 -> (1)[INT32]], [1027 -> (1)[INT32]], [1028 -> (1)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1027 for ONNX node: 1027
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1028 for ONNX node: 1028
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Concat_435 for ONNX node: Concat_435
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 759 for ONNX tensor: 759
[07/30/2021-18:56:39] [V] [TRT] Concat_435 [Concat] outputs: [759 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Reshape_436 [Reshape]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 750
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 759
[07/30/2021-18:56:39] [V] [TRT] Reshape_436 [Reshape] inputs: [750 -> (32, 512, 12, 64)[FLOAT]], [759 -> (3)[INT32]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Reshape_436 for ONNX node: Reshape_436
[07/30/2021-18:56:39] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 760 for ONNX tensor: 760
[07/30/2021-18:56:39] [V] [TRT] Reshape_436 [Reshape] outputs: [760 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_437 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 760
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1029
[07/30/2021-18:56:39] [V] [TRT] MatMul_437 [MatMul] inputs: [760 -> (32, 512, 768)[FLOAT]], [1029 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1029 for ONNX node: 1029
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_437 for ONNX node: MatMul_437
[07/30/2021-18:56:39] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 762 for ONNX tensor: 762
[07/30/2021-18:56:39] [V] [TRT] MatMul_437 [MatMul] outputs: [762 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_438 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 762
[07/30/2021-18:56:39] [V] [TRT] Add_438 [Add] inputs: [transformer.layer.4.attention.out_lin.bias -> (768)[FLOAT]], [762 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.attention.out_lin.bias for ONNX node: transformer.layer.4.attention.out_lin.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_438 for ONNX node: Add_438
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 763 for ONNX tensor: 763
[07/30/2021-18:56:39] [V] [TRT] Add_438 [Add] outputs: [763 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_439 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 763
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 666
[07/30/2021-18:56:39] [V] [TRT] Add_439 [Add] inputs: [763 -> (32, 512, 768)[FLOAT]], [666 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_439 for ONNX node: Add_439
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 764 for ONNX tensor: 764
[07/30/2021-18:56:39] [V] [TRT] Add_439 [Add] outputs: [764 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_440 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 764
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_440 [ReduceMean] inputs: [764 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_440 for ONNX node: ReduceMean_440
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 765 for ONNX tensor: 765
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_440 [ReduceMean] outputs: [765 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sub_441 [Sub]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 764
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 765
[07/30/2021-18:56:39] [V] [TRT] Sub_441 [Sub] inputs: [764 -> (32, 512, 768)[FLOAT]], [765 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sub_441 for ONNX node: Sub_441
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 766 for ONNX tensor: 766
[07/30/2021-18:56:39] [V] [TRT] Sub_441 [Sub] outputs: [766 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_442 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_442 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_442 [Constant] outputs: [767 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Pow_443 [Pow]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 766
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 767
[07/30/2021-18:56:39] [V] [TRT] Pow_443 [Pow] inputs: [766 -> (32, 512, 768)[FLOAT]], [767 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 767 for ONNX node: 767
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Pow_443 for ONNX node: Pow_443
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 768 for ONNX tensor: 768
[07/30/2021-18:56:39] [V] [TRT] Pow_443 [Pow] outputs: [768 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: ReduceMean_444 [ReduceMean]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 768
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_444 [ReduceMean] inputs: [768 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: ReduceMean_444 for ONNX node: ReduceMean_444
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 769 for ONNX tensor: 769
[07/30/2021-18:56:39] [V] [TRT] ReduceMean_444 [ReduceMean] outputs: [769 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_445 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_445 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_445 [Constant] outputs: [770 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_446 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 769
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 770
[07/30/2021-18:56:39] [V] [TRT] Add_446 [Add] inputs: [769 -> (32, 512, 1)[FLOAT]], [770 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 770 for ONNX node: 770
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_446 for ONNX node: Add_446
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 771 for ONNX tensor: 771
[07/30/2021-18:56:39] [V] [TRT] Add_446 [Add] outputs: [771 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Sqrt_447 [Sqrt]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 771
[07/30/2021-18:56:39] [V] [TRT] Sqrt_447 [Sqrt] inputs: [771 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Sqrt_447 for ONNX node: Sqrt_447
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 772 for ONNX tensor: 772
[07/30/2021-18:56:39] [V] [TRT] Sqrt_447 [Sqrt] outputs: [772 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_448 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 766
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 772
[07/30/2021-18:56:39] [V] [TRT] Div_448 [Div] inputs: [766 -> (32, 512, 768)[FLOAT]], [772 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_448 for ONNX node: Div_448
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 773 for ONNX tensor: 773
[07/30/2021-18:56:39] [V] [TRT] Div_448 [Div] outputs: [773 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_449 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 773
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Mul_449 [Mul] inputs: [773 -> (32, 512, 768)[FLOAT]], [transformer.layer.4.sa_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.sa_layer_norm.weight for ONNX node: transformer.layer.4.sa_layer_norm.weight
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_449 for ONNX node: Mul_449
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 774 for ONNX tensor: 774
[07/30/2021-18:56:39] [V] [TRT] Mul_449 [Mul] outputs: [774 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_450 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 774
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Add_450 [Add] inputs: [774 -> (32, 512, 768)[FLOAT]], [transformer.layer.4.sa_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.sa_layer_norm.bias for ONNX node: transformer.layer.4.sa_layer_norm.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_450 for ONNX node: Add_450
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 775 for ONNX tensor: 775
[07/30/2021-18:56:39] [V] [TRT] Add_450 [Add] outputs: [775 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: MatMul_451 [MatMul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 775
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 1030
[07/30/2021-18:56:39] [V] [TRT] MatMul_451 [MatMul] inputs: [775 -> (32, 512, 768)[FLOAT]], [1030 -> (768, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 1030 for ONNX node: 1030
[07/30/2021-18:56:39] [V] [TRT] Registering layer: MatMul_451 for ONNX node: MatMul_451
[07/30/2021-18:56:39] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 777 for ONNX tensor: 777
[07/30/2021-18:56:39] [V] [TRT] MatMul_451 [MatMul] outputs: [777 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_452 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: transformer.layer.4.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 777
[07/30/2021-18:56:39] [V] [TRT] Add_452 [Add] inputs: [transformer.layer.4.ffn.lin1.bias -> (3072)[FLOAT]], [777 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: transformer.layer.4.ffn.lin1.bias for ONNX node: transformer.layer.4.ffn.lin1.bias
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_452 for ONNX node: Add_452
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 778 for ONNX tensor: 778
[07/30/2021-18:56:39] [V] [TRT] Add_452 [Add] outputs: [778 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_453 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_453 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_453 [Constant] outputs: [779 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Div_454 [Div]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 778
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 779
[07/30/2021-18:56:39] [V] [TRT] Div_454 [Div] inputs: [778 -> (32, 512, 3072)[FLOAT]], [779 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 779 for ONNX node: 779
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Div_454 for ONNX node: Div_454
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 780 for ONNX tensor: 780
[07/30/2021-18:56:39] [V] [TRT] Div_454 [Div] outputs: [780 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Erf_455 [Erf]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 780
[07/30/2021-18:56:39] [V] [TRT] Erf_455 [Erf] inputs: [780 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Erf_455 for ONNX node: Erf_455
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 781 for ONNX tensor: 781
[07/30/2021-18:56:39] [V] [TRT] Erf_455 [Erf] outputs: [781 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Constant_456 [Constant]
[07/30/2021-18:56:39] [V] [TRT] Constant_456 [Constant] inputs: 
[07/30/2021-18:56:39] [V] [TRT] Constant_456 [Constant] outputs: [782 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Add_457 [Add]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 781
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 782
[07/30/2021-18:56:39] [V] [TRT] Add_457 [Add] inputs: [781 -> (32, 512, 3072)[FLOAT]], [782 -> ()[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: 782 for ONNX node: 782
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Add_457 for ONNX node: Add_457
[07/30/2021-18:56:39] [V] [TRT] Registering tensor: 783 for ONNX tensor: 783
[07/30/2021-18:56:39] [V] [TRT] Add_457 [Add] outputs: [783 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Parsing node: Mul_458 [Mul]
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 778
[07/30/2021-18:56:39] [V] [TRT] Searching for input: 783
[07/30/2021-18:56:39] [V] [TRT] Mul_458 [Mul] inputs: [778 -> (32, 512, 3072)[FLOAT]], [783 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:39] [V] [TRT] Registering layer: Mul_458 for ONNX node: Mul_458
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 784 for ONNX tensor: 784
[07/30/2021-18:56:40] [V] [TRT] Mul_458 [Mul] outputs: [784 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_459 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_459 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_459 [Constant] outputs: [785 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Mul_460 [Mul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 784
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 785
[07/30/2021-18:56:40] [V] [TRT] Mul_460 [Mul] inputs: [784 -> (32, 512, 3072)[FLOAT]], [785 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 785 for ONNX node: 785
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Mul_460 for ONNX node: Mul_460
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 786 for ONNX tensor: 786
[07/30/2021-18:56:40] [V] [TRT] Mul_460 [Mul] outputs: [786 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_461 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 786
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1031
[07/30/2021-18:56:40] [V] [TRT] MatMul_461 [MatMul] inputs: [786 -> (32, 512, 3072)[FLOAT]], [1031 -> (3072, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1031 for ONNX node: 1031
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_461 for ONNX node: MatMul_461
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 788 for ONNX tensor: 788
[07/30/2021-18:56:40] [V] [TRT] MatMul_461 [MatMul] outputs: [788 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_462 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.4.ffn.lin2.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 788
[07/30/2021-18:56:40] [V] [TRT] Add_462 [Add] inputs: [transformer.layer.4.ffn.lin2.bias -> (768)[FLOAT]], [788 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.4.ffn.lin2.bias for ONNX node: transformer.layer.4.ffn.lin2.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_462 for ONNX node: Add_462
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 789 for ONNX tensor: 789
[07/30/2021-18:56:40] [V] [TRT] Add_462 [Add] outputs: [789 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_463 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 789
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 775
[07/30/2021-18:56:40] [V] [TRT] Add_463 [Add] inputs: [789 -> (32, 512, 768)[FLOAT]], [775 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_463 for ONNX node: Add_463
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 790 for ONNX tensor: 790
[07/30/2021-18:56:40] [V] [TRT] Add_463 [Add] outputs: [790 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: ReduceMean_464 [ReduceMean]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 790
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_464 [ReduceMean] inputs: [790 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: ReduceMean_464 for ONNX node: ReduceMean_464
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 791 for ONNX tensor: 791
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_464 [ReduceMean] outputs: [791 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Sub_465 [Sub]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 790
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 791
[07/30/2021-18:56:40] [V] [TRT] Sub_465 [Sub] inputs: [790 -> (32, 512, 768)[FLOAT]], [791 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Sub_465 for ONNX node: Sub_465
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 792 for ONNX tensor: 792
[07/30/2021-18:56:40] [V] [TRT] Sub_465 [Sub] outputs: [792 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_466 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_466 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_466 [Constant] outputs: [793 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Pow_467 [Pow]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 792
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 793
[07/30/2021-18:56:40] [V] [TRT] Pow_467 [Pow] inputs: [792 -> (32, 512, 768)[FLOAT]], [793 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 793 for ONNX node: 793
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Pow_467 for ONNX node: Pow_467
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 794 for ONNX tensor: 794
[07/30/2021-18:56:40] [V] [TRT] Pow_467 [Pow] outputs: [794 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: ReduceMean_468 [ReduceMean]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 794
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_468 [ReduceMean] inputs: [794 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: ReduceMean_468 for ONNX node: ReduceMean_468
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 795 for ONNX tensor: 795
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_468 [ReduceMean] outputs: [795 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_469 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_469 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_469 [Constant] outputs: [796 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_470 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 795
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 796
[07/30/2021-18:56:40] [V] [TRT] Add_470 [Add] inputs: [795 -> (32, 512, 1)[FLOAT]], [796 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 796 for ONNX node: 796
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_470 for ONNX node: Add_470
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 797 for ONNX tensor: 797
[07/30/2021-18:56:40] [V] [TRT] Add_470 [Add] outputs: [797 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Sqrt_471 [Sqrt]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 797
[07/30/2021-18:56:40] [V] [TRT] Sqrt_471 [Sqrt] inputs: [797 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Sqrt_471 for ONNX node: Sqrt_471
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 798 for ONNX tensor: 798
[07/30/2021-18:56:40] [V] [TRT] Sqrt_471 [Sqrt] outputs: [798 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Div_472 [Div]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 792
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 798
[07/30/2021-18:56:40] [V] [TRT] Div_472 [Div] inputs: [792 -> (32, 512, 768)[FLOAT]], [798 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Div_472 for ONNX node: Div_472
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 799 for ONNX tensor: 799
[07/30/2021-18:56:40] [V] [TRT] Div_472 [Div] outputs: [799 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Mul_473 [Mul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 799
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.4.output_layer_norm.weight
[07/30/2021-18:56:40] [V] [TRT] Mul_473 [Mul] inputs: [799 -> (32, 512, 768)[FLOAT]], [transformer.layer.4.output_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.4.output_layer_norm.weight for ONNX node: transformer.layer.4.output_layer_norm.weight
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Mul_473 for ONNX node: Mul_473
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 800 for ONNX tensor: 800
[07/30/2021-18:56:40] [V] [TRT] Mul_473 [Mul] outputs: [800 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_474 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 800
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.4.output_layer_norm.bias
[07/30/2021-18:56:40] [V] [TRT] Add_474 [Add] inputs: [800 -> (32, 512, 768)[FLOAT]], [transformer.layer.4.output_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.4.output_layer_norm.bias for ONNX node: transformer.layer.4.output_layer_norm.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_474 for ONNX node: Add_474
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 801 for ONNX tensor: 801
[07/30/2021-18:56:40] [V] [TRT] Add_474 [Add] outputs: [801 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Shape_475 [Shape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 801
[07/30/2021-18:56:40] [V] [TRT] Shape_475 [Shape] inputs: [801 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Shape_475 for ONNX node: Shape_475
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 802 for ONNX tensor: 802
[07/30/2021-18:56:40] [V] [TRT] Shape_475 [Shape] outputs: [802 -> (3)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_476 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_476 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_476 [Constant] outputs: [803 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Gather_477 [Gather]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 802
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 803
[07/30/2021-18:56:40] [V] [TRT] Gather_477 [Gather] inputs: [802 -> (3)[INT32]], [803 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 803 for ONNX node: 803
[07/30/2021-18:56:40] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Gather_477 for ONNX node: Gather_477
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 804 for ONNX tensor: 804
[07/30/2021-18:56:40] [V] [TRT] Gather_477 [Gather] outputs: [804 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Shape_478 [Shape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 801
[07/30/2021-18:56:40] [V] [TRT] Shape_478 [Shape] inputs: [801 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Shape_478 for ONNX node: Shape_478
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 805 for ONNX tensor: 805
[07/30/2021-18:56:40] [V] [TRT] Shape_478 [Shape] outputs: [805 -> (3)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_479 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_479 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_479 [Constant] outputs: [806 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Gather_480 [Gather]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 805
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 806
[07/30/2021-18:56:40] [V] [TRT] Gather_480 [Gather] inputs: [805 -> (3)[INT32]], [806 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 806 for ONNX node: 806
[07/30/2021-18:56:40] [V] [TRT] Using Gather axis: 0
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Gather_480 for ONNX node: Gather_480
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 807 for ONNX tensor: 807
[07/30/2021-18:56:40] [V] [TRT] Gather_480 [Gather] outputs: [807 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_481 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 801
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1032
[07/30/2021-18:56:40] [V] [TRT] MatMul_481 [MatMul] inputs: [801 -> (32, 512, 768)[FLOAT]], [1032 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1032 for ONNX node: 1032
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_481 for ONNX node: MatMul_481
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 809 for ONNX tensor: 809
[07/30/2021-18:56:40] [V] [TRT] MatMul_481 [MatMul] outputs: [809 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_482 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.attention.q_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 809
[07/30/2021-18:56:40] [V] [TRT] Add_482 [Add] inputs: [transformer.layer.5.attention.q_lin.bias -> (768)[FLOAT]], [809 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.attention.q_lin.bias for ONNX node: transformer.layer.5.attention.q_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_482 for ONNX node: Add_482
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 810 for ONNX tensor: 810
[07/30/2021-18:56:40] [V] [TRT] Add_482 [Add] outputs: [810 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_483 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_483 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_483 [Constant] outputs: [814 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Unsqueeze_484 [Unsqueeze]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 804
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 814
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_484 [Unsqueeze] inputs: [804 -> ()[INT32]], [814 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Unsqueeze_484 for ONNX node: Unsqueeze_484
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 815 for ONNX tensor: 815
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_484 [Unsqueeze] outputs: [815 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Concat_485 [Concat]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 815
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1033
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1034
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1035
[07/30/2021-18:56:40] [V] [TRT] Concat_485 [Concat] inputs: [815 -> (1)[INT32]], [1033 -> (1)[INT32]], [1034 -> (1)[INT32]], [1035 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1033 for ONNX node: 1033
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1034 for ONNX node: 1034
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1035 for ONNX node: 1035
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Concat_485 for ONNX node: Concat_485
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 822 for ONNX tensor: 822
[07/30/2021-18:56:40] [V] [TRT] Concat_485 [Concat] outputs: [822 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Reshape_486 [Reshape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 810
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 822
[07/30/2021-18:56:40] [V] [TRT] Reshape_486 [Reshape] inputs: [810 -> (32, 512, 768)[FLOAT]], [822 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Reshape_486 for ONNX node: Reshape_486
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 823 for ONNX tensor: 823
[07/30/2021-18:56:40] [V] [TRT] Reshape_486 [Reshape] outputs: [823 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Transpose_487 [Transpose]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 823
[07/30/2021-18:56:40] [V] [TRT] Transpose_487 [Transpose] inputs: [823 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Transpose_487 for ONNX node: Transpose_487
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 824 for ONNX tensor: 824
[07/30/2021-18:56:40] [V] [TRT] Transpose_487 [Transpose] outputs: [824 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_488 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 801
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1036
[07/30/2021-18:56:40] [V] [TRT] MatMul_488 [MatMul] inputs: [801 -> (32, 512, 768)[FLOAT]], [1036 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1036 for ONNX node: 1036
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_488 for ONNX node: MatMul_488
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 826 for ONNX tensor: 826
[07/30/2021-18:56:40] [V] [TRT] MatMul_488 [MatMul] outputs: [826 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_489 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.attention.k_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 826
[07/30/2021-18:56:40] [V] [TRT] Add_489 [Add] inputs: [transformer.layer.5.attention.k_lin.bias -> (768)[FLOAT]], [826 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.attention.k_lin.bias for ONNX node: transformer.layer.5.attention.k_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_489 for ONNX node: Add_489
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 827 for ONNX tensor: 827
[07/30/2021-18:56:40] [V] [TRT] Add_489 [Add] outputs: [827 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_490 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_490 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_490 [Constant] outputs: [831 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Unsqueeze_491 [Unsqueeze]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 804
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 831
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_491 [Unsqueeze] inputs: [804 -> ()[INT32]], [831 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Unsqueeze_491 for ONNX node: Unsqueeze_491
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 832 for ONNX tensor: 832
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_491 [Unsqueeze] outputs: [832 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Concat_492 [Concat]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 832
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1037
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1038
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1039
[07/30/2021-18:56:40] [V] [TRT] Concat_492 [Concat] inputs: [832 -> (1)[INT32]], [1037 -> (1)[INT32]], [1038 -> (1)[INT32]], [1039 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1037 for ONNX node: 1037
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1038 for ONNX node: 1038
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1039 for ONNX node: 1039
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Concat_492 for ONNX node: Concat_492
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 839 for ONNX tensor: 839
[07/30/2021-18:56:40] [V] [TRT] Concat_492 [Concat] outputs: [839 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Reshape_493 [Reshape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 827
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 839
[07/30/2021-18:56:40] [V] [TRT] Reshape_493 [Reshape] inputs: [827 -> (32, 512, 768)[FLOAT]], [839 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Reshape_493 for ONNX node: Reshape_493
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 840 for ONNX tensor: 840
[07/30/2021-18:56:40] [V] [TRT] Reshape_493 [Reshape] outputs: [840 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_494 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 801
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1040
[07/30/2021-18:56:40] [V] [TRT] MatMul_494 [MatMul] inputs: [801 -> (32, 512, 768)[FLOAT]], [1040 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1040 for ONNX node: 1040
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_494 for ONNX node: MatMul_494
[07/30/2021-18:56:40] [I] [TRT] MatMul_494: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 842 for ONNX tensor: 842
[07/30/2021-18:56:40] [V] [TRT] MatMul_494 [MatMul] outputs: [842 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_495 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.attention.v_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 842
[07/30/2021-18:56:40] [V] [TRT] Add_495 [Add] inputs: [transformer.layer.5.attention.v_lin.bias -> (768)[FLOAT]], [842 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.attention.v_lin.bias for ONNX node: transformer.layer.5.attention.v_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_495 for ONNX node: Add_495
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 843 for ONNX tensor: 843
[07/30/2021-18:56:40] [V] [TRT] Add_495 [Add] outputs: [843 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_496 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_496 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_496 [Constant] outputs: [847 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Unsqueeze_497 [Unsqueeze]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 804
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 847
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_497 [Unsqueeze] inputs: [804 -> ()[INT32]], [847 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Unsqueeze_497 for ONNX node: Unsqueeze_497
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 848 for ONNX tensor: 848
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_497 [Unsqueeze] outputs: [848 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Concat_498 [Concat]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 848
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1041
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1042
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1043
[07/30/2021-18:56:40] [V] [TRT] Concat_498 [Concat] inputs: [848 -> (1)[INT32]], [1041 -> (1)[INT32]], [1042 -> (1)[INT32]], [1043 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1041 for ONNX node: 1041
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1042 for ONNX node: 1042
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1043 for ONNX node: 1043
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Concat_498 for ONNX node: Concat_498
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 855 for ONNX tensor: 855
[07/30/2021-18:56:40] [V] [TRT] Concat_498 [Concat] outputs: [855 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Reshape_499 [Reshape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 843
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 855
[07/30/2021-18:56:40] [V] [TRT] Reshape_499 [Reshape] inputs: [843 -> (32, 512, 768)[FLOAT]], [855 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Reshape_499 for ONNX node: Reshape_499
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_494: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 856 for ONNX tensor: 856
[07/30/2021-18:56:40] [V] [TRT] Reshape_499 [Reshape] outputs: [856 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Transpose_500 [Transpose]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 856
[07/30/2021-18:56:40] [V] [TRT] Transpose_500 [Transpose] inputs: [856 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Transpose_500 for ONNX node: Transpose_500
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 857 for ONNX tensor: 857
[07/30/2021-18:56:40] [V] [TRT] Transpose_500 [Transpose] outputs: [857 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_501 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_501 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_501 [Constant] outputs: [858 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Div_502 [Div]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 824
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 858
[07/30/2021-18:56:40] [V] [TRT] Div_502 [Div] inputs: [824 -> (32, 12, 512, 64)[FLOAT]], [858 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 858 for ONNX node: 858
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Div_502 for ONNX node: Div_502
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 859 for ONNX tensor: 859
[07/30/2021-18:56:40] [V] [TRT] Div_502 [Div] outputs: [859 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Transpose_503 [Transpose]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 840
[07/30/2021-18:56:40] [V] [TRT] Transpose_503 [Transpose] inputs: [840 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Transpose_503 for ONNX node: Transpose_503
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 860 for ONNX tensor: 860
[07/30/2021-18:56:40] [V] [TRT] Transpose_503 [Transpose] outputs: [860 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_504 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 859
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 860
[07/30/2021-18:56:40] [V] [TRT] MatMul_504 [MatMul] inputs: [859 -> (32, 12, 512, 64)[FLOAT]], [860 -> (32, 12, 64, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_504 for ONNX node: MatMul_504
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 861 for ONNX tensor: 861
[07/30/2021-18:56:40] [V] [TRT] MatMul_504 [MatMul] outputs: [861 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_505 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_505 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_505 [Constant] outputs: [862 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Equal_506 [Equal]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 862
[07/30/2021-18:56:40] [V] [TRT] Equal_506 [Equal] inputs: [1 -> (32, 512)[INT32]], [862 -> ()[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 862 for ONNX node: 862
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Equal_506 for ONNX node: Equal_506
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 863 for ONNX tensor: 863
[07/30/2021-18:56:40] [V] [TRT] Equal_506 [Equal] outputs: [863 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Cast_507 [Cast]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 863
[07/30/2021-18:56:40] [V] [TRT] Cast_507 [Cast] inputs: [863 -> (32, 512)[BOOL]], 
[07/30/2021-18:56:40] [V] [TRT] Casting to type: int32
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Cast_507 for ONNX node: Cast_507
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 864 for ONNX tensor: 864
[07/30/2021-18:56:40] [V] [TRT] Cast_507 [Cast] outputs: [864 -> (32, 512)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_508 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_508 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_508 [Constant] outputs: [867 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Unsqueeze_509 [Unsqueeze]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 804
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 867
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_509 [Unsqueeze] inputs: [804 -> ()[INT32]], [867 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Unsqueeze_509 for ONNX node: Unsqueeze_509
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 868 for ONNX tensor: 868
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_509 [Unsqueeze] outputs: [868 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_510 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_510 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_510 [Constant] outputs: [873 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Unsqueeze_511 [Unsqueeze]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 807
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 873
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_511 [Unsqueeze] inputs: [807 -> ()[INT32]], [873 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Unsqueeze_511 for ONNX node: Unsqueeze_511
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_511 [Unsqueeze] outputs: [874 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Concat_512 [Concat]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 868
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1044
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1045
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 874
[07/30/2021-18:56:40] [V] [TRT] Concat_512 [Concat] inputs: [868 -> (1)[INT32]], [1044 -> (1)[INT32]], [1045 -> (1)[INT32]], [874 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1044 for ONNX node: 1044
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1045 for ONNX node: 1045
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Concat_512 for ONNX node: Concat_512
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 875 for ONNX tensor: 875
[07/30/2021-18:56:40] [V] [TRT] Concat_512 [Concat] outputs: [875 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Reshape_513 [Reshape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 864
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 875
[07/30/2021-18:56:40] [V] [TRT] Reshape_513 [Reshape] inputs: [864 -> (32, 512)[INT32]], [875 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Reshape_513 for ONNX node: Reshape_513
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_494: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 876 for ONNX tensor: 876
[07/30/2021-18:56:40] [V] [TRT] Reshape_513 [Reshape] outputs: [876 -> (32, 1, 1, 512)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Shape_514 [Shape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 861
[07/30/2021-18:56:40] [V] [TRT] Shape_514 [Shape] inputs: [861 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Shape_514 for ONNX node: Shape_514
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 877 for ONNX tensor: 877
[07/30/2021-18:56:40] [V] [TRT] Shape_514 [Shape] outputs: [877 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Expand_515 [Expand]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 876
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 877
[07/30/2021-18:56:40] [V] [TRT] Expand_515 [Expand] inputs: [876 -> (32, 1, 1, 512)[INT32]], [877 -> (4)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Expand_515 for ONNX node: Expand_515
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_494: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 878 for ONNX tensor: 878
[07/30/2021-18:56:40] [V] [TRT] Expand_515 [Expand] outputs: [878 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Cast_516 [Cast]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 878
[07/30/2021-18:56:40] [V] [TRT] Cast_516 [Cast] inputs: [878 -> (32, 12, 512, 512)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Cast_516 for ONNX node: Cast_516
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 879 for ONNX tensor: 879
[07/30/2021-18:56:40] [V] [TRT] Cast_516 [Cast] outputs: [879 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Cast_517 [Cast]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 879
[07/30/2021-18:56:40] [V] [TRT] Cast_517 [Cast] inputs: [879 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:40] [V] [TRT] Casting to type: bool
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Cast_517 for ONNX node: Cast_517
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 880 for ONNX tensor: 880
[07/30/2021-18:56:40] [V] [TRT] Cast_517 [Cast] outputs: [880 -> (32, 12, 512, 512)[BOOL]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_518 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_518 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_518 [Constant] outputs: [881 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Where_519 [Where]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 880
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 881
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 861
[07/30/2021-18:56:40] [V] [TRT] Where_519 [Where] inputs: [880 -> (32, 12, 512, 512)[BOOL]], [881 -> ()[FLOAT]], [861 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 881 for ONNX node: 881
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Where_519 for ONNX node: Where_519
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 882 for ONNX tensor: 882
[07/30/2021-18:56:40] [V] [TRT] Where_519 [Where] outputs: [882 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Softmax_520 [Softmax]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 882
[07/30/2021-18:56:40] [V] [TRT] Softmax_520 [Softmax] inputs: [882 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Softmax_520 for ONNX node: Softmax_520
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 883 for ONNX tensor: 883
[07/30/2021-18:56:40] [V] [TRT] Softmax_520 [Softmax] outputs: [883 -> (32, 12, 512, 512)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_521 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 883
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 857
[07/30/2021-18:56:40] [V] [TRT] MatMul_521 [MatMul] inputs: [883 -> (32, 12, 512, 512)[FLOAT]], [857 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_521 for ONNX node: MatMul_521
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 884 for ONNX tensor: 884
[07/30/2021-18:56:40] [V] [TRT] MatMul_521 [MatMul] outputs: [884 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Transpose_522 [Transpose]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 884
[07/30/2021-18:56:40] [V] [TRT] Transpose_522 [Transpose] inputs: [884 -> (32, 12, 512, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Transpose_522 for ONNX node: Transpose_522
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 885 for ONNX tensor: 885
[07/30/2021-18:56:40] [V] [TRT] Transpose_522 [Transpose] outputs: [885 -> (32, 512, 12, 64)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_523 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_523 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_523 [Constant] outputs: [888 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Unsqueeze_524 [Unsqueeze]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 804
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 888
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_524 [Unsqueeze] inputs: [804 -> ()[INT32]], [888 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Original shape: (), unsqueezing to: (1,)
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Unsqueeze_524 for ONNX node: Unsqueeze_524
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 889 for ONNX tensor: 889
[07/30/2021-18:56:40] [V] [TRT] Unsqueeze_524 [Unsqueeze] outputs: [889 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Concat_525 [Concat]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 889
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1046
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1047
[07/30/2021-18:56:40] [V] [TRT] Concat_525 [Concat] inputs: [889 -> (1)[INT32]], [1046 -> (1)[INT32]], [1047 -> (1)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1046 for ONNX node: 1046
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1047 for ONNX node: 1047
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Concat_525 for ONNX node: Concat_525
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 894 for ONNX tensor: 894
[07/30/2021-18:56:40] [V] [TRT] Concat_525 [Concat] outputs: [894 -> (3)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Reshape_526 [Reshape]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 885
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 894
[07/30/2021-18:56:40] [V] [TRT] Reshape_526 [Reshape] inputs: [885 -> (32, 512, 12, 64)[FLOAT]], [894 -> (3)[INT32]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Reshape_526 for ONNX node: Reshape_526
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_494: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 895 for ONNX tensor: 895
[07/30/2021-18:56:40] [V] [TRT] Reshape_526 [Reshape] outputs: [895 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_527 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 895
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1048
[07/30/2021-18:56:40] [V] [TRT] MatMul_527 [MatMul] inputs: [895 -> (32, 512, 768)[FLOAT]], [1048 -> (768, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1048 for ONNX node: 1048
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_527 for ONNX node: MatMul_527
[07/30/2021-18:56:40] [I] [TRT] MatMul_527: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 897 for ONNX tensor: 897
[07/30/2021-18:56:40] [V] [TRT] MatMul_527 [MatMul] outputs: [897 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_528 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.attention.out_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 897
[07/30/2021-18:56:40] [V] [TRT] Add_528 [Add] inputs: [transformer.layer.5.attention.out_lin.bias -> (768)[FLOAT]], [897 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.attention.out_lin.bias for ONNX node: transformer.layer.5.attention.out_lin.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_528 for ONNX node: Add_528
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 898 for ONNX tensor: 898
[07/30/2021-18:56:40] [V] [TRT] Add_528 [Add] outputs: [898 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_529 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 898
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 801
[07/30/2021-18:56:40] [V] [TRT] Add_529 [Add] inputs: [898 -> (32, 512, 768)[FLOAT]], [801 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_529 for ONNX node: Add_529
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 899 for ONNX tensor: 899
[07/30/2021-18:56:40] [V] [TRT] Add_529 [Add] outputs: [899 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: ReduceMean_530 [ReduceMean]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 899
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_530 [ReduceMean] inputs: [899 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: ReduceMean_530 for ONNX node: ReduceMean_530
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 900 for ONNX tensor: 900
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_530 [ReduceMean] outputs: [900 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Sub_531 [Sub]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 899
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 900
[07/30/2021-18:56:40] [V] [TRT] Sub_531 [Sub] inputs: [899 -> (32, 512, 768)[FLOAT]], [900 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Sub_531 for ONNX node: Sub_531
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 901 for ONNX tensor: 901
[07/30/2021-18:56:40] [V] [TRT] Sub_531 [Sub] outputs: [901 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_532 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_532 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_532 [Constant] outputs: [902 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Pow_533 [Pow]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 901
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 902
[07/30/2021-18:56:40] [V] [TRT] Pow_533 [Pow] inputs: [901 -> (32, 512, 768)[FLOAT]], [902 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 902 for ONNX node: 902
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Pow_533 for ONNX node: Pow_533
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 903 for ONNX tensor: 903
[07/30/2021-18:56:40] [V] [TRT] Pow_533 [Pow] outputs: [903 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: ReduceMean_534 [ReduceMean]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 903
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_534 [ReduceMean] inputs: [903 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: ReduceMean_534 for ONNX node: ReduceMean_534
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 904 for ONNX tensor: 904
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_534 [ReduceMean] outputs: [904 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_535 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_535 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_535 [Constant] outputs: [905 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_536 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 904
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 905
[07/30/2021-18:56:40] [V] [TRT] Add_536 [Add] inputs: [904 -> (32, 512, 1)[FLOAT]], [905 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 905 for ONNX node: 905
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_536 for ONNX node: Add_536
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 906 for ONNX tensor: 906
[07/30/2021-18:56:40] [V] [TRT] Add_536 [Add] outputs: [906 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Sqrt_537 [Sqrt]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 906
[07/30/2021-18:56:40] [V] [TRT] Sqrt_537 [Sqrt] inputs: [906 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Sqrt_537 for ONNX node: Sqrt_537
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 907 for ONNX tensor: 907
[07/30/2021-18:56:40] [V] [TRT] Sqrt_537 [Sqrt] outputs: [907 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Div_538 [Div]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 901
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 907
[07/30/2021-18:56:40] [V] [TRT] Div_538 [Div] inputs: [901 -> (32, 512, 768)[FLOAT]], [907 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Div_538 for ONNX node: Div_538
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 908 for ONNX tensor: 908
[07/30/2021-18:56:40] [V] [TRT] Div_538 [Div] outputs: [908 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Mul_539 [Mul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 908
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.sa_layer_norm.weight
[07/30/2021-18:56:40] [V] [TRT] Mul_539 [Mul] inputs: [908 -> (32, 512, 768)[FLOAT]], [transformer.layer.5.sa_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.sa_layer_norm.weight for ONNX node: transformer.layer.5.sa_layer_norm.weight
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Mul_539 for ONNX node: Mul_539
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 909 for ONNX tensor: 909
[07/30/2021-18:56:40] [V] [TRT] Mul_539 [Mul] outputs: [909 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_540 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 909
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.sa_layer_norm.bias
[07/30/2021-18:56:40] [V] [TRT] Add_540 [Add] inputs: [909 -> (32, 512, 768)[FLOAT]], [transformer.layer.5.sa_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.sa_layer_norm.bias for ONNX node: transformer.layer.5.sa_layer_norm.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_540 for ONNX node: Add_540
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 910 for ONNX tensor: 910
[07/30/2021-18:56:40] [V] [TRT] Add_540 [Add] outputs: [910 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_541 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 910
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1049
[07/30/2021-18:56:40] [V] [TRT] MatMul_541 [MatMul] inputs: [910 -> (32, 512, 768)[FLOAT]], [1049 -> (768, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1049 for ONNX node: 1049
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_541 for ONNX node: MatMul_541
[07/30/2021-18:56:40] [I] [TRT] MatMul_541: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 912 for ONNX tensor: 912
[07/30/2021-18:56:40] [V] [TRT] MatMul_541 [MatMul] outputs: [912 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_542 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.ffn.lin1.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 912
[07/30/2021-18:56:40] [V] [TRT] Add_542 [Add] inputs: [transformer.layer.5.ffn.lin1.bias -> (3072)[FLOAT]], [912 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.ffn.lin1.bias for ONNX node: transformer.layer.5.ffn.lin1.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_542 for ONNX node: Add_542
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 913 for ONNX tensor: 913
[07/30/2021-18:56:40] [V] [TRT] Add_542 [Add] outputs: [913 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_543 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_543 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_543 [Constant] outputs: [914 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Div_544 [Div]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 913
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 914
[07/30/2021-18:56:40] [V] [TRT] Div_544 [Div] inputs: [913 -> (32, 512, 3072)[FLOAT]], [914 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 914 for ONNX node: 914
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Div_544 for ONNX node: Div_544
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 915 for ONNX tensor: 915
[07/30/2021-18:56:40] [V] [TRT] Div_544 [Div] outputs: [915 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Erf_545 [Erf]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 915
[07/30/2021-18:56:40] [V] [TRT] Erf_545 [Erf] inputs: [915 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Erf_545 for ONNX node: Erf_545
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 916 for ONNX tensor: 916
[07/30/2021-18:56:40] [V] [TRT] Erf_545 [Erf] outputs: [916 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_546 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_546 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_546 [Constant] outputs: [917 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_547 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 916
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 917
[07/30/2021-18:56:40] [V] [TRT] Add_547 [Add] inputs: [916 -> (32, 512, 3072)[FLOAT]], [917 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 917 for ONNX node: 917
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_547 for ONNX node: Add_547
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 918 for ONNX tensor: 918
[07/30/2021-18:56:40] [V] [TRT] Add_547 [Add] outputs: [918 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Mul_548 [Mul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 913
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 918
[07/30/2021-18:56:40] [V] [TRT] Mul_548 [Mul] inputs: [913 -> (32, 512, 3072)[FLOAT]], [918 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Mul_548 for ONNX node: Mul_548
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 919 for ONNX tensor: 919
[07/30/2021-18:56:40] [V] [TRT] Mul_548 [Mul] outputs: [919 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_549 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_549 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_549 [Constant] outputs: [920 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Mul_550 [Mul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 919
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 920
[07/30/2021-18:56:40] [V] [TRT] Mul_550 [Mul] inputs: [919 -> (32, 512, 3072)[FLOAT]], [920 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 920 for ONNX node: 920
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Mul_550 for ONNX node: Mul_550
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 921 for ONNX tensor: 921
[07/30/2021-18:56:40] [V] [TRT] Mul_550 [Mul] outputs: [921 -> (32, 512, 3072)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: MatMul_551 [MatMul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 921
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 1050
[07/30/2021-18:56:40] [V] [TRT] MatMul_551 [MatMul] inputs: [921 -> (32, 512, 3072)[FLOAT]], [1050 -> (3072, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 1050 for ONNX node: 1050
[07/30/2021-18:56:40] [V] [TRT] Registering layer: MatMul_551 for ONNX node: MatMul_551
[07/30/2021-18:56:40] [I] [TRT] MatMul_551: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 923 for ONNX tensor: 923
[07/30/2021-18:56:40] [V] [TRT] MatMul_551 [MatMul] outputs: [923 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_552 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.ffn.lin2.bias
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 923
[07/30/2021-18:56:40] [V] [TRT] Add_552 [Add] inputs: [transformer.layer.5.ffn.lin2.bias -> (768)[FLOAT]], [923 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.ffn.lin2.bias for ONNX node: transformer.layer.5.ffn.lin2.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_552 for ONNX node: Add_552
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 924 for ONNX tensor: 924
[07/30/2021-18:56:40] [V] [TRT] Add_552 [Add] outputs: [924 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_553 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 924
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 910
[07/30/2021-18:56:40] [V] [TRT] Add_553 [Add] inputs: [924 -> (32, 512, 768)[FLOAT]], [910 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_553 for ONNX node: Add_553
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 925 for ONNX tensor: 925
[07/30/2021-18:56:40] [V] [TRT] Add_553 [Add] outputs: [925 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: ReduceMean_554 [ReduceMean]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 925
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_554 [ReduceMean] inputs: [925 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: ReduceMean_554 for ONNX node: ReduceMean_554
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 926 for ONNX tensor: 926
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_554 [ReduceMean] outputs: [926 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Sub_555 [Sub]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 925
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 926
[07/30/2021-18:56:40] [V] [TRT] Sub_555 [Sub] inputs: [925 -> (32, 512, 768)[FLOAT]], [926 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Sub_555 for ONNX node: Sub_555
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 927 for ONNX tensor: 927
[07/30/2021-18:56:40] [V] [TRT] Sub_555 [Sub] outputs: [927 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_556 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_556 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_556 [Constant] outputs: [928 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Pow_557 [Pow]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 927
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 928
[07/30/2021-18:56:40] [V] [TRT] Pow_557 [Pow] inputs: [927 -> (32, 512, 768)[FLOAT]], [928 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 928 for ONNX node: 928
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Pow_557 for ONNX node: Pow_557
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 929 for ONNX tensor: 929
[07/30/2021-18:56:40] [V] [TRT] Pow_557 [Pow] outputs: [929 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: ReduceMean_558 [ReduceMean]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 929
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_558 [ReduceMean] inputs: [929 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: ReduceMean_558 for ONNX node: ReduceMean_558
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 930 for ONNX tensor: 930
[07/30/2021-18:56:40] [V] [TRT] ReduceMean_558 [ReduceMean] outputs: [930 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Constant_559 [Constant]
[07/30/2021-18:56:40] [V] [TRT] Constant_559 [Constant] inputs: 
[07/30/2021-18:56:40] [V] [TRT] Constant_559 [Constant] outputs: [931 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_560 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 930
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 931
[07/30/2021-18:56:40] [V] [TRT] Add_560 [Add] inputs: [930 -> (32, 512, 1)[FLOAT]], [931 -> ()[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: 931 for ONNX node: 931
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_560 for ONNX node: Add_560
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 932 for ONNX tensor: 932
[07/30/2021-18:56:40] [V] [TRT] Add_560 [Add] outputs: [932 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Sqrt_561 [Sqrt]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 932
[07/30/2021-18:56:40] [V] [TRT] Sqrt_561 [Sqrt] inputs: [932 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Sqrt_561 for ONNX node: Sqrt_561
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 933 for ONNX tensor: 933
[07/30/2021-18:56:40] [V] [TRT] Sqrt_561 [Sqrt] outputs: [933 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Div_562 [Div]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 927
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 933
[07/30/2021-18:56:40] [V] [TRT] Div_562 [Div] inputs: [927 -> (32, 512, 768)[FLOAT]], [933 -> (32, 512, 1)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Div_562 for ONNX node: Div_562
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 934 for ONNX tensor: 934
[07/30/2021-18:56:40] [V] [TRT] Div_562 [Div] outputs: [934 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Mul_563 [Mul]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 934
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.output_layer_norm.weight
[07/30/2021-18:56:40] [V] [TRT] Mul_563 [Mul] inputs: [934 -> (32, 512, 768)[FLOAT]], [transformer.layer.5.output_layer_norm.weight -> (768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.output_layer_norm.weight for ONNX node: transformer.layer.5.output_layer_norm.weight
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Mul_563 for ONNX node: Mul_563
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 935 for ONNX tensor: 935
[07/30/2021-18:56:40] [V] [TRT] Mul_563 [Mul] outputs: [935 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Parsing node: Add_564 [Add]
[07/30/2021-18:56:40] [V] [TRT] Searching for input: 935
[07/30/2021-18:56:40] [V] [TRT] Searching for input: transformer.layer.5.output_layer_norm.bias
[07/30/2021-18:56:40] [V] [TRT] Add_564 [Add] inputs: [935 -> (32, 512, 768)[FLOAT]], [transformer.layer.5.output_layer_norm.bias -> (768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Registering layer: transformer.layer.5.output_layer_norm.bias for ONNX node: transformer.layer.5.output_layer_norm.bias
[07/30/2021-18:56:40] [V] [TRT] Registering layer: Add_564 for ONNX node: Add_564
[07/30/2021-18:56:40] [V] [TRT] Registering tensor: 936_0 for ONNX tensor: 936
[07/30/2021-18:56:40] [V] [TRT] Add_564 [Add] outputs: [936 -> (32, 512, 768)[FLOAT]], 
[07/30/2021-18:56:40] [V] [TRT] Marking 936_0 as output: 936
[07/30/2021-18:56:40] [I] Finish parsing network model
[07/30/2021-18:56:40] [I] [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 795, GPU 1286 (MiB)
[07/30/2021-18:56:40] [I] [TRT] MatMul_31: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_38: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_44: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_77: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_91: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_101: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_121: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_128: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_134: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_167: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_181: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_191: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_211: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_218: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_224: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_257: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_271: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_281: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_301: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_308: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_314: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_347: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_361: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_371: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_391: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_398: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_404: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_437: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_451: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_461: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_481: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_488: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_494: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_527: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_541: broadcasting input1 to make tensors conform, dims(input0)=[32,512,768][NONE] dims(input1)=[1,768,3072][NONE].
[07/30/2021-18:56:40] [I] [TRT] MatMul_551: broadcasting input1 to make tensors conform, dims(input0)=[32,512,3072][NONE] dims(input1)=[1,3072,768][NONE].
[07/30/2021-18:56:40] [I] [TRT] [MemUsageSnapshot] Builder begin: CPU 809 MiB, GPU 1292 MiB
[07/30/2021-18:56:40] [V] [TRT] Applying generic optimizations to the graph for inference.
[07/30/2021-18:56:40] [V] [TRT] Original: 679 layers
[07/30/2021-18:56:40] [V] [TRT] After dead-layer removal: 679 layers
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 118 with (Unnamed Layer* 28) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 121 with (Unnamed Layer* 32) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing embeddings.LayerNorm.weight with (Unnamed Layer* 37) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing embeddings.LayerNorm.bias with (Unnamed Layer* 40) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 937 with (Unnamed Layer* 49) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.attention.q_lin.bias with (Unnamed Layer* 52) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 941 with (Unnamed Layer* 62) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.attention.k_lin.bias with (Unnamed Layer* 65) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 945 with (Unnamed Layer* 74) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.attention.v_lin.bias with (Unnamed Layer* 77) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 183 with (Unnamed Layer* 87) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 187 with (Unnamed Layer* 92) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 206 with (Unnamed Layer* 112) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 953 with (Unnamed Layer* 124) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.attention.out_lin.bias with (Unnamed Layer* 127) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 227 with (Unnamed Layer* 133) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 230 with (Unnamed Layer* 137) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.sa_layer_norm.weight with (Unnamed Layer* 142) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.sa_layer_norm.bias with (Unnamed Layer* 145) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 954 with (Unnamed Layer* 148) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.ffn.lin1.bias with (Unnamed Layer* 151) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 239 with (Unnamed Layer* 154) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 242 with (Unnamed Layer* 158) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 245 with (Unnamed Layer* 162) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 955 with (Unnamed Layer* 165) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.ffn.lin2.bias with (Unnamed Layer* 168) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 253 with (Unnamed Layer* 174) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 256 with (Unnamed Layer* 178) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.output_layer_norm.weight with (Unnamed Layer* 183) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.0.output_layer_norm.bias with (Unnamed Layer* 186) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 956 with (Unnamed Layer* 195) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.attention.q_lin.bias with (Unnamed Layer* 198) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 960 with (Unnamed Layer* 208) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.attention.k_lin.bias with (Unnamed Layer* 211) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 964 with (Unnamed Layer* 220) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.attention.v_lin.bias with (Unnamed Layer* 223) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 318 with (Unnamed Layer* 233) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 322 with (Unnamed Layer* 238) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 341 with (Unnamed Layer* 258) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 972 with (Unnamed Layer* 270) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.attention.out_lin.bias with (Unnamed Layer* 273) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 362 with (Unnamed Layer* 279) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 365 with (Unnamed Layer* 283) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.sa_layer_norm.weight with (Unnamed Layer* 288) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.sa_layer_norm.bias with (Unnamed Layer* 291) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 973 with (Unnamed Layer* 294) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.ffn.lin1.bias with (Unnamed Layer* 297) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 374 with (Unnamed Layer* 300) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 377 with (Unnamed Layer* 304) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 380 with (Unnamed Layer* 308) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 974 with (Unnamed Layer* 311) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.ffn.lin2.bias with (Unnamed Layer* 314) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 388 with (Unnamed Layer* 320) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 391 with (Unnamed Layer* 324) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.output_layer_norm.weight with (Unnamed Layer* 329) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.1.output_layer_norm.bias with (Unnamed Layer* 332) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 975 with (Unnamed Layer* 341) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.attention.q_lin.bias with (Unnamed Layer* 344) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 979 with (Unnamed Layer* 354) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.attention.k_lin.bias with (Unnamed Layer* 357) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 983 with (Unnamed Layer* 366) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.attention.v_lin.bias with (Unnamed Layer* 369) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 453 with (Unnamed Layer* 379) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 457 with (Unnamed Layer* 384) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 476 with (Unnamed Layer* 404) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 991 with (Unnamed Layer* 416) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.attention.out_lin.bias with (Unnamed Layer* 419) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 497 with (Unnamed Layer* 425) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 500 with (Unnamed Layer* 429) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.sa_layer_norm.weight with (Unnamed Layer* 434) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.sa_layer_norm.bias with (Unnamed Layer* 437) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 992 with (Unnamed Layer* 440) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.ffn.lin1.bias with (Unnamed Layer* 443) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 509 with (Unnamed Layer* 446) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 512 with (Unnamed Layer* 450) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 515 with (Unnamed Layer* 454) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 993 with (Unnamed Layer* 457) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.ffn.lin2.bias with (Unnamed Layer* 460) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 523 with (Unnamed Layer* 466) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 526 with (Unnamed Layer* 470) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.output_layer_norm.weight with (Unnamed Layer* 475) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.2.output_layer_norm.bias with (Unnamed Layer* 478) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 994 with (Unnamed Layer* 487) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.attention.q_lin.bias with (Unnamed Layer* 490) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 998 with (Unnamed Layer* 500) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.attention.k_lin.bias with (Unnamed Layer* 503) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1002 with (Unnamed Layer* 512) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.attention.v_lin.bias with (Unnamed Layer* 515) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 588 with (Unnamed Layer* 525) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 592 with (Unnamed Layer* 530) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 611 with (Unnamed Layer* 550) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1010 with (Unnamed Layer* 562) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.attention.out_lin.bias with (Unnamed Layer* 565) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 632 with (Unnamed Layer* 571) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 635 with (Unnamed Layer* 575) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.sa_layer_norm.weight with (Unnamed Layer* 580) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.sa_layer_norm.bias with (Unnamed Layer* 583) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1011 with (Unnamed Layer* 586) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.ffn.lin1.bias with (Unnamed Layer* 589) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 644 with (Unnamed Layer* 592) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 647 with (Unnamed Layer* 596) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 650 with (Unnamed Layer* 600) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1012 with (Unnamed Layer* 603) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.ffn.lin2.bias with (Unnamed Layer* 606) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 658 with (Unnamed Layer* 612) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 661 with (Unnamed Layer* 616) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.output_layer_norm.weight with (Unnamed Layer* 621) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.3.output_layer_norm.bias with (Unnamed Layer* 624) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1013 with (Unnamed Layer* 633) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.attention.q_lin.bias with (Unnamed Layer* 636) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1017 with (Unnamed Layer* 646) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.attention.k_lin.bias with (Unnamed Layer* 649) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1021 with (Unnamed Layer* 658) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.attention.v_lin.bias with (Unnamed Layer* 661) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 723 with (Unnamed Layer* 671) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 727 with (Unnamed Layer* 676) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 746 with (Unnamed Layer* 696) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1029 with (Unnamed Layer* 708) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.attention.out_lin.bias with (Unnamed Layer* 711) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 767 with (Unnamed Layer* 717) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 770 with (Unnamed Layer* 721) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.sa_layer_norm.weight with (Unnamed Layer* 726) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.sa_layer_norm.bias with (Unnamed Layer* 729) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1030 with (Unnamed Layer* 732) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.ffn.lin1.bias with (Unnamed Layer* 735) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 779 with (Unnamed Layer* 738) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 782 with (Unnamed Layer* 742) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 785 with (Unnamed Layer* 746) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1031 with (Unnamed Layer* 749) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.ffn.lin2.bias with (Unnamed Layer* 752) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 793 with (Unnamed Layer* 758) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 796 with (Unnamed Layer* 762) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.output_layer_norm.weight with (Unnamed Layer* 767) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.4.output_layer_norm.bias with (Unnamed Layer* 770) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1032 with (Unnamed Layer* 779) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.attention.q_lin.bias with (Unnamed Layer* 782) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1036 with (Unnamed Layer* 792) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.attention.k_lin.bias with (Unnamed Layer* 795) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1040 with (Unnamed Layer* 804) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.attention.v_lin.bias with (Unnamed Layer* 807) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 858 with (Unnamed Layer* 817) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 862 with (Unnamed Layer* 822) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 881 with (Unnamed Layer* 842) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_36 with Transpose_37
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_43 with Transpose_53
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_49 with Transpose_50
[07/30/2021-18:56:40] [V] [TRT] Removing (Unnamed Layer* 115) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_72 with Reshape_76
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_126 with Transpose_127
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_133 with Transpose_143
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_139 with Transpose_140
[07/30/2021-18:56:40] [V] [TRT] Removing (Unnamed Layer* 261) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_162 with Reshape_166
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_216 with Transpose_217
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_223 with Transpose_233
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_229 with Transpose_230
[07/30/2021-18:56:40] [V] [TRT] Removing (Unnamed Layer* 407) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_252 with Reshape_256
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_306 with Transpose_307
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_313 with Transpose_323
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_319 with Transpose_320
[07/30/2021-18:56:40] [V] [TRT] Removing (Unnamed Layer* 553) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_342 with Reshape_346
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_396 with Transpose_397
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_403 with Transpose_413
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_409 with Transpose_410
[07/30/2021-18:56:40] [V] [TRT] Removing (Unnamed Layer* 699) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_432 with Reshape_436
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_486 with Transpose_487
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_493 with Transpose_503
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Reshape_499 with Transpose_500
[07/30/2021-18:56:40] [V] [TRT] Removing (Unnamed Layer* 845) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ShuffleShuffleFusion: Fusing Transpose_522 with Reshape_526
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1048 with (Unnamed Layer* 854) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.attention.out_lin.bias with (Unnamed Layer* 857) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 902 with (Unnamed Layer* 863) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 905 with (Unnamed Layer* 867) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.sa_layer_norm.weight with (Unnamed Layer* 872) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.sa_layer_norm.bias with (Unnamed Layer* 875) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1049 with (Unnamed Layer* 878) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.ffn.lin1.bias with (Unnamed Layer* 881) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 914 with (Unnamed Layer* 884) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 917 with (Unnamed Layer* 888) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 920 with (Unnamed Layer* 892) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 1050 with (Unnamed Layer* 895) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.ffn.lin2.bias with (Unnamed Layer* 898) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 928 with (Unnamed Layer* 904) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing 931 with (Unnamed Layer* 908) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.output_layer_norm.weight with (Unnamed Layer* 913) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] ConstShuffleFusion: Fusing transformer.layer.5.output_layer_norm.bias with (Unnamed Layer* 916) [Shuffle]
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_38 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_31 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_44 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_71 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found Softmax_70 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_128 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_121 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_134 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_161 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found Softmax_160 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_218 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_211 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_224 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_251 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found Softmax_250 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_308 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_301 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_314 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_341 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found Softmax_340 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_398 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_391 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_404 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_431 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found Softmax_430 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_488 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_481 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_494 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found MatMul_521 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found Softmax_520 to be part of self-attention pattern.
[07/30/2021-18:56:40] [V] [TRT] Found and reassigned Myelin backends for Self-Attention nodes
[07/30/2021-18:56:40] [V] [TRT] After Myelin optimization: 8 layers
[07/30/2021-18:56:40] [V] [TRT] After scale fusion: 8 layers
[07/30/2021-18:56:40] [V] [TRT] After vertical fusions: 8 layers
[07/30/2021-18:56:40] [V] [TRT] After dupe layer removal: 8 layers
[07/30/2021-18:56:40] [V] [TRT] After final dead-layer removal: 8 layers
[07/30/2021-18:56:40] [V] [TRT] After tensor merging: 8 layers
[07/30/2021-18:56:40] [V] [TRT] After concat removal: 8 layers
[07/30/2021-18:56:40] [V] [TRT] Graph construction and optimization completed in 0.130269 seconds.
[07/30/2021-18:56:41] [V] [TRT] Using cublasLt a tactic source
[07/30/2021-18:56:41] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +747, GPU +320, now: CPU 1557, GPU 1612 (MiB)
[07/30/2021-18:56:41] [V] [TRT] Using cuDNN as a tactic source
[07/30/2021-18:56:41] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +619, GPU +266, now: CPU 2176, GPU 1878 (MiB)
[07/30/2021-18:56:41] [W] [TRT] TensorRT was linked against cuDNN 8.2.1 but loaded cuDNN 8.2.0
[07/30/2021-18:56:41] [W] [TRT] Detected invalid timing cache, setup a local cache instead
[07/30/2021-18:56:41] [V] [TRT] Constructing optimization profile number 0 [1/1].
[07/30/2021-18:56:41] [V] [TRT] *************** Autotuning format combination:  -> Float(768,1) ***************
[07/30/2021-18:56:41] [V] [TRT] *************** Autotuning format combination: Float(768,1), Int32(512,1) -> Float(393216,768,1) ***************
[07/30/2021-18:56:41] [V] [TRT] --------------- Timing Runner: Gather_11 (Gather)
[07/30/2021-18:56:41] [V] [TRT] Tactic: 1 Time: 0.702976
[07/30/2021-18:56:41] [V] [TRT] Tactic: 2 Time: 1.18272
[07/30/2021-18:56:42] [V] [TRT] Tactic: 3 Time: 5.17056
[07/30/2021-18:56:42] [V] [TRT] Tactic: 4 Time: 1.30578
[07/30/2021-18:56:42] [V] [TRT] Tactic: 6 Time: 12.3953
[07/30/2021-18:56:42] [V] [TRT] Tactic: 7 Time: 0.276672
[07/30/2021-18:56:42] [V] [TRT] Tactic: 8 Time: 0.27808
[07/30/2021-18:56:42] [V] [TRT] Tactic: 9 Time: 0.284164
[07/30/2021-18:56:42] [V] [TRT] Fastest Tactic: 7 Time: 0.276672
[07/30/2021-18:56:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Gather Tactic: 7
[07/30/2021-18:56:42] [V] [TRT] *************** Autotuning format combination:  -> Int32(1) ***************
[07/30/2021-18:56:42] [V] [TRT] --------------- Timing Runner: Range_6 (Fill)
[07/30/2021-18:56:42] [V] [TRT] Tactic: 0 is the only option, timing skipped
[07/30/2021-18:56:42] [V] [TRT] Fastest Tactic: 0 Time: 0
[07/30/2021-18:56:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Fill Tactic: 0
[07/30/2021-18:56:42] [V] [TRT] *************** Autotuning format combination:  -> Float(768,1) ***************
[07/30/2021-18:56:42] [V] [TRT] *************** Autotuning format combination: Int32(1) -> Int32(512,1) ***************
[07/30/2021-18:56:42] [V] [TRT] --------------- Timing Runner: Unsqueeze_8 (Shuffle)
[07/30/2021-18:56:42] [V] [TRT] Tactic: 0 Time: 0.00512
[07/30/2021-18:56:42] [V] [TRT] Tactic: 1 Time: 0.007552
[07/30/2021-18:56:42] [V] [TRT] Fastest Tactic: 0 Time: 0.00512
[07/30/2021-18:56:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0
[07/30/2021-18:56:42] [V] [TRT] *************** Autotuning format combination: Int32(512,1) -> Int32(512,1) ***************
[07/30/2021-18:56:42] [V] [TRT] --------------- Timing Runner: Expand_10 (Slice)
[07/30/2021-18:56:42] [V] [TRT] Tactic: 0 is the only option, timing skipped
[07/30/2021-18:56:42] [V] [TRT] Fastest Tactic: 0 Time: 0
[07/30/2021-18:56:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Slice Tactic: 0
[07/30/2021-18:56:42] [V] [TRT] *************** Autotuning format combination: Float(768,1), Int32(512,1) -> Float(393216,768,1) ***************
[07/30/2021-18:56:42] [V] [TRT] --------------- Timing Runner: Gather_12 (Gather)
[07/30/2021-18:56:42] [V] [TRT] Tactic: 1 Time: 0.62592
[07/30/2021-18:56:42] [V] [TRT] Tactic: 2 Time: 1.12326
[07/30/2021-18:56:42] [V] [TRT] Tactic: 3 Time: 5.37651
[07/30/2021-18:56:42] [V] [TRT] Tactic: 4 Time: 0.749824
[07/30/2021-18:56:42] [V] [TRT] Tactic: 6 Time: 12.388
[07/30/2021-18:56:42] [V] [TRT] Tactic: 7 Time: 0.154432
[07/30/2021-18:56:42] [V] [TRT] Tactic: 8 Time: 0.151552
[07/30/2021-18:56:42] [V] [TRT] Tactic: 9 Time: 0.153108
[07/30/2021-18:56:42] [V] [TRT] Fastest Tactic: 8 Time: 0.151552
[07/30/2021-18:56:42] [V] [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Gather Tactic: 8
[07/30/2021-18:56:42] [V] [TRT] *************** Autotuning format combination: Float(393216,768,1), Float(393216,768,1), Int32(512,1) -> Float(393216,768,1) ***************
[07/30/2021-18:56:42] [V] [TRT] --------------- Timing Runner: {ForeignNode[945 + (Unnamed Layer* 74) [Shuffle]...Add_564]} (Myelin)
trtexec: /dvs/p4/build/sw/rel/gpgpu/MachineLearning/myelin_trt8/src/compiler/.././compiler/kernel_gen/kernel_gen_utils.hpp:190: myelin::kgen::dag_vertex_t::operand_t myelin::kgen::{anonymous}::red_partial_operand(const myelin::kgen::dag_vertex_t*): Assertion `rvtx->is_lowered_op()' failed.
Aborted (core dumped)