&&&& RUNNING TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=./sidewalk3.onnx [02/07/2023-12:33:57] [I] === Model Options === [02/07/2023-12:33:57] [I] Format: ONNX [02/07/2023-12:33:57] [I] Model: ./sidewalk3.onnx [02/07/2023-12:33:57] [I] Output: [02/07/2023-12:33:57] [I] === Build Options === [02/07/2023-12:33:57] [I] Max batch: explicit batch [02/07/2023-12:33:57] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default [02/07/2023-12:33:57] [I] minTiming: 1 [02/07/2023-12:33:57] [I] avgTiming: 8 [02/07/2023-12:33:57] [I] Precision: FP32 [02/07/2023-12:33:57] [I] LayerPrecisions: [02/07/2023-12:33:57] [I] Calibration: [02/07/2023-12:33:57] [I] Refit: Disabled [02/07/2023-12:33:57] [I] Sparsity: Disabled [02/07/2023-12:33:57] [I] Safe mode: Disabled [02/07/2023-12:33:57] [I] DirectIO mode: Disabled [02/07/2023-12:33:57] [I] Restricted mode: Disabled [02/07/2023-12:33:57] [I] Build only: Disabled [02/07/2023-12:33:57] [I] Save engine: [02/07/2023-12:33:57] [I] Load engine: [02/07/2023-12:33:57] [I] Profiling verbosity: 0 [02/07/2023-12:33:57] [I] Tactic sources: Using default tactic sources [02/07/2023-12:33:57] [I] timingCacheMode: local [02/07/2023-12:33:57] [I] timingCacheFile: [02/07/2023-12:33:57] [I] Heuristic: Disabled [02/07/2023-12:33:57] [I] Preview Features: Use default preview flags. [02/07/2023-12:33:57] [I] Input(s)s format: fp32:CHW [02/07/2023-12:33:57] [I] Output(s)s format: fp32:CHW [02/07/2023-12:33:57] [I] Input build shapes: model [02/07/2023-12:33:57] [I] Input calibration shapes: model [02/07/2023-12:33:57] [I] === System Options === [02/07/2023-12:33:57] [I] Device: 0 [02/07/2023-12:33:57] [I] DLACore: [02/07/2023-12:33:57] [I] Plugins: [02/07/2023-12:33:57] [I] === Inference Options === [02/07/2023-12:33:57] [I] Batch: Explicit [02/07/2023-12:33:57] [I] Input inference shapes: model [02/07/2023-12:33:57] [I] Iterations: 10 [02/07/2023-12:33:57] [I] Duration: 3s (+ 200ms warm up) [02/07/2023-12:33:57] [I] Sleep time: 0ms [02/07/2023-12:33:57] [I] Idle time: 0ms [02/07/2023-12:33:57] [I] Streams: 1 [02/07/2023-12:33:57] [I] ExposeDMA: Disabled [02/07/2023-12:33:57] [I] Data transfers: Enabled [02/07/2023-12:33:57] [I] Spin-wait: Disabled [02/07/2023-12:33:57] [I] Multithreading: Disabled [02/07/2023-12:33:57] [I] CUDA Graph: Disabled [02/07/2023-12:33:57] [I] Separate profiling: Disabled [02/07/2023-12:33:57] [I] Time Deserialize: Disabled [02/07/2023-12:33:57] [I] Time Refit: Disabled [02/07/2023-12:33:57] [I] NVTX verbosity: 0 [02/07/2023-12:33:57] [I] Persistent Cache Ratio: 0 [02/07/2023-12:33:57] [I] Inputs: [02/07/2023-12:33:57] [I] === Reporting Options === [02/07/2023-12:33:57] [I] Verbose: Disabled [02/07/2023-12:33:57] [I] Averages: 10 inferences [02/07/2023-12:33:57] [I] Percentiles: 90,95,99 [02/07/2023-12:33:57] [I] Dump refittable layers:Disabled [02/07/2023-12:33:57] [I] Dump output: Disabled [02/07/2023-12:33:57] [I] Profile: Disabled [02/07/2023-12:33:57] [I] Export timing to JSON file: [02/07/2023-12:33:57] [I] Export output to JSON file: [02/07/2023-12:33:57] [I] Export profile to JSON file: [02/07/2023-12:33:57] [I] [02/07/2023-12:33:57] [I] === Device Information === [02/07/2023-12:33:57] [I] Selected Device: Orin [02/07/2023-12:33:57] [I] Compute Capability: 8.7 [02/07/2023-12:33:57] [I] SMs: 16 [02/07/2023-12:33:57] [I] Compute Clock Rate: 1.3 GHz [02/07/2023-12:33:57] [I] Device Global Memory: 30588 MiB [02/07/2023-12:33:57] [I] Shared Memory per SM: 164 KiB [02/07/2023-12:33:57] [I] Memory Bus Width: 128 bits (ECC disabled) [02/07/2023-12:33:57] [I] Memory Clock Rate: 1.3 GHz [02/07/2023-12:33:57] [I] [02/07/2023-12:33:57] [I] TensorRT version: 8.5.2 [02/07/2023-12:33:58] [I] [TRT] [MemUsageChange] Init CUDA: CPU +220, GPU +0, now: CPU 246, GPU 4194 (MiB) [02/07/2023-12:34:00] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +302, GPU +398, now: CPU 571, GPU 4613 (MiB) [02/07/2023-12:34:00] [I] Start parsing network model [02/07/2023-12:34:00] [I] [TRT] ---------------------------------------------------------------- [02/07/2023-12:34:00] [I] [TRT] Input filename: ./sidewalk3.onnx [02/07/2023-12:34:00] [I] [TRT] ONNX IR version: 0.0.8 [02/07/2023-12:34:00] [I] [TRT] Opset version: 16 [02/07/2023-12:34:00] [I] [TRT] Producer name: pytorch [02/07/2023-12:34:00] [I] [TRT] Producer version: 1.12.1 [02/07/2023-12:34:00] [I] [TRT] Domain: [02/07/2023-12:34:00] [I] [TRT] Model version: 0 [02/07/2023-12:34:00] [I] [TRT] Doc string: [02/07/2023-12:34:00] [I] [TRT] ---------------------------------------------------------------- [02/07/2023-12:34:00] [W] [TRT] onnx2trt_utils.cpp:375: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32. [02/07/2023-12:34:41] [I] Finish parsing network model [02/07/2023-12:35:34] [I] [TRT] ---------- Layers Running on DLA ---------- [02/07/2023-12:35:34] [I] [TRT] ---------- Layers Running on GPU ---------- [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_263 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.layer_norm_1.bias + (Unnamed Layer* 324) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.layer_norm_1.weight + (Unnamed Layer* 321) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.patch_embeddings.0.layer_norm.bias + (Unnamed Layer* 307) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.patch_embeddings.0.layer_norm.weight + (Unnamed Layer* 304) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_271 + Transpose_272 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_273 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_274 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_946 + (Unnamed Layer* 295) [Shuffle], Pow_276) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_277 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_949 + (Unnamed Layer* 299) [Shuffle], Add_279), Sqrt_280), Div_281), Mul_282), Add_283) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_284 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_285 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_957 + (Unnamed Layer* 312) [Shuffle], Pow_287) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_288 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_960 + (Unnamed Layer* 316) [Shuffle], Add_290), Sqrt_291), Div_292), Mul_293), Add_294) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_299 + Reshape_300 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_301 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.mlp.dense1.bias + (Unnamed Layer* 409) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.layer_norm_2.bias + (Unnamed Layer* 403) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.layer_norm_2.weight + (Unnamed Layer* 400) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.attention.output.dense.bias + (Unnamed Layer* 385) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.attention.self.value.bias + (Unnamed Layer* 367) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.attention.self.layer_norm.bias + (Unnamed Layer* 354) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.attention.self.layer_norm.weight + (Unnamed Layer* 351) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_302 + Transpose_303 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_304 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_305 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1010 + (Unnamed Layer* 342) [Shuffle], Pow_307) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_308 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1013 + (Unnamed Layer* 346) [Shuffle], Add_310), Sqrt_311), Div_312), Mul_313), Add_314) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_318 || MatMul_315 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_318_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_319 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_320 + Transpose_321 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.attention.self.query.bias + (Unnamed Layer* 330) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_295 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_295 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_295 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_296 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_297 + Transpose_298 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.attention.self.key.bias + (Unnamed Layer* 360) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_315_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_315 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_316 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_317 + Transpose_322 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_323 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_1056 + (Unnamed Layer* 374) [Shuffle], Div_325) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_326 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_327 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_328 + Reshape_329 + reshape_before_MatMul_330 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_330 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_330 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_331, Add_332) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_333 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_334 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1078 + (Unnamed Layer* 391) [Shuffle], Pow_336) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_337 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1081 + (Unnamed Layer* 395) [Shuffle], Add_339), Sqrt_340), Div_341), Mul_342), Add_343) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_344 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_344 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_344 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_345 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_346 + Reshape_347 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_348 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.layer_norm_1.bias + (Unnamed Layer* 453) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.layer_norm_1.weight + (Unnamed Layer* 450) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.0.mlp.dense2.bias + (Unnamed Layer* 435) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_356 + Transpose_357 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_1113 + (Unnamed Layer* 421) [Shuffle], Div_359), Erf_360), PWN(onnx::Add_1116 + (Unnamed Layer* 425) [Shuffle], Add_362)), Mul_363), PWN(onnx::Mul_1119 + (Unnamed Layer* 429) [Shuffle], Mul_365)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_366 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_366 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_366 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_367, Add_368) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_369 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_370 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1127 + (Unnamed Layer* 441) [Shuffle], Pow_372) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_373 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1130 + (Unnamed Layer* 445) [Shuffle], Add_375), Sqrt_376), Div_377), Mul_378), Add_379) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_384 + Reshape_385 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_386 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.mlp.dense1.bias + (Unnamed Layer* 538) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.layer_norm_2.bias + (Unnamed Layer* 532) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.layer_norm_2.weight + (Unnamed Layer* 529) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.attention.output.dense.bias + (Unnamed Layer* 514) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.attention.self.value.bias + (Unnamed Layer* 496) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.attention.self.layer_norm.bias + (Unnamed Layer* 483) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.attention.self.layer_norm.weight + (Unnamed Layer* 480) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_387 + Transpose_388 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_389 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_390 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1180 + (Unnamed Layer* 471) [Shuffle], Pow_392) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_393 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1183 + (Unnamed Layer* 475) [Shuffle], Add_395), Sqrt_396), Div_397), Mul_398), Add_399) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_403 || MatMul_400 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_403_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_404 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_405 + Transpose_406 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.attention.self.query.bias + (Unnamed Layer* 459) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_380 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_380 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_380 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_381 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_382 + Transpose_383 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.attention.self.key.bias + (Unnamed Layer* 489) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_400_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_400 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_401 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_402 + Transpose_407 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_408 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_1226 + (Unnamed Layer* 503) [Shuffle], Div_410) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_411 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_412 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_413 + Reshape_414 + reshape_before_MatMul_415 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_415 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_415 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_416, Add_417) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_418 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_419 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1248 + (Unnamed Layer* 520) [Shuffle], Pow_421) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_422 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1251 + (Unnamed Layer* 524) [Shuffle], Add_424), Sqrt_425), Div_426), Mul_427), Add_428) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_429 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_429 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_429 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_430 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_431 + Reshape_432 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_433 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.layer_norm_1.bias + (Unnamed Layer* 582) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.layer_norm_1.weight + (Unnamed Layer* 579) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.1.mlp.dense2.bias + (Unnamed Layer* 564) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_441 + Transpose_442 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_1283 + (Unnamed Layer* 550) [Shuffle], Div_444), Erf_445), PWN(onnx::Add_1286 + (Unnamed Layer* 554) [Shuffle], Add_447)), Mul_448), PWN(onnx::Mul_1289 + (Unnamed Layer* 558) [Shuffle], Mul_450)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_451 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_451 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_451 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_452, Add_453) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_454 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_455 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1297 + (Unnamed Layer* 570) [Shuffle], Pow_457) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_458 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1300 + (Unnamed Layer* 574) [Shuffle], Add_460), Sqrt_461), Div_462), Mul_463), Add_464) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_469 + Reshape_470 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_471 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.mlp.dense1.bias + (Unnamed Layer* 667) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.layer_norm_2.bias + (Unnamed Layer* 661) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.layer_norm_2.weight + (Unnamed Layer* 658) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.attention.output.dense.bias + (Unnamed Layer* 643) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.attention.self.value.bias + (Unnamed Layer* 625) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.attention.self.layer_norm.bias + (Unnamed Layer* 612) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.attention.self.layer_norm.weight + (Unnamed Layer* 609) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_472 + Transpose_473 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_474 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_475 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1350 + (Unnamed Layer* 600) [Shuffle], Pow_477) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_478 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1353 + (Unnamed Layer* 604) [Shuffle], Add_480), Sqrt_481), Div_482), Mul_483), Add_484) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_488 || MatMul_485 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_488_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_489 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_490 + Transpose_491 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.attention.self.query.bias + (Unnamed Layer* 588) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_465 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_465 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_465 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_466 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_467 + Transpose_468 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.attention.self.key.bias + (Unnamed Layer* 618) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_485_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_485 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_486 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_487 + Transpose_492 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_493 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_1396 + (Unnamed Layer* 632) [Shuffle], Div_495) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_496 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_497 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_498 + Reshape_499 + reshape_before_MatMul_500 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_500 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_500 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_501, Add_502) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_503 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_504 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1418 + (Unnamed Layer* 649) [Shuffle], Pow_506) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_507 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1421 + (Unnamed Layer* 653) [Shuffle], Add_509), Sqrt_510), Div_511), Mul_512), Add_513) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_514 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_514 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_514 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_515 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_516 + Reshape_517 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_518 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.0.bias + (Unnamed Layer* 711) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.0.weight + (Unnamed Layer* 708) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.0.2.mlp.dense2.bias + (Unnamed Layer* 693) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_526 + Transpose_527 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_1453 + (Unnamed Layer* 679) [Shuffle], Div_529), Erf_530), PWN(onnx::Add_1456 + (Unnamed Layer* 683) [Shuffle], Add_532)), Mul_533), PWN(onnx::Mul_1459 + (Unnamed Layer* 687) [Shuffle], Mul_535)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_536 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_536 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_536 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_537, Add_538) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_539 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_540 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1467 + (Unnamed Layer* 699) [Shuffle], Pow_542) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_543 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1470 + (Unnamed Layer* 703) [Shuffle], Add_545), Sqrt_546), Div_547), Mul_548), Add_549) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_550 + Transpose_551 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_552 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.layer_norm_1.bias + (Unnamed Layer* 754) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.layer_norm_1.weight + (Unnamed Layer* 751) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.patch_embeddings.1.layer_norm.bias + (Unnamed Layer* 737) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.patch_embeddings.1.layer_norm.weight + (Unnamed Layer* 734) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_560 + Transpose_561 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_562 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_563 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1502 + (Unnamed Layer* 725) [Shuffle], Pow_565) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_566 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1505 + (Unnamed Layer* 729) [Shuffle], Add_568), Sqrt_569), Div_570), Mul_571), Add_572) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_573 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_574 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1513 + (Unnamed Layer* 742) [Shuffle], Pow_576) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_577 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1516 + (Unnamed Layer* 746) [Shuffle], Add_579), Sqrt_580), Div_581), Mul_582), Add_583) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_588 + Reshape_589 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_590 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.mlp.dense1.bias + (Unnamed Layer* 839) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.layer_norm_2.bias + (Unnamed Layer* 833) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.layer_norm_2.weight + (Unnamed Layer* 830) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.attention.output.dense.bias + (Unnamed Layer* 815) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.attention.self.value.bias + (Unnamed Layer* 797) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.attention.self.layer_norm.bias + (Unnamed Layer* 784) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.attention.self.layer_norm.weight + (Unnamed Layer* 781) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_591 + Transpose_592 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_593 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_594 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1566 + (Unnamed Layer* 772) [Shuffle], Pow_596) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_597 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1569 + (Unnamed Layer* 776) [Shuffle], Add_599), Sqrt_600), Div_601), Mul_602), Add_603) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_607 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_607 || MatMul_604 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_607_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_607 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_608 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_609 + Transpose_610 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.attention.self.query.bias + (Unnamed Layer* 760) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_584 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_584 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_584 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_585 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_586 + Transpose_587 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.attention.self.key.bias + (Unnamed Layer* 790) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_604_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_604 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_605 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_606 + Transpose_611 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_612 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_1612 + (Unnamed Layer* 804) [Shuffle], Div_614) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_615 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_616 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_617 + Reshape_618 + reshape_before_MatMul_619 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_619 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_619 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_620, Add_621) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_622 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_623 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1634 + (Unnamed Layer* 821) [Shuffle], Pow_625) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_626 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1637 + (Unnamed Layer* 825) [Shuffle], Add_628), Sqrt_629), Div_630), Mul_631), Add_632) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_633 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_633 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_633 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_634 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_635 + Reshape_636 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_637 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.layer_norm_1.bias + (Unnamed Layer* 883) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.layer_norm_1.weight + (Unnamed Layer* 880) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.0.mlp.dense2.bias + (Unnamed Layer* 865) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_645 + Transpose_646 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_1669 + (Unnamed Layer* 851) [Shuffle], Div_648), Erf_649), PWN(onnx::Add_1672 + (Unnamed Layer* 855) [Shuffle], Add_651)), Mul_652), PWN(onnx::Mul_1675 + (Unnamed Layer* 859) [Shuffle], Mul_654)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_655 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_655 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_655 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_656, Add_657) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_658 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_659 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1683 + (Unnamed Layer* 871) [Shuffle], Pow_661) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_662 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1686 + (Unnamed Layer* 875) [Shuffle], Add_664), Sqrt_665), Div_666), Mul_667), Add_668) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_673 + Reshape_674 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_675 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.mlp.dense1.bias + (Unnamed Layer* 968) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.layer_norm_2.bias + (Unnamed Layer* 962) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.layer_norm_2.weight + (Unnamed Layer* 959) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.attention.output.dense.bias + (Unnamed Layer* 944) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.attention.self.value.bias + (Unnamed Layer* 926) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.attention.self.layer_norm.bias + (Unnamed Layer* 913) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.attention.self.layer_norm.weight + (Unnamed Layer* 910) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_676 + Transpose_677 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_678 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_679 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1736 + (Unnamed Layer* 901) [Shuffle], Pow_681) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_682 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1739 + (Unnamed Layer* 905) [Shuffle], Add_684), Sqrt_685), Div_686), Mul_687), Add_688) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_692 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_692 || MatMul_689 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_692_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_692 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_693 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_694 + Transpose_695 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.attention.self.query.bias + (Unnamed Layer* 889) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_669 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_669 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_669 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_670 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_671 + Transpose_672 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.attention.self.key.bias + (Unnamed Layer* 919) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_689_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_689 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_690 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_691 + Transpose_696 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_697 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_1782 + (Unnamed Layer* 933) [Shuffle], Div_699) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_700 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_701 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_702 + Reshape_703 + reshape_before_MatMul_704 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_704 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_704 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_705, Add_706) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_707 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_708 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1804 + (Unnamed Layer* 950) [Shuffle], Pow_710) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_711 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1807 + (Unnamed Layer* 954) [Shuffle], Add_713), Sqrt_714), Div_715), Mul_716), Add_717) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_718 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_718 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_718 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_719 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_720 + Reshape_721 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_722 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.layer_norm_1.bias + (Unnamed Layer* 1012) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.layer_norm_1.weight + (Unnamed Layer* 1009) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.1.mlp.dense2.bias + (Unnamed Layer* 994) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_730 + Transpose_731 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_1839 + (Unnamed Layer* 980) [Shuffle], Div_733), Erf_734), PWN(onnx::Add_1842 + (Unnamed Layer* 984) [Shuffle], Add_736)), Mul_737), PWN(onnx::Mul_1845 + (Unnamed Layer* 988) [Shuffle], Mul_739)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_740 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_740 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_740 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_741, Add_742) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_743 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_744 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1853 + (Unnamed Layer* 1000) [Shuffle], Pow_746) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_747 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1856 + (Unnamed Layer* 1004) [Shuffle], Add_749), Sqrt_750), Div_751), Mul_752), Add_753) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_758 + Reshape_759 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_760 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.mlp.dense1.bias + (Unnamed Layer* 1097) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.layer_norm_2.bias + (Unnamed Layer* 1091) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.layer_norm_2.weight + (Unnamed Layer* 1088) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.attention.output.dense.bias + (Unnamed Layer* 1073) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.attention.self.value.bias + (Unnamed Layer* 1055) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.attention.self.layer_norm.bias + (Unnamed Layer* 1042) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.attention.self.layer_norm.weight + (Unnamed Layer* 1039) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_761 + Transpose_762 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_763 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_764 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1906 + (Unnamed Layer* 1030) [Shuffle], Pow_766) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_767 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1909 + (Unnamed Layer* 1034) [Shuffle], Add_769), Sqrt_770), Div_771), Mul_772), Add_773) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_777 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_777 || MatMul_774 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_777_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_777 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_778 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_779 + Transpose_780 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.attention.self.query.bias + (Unnamed Layer* 1018) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_754 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_754 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_754 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_755 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_756 + Transpose_757 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.attention.self.key.bias + (Unnamed Layer* 1048) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_774_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_774 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_775 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_776 + Transpose_781 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_782 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_1952 + (Unnamed Layer* 1062) [Shuffle], Div_784) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_785 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_786 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_787 + Reshape_788 + reshape_before_MatMul_789 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_789 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_789 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_790, Add_791) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_792 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_793 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_1974 + (Unnamed Layer* 1079) [Shuffle], Pow_795) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_796 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_1977 + (Unnamed Layer* 1083) [Shuffle], Add_798), Sqrt_799), Div_800), Mul_801), Add_802) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_803 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_803 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_803 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_804 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_805 + Reshape_806 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_807 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.layer_norm_1.bias + (Unnamed Layer* 1141) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.layer_norm_1.weight + (Unnamed Layer* 1138) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.2.mlp.dense2.bias + (Unnamed Layer* 1123) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_815 + Transpose_816 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_2009 + (Unnamed Layer* 1109) [Shuffle], Div_818), Erf_819), PWN(onnx::Add_2012 + (Unnamed Layer* 1113) [Shuffle], Add_821)), Mul_822), PWN(onnx::Mul_2015 + (Unnamed Layer* 1117) [Shuffle], Mul_824)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_825 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_825 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_825 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_826, Add_827) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_828 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_829 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2023 + (Unnamed Layer* 1129) [Shuffle], Pow_831) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_832 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2026 + (Unnamed Layer* 1133) [Shuffle], Add_834), Sqrt_835), Div_836), Mul_837), Add_838) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_843 + Reshape_844 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_845 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.mlp.dense1.bias + (Unnamed Layer* 1226) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.layer_norm_2.bias + (Unnamed Layer* 1220) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.layer_norm_2.weight + (Unnamed Layer* 1217) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.attention.output.dense.bias + (Unnamed Layer* 1202) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.attention.self.value.bias + (Unnamed Layer* 1184) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.attention.self.layer_norm.bias + (Unnamed Layer* 1171) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.attention.self.layer_norm.weight + (Unnamed Layer* 1168) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_846 + Transpose_847 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_848 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_849 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2076 + (Unnamed Layer* 1159) [Shuffle], Pow_851) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_852 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2079 + (Unnamed Layer* 1163) [Shuffle], Add_854), Sqrt_855), Div_856), Mul_857), Add_858) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_862 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_862 || MatMul_859 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_862_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_862 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_863 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_864 + Transpose_865 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.attention.self.query.bias + (Unnamed Layer* 1147) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_839 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_839 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_839 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_840 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_841 + Transpose_842 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.attention.self.key.bias + (Unnamed Layer* 1177) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_859_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_859 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_860 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_861 + Transpose_866 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_867 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_2122 + (Unnamed Layer* 1191) [Shuffle], Div_869) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_870 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_871 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_872 + Reshape_873 + reshape_before_MatMul_874 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_874 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_874 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_875, Add_876) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_877 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_878 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2144 + (Unnamed Layer* 1208) [Shuffle], Pow_880) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_881 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2147 + (Unnamed Layer* 1212) [Shuffle], Add_883), Sqrt_884), Div_885), Mul_886), Add_887) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_888 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_888 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_888 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_889 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_890 + Reshape_891 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_892 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.layer_norm_1.bias + (Unnamed Layer* 1270) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.layer_norm_1.weight + (Unnamed Layer* 1267) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.3.mlp.dense2.bias + (Unnamed Layer* 1252) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_900 + Transpose_901 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_2179 + (Unnamed Layer* 1238) [Shuffle], Div_903), Erf_904), PWN(onnx::Add_2182 + (Unnamed Layer* 1242) [Shuffle], Add_906)), Mul_907), PWN(onnx::Mul_2185 + (Unnamed Layer* 1246) [Shuffle], Mul_909)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_910 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_910 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_910 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_911, Add_912) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_913 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_914 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2193 + (Unnamed Layer* 1258) [Shuffle], Pow_916) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_917 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2196 + (Unnamed Layer* 1262) [Shuffle], Add_919), Sqrt_920), Div_921), Mul_922), Add_923) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_928 + Reshape_929 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_930 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.mlp.dense1.bias + (Unnamed Layer* 1355) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.layer_norm_2.bias + (Unnamed Layer* 1349) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.layer_norm_2.weight + (Unnamed Layer* 1346) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.attention.output.dense.bias + (Unnamed Layer* 1331) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.attention.self.value.bias + (Unnamed Layer* 1313) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.attention.self.layer_norm.bias + (Unnamed Layer* 1300) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.attention.self.layer_norm.weight + (Unnamed Layer* 1297) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_931 + Transpose_932 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_933 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_934 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2246 + (Unnamed Layer* 1288) [Shuffle], Pow_936) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_937 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2249 + (Unnamed Layer* 1292) [Shuffle], Add_939), Sqrt_940), Div_941), Mul_942), Add_943) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_947 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_947 || MatMul_944 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_947_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_947 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_948 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_949 + Transpose_950 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.attention.self.query.bias + (Unnamed Layer* 1276) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_924 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_924 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_924 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_925 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_926 + Transpose_927 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.attention.self.key.bias + (Unnamed Layer* 1306) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_944_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_944 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_945 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_946 + Transpose_951 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_952 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_2292 + (Unnamed Layer* 1320) [Shuffle], Div_954) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_955 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_956 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_957 + Reshape_958 + reshape_before_MatMul_959 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_959 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_959 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_960, Add_961) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_962 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_963 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2314 + (Unnamed Layer* 1337) [Shuffle], Pow_965) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_966 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2317 + (Unnamed Layer* 1341) [Shuffle], Add_968), Sqrt_969), Div_970), Mul_971), Add_972) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_973 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_973 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_973 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_974 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_975 + Reshape_976 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_977 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.layer_norm_1.bias + (Unnamed Layer* 1399) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.layer_norm_1.weight + (Unnamed Layer* 1396) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.4.mlp.dense2.bias + (Unnamed Layer* 1381) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_985 + Transpose_986 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_2349 + (Unnamed Layer* 1367) [Shuffle], Div_988), Erf_989), PWN(onnx::Add_2352 + (Unnamed Layer* 1371) [Shuffle], Add_991)), Mul_992), PWN(onnx::Mul_2355 + (Unnamed Layer* 1375) [Shuffle], Mul_994)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_995 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_995 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_995 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_996, Add_997) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_998 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_999 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2363 + (Unnamed Layer* 1387) [Shuffle], Pow_1001) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1002 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2366 + (Unnamed Layer* 1391) [Shuffle], Add_1004), Sqrt_1005), Div_1006), Mul_1007), Add_1008) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1013 + Reshape_1014 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1015 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.mlp.dense1.bias + (Unnamed Layer* 1484) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.layer_norm_2.bias + (Unnamed Layer* 1478) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.layer_norm_2.weight + (Unnamed Layer* 1475) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.attention.output.dense.bias + (Unnamed Layer* 1460) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.attention.self.value.bias + (Unnamed Layer* 1442) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.attention.self.layer_norm.bias + (Unnamed Layer* 1429) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.attention.self.layer_norm.weight + (Unnamed Layer* 1426) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1016 + Transpose_1017 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1018 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1019 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2416 + (Unnamed Layer* 1417) [Shuffle], Pow_1021) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1022 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2419 + (Unnamed Layer* 1421) [Shuffle], Add_1024), Sqrt_1025), Div_1026), Mul_1027), Add_1028) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1032 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1032 || MatMul_1029 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1032_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1032 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1033 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1034 + Transpose_1035 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.attention.self.query.bias + (Unnamed Layer* 1405) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1009 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1009 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1009 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1010 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1011 + Transpose_1012 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.attention.self.key.bias + (Unnamed Layer* 1435) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1029_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1029 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1030 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1031 + Transpose_1036 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1037 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_2462 + (Unnamed Layer* 1449) [Shuffle], Div_1039) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1040 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1041 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1042 + Reshape_1043 + reshape_before_MatMul_1044 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1044 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1044 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1045, Add_1046) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1047 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1048 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2484 + (Unnamed Layer* 1466) [Shuffle], Pow_1050) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1051 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2487 + (Unnamed Layer* 1470) [Shuffle], Add_1053), Sqrt_1054), Div_1055), Mul_1056), Add_1057) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1058 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1058 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1058 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1059 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1060 + Reshape_1061 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1062 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.layer_norm_1.bias + (Unnamed Layer* 1528) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.layer_norm_1.weight + (Unnamed Layer* 1525) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.5.mlp.dense2.bias + (Unnamed Layer* 1510) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1070 + Transpose_1071 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_2519 + (Unnamed Layer* 1496) [Shuffle], Div_1073), Erf_1074), PWN(onnx::Add_2522 + (Unnamed Layer* 1500) [Shuffle], Add_1076)), Mul_1077), PWN(onnx::Mul_2525 + (Unnamed Layer* 1504) [Shuffle], Mul_1079)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1080 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1080 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1080 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1081, Add_1082) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1083 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1084 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2533 + (Unnamed Layer* 1516) [Shuffle], Pow_1086) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1087 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2536 + (Unnamed Layer* 1520) [Shuffle], Add_1089), Sqrt_1090), Div_1091), Mul_1092), Add_1093) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1098 + Reshape_1099 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1100 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.mlp.dense1.bias + (Unnamed Layer* 1613) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.layer_norm_2.bias + (Unnamed Layer* 1607) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.layer_norm_2.weight + (Unnamed Layer* 1604) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.attention.output.dense.bias + (Unnamed Layer* 1589) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.attention.self.value.bias + (Unnamed Layer* 1571) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.attention.self.layer_norm.bias + (Unnamed Layer* 1558) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.attention.self.layer_norm.weight + (Unnamed Layer* 1555) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1101 + Transpose_1102 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1103 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1104 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2586 + (Unnamed Layer* 1546) [Shuffle], Pow_1106) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1107 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2589 + (Unnamed Layer* 1550) [Shuffle], Add_1109), Sqrt_1110), Div_1111), Mul_1112), Add_1113) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1117 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1117 || MatMul_1114 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1117_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1117 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1118 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1119 + Transpose_1120 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.attention.self.query.bias + (Unnamed Layer* 1534) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1094 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1094 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1094 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1095 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1096 + Transpose_1097 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.attention.self.key.bias + (Unnamed Layer* 1564) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1114_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1114 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1115 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1116 + Transpose_1121 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1122 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_2632 + (Unnamed Layer* 1578) [Shuffle], Div_1124) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1125 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1126 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1127 + Reshape_1128 + reshape_before_MatMul_1129 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1129 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1129 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1130, Add_1131) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1132 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1133 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2654 + (Unnamed Layer* 1595) [Shuffle], Pow_1135) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1136 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2657 + (Unnamed Layer* 1599) [Shuffle], Add_1138), Sqrt_1139), Div_1140), Mul_1141), Add_1142) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1143 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1143 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1143 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1144 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1145 + Reshape_1146 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1147 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.layer_norm_1.bias + (Unnamed Layer* 1657) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.layer_norm_1.weight + (Unnamed Layer* 1654) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.6.mlp.dense2.bias + (Unnamed Layer* 1639) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1155 + Transpose_1156 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_2689 + (Unnamed Layer* 1625) [Shuffle], Div_1158), Erf_1159), PWN(onnx::Add_2692 + (Unnamed Layer* 1629) [Shuffle], Add_1161)), Mul_1162), PWN(onnx::Mul_2695 + (Unnamed Layer* 1633) [Shuffle], Mul_1164)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1165 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1165 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1165 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1166, Add_1167) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1168 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1169 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2703 + (Unnamed Layer* 1645) [Shuffle], Pow_1171) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1172 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2706 + (Unnamed Layer* 1649) [Shuffle], Add_1174), Sqrt_1175), Div_1176), Mul_1177), Add_1178) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1183 + Reshape_1184 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1185 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.mlp.dense1.bias + (Unnamed Layer* 1742) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.layer_norm_2.bias + (Unnamed Layer* 1736) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.layer_norm_2.weight + (Unnamed Layer* 1733) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.attention.output.dense.bias + (Unnamed Layer* 1718) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.attention.self.value.bias + (Unnamed Layer* 1700) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.attention.self.layer_norm.bias + (Unnamed Layer* 1687) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.attention.self.layer_norm.weight + (Unnamed Layer* 1684) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1186 + Transpose_1187 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1188 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1189 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2756 + (Unnamed Layer* 1675) [Shuffle], Pow_1191) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1192 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2759 + (Unnamed Layer* 1679) [Shuffle], Add_1194), Sqrt_1195), Div_1196), Mul_1197), Add_1198) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1202 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1202 || MatMul_1199 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1202_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1202 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1203 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1204 + Transpose_1205 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.attention.self.query.bias + (Unnamed Layer* 1663) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1179 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1179 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1179 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1180 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1181 + Transpose_1182 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.attention.self.key.bias + (Unnamed Layer* 1693) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1199_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1199 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1200 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1201 + Transpose_1206 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1207 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_2802 + (Unnamed Layer* 1707) [Shuffle], Div_1209) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1210 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1211 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1212 + Reshape_1213 + reshape_before_MatMul_1214 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1214 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1214 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1215, Add_1216) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1217 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1218 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2824 + (Unnamed Layer* 1724) [Shuffle], Pow_1220) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1221 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2827 + (Unnamed Layer* 1728) [Shuffle], Add_1223), Sqrt_1224), Div_1225), Mul_1226), Add_1227) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1228 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1228 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1228 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1229 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1230 + Reshape_1231 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1232 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.1.bias + (Unnamed Layer* 1786) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.1.weight + (Unnamed Layer* 1783) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.1.7.mlp.dense2.bias + (Unnamed Layer* 1768) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1240 + Transpose_1241 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_2859 + (Unnamed Layer* 1754) [Shuffle], Div_1243), Erf_1244), PWN(onnx::Add_2862 + (Unnamed Layer* 1758) [Shuffle], Add_1246)), Mul_1247), PWN(onnx::Mul_2865 + (Unnamed Layer* 1762) [Shuffle], Mul_1249)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1250 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1250 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1250 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1251, Add_1252) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1253 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1254 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2873 + (Unnamed Layer* 1774) [Shuffle], Pow_1256) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1257 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2876 + (Unnamed Layer* 1778) [Shuffle], Add_1259), Sqrt_1260), Div_1261), Mul_1262), Add_1263) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1264 + Transpose_1265 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1266 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.layer_norm_1.bias + (Unnamed Layer* 1829) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.layer_norm_1.weight + (Unnamed Layer* 1826) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.patch_embeddings.2.layer_norm.bias + (Unnamed Layer* 1812) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.patch_embeddings.2.layer_norm.weight + (Unnamed Layer* 1809) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1274 + Transpose_1275 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1276 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1277 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2908 + (Unnamed Layer* 1800) [Shuffle], Pow_1279) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1280 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2911 + (Unnamed Layer* 1804) [Shuffle], Add_1282), Sqrt_1283), Div_1284), Mul_1285), Add_1286) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1287 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1288 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2919 + (Unnamed Layer* 1817) [Shuffle], Pow_1290) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1291 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2922 + (Unnamed Layer* 1821) [Shuffle], Add_1293), Sqrt_1294), Div_1295), Mul_1296), Add_1297) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1302 + Reshape_1303 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1304 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.mlp.dense1.bias + (Unnamed Layer* 1914) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.layer_norm_2.bias + (Unnamed Layer* 1908) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.layer_norm_2.weight + (Unnamed Layer* 1905) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.attention.output.dense.bias + (Unnamed Layer* 1890) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.attention.self.value.bias + (Unnamed Layer* 1872) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.attention.self.layer_norm.bias + (Unnamed Layer* 1859) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.attention.self.layer_norm.weight + (Unnamed Layer* 1856) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1305 + Transpose_1306 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1307 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1308 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_2972 + (Unnamed Layer* 1847) [Shuffle], Pow_1310) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1311 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_2975 + (Unnamed Layer* 1851) [Shuffle], Add_1313), Sqrt_1314), Div_1315), Mul_1316), Add_1317) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1321 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1321 || MatMul_1318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1321_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1321 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1322 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1323 + Transpose_1324 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.attention.self.query.bias + (Unnamed Layer* 1835) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1298 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1298 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1298 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1299 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1300 + Transpose_1301 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.attention.self.key.bias + (Unnamed Layer* 1865) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1318_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1319 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1320 + Transpose_1325 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1326 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_3018 + (Unnamed Layer* 1879) [Shuffle], Div_1328) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1329 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1330 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1331 + Reshape_1332 + reshape_before_MatMul_1333 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1333 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1333 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1334, Add_1335) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1336 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1337 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3040 + (Unnamed Layer* 1896) [Shuffle], Pow_1339) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1340 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3043 + (Unnamed Layer* 1900) [Shuffle], Add_1342), Sqrt_1343), Div_1344), Mul_1345), Add_1346) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1347 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1347 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1347 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1348 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1349 + Reshape_1350 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1351 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.layer_norm_1.bias + (Unnamed Layer* 1958) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.layer_norm_1.weight + (Unnamed Layer* 1955) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.0.mlp.dense2.bias + (Unnamed Layer* 1940) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1359 + Transpose_1360 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_3075 + (Unnamed Layer* 1926) [Shuffle], Div_1362), Erf_1363), PWN(onnx::Add_3078 + (Unnamed Layer* 1930) [Shuffle], Add_1365)), Mul_1366), PWN(onnx::Mul_3081 + (Unnamed Layer* 1934) [Shuffle], Mul_1368)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1369 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1369 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1369 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1370, Add_1371) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1372 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1373 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3089 + (Unnamed Layer* 1946) [Shuffle], Pow_1375) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1376 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3092 + (Unnamed Layer* 1950) [Shuffle], Add_1378), Sqrt_1379), Div_1380), Mul_1381), Add_1382) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1387 + Reshape_1388 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1389 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.mlp.dense1.bias + (Unnamed Layer* 2043) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.layer_norm_2.bias + (Unnamed Layer* 2037) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.layer_norm_2.weight + (Unnamed Layer* 2034) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.attention.output.dense.bias + (Unnamed Layer* 2019) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.attention.self.value.bias + (Unnamed Layer* 2001) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.attention.self.layer_norm.bias + (Unnamed Layer* 1988) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.attention.self.layer_norm.weight + (Unnamed Layer* 1985) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1390 + Transpose_1391 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1392 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1393 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3142 + (Unnamed Layer* 1976) [Shuffle], Pow_1395) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1396 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3145 + (Unnamed Layer* 1980) [Shuffle], Add_1398), Sqrt_1399), Div_1400), Mul_1401), Add_1402) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1406 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1406 || MatMul_1403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1406_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1406 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1407 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1408 + Transpose_1409 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.attention.self.query.bias + (Unnamed Layer* 1964) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1383 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1383 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1383 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1384 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1385 + Transpose_1386 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.attention.self.key.bias + (Unnamed Layer* 1994) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1403_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1404 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1405 + Transpose_1410 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1411 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_3188 + (Unnamed Layer* 2008) [Shuffle], Div_1413) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1414 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1415 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1416 + Reshape_1417 + reshape_before_MatMul_1418 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1418 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1418 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1419, Add_1420) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1421 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1422 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3210 + (Unnamed Layer* 2025) [Shuffle], Pow_1424) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1425 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3213 + (Unnamed Layer* 2029) [Shuffle], Add_1427), Sqrt_1428), Div_1429), Mul_1430), Add_1431) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1432 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1432 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1432 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1433 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1434 + Reshape_1435 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1436 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.layer_norm_1.bias + (Unnamed Layer* 2087) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.layer_norm_1.weight + (Unnamed Layer* 2084) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.1.mlp.dense2.bias + (Unnamed Layer* 2069) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1444 + Transpose_1445 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_3245 + (Unnamed Layer* 2055) [Shuffle], Div_1447), Erf_1448), PWN(onnx::Add_3248 + (Unnamed Layer* 2059) [Shuffle], Add_1450)), Mul_1451), PWN(onnx::Mul_3251 + (Unnamed Layer* 2063) [Shuffle], Mul_1453)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1454 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1454 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1454 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1455, Add_1456) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1457 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1458 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3259 + (Unnamed Layer* 2075) [Shuffle], Pow_1460) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1461 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3262 + (Unnamed Layer* 2079) [Shuffle], Add_1463), Sqrt_1464), Div_1465), Mul_1466), Add_1467) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1472 + Reshape_1473 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1474 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.mlp.dense1.bias + (Unnamed Layer* 2172) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.layer_norm_2.bias + (Unnamed Layer* 2166) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.layer_norm_2.weight + (Unnamed Layer* 2163) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.attention.output.dense.bias + (Unnamed Layer* 2148) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.attention.self.value.bias + (Unnamed Layer* 2130) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.attention.self.layer_norm.bias + (Unnamed Layer* 2117) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.attention.self.layer_norm.weight + (Unnamed Layer* 2114) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1475 + Transpose_1476 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1477 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1478 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3312 + (Unnamed Layer* 2105) [Shuffle], Pow_1480) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1481 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3315 + (Unnamed Layer* 2109) [Shuffle], Add_1483), Sqrt_1484), Div_1485), Mul_1486), Add_1487) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1491 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1491 || MatMul_1488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1491_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1491 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1492 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1493 + Transpose_1494 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.attention.self.query.bias + (Unnamed Layer* 2093) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1468 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1468 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1468 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1469 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1470 + Transpose_1471 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.attention.self.key.bias + (Unnamed Layer* 2123) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1488_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1489 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1490 + Transpose_1495 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1496 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_3358 + (Unnamed Layer* 2137) [Shuffle], Div_1498) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1499 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1500 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1501 + Reshape_1502 + reshape_before_MatMul_1503 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1503 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1503 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1504, Add_1505) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1506 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1507 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3380 + (Unnamed Layer* 2154) [Shuffle], Pow_1509) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1510 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3383 + (Unnamed Layer* 2158) [Shuffle], Add_1512), Sqrt_1513), Div_1514), Mul_1515), Add_1516) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1517 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1517 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1517 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1518 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1519 + Reshape_1520 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1521 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.layer_norm_1.bias + (Unnamed Layer* 2216) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.layer_norm_1.weight + (Unnamed Layer* 2213) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.2.mlp.dense2.bias + (Unnamed Layer* 2198) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1529 + Transpose_1530 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_3415 + (Unnamed Layer* 2184) [Shuffle], Div_1532), Erf_1533), PWN(onnx::Add_3418 + (Unnamed Layer* 2188) [Shuffle], Add_1535)), Mul_1536), PWN(onnx::Mul_3421 + (Unnamed Layer* 2192) [Shuffle], Mul_1538)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1539 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1539 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1539 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1540, Add_1541) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1542 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1543 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3429 + (Unnamed Layer* 2204) [Shuffle], Pow_1545) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1546 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3432 + (Unnamed Layer* 2208) [Shuffle], Add_1548), Sqrt_1549), Div_1550), Mul_1551), Add_1552) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1557 + Reshape_1558 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1559 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.mlp.dense1.bias + (Unnamed Layer* 2301) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.layer_norm_2.bias + (Unnamed Layer* 2295) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.layer_norm_2.weight + (Unnamed Layer* 2292) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.attention.output.dense.bias + (Unnamed Layer* 2277) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.attention.self.value.bias + (Unnamed Layer* 2259) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.attention.self.layer_norm.bias + (Unnamed Layer* 2246) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.attention.self.layer_norm.weight + (Unnamed Layer* 2243) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1560 + Transpose_1561 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1562 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1563 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3482 + (Unnamed Layer* 2234) [Shuffle], Pow_1565) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1566 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3485 + (Unnamed Layer* 2238) [Shuffle], Add_1568), Sqrt_1569), Div_1570), Mul_1571), Add_1572) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1576 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1576 || MatMul_1573 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1576_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1576 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1577 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1578 + Transpose_1579 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.attention.self.query.bias + (Unnamed Layer* 2222) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1553 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1553 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1553 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1554 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1555 + Transpose_1556 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.attention.self.key.bias + (Unnamed Layer* 2252) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1573_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1573 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1574 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1575 + Transpose_1580 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1581 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_3528 + (Unnamed Layer* 2266) [Shuffle], Div_1583) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1584 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1585 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1586 + Reshape_1587 + reshape_before_MatMul_1588 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1588 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1588 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1589, Add_1590) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1591 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1592 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3550 + (Unnamed Layer* 2283) [Shuffle], Pow_1594) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1595 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3553 + (Unnamed Layer* 2287) [Shuffle], Add_1597), Sqrt_1598), Div_1599), Mul_1600), Add_1601) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1602 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1602 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1602 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1603 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1604 + Reshape_1605 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1606 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.layer_norm_1.bias + (Unnamed Layer* 2345) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.layer_norm_1.weight + (Unnamed Layer* 2342) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.3.mlp.dense2.bias + (Unnamed Layer* 2327) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1614 + Transpose_1615 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_3585 + (Unnamed Layer* 2313) [Shuffle], Div_1617), Erf_1618), PWN(onnx::Add_3588 + (Unnamed Layer* 2317) [Shuffle], Add_1620)), Mul_1621), PWN(onnx::Mul_3591 + (Unnamed Layer* 2321) [Shuffle], Mul_1623)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1624 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1624 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1624 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1625, Add_1626) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1627 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1628 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3599 + (Unnamed Layer* 2333) [Shuffle], Pow_1630) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1631 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3602 + (Unnamed Layer* 2337) [Shuffle], Add_1633), Sqrt_1634), Div_1635), Mul_1636), Add_1637) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1642 + Reshape_1643 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1644 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.mlp.dense1.bias + (Unnamed Layer* 2430) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.layer_norm_2.bias + (Unnamed Layer* 2424) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.layer_norm_2.weight + (Unnamed Layer* 2421) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.attention.output.dense.bias + (Unnamed Layer* 2406) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.attention.self.value.bias + (Unnamed Layer* 2388) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.attention.self.layer_norm.bias + (Unnamed Layer* 2375) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.attention.self.layer_norm.weight + (Unnamed Layer* 2372) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1645 + Transpose_1646 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1647 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1648 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3652 + (Unnamed Layer* 2363) [Shuffle], Pow_1650) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1651 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3655 + (Unnamed Layer* 2367) [Shuffle], Add_1653), Sqrt_1654), Div_1655), Mul_1656), Add_1657) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1661 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1661 || MatMul_1658 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1661_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1661 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1662 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1663 + Transpose_1664 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.attention.self.query.bias + (Unnamed Layer* 2351) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1638 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1638 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1638 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1639 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1640 + Transpose_1641 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.attention.self.key.bias + (Unnamed Layer* 2381) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1658_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1658 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1659 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1660 + Transpose_1665 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1666 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_3698 + (Unnamed Layer* 2395) [Shuffle], Div_1668) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1669 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1670 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1671 + Reshape_1672 + reshape_before_MatMul_1673 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1673 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1673 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1674, Add_1675) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1676 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1677 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3720 + (Unnamed Layer* 2412) [Shuffle], Pow_1679) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1680 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3723 + (Unnamed Layer* 2416) [Shuffle], Add_1682), Sqrt_1683), Div_1684), Mul_1685), Add_1686) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1687 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1687 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1687 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1688 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1689 + Reshape_1690 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1691 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.layer_norm_1.bias + (Unnamed Layer* 2474) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.layer_norm_1.weight + (Unnamed Layer* 2471) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.4.mlp.dense2.bias + (Unnamed Layer* 2456) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1699 + Transpose_1700 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_3755 + (Unnamed Layer* 2442) [Shuffle], Div_1702), Erf_1703), PWN(onnx::Add_3758 + (Unnamed Layer* 2446) [Shuffle], Add_1705)), Mul_1706), PWN(onnx::Mul_3761 + (Unnamed Layer* 2450) [Shuffle], Mul_1708)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1709 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1709 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1709 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1710, Add_1711) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1712 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1713 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3769 + (Unnamed Layer* 2462) [Shuffle], Pow_1715) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1716 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3772 + (Unnamed Layer* 2466) [Shuffle], Add_1718), Sqrt_1719), Div_1720), Mul_1721), Add_1722) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1727 + Reshape_1728 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1729 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.mlp.dense1.bias + (Unnamed Layer* 2559) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.layer_norm_2.bias + (Unnamed Layer* 2553) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.layer_norm_2.weight + (Unnamed Layer* 2550) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.attention.output.dense.bias + (Unnamed Layer* 2535) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.attention.self.value.bias + (Unnamed Layer* 2517) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.attention.self.layer_norm.bias + (Unnamed Layer* 2504) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.attention.self.layer_norm.weight + (Unnamed Layer* 2501) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1730 + Transpose_1731 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1732 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1733 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3822 + (Unnamed Layer* 2492) [Shuffle], Pow_1735) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1736 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3825 + (Unnamed Layer* 2496) [Shuffle], Add_1738), Sqrt_1739), Div_1740), Mul_1741), Add_1742) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1746 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1746 || MatMul_1743 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1746_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1746 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1747 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1748 + Transpose_1749 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.attention.self.query.bias + (Unnamed Layer* 2480) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1723 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1723 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1723 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1724 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1725 + Transpose_1726 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.attention.self.key.bias + (Unnamed Layer* 2510) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1743_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1743 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1744 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1745 + Transpose_1750 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1751 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_3868 + (Unnamed Layer* 2524) [Shuffle], Div_1753) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1754 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1755 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1756 + Reshape_1757 + reshape_before_MatMul_1758 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1758 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1758 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1759, Add_1760) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1761 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1762 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3890 + (Unnamed Layer* 2541) [Shuffle], Pow_1764) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1765 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3893 + (Unnamed Layer* 2545) [Shuffle], Add_1767), Sqrt_1768), Div_1769), Mul_1770), Add_1771) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1772 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1772 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1772 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1773 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1774 + Reshape_1775 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1776 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.layer_norm_1.bias + (Unnamed Layer* 2603) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.layer_norm_1.weight + (Unnamed Layer* 2600) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.5.mlp.dense2.bias + (Unnamed Layer* 2585) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1784 + Transpose_1785 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_3925 + (Unnamed Layer* 2571) [Shuffle], Div_1787), Erf_1788), PWN(onnx::Add_3928 + (Unnamed Layer* 2575) [Shuffle], Add_1790)), Mul_1791), PWN(onnx::Mul_3931 + (Unnamed Layer* 2579) [Shuffle], Mul_1793)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1794 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1794 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1794 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1795, Add_1796) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1797 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1798 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3939 + (Unnamed Layer* 2591) [Shuffle], Pow_1800) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1801 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3942 + (Unnamed Layer* 2595) [Shuffle], Add_1803), Sqrt_1804), Div_1805), Mul_1806), Add_1807) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1812 + Reshape_1813 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1814 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.mlp.dense1.bias + (Unnamed Layer* 2688) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.layer_norm_2.bias + (Unnamed Layer* 2682) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.layer_norm_2.weight + (Unnamed Layer* 2679) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.attention.output.dense.bias + (Unnamed Layer* 2664) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.attention.self.value.bias + (Unnamed Layer* 2646) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.attention.self.layer_norm.bias + (Unnamed Layer* 2633) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.attention.self.layer_norm.weight + (Unnamed Layer* 2630) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1815 + Transpose_1816 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1817 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1818 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_3992 + (Unnamed Layer* 2621) [Shuffle], Pow_1820) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1821 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_3995 + (Unnamed Layer* 2625) [Shuffle], Add_1823), Sqrt_1824), Div_1825), Mul_1826), Add_1827) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1831 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1831 || MatMul_1828 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1831_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1831 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1832 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1833 + Transpose_1834 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.attention.self.query.bias + (Unnamed Layer* 2609) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1808 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1808 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1808 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1809 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1810 + Transpose_1811 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.attention.self.key.bias + (Unnamed Layer* 2639) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1828_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1828 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1829 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1830 + Transpose_1835 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1836 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_4038 + (Unnamed Layer* 2653) [Shuffle], Div_1838) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1839 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1840 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1841 + Reshape_1842 + reshape_before_MatMul_1843 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1843 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1843 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1844, Add_1845) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1846 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1847 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4060 + (Unnamed Layer* 2670) [Shuffle], Pow_1849) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1850 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4063 + (Unnamed Layer* 2674) [Shuffle], Add_1852), Sqrt_1853), Div_1854), Mul_1855), Add_1856) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1857 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1857 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1857 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1858 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1859 + Reshape_1860 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1861 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.layer_norm_1.bias + (Unnamed Layer* 2732) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.layer_norm_1.weight + (Unnamed Layer* 2729) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.6.mlp.dense2.bias + (Unnamed Layer* 2714) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1869 + Transpose_1870 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_4095 + (Unnamed Layer* 2700) [Shuffle], Div_1872), Erf_1873), PWN(onnx::Add_4098 + (Unnamed Layer* 2704) [Shuffle], Add_1875)), Mul_1876), PWN(onnx::Mul_4101 + (Unnamed Layer* 2708) [Shuffle], Mul_1878)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1879 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1879 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1879 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1880, Add_1881) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1882 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1883 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4109 + (Unnamed Layer* 2720) [Shuffle], Pow_1885) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1886 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4112 + (Unnamed Layer* 2724) [Shuffle], Add_1888), Sqrt_1889), Div_1890), Mul_1891), Add_1892) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1897 + Reshape_1898 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1899 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.mlp.dense1.bias + (Unnamed Layer* 2817) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.layer_norm_2.bias + (Unnamed Layer* 2811) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.layer_norm_2.weight + (Unnamed Layer* 2808) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.attention.output.dense.bias + (Unnamed Layer* 2793) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.attention.self.value.bias + (Unnamed Layer* 2775) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.attention.self.layer_norm.bias + (Unnamed Layer* 2762) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.attention.self.layer_norm.weight + (Unnamed Layer* 2759) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1900 + Transpose_1901 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1902 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1903 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4162 + (Unnamed Layer* 2750) [Shuffle], Pow_1905) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1906 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4165 + (Unnamed Layer* 2754) [Shuffle], Add_1908), Sqrt_1909), Div_1910), Mul_1911), Add_1912) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1916 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1916 || MatMul_1913 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1916_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1916 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1917 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1918 + Transpose_1919 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.attention.self.query.bias + (Unnamed Layer* 2738) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1893 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1893 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1893 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1894 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1895 + Transpose_1896 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.attention.self.key.bias + (Unnamed Layer* 2768) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1913_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1913 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1914 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1915 + Transpose_1920 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1921 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_4208 + (Unnamed Layer* 2782) [Shuffle], Div_1923) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_1924 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_1925 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1926 + Reshape_1927 + reshape_before_MatMul_1928 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1928 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1928 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1929, Add_1930) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1931 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1932 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4230 + (Unnamed Layer* 2799) [Shuffle], Pow_1934) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1935 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4233 + (Unnamed Layer* 2803) [Shuffle], Add_1937), Sqrt_1938), Div_1939), Mul_1940), Add_1941) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1942 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1942 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1942 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1943 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1944 + Reshape_1945 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1946 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.layer_norm_1.bias + (Unnamed Layer* 2861) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.layer_norm_1.weight + (Unnamed Layer* 2858) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.7.mlp.dense2.bias + (Unnamed Layer* 2843) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1954 + Transpose_1955 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_4265 + (Unnamed Layer* 2829) [Shuffle], Div_1957), Erf_1958), PWN(onnx::Add_4268 + (Unnamed Layer* 2833) [Shuffle], Add_1960)), Mul_1961), PWN(onnx::Mul_4271 + (Unnamed Layer* 2837) [Shuffle], Mul_1963)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1964 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1964 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1964 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_1965, Add_1966) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1967 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1968 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4279 + (Unnamed Layer* 2849) [Shuffle], Pow_1970) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1971 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4282 + (Unnamed Layer* 2853) [Shuffle], Add_1973), Sqrt_1974), Div_1975), Mul_1976), Add_1977) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_1982 + Reshape_1983 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_1984 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.mlp.dense1.bias + (Unnamed Layer* 2946) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.layer_norm_2.bias + (Unnamed Layer* 2940) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.layer_norm_2.weight + (Unnamed Layer* 2937) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.attention.output.dense.bias + (Unnamed Layer* 2922) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.attention.self.value.bias + (Unnamed Layer* 2904) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.attention.self.layer_norm.bias + (Unnamed Layer* 2891) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.attention.self.layer_norm.weight + (Unnamed Layer* 2888) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1985 + Transpose_1986 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1987 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_1988 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4332 + (Unnamed Layer* 2879) [Shuffle], Pow_1990) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_1991 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4335 + (Unnamed Layer* 2883) [Shuffle], Add_1993), Sqrt_1994), Div_1995), Mul_1996), Add_1997) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2001 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2001 || MatMul_1998 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2001_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2001 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2002 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2003 + Transpose_2004 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.attention.self.query.bias + (Unnamed Layer* 2867) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_1978 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_1978 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1978 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1979 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_1980 + Transpose_1981 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.attention.self.key.bias + (Unnamed Layer* 2897) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_1998_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_1998 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_1999 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2000 + Transpose_2005 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2006 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_4378 + (Unnamed Layer* 2911) [Shuffle], Div_2008) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2009 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2010 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2011 + Reshape_2012 + reshape_before_MatMul_2013 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2013 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2013 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2014, Add_2015) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2016 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2017 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4400 + (Unnamed Layer* 2928) [Shuffle], Pow_2019) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2020 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4403 + (Unnamed Layer* 2932) [Shuffle], Add_2022), Sqrt_2023), Div_2024), Mul_2025), Add_2026) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2027 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2027 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2027 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2028 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2029 + Reshape_2030 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2031 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.layer_norm_1.bias + (Unnamed Layer* 2990) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.layer_norm_1.weight + (Unnamed Layer* 2987) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.8.mlp.dense2.bias + (Unnamed Layer* 2972) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2039 + Transpose_2040 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_4435 + (Unnamed Layer* 2958) [Shuffle], Div_2042), Erf_2043), PWN(onnx::Add_4438 + (Unnamed Layer* 2962) [Shuffle], Add_2045)), Mul_2046), PWN(onnx::Mul_4441 + (Unnamed Layer* 2966) [Shuffle], Mul_2048)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2049 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2049 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2049 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2050, Add_2051) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2052 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2053 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4449 + (Unnamed Layer* 2978) [Shuffle], Pow_2055) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2056 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4452 + (Unnamed Layer* 2982) [Shuffle], Add_2058), Sqrt_2059), Div_2060), Mul_2061), Add_2062) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2067 + Reshape_2068 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2069 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.mlp.dense1.bias + (Unnamed Layer* 3075) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.layer_norm_2.bias + (Unnamed Layer* 3069) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.layer_norm_2.weight + (Unnamed Layer* 3066) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.attention.output.dense.bias + (Unnamed Layer* 3051) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.attention.self.value.bias + (Unnamed Layer* 3033) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.attention.self.layer_norm.bias + (Unnamed Layer* 3020) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.attention.self.layer_norm.weight + (Unnamed Layer* 3017) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2070 + Transpose_2071 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2072 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2073 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4502 + (Unnamed Layer* 3008) [Shuffle], Pow_2075) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2076 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4505 + (Unnamed Layer* 3012) [Shuffle], Add_2078), Sqrt_2079), Div_2080), Mul_2081), Add_2082) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2086 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2086 || MatMul_2083 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2086_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2086 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2087 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2088 + Transpose_2089 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.attention.self.query.bias + (Unnamed Layer* 2996) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2063 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2063 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2063 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2064 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2065 + Transpose_2066 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.attention.self.key.bias + (Unnamed Layer* 3026) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2083_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2083 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2084 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2085 + Transpose_2090 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2091 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_4548 + (Unnamed Layer* 3040) [Shuffle], Div_2093) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2094 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2095 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2096 + Reshape_2097 + reshape_before_MatMul_2098 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2098 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2098 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2099, Add_2100) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2101 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2102 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4570 + (Unnamed Layer* 3057) [Shuffle], Pow_2104) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2105 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4573 + (Unnamed Layer* 3061) [Shuffle], Add_2107), Sqrt_2108), Div_2109), Mul_2110), Add_2111) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2112 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2112 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2112 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2113 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2114 + Reshape_2115 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2116 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.layer_norm_1.bias + (Unnamed Layer* 3119) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.layer_norm_1.weight + (Unnamed Layer* 3116) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.9.mlp.dense2.bias + (Unnamed Layer* 3101) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2124 + Transpose_2125 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_4605 + (Unnamed Layer* 3087) [Shuffle], Div_2127), Erf_2128), PWN(onnx::Add_4608 + (Unnamed Layer* 3091) [Shuffle], Add_2130)), Mul_2131), PWN(onnx::Mul_4611 + (Unnamed Layer* 3095) [Shuffle], Mul_2133)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2134 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2134 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2134 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2135, Add_2136) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2137 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2138 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4619 + (Unnamed Layer* 3107) [Shuffle], Pow_2140) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2141 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4622 + (Unnamed Layer* 3111) [Shuffle], Add_2143), Sqrt_2144), Div_2145), Mul_2146), Add_2147) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2152 + Reshape_2153 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2154 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.mlp.dense1.bias + (Unnamed Layer* 3204) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.layer_norm_2.bias + (Unnamed Layer* 3198) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.layer_norm_2.weight + (Unnamed Layer* 3195) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.attention.output.dense.bias + (Unnamed Layer* 3180) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.attention.self.value.bias + (Unnamed Layer* 3162) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.attention.self.layer_norm.bias + (Unnamed Layer* 3149) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.attention.self.layer_norm.weight + (Unnamed Layer* 3146) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2155 + Transpose_2156 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2157 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2158 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4672 + (Unnamed Layer* 3137) [Shuffle], Pow_2160) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2161 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4675 + (Unnamed Layer* 3141) [Shuffle], Add_2163), Sqrt_2164), Div_2165), Mul_2166), Add_2167) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2171 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2171 || MatMul_2168 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2171_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2171 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2172 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2173 + Transpose_2174 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.attention.self.query.bias + (Unnamed Layer* 3125) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2148 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2148 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2148 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2149 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2150 + Transpose_2151 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.attention.self.key.bias + (Unnamed Layer* 3155) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2168_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2168 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2169 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2170 + Transpose_2175 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2176 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_4718 + (Unnamed Layer* 3169) [Shuffle], Div_2178) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2179 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2180 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2181 + Reshape_2182 + reshape_before_MatMul_2183 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2183 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2183 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2184, Add_2185) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2186 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2187 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4740 + (Unnamed Layer* 3186) [Shuffle], Pow_2189) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2190 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4743 + (Unnamed Layer* 3190) [Shuffle], Add_2192), Sqrt_2193), Div_2194), Mul_2195), Add_2196) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2197 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2197 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2197 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2198 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2199 + Reshape_2200 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2201 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.layer_norm_1.bias + (Unnamed Layer* 3248) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.layer_norm_1.weight + (Unnamed Layer* 3245) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.10.mlp.dense2.bias + (Unnamed Layer* 3230) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2209 + Transpose_2210 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_4775 + (Unnamed Layer* 3216) [Shuffle], Div_2212), Erf_2213), PWN(onnx::Add_4778 + (Unnamed Layer* 3220) [Shuffle], Add_2215)), Mul_2216), PWN(onnx::Mul_4781 + (Unnamed Layer* 3224) [Shuffle], Mul_2218)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2219 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2219 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2219 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2220, Add_2221) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2222 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2223 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4789 + (Unnamed Layer* 3236) [Shuffle], Pow_2225) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2226 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4792 + (Unnamed Layer* 3240) [Shuffle], Add_2228), Sqrt_2229), Div_2230), Mul_2231), Add_2232) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2237 + Reshape_2238 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2239 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.mlp.dense1.bias + (Unnamed Layer* 3333) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.layer_norm_2.bias + (Unnamed Layer* 3327) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.layer_norm_2.weight + (Unnamed Layer* 3324) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.attention.output.dense.bias + (Unnamed Layer* 3309) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.attention.self.value.bias + (Unnamed Layer* 3291) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.attention.self.layer_norm.bias + (Unnamed Layer* 3278) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.attention.self.layer_norm.weight + (Unnamed Layer* 3275) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2240 + Transpose_2241 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2242 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2243 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4842 + (Unnamed Layer* 3266) [Shuffle], Pow_2245) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2246 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4845 + (Unnamed Layer* 3270) [Shuffle], Add_2248), Sqrt_2249), Div_2250), Mul_2251), Add_2252) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2256 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2256 || MatMul_2253 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2256_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2256 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2257 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2258 + Transpose_2259 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.attention.self.query.bias + (Unnamed Layer* 3254) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2233 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2233 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2233 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2234 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2235 + Transpose_2236 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.attention.self.key.bias + (Unnamed Layer* 3284) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2253_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2253 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2254 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2255 + Transpose_2260 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2261 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_4888 + (Unnamed Layer* 3298) [Shuffle], Div_2263) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2264 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2265 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2266 + Reshape_2267 + reshape_before_MatMul_2268 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2268 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2268 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2269, Add_2270) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2271 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2272 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4910 + (Unnamed Layer* 3315) [Shuffle], Pow_2274) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2275 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4913 + (Unnamed Layer* 3319) [Shuffle], Add_2277), Sqrt_2278), Div_2279), Mul_2280), Add_2281) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2282 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2282 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2282 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2283 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2284 + Reshape_2285 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2286 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.layer_norm_1.bias + (Unnamed Layer* 3377) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.layer_norm_1.weight + (Unnamed Layer* 3374) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.11.mlp.dense2.bias + (Unnamed Layer* 3359) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2294 + Transpose_2295 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_4945 + (Unnamed Layer* 3345) [Shuffle], Div_2297), Erf_2298), PWN(onnx::Add_4948 + (Unnamed Layer* 3349) [Shuffle], Add_2300)), Mul_2301), PWN(onnx::Mul_4951 + (Unnamed Layer* 3353) [Shuffle], Mul_2303)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2304 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2304 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2304 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2305, Add_2306) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2307 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2308 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_4959 + (Unnamed Layer* 3365) [Shuffle], Pow_2310) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2311 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_4962 + (Unnamed Layer* 3369) [Shuffle], Add_2313), Sqrt_2314), Div_2315), Mul_2316), Add_2317) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2322 + Reshape_2323 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2324 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.mlp.dense1.bias + (Unnamed Layer* 3462) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.layer_norm_2.bias + (Unnamed Layer* 3456) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.layer_norm_2.weight + (Unnamed Layer* 3453) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.attention.output.dense.bias + (Unnamed Layer* 3438) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.attention.self.value.bias + (Unnamed Layer* 3420) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.attention.self.layer_norm.bias + (Unnamed Layer* 3407) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.attention.self.layer_norm.weight + (Unnamed Layer* 3404) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2325 + Transpose_2326 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2327 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2328 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5012 + (Unnamed Layer* 3395) [Shuffle], Pow_2330) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2331 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5015 + (Unnamed Layer* 3399) [Shuffle], Add_2333), Sqrt_2334), Div_2335), Mul_2336), Add_2337) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2341 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2341 || MatMul_2338 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2341_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2341 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2342 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2343 + Transpose_2344 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.attention.self.query.bias + (Unnamed Layer* 3383) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2318 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2319 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2320 + Transpose_2321 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.attention.self.key.bias + (Unnamed Layer* 3413) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2338_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2338 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2339 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2340 + Transpose_2345 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2346 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_5058 + (Unnamed Layer* 3427) [Shuffle], Div_2348) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2349 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2350 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2351 + Reshape_2352 + reshape_before_MatMul_2353 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2353 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2353 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2354, Add_2355) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2356 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2357 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5080 + (Unnamed Layer* 3444) [Shuffle], Pow_2359) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2360 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5083 + (Unnamed Layer* 3448) [Shuffle], Add_2362), Sqrt_2363), Div_2364), Mul_2365), Add_2366) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2367 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2367 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2367 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2368 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2369 + Reshape_2370 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2371 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.layer_norm_1.bias + (Unnamed Layer* 3506) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.layer_norm_1.weight + (Unnamed Layer* 3503) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.12.mlp.dense2.bias + (Unnamed Layer* 3488) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2379 + Transpose_2380 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_5115 + (Unnamed Layer* 3474) [Shuffle], Div_2382), Erf_2383), PWN(onnx::Add_5118 + (Unnamed Layer* 3478) [Shuffle], Add_2385)), Mul_2386), PWN(onnx::Mul_5121 + (Unnamed Layer* 3482) [Shuffle], Mul_2388)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2389 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2389 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2389 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2390, Add_2391) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2392 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2393 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5129 + (Unnamed Layer* 3494) [Shuffle], Pow_2395) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2396 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5132 + (Unnamed Layer* 3498) [Shuffle], Add_2398), Sqrt_2399), Div_2400), Mul_2401), Add_2402) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2407 + Reshape_2408 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2409 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.mlp.dense1.bias + (Unnamed Layer* 3591) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.layer_norm_2.bias + (Unnamed Layer* 3585) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.layer_norm_2.weight + (Unnamed Layer* 3582) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.attention.output.dense.bias + (Unnamed Layer* 3567) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.attention.self.value.bias + (Unnamed Layer* 3549) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.attention.self.layer_norm.bias + (Unnamed Layer* 3536) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.attention.self.layer_norm.weight + (Unnamed Layer* 3533) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2410 + Transpose_2411 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2412 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2413 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5182 + (Unnamed Layer* 3524) [Shuffle], Pow_2415) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2416 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5185 + (Unnamed Layer* 3528) [Shuffle], Add_2418), Sqrt_2419), Div_2420), Mul_2421), Add_2422) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2426 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2426 || MatMul_2423 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2426_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2426 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2427 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2428 + Transpose_2429 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.attention.self.query.bias + (Unnamed Layer* 3512) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2403 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2404 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2405 + Transpose_2406 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.attention.self.key.bias + (Unnamed Layer* 3542) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2423_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2423 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2424 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2425 + Transpose_2430 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2431 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_5228 + (Unnamed Layer* 3556) [Shuffle], Div_2433) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2434 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2435 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2436 + Reshape_2437 + reshape_before_MatMul_2438 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2438 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2438 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2439, Add_2440) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2441 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2442 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5250 + (Unnamed Layer* 3573) [Shuffle], Pow_2444) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2445 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5253 + (Unnamed Layer* 3577) [Shuffle], Add_2447), Sqrt_2448), Div_2449), Mul_2450), Add_2451) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2452 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2452 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2452 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2453 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2454 + Reshape_2455 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2456 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.layer_norm_1.bias + (Unnamed Layer* 3635) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.layer_norm_1.weight + (Unnamed Layer* 3632) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.13.mlp.dense2.bias + (Unnamed Layer* 3617) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2464 + Transpose_2465 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_5285 + (Unnamed Layer* 3603) [Shuffle], Div_2467), Erf_2468), PWN(onnx::Add_5288 + (Unnamed Layer* 3607) [Shuffle], Add_2470)), Mul_2471), PWN(onnx::Mul_5291 + (Unnamed Layer* 3611) [Shuffle], Mul_2473)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2474 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2474 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2474 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2475, Add_2476) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2477 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2478 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5299 + (Unnamed Layer* 3623) [Shuffle], Pow_2480) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2481 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5302 + (Unnamed Layer* 3627) [Shuffle], Add_2483), Sqrt_2484), Div_2485), Mul_2486), Add_2487) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2492 + Reshape_2493 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2494 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.mlp.dense1.bias + (Unnamed Layer* 3720) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.layer_norm_2.bias + (Unnamed Layer* 3714) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.layer_norm_2.weight + (Unnamed Layer* 3711) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.attention.output.dense.bias + (Unnamed Layer* 3696) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.attention.self.value.bias + (Unnamed Layer* 3678) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.attention.self.layer_norm.bias + (Unnamed Layer* 3665) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.attention.self.layer_norm.weight + (Unnamed Layer* 3662) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2495 + Transpose_2496 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2497 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2498 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5352 + (Unnamed Layer* 3653) [Shuffle], Pow_2500) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2501 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5355 + (Unnamed Layer* 3657) [Shuffle], Add_2503), Sqrt_2504), Div_2505), Mul_2506), Add_2507) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2511 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2511 || MatMul_2508 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2511_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2511 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2512 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2513 + Transpose_2514 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.attention.self.query.bias + (Unnamed Layer* 3641) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2488 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2489 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2490 + Transpose_2491 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.attention.self.key.bias + (Unnamed Layer* 3671) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2508_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2508 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2509 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2510 + Transpose_2515 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2516 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_5398 + (Unnamed Layer* 3685) [Shuffle], Div_2518) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2519 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2520 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2521 + Reshape_2522 + reshape_before_MatMul_2523 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2523 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2523 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2524, Add_2525) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2526 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2527 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5420 + (Unnamed Layer* 3702) [Shuffle], Pow_2529) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2530 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5423 + (Unnamed Layer* 3706) [Shuffle], Add_2532), Sqrt_2533), Div_2534), Mul_2535), Add_2536) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2537 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2537 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2537 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2538 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2539 + Reshape_2540 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2541 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.layer_norm_1.bias + (Unnamed Layer* 3764) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.layer_norm_1.weight + (Unnamed Layer* 3761) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.14.mlp.dense2.bias + (Unnamed Layer* 3746) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2549 + Transpose_2550 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_5455 + (Unnamed Layer* 3732) [Shuffle], Div_2552), Erf_2553), PWN(onnx::Add_5458 + (Unnamed Layer* 3736) [Shuffle], Add_2555)), Mul_2556), PWN(onnx::Mul_5461 + (Unnamed Layer* 3740) [Shuffle], Mul_2558)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2559 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2559 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2559 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2560, Add_2561) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2562 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2563 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5469 + (Unnamed Layer* 3752) [Shuffle], Pow_2565) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2566 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5472 + (Unnamed Layer* 3756) [Shuffle], Add_2568), Sqrt_2569), Div_2570), Mul_2571), Add_2572) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2577 + Reshape_2578 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2579 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.mlp.dense1.bias + (Unnamed Layer* 3849) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.layer_norm_2.bias + (Unnamed Layer* 3843) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.layer_norm_2.weight + (Unnamed Layer* 3840) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.attention.output.dense.bias + (Unnamed Layer* 3825) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.attention.self.value.bias + (Unnamed Layer* 3807) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.attention.self.layer_norm.bias + (Unnamed Layer* 3794) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.attention.self.layer_norm.weight + (Unnamed Layer* 3791) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2580 + Transpose_2581 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2582 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2583 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5522 + (Unnamed Layer* 3782) [Shuffle], Pow_2585) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2586 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5525 + (Unnamed Layer* 3786) [Shuffle], Add_2588), Sqrt_2589), Div_2590), Mul_2591), Add_2592) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2596 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2596 || MatMul_2593 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2596_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2596 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2597 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2598 + Transpose_2599 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.attention.self.query.bias + (Unnamed Layer* 3770) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2573 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2573 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2573 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2574 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2575 + Transpose_2576 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.attention.self.key.bias + (Unnamed Layer* 3800) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2593_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2593 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2594 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2595 + Transpose_2600 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2601 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_5568 + (Unnamed Layer* 3814) [Shuffle], Div_2603) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2604 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2605 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2606 + Reshape_2607 + reshape_before_MatMul_2608 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2608 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2608 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2609, Add_2610) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2611 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2612 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5590 + (Unnamed Layer* 3831) [Shuffle], Pow_2614) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2615 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5593 + (Unnamed Layer* 3835) [Shuffle], Add_2617), Sqrt_2618), Div_2619), Mul_2620), Add_2621) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2622 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2622 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2622 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2623 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2624 + Reshape_2625 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2626 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.layer_norm_1.bias + (Unnamed Layer* 3893) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.layer_norm_1.weight + (Unnamed Layer* 3890) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.15.mlp.dense2.bias + (Unnamed Layer* 3875) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2634 + Transpose_2635 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_5625 + (Unnamed Layer* 3861) [Shuffle], Div_2637), Erf_2638), PWN(onnx::Add_5628 + (Unnamed Layer* 3865) [Shuffle], Add_2640)), Mul_2641), PWN(onnx::Mul_5631 + (Unnamed Layer* 3869) [Shuffle], Mul_2643)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2644 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2644 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2644 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2645, Add_2646) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2647 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2648 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5639 + (Unnamed Layer* 3881) [Shuffle], Pow_2650) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2651 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5642 + (Unnamed Layer* 3885) [Shuffle], Add_2653), Sqrt_2654), Div_2655), Mul_2656), Add_2657) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2662 + Reshape_2663 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2664 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.mlp.dense1.bias + (Unnamed Layer* 3978) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.layer_norm_2.bias + (Unnamed Layer* 3972) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.layer_norm_2.weight + (Unnamed Layer* 3969) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.attention.output.dense.bias + (Unnamed Layer* 3954) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.attention.self.value.bias + (Unnamed Layer* 3936) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.attention.self.layer_norm.bias + (Unnamed Layer* 3923) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.attention.self.layer_norm.weight + (Unnamed Layer* 3920) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2665 + Transpose_2666 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2667 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2668 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5692 + (Unnamed Layer* 3911) [Shuffle], Pow_2670) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2671 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5695 + (Unnamed Layer* 3915) [Shuffle], Add_2673), Sqrt_2674), Div_2675), Mul_2676), Add_2677) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2681 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2681 || MatMul_2678 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2681_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2681 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2682 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2683 + Transpose_2684 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.attention.self.query.bias + (Unnamed Layer* 3899) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2658 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2658 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2658 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2659 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2660 + Transpose_2661 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.attention.self.key.bias + (Unnamed Layer* 3929) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2678_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2678 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2679 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2680 + Transpose_2685 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2686 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_5738 + (Unnamed Layer* 3943) [Shuffle], Div_2688) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2689 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2690 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2691 + Reshape_2692 + reshape_before_MatMul_2693 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2693 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2693 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2694, Add_2695) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2696 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2697 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5760 + (Unnamed Layer* 3960) [Shuffle], Pow_2699) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2700 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5763 + (Unnamed Layer* 3964) [Shuffle], Add_2702), Sqrt_2703), Div_2704), Mul_2705), Add_2706) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2707 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2707 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2707 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2708 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2709 + Reshape_2710 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2711 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.layer_norm_1.bias + (Unnamed Layer* 4022) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.layer_norm_1.weight + (Unnamed Layer* 4019) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.16.mlp.dense2.bias + (Unnamed Layer* 4004) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2719 + Transpose_2720 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_5795 + (Unnamed Layer* 3990) [Shuffle], Div_2722), Erf_2723), PWN(onnx::Add_5798 + (Unnamed Layer* 3994) [Shuffle], Add_2725)), Mul_2726), PWN(onnx::Mul_5801 + (Unnamed Layer* 3998) [Shuffle], Mul_2728)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2729 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2729 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2729 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2730, Add_2731) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2732 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2733 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5809 + (Unnamed Layer* 4010) [Shuffle], Pow_2735) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2736 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5812 + (Unnamed Layer* 4014) [Shuffle], Add_2738), Sqrt_2739), Div_2740), Mul_2741), Add_2742) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2747 + Reshape_2748 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2749 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.mlp.dense1.bias + (Unnamed Layer* 4107) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.layer_norm_2.bias + (Unnamed Layer* 4101) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.layer_norm_2.weight + (Unnamed Layer* 4098) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.attention.output.dense.bias + (Unnamed Layer* 4083) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.attention.self.value.bias + (Unnamed Layer* 4065) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.attention.self.layer_norm.bias + (Unnamed Layer* 4052) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.attention.self.layer_norm.weight + (Unnamed Layer* 4049) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2750 + Transpose_2751 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2752 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2753 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5862 + (Unnamed Layer* 4040) [Shuffle], Pow_2755) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2756 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5865 + (Unnamed Layer* 4044) [Shuffle], Add_2758), Sqrt_2759), Div_2760), Mul_2761), Add_2762) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2766 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2766 || MatMul_2763 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2766_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2766 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2767 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2768 + Transpose_2769 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.attention.self.query.bias + (Unnamed Layer* 4028) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2743 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2743 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2743 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2744 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2745 + Transpose_2746 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.attention.self.key.bias + (Unnamed Layer* 4058) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2763_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2763 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2764 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2765 + Transpose_2770 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2771 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_5908 + (Unnamed Layer* 4072) [Shuffle], Div_2773) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2774 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2775 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2776 + Reshape_2777 + reshape_before_MatMul_2778 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2778 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2778 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2779, Add_2780) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2781 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2782 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5930 + (Unnamed Layer* 4089) [Shuffle], Pow_2784) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2785 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5933 + (Unnamed Layer* 4093) [Shuffle], Add_2787), Sqrt_2788), Div_2789), Mul_2790), Add_2791) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2792 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2792 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2792 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2793 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2794 + Reshape_2795 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2796 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.layer_norm_1.bias + (Unnamed Layer* 4151) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.layer_norm_1.weight + (Unnamed Layer* 4148) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.17.mlp.dense2.bias + (Unnamed Layer* 4133) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2804 + Transpose_2805 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_5965 + (Unnamed Layer* 4119) [Shuffle], Div_2807), Erf_2808), PWN(onnx::Add_5968 + (Unnamed Layer* 4123) [Shuffle], Add_2810)), Mul_2811), PWN(onnx::Mul_5971 + (Unnamed Layer* 4127) [Shuffle], Mul_2813)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2814 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2814 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2814 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2815, Add_2816) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2817 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2818 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_5979 + (Unnamed Layer* 4139) [Shuffle], Pow_2820) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2821 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_5982 + (Unnamed Layer* 4143) [Shuffle], Add_2823), Sqrt_2824), Div_2825), Mul_2826), Add_2827) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2832 + Reshape_2833 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2834 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.mlp.dense1.bias + (Unnamed Layer* 4236) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.layer_norm_2.bias + (Unnamed Layer* 4230) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.layer_norm_2.weight + (Unnamed Layer* 4227) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.attention.output.dense.bias + (Unnamed Layer* 4212) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.attention.self.value.bias + (Unnamed Layer* 4194) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.attention.self.layer_norm.bias + (Unnamed Layer* 4181) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.attention.self.layer_norm.weight + (Unnamed Layer* 4178) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2835 + Transpose_2836 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2837 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2838 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6032 + (Unnamed Layer* 4169) [Shuffle], Pow_2840) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2841 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6035 + (Unnamed Layer* 4173) [Shuffle], Add_2843), Sqrt_2844), Div_2845), Mul_2846), Add_2847) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2851 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2851 || MatMul_2848 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2851_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2851 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2852 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2853 + Transpose_2854 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.attention.self.query.bias + (Unnamed Layer* 4157) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2828 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2828 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2828 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2829 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2830 + Transpose_2831 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.attention.self.key.bias + (Unnamed Layer* 4187) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2848_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2848 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2849 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2850 + Transpose_2855 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2856 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_6078 + (Unnamed Layer* 4201) [Shuffle], Div_2858) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2859 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2860 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2861 + Reshape_2862 + reshape_before_MatMul_2863 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2863 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2863 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2864, Add_2865) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2866 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2867 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6100 + (Unnamed Layer* 4218) [Shuffle], Pow_2869) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2870 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6103 + (Unnamed Layer* 4222) [Shuffle], Add_2872), Sqrt_2873), Div_2874), Mul_2875), Add_2876) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2877 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2877 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2877 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2878 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2879 + Reshape_2880 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2881 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.layer_norm_1.bias + (Unnamed Layer* 4280) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.layer_norm_1.weight + (Unnamed Layer* 4277) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.18.mlp.dense2.bias + (Unnamed Layer* 4262) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2889 + Transpose_2890 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_6135 + (Unnamed Layer* 4248) [Shuffle], Div_2892), Erf_2893), PWN(onnx::Add_6138 + (Unnamed Layer* 4252) [Shuffle], Add_2895)), Mul_2896), PWN(onnx::Mul_6141 + (Unnamed Layer* 4256) [Shuffle], Mul_2898)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2899 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2899 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2899 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2900, Add_2901) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2902 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2903 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6149 + (Unnamed Layer* 4268) [Shuffle], Pow_2905) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2906 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6152 + (Unnamed Layer* 4272) [Shuffle], Add_2908), Sqrt_2909), Div_2910), Mul_2911), Add_2912) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2917 + Reshape_2918 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2919 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.mlp.dense1.bias + (Unnamed Layer* 4365) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.layer_norm_2.bias + (Unnamed Layer* 4359) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.layer_norm_2.weight + (Unnamed Layer* 4356) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.attention.output.dense.bias + (Unnamed Layer* 4341) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.attention.self.value.bias + (Unnamed Layer* 4323) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.attention.self.layer_norm.bias + (Unnamed Layer* 4310) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.attention.self.layer_norm.weight + (Unnamed Layer* 4307) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2920 + Transpose_2921 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2922 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2923 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6202 + (Unnamed Layer* 4298) [Shuffle], Pow_2925) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2926 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6205 + (Unnamed Layer* 4302) [Shuffle], Add_2928), Sqrt_2929), Div_2930), Mul_2931), Add_2932) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2936 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2936 || MatMul_2933 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2936_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2936 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2937 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2938 + Transpose_2939 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.attention.self.query.bias + (Unnamed Layer* 4286) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2913 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2913 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2913 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2914 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2915 + Transpose_2916 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.attention.self.key.bias + (Unnamed Layer* 4316) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_2933_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2933 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2934 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2935 + Transpose_2940 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2941 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_6248 + (Unnamed Layer* 4330) [Shuffle], Div_2943) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_2944 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_2945 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2946 + Reshape_2947 + reshape_before_MatMul_2948 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2948 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2948 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2949, Add_2950) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2951 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2952 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6270 + (Unnamed Layer* 4347) [Shuffle], Pow_2954) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2955 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6273 + (Unnamed Layer* 4351) [Shuffle], Add_2957), Sqrt_2958), Div_2959), Mul_2960), Add_2961) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2962 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2962 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2962 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2963 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_2964 + Reshape_2965 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_2966 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.layer_norm_1.bias + (Unnamed Layer* 4409) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.layer_norm_1.weight + (Unnamed Layer* 4406) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.19.mlp.dense2.bias + (Unnamed Layer* 4391) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_2974 + Transpose_2975 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_6305 + (Unnamed Layer* 4377) [Shuffle], Div_2977), Erf_2978), PWN(onnx::Add_6308 + (Unnamed Layer* 4381) [Shuffle], Add_2980)), Mul_2981), PWN(onnx::Mul_6311 + (Unnamed Layer* 4385) [Shuffle], Mul_2983)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2984 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2984 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2984 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_2985, Add_2986) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2987 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_2988 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6319 + (Unnamed Layer* 4397) [Shuffle], Pow_2990) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_2991 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6322 + (Unnamed Layer* 4401) [Shuffle], Add_2993), Sqrt_2994), Div_2995), Mul_2996), Add_2997) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3002 + Reshape_3003 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3004 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.mlp.dense1.bias + (Unnamed Layer* 4494) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.layer_norm_2.bias + (Unnamed Layer* 4488) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.layer_norm_2.weight + (Unnamed Layer* 4485) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.attention.output.dense.bias + (Unnamed Layer* 4470) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.attention.self.value.bias + (Unnamed Layer* 4452) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.attention.self.layer_norm.bias + (Unnamed Layer* 4439) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.attention.self.layer_norm.weight + (Unnamed Layer* 4436) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3005 + Transpose_3006 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3007 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3008 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6372 + (Unnamed Layer* 4427) [Shuffle], Pow_3010) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3011 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6375 + (Unnamed Layer* 4431) [Shuffle], Add_3013), Sqrt_3014), Div_3015), Mul_3016), Add_3017) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3021 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3021 || MatMul_3018 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3021_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3021 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3022 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3023 + Transpose_3024 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.attention.self.query.bias + (Unnamed Layer* 4415) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_2998 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_2998 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_2998 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_2999 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3000 + Transpose_3001 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.attention.self.key.bias + (Unnamed Layer* 4445) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3018_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3018 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3019 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3020 + Transpose_3025 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3026 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_6418 + (Unnamed Layer* 4459) [Shuffle], Div_3028) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3029 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3030 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3031 + Reshape_3032 + reshape_before_MatMul_3033 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3033 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3033 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3034, Add_3035) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3036 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3037 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6440 + (Unnamed Layer* 4476) [Shuffle], Pow_3039) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3040 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6443 + (Unnamed Layer* 4480) [Shuffle], Add_3042), Sqrt_3043), Div_3044), Mul_3045), Add_3046) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3047 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3047 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3047 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3048 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3049 + Reshape_3050 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3051 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.layer_norm_1.bias + (Unnamed Layer* 4538) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.layer_norm_1.weight + (Unnamed Layer* 4535) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.20.mlp.dense2.bias + (Unnamed Layer* 4520) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3059 + Transpose_3060 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_6475 + (Unnamed Layer* 4506) [Shuffle], Div_3062), Erf_3063), PWN(onnx::Add_6478 + (Unnamed Layer* 4510) [Shuffle], Add_3065)), Mul_3066), PWN(onnx::Mul_6481 + (Unnamed Layer* 4514) [Shuffle], Mul_3068)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3069 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3069 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3069 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3070, Add_3071) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3072 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3073 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6489 + (Unnamed Layer* 4526) [Shuffle], Pow_3075) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3076 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6492 + (Unnamed Layer* 4530) [Shuffle], Add_3078), Sqrt_3079), Div_3080), Mul_3081), Add_3082) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3087 + Reshape_3088 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3089 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.mlp.dense1.bias + (Unnamed Layer* 4623) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.layer_norm_2.bias + (Unnamed Layer* 4617) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.layer_norm_2.weight + (Unnamed Layer* 4614) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.attention.output.dense.bias + (Unnamed Layer* 4599) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.attention.self.value.bias + (Unnamed Layer* 4581) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.attention.self.layer_norm.bias + (Unnamed Layer* 4568) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.attention.self.layer_norm.weight + (Unnamed Layer* 4565) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3090 + Transpose_3091 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3092 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3093 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6542 + (Unnamed Layer* 4556) [Shuffle], Pow_3095) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3096 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6545 + (Unnamed Layer* 4560) [Shuffle], Add_3098), Sqrt_3099), Div_3100), Mul_3101), Add_3102) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3106 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3106 || MatMul_3103 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3106_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3106 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3107 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3108 + Transpose_3109 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.attention.self.query.bias + (Unnamed Layer* 4544) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3083 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3083 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3083 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3084 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3085 + Transpose_3086 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.attention.self.key.bias + (Unnamed Layer* 4574) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3103_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3103 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3104 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3105 + Transpose_3110 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3111 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_6588 + (Unnamed Layer* 4588) [Shuffle], Div_3113) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3114 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3115 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3116 + Reshape_3117 + reshape_before_MatMul_3118 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3118 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3118 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3119, Add_3120) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3121 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3122 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6610 + (Unnamed Layer* 4605) [Shuffle], Pow_3124) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3125 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6613 + (Unnamed Layer* 4609) [Shuffle], Add_3127), Sqrt_3128), Div_3129), Mul_3130), Add_3131) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3132 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3132 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3132 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3133 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3134 + Reshape_3135 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3136 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.layer_norm_1.bias + (Unnamed Layer* 4667) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.layer_norm_1.weight + (Unnamed Layer* 4664) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.21.mlp.dense2.bias + (Unnamed Layer* 4649) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3144 + Transpose_3145 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_6645 + (Unnamed Layer* 4635) [Shuffle], Div_3147), Erf_3148), PWN(onnx::Add_6648 + (Unnamed Layer* 4639) [Shuffle], Add_3150)), Mul_3151), PWN(onnx::Mul_6651 + (Unnamed Layer* 4643) [Shuffle], Mul_3153)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3154 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3154 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3154 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3155, Add_3156) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3157 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3158 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6659 + (Unnamed Layer* 4655) [Shuffle], Pow_3160) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3161 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6662 + (Unnamed Layer* 4659) [Shuffle], Add_3163), Sqrt_3164), Div_3165), Mul_3166), Add_3167) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3172 + Reshape_3173 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3174 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.mlp.dense1.bias + (Unnamed Layer* 4752) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.layer_norm_2.bias + (Unnamed Layer* 4746) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.layer_norm_2.weight + (Unnamed Layer* 4743) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.attention.output.dense.bias + (Unnamed Layer* 4728) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.attention.self.value.bias + (Unnamed Layer* 4710) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.attention.self.layer_norm.bias + (Unnamed Layer* 4697) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.attention.self.layer_norm.weight + (Unnamed Layer* 4694) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3175 + Transpose_3176 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3177 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3178 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6712 + (Unnamed Layer* 4685) [Shuffle], Pow_3180) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3181 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6715 + (Unnamed Layer* 4689) [Shuffle], Add_3183), Sqrt_3184), Div_3185), Mul_3186), Add_3187) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3191 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3191 || MatMul_3188 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3191_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3191 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3192 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3193 + Transpose_3194 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.attention.self.query.bias + (Unnamed Layer* 4673) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3168 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3168 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3168 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3169 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3170 + Transpose_3171 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.attention.self.key.bias + (Unnamed Layer* 4703) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3188_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3188 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3189 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3190 + Transpose_3195 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3196 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_6758 + (Unnamed Layer* 4717) [Shuffle], Div_3198) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3199 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3200 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3201 + Reshape_3202 + reshape_before_MatMul_3203 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3203 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3203 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3204, Add_3205) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3206 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3207 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6780 + (Unnamed Layer* 4734) [Shuffle], Pow_3209) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3210 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6783 + (Unnamed Layer* 4738) [Shuffle], Add_3212), Sqrt_3213), Div_3214), Mul_3215), Add_3216) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3217 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3217 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3217 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3218 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3219 + Reshape_3220 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3221 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.layer_norm_1.bias + (Unnamed Layer* 4796) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.layer_norm_1.weight + (Unnamed Layer* 4793) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.22.mlp.dense2.bias + (Unnamed Layer* 4778) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3229 + Transpose_3230 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_6815 + (Unnamed Layer* 4764) [Shuffle], Div_3232), Erf_3233), PWN(onnx::Add_6818 + (Unnamed Layer* 4768) [Shuffle], Add_3235)), Mul_3236), PWN(onnx::Mul_6821 + (Unnamed Layer* 4772) [Shuffle], Mul_3238)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3239 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3239 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3239 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3240, Add_3241) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3242 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3243 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6829 + (Unnamed Layer* 4784) [Shuffle], Pow_3245) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3246 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6832 + (Unnamed Layer* 4788) [Shuffle], Add_3248), Sqrt_3249), Div_3250), Mul_3251), Add_3252) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3257 + Reshape_3258 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3259 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.mlp.dense1.bias + (Unnamed Layer* 4881) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.layer_norm_2.bias + (Unnamed Layer* 4875) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.layer_norm_2.weight + (Unnamed Layer* 4872) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.attention.output.dense.bias + (Unnamed Layer* 4857) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.attention.self.value.bias + (Unnamed Layer* 4839) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.attention.self.layer_norm.bias + (Unnamed Layer* 4826) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.attention.self.layer_norm.weight + (Unnamed Layer* 4823) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3260 + Transpose_3261 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3262 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3263 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6882 + (Unnamed Layer* 4814) [Shuffle], Pow_3265) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3266 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6885 + (Unnamed Layer* 4818) [Shuffle], Add_3268), Sqrt_3269), Div_3270), Mul_3271), Add_3272) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3276 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3276 || MatMul_3273 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3276_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3276 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3277 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3278 + Transpose_3279 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.attention.self.query.bias + (Unnamed Layer* 4802) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3253 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3253 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3253 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3254 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3255 + Transpose_3256 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.attention.self.key.bias + (Unnamed Layer* 4832) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3273_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3273 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3274 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3275 + Transpose_3280 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3281 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_6928 + (Unnamed Layer* 4846) [Shuffle], Div_3283) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3284 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3285 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3286 + Reshape_3287 + reshape_before_MatMul_3288 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3288 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3288 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3289, Add_3290) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3291 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3292 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6950 + (Unnamed Layer* 4863) [Shuffle], Pow_3294) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3295 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_6953 + (Unnamed Layer* 4867) [Shuffle], Add_3297), Sqrt_3298), Div_3299), Mul_3300), Add_3301) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3302 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3302 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3302 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3303 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3304 + Reshape_3305 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3306 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.layer_norm_1.bias + (Unnamed Layer* 4925) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.layer_norm_1.weight + (Unnamed Layer* 4922) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.23.mlp.dense2.bias + (Unnamed Layer* 4907) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3314 + Transpose_3315 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_6985 + (Unnamed Layer* 4893) [Shuffle], Div_3317), Erf_3318), PWN(onnx::Add_6988 + (Unnamed Layer* 4897) [Shuffle], Add_3320)), Mul_3321), PWN(onnx::Mul_6991 + (Unnamed Layer* 4901) [Shuffle], Mul_3323)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3324 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3324 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3324 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3325, Add_3326) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3327 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3328 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_6999 + (Unnamed Layer* 4913) [Shuffle], Pow_3330) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3331 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7002 + (Unnamed Layer* 4917) [Shuffle], Add_3333), Sqrt_3334), Div_3335), Mul_3336), Add_3337) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3342 + Reshape_3343 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3344 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.mlp.dense1.bias + (Unnamed Layer* 5010) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.layer_norm_2.bias + (Unnamed Layer* 5004) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.layer_norm_2.weight + (Unnamed Layer* 5001) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.attention.output.dense.bias + (Unnamed Layer* 4986) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.attention.self.value.bias + (Unnamed Layer* 4968) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.attention.self.layer_norm.bias + (Unnamed Layer* 4955) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.attention.self.layer_norm.weight + (Unnamed Layer* 4952) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3345 + Transpose_3346 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3347 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3348 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7052 + (Unnamed Layer* 4943) [Shuffle], Pow_3350) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3351 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7055 + (Unnamed Layer* 4947) [Shuffle], Add_3353), Sqrt_3354), Div_3355), Mul_3356), Add_3357) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3361 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3361 || MatMul_3358 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3361_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3361 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3362 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3363 + Transpose_3364 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.attention.self.query.bias + (Unnamed Layer* 4931) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3338 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3338 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3338 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3339 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3340 + Transpose_3341 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.attention.self.key.bias + (Unnamed Layer* 4961) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3358_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3358 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3359 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3360 + Transpose_3365 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3366 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_7098 + (Unnamed Layer* 4975) [Shuffle], Div_3368) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3369 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3370 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3371 + Reshape_3372 + reshape_before_MatMul_3373 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3373 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3373 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3374, Add_3375) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3376 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3377 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7120 + (Unnamed Layer* 4992) [Shuffle], Pow_3379) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3380 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7123 + (Unnamed Layer* 4996) [Shuffle], Add_3382), Sqrt_3383), Div_3384), Mul_3385), Add_3386) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3387 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3387 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3387 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3388 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3389 + Reshape_3390 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3391 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.layer_norm_1.bias + (Unnamed Layer* 5054) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.layer_norm_1.weight + (Unnamed Layer* 5051) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.24.mlp.dense2.bias + (Unnamed Layer* 5036) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3399 + Transpose_3400 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_7155 + (Unnamed Layer* 5022) [Shuffle], Div_3402), Erf_3403), PWN(onnx::Add_7158 + (Unnamed Layer* 5026) [Shuffle], Add_3405)), Mul_3406), PWN(onnx::Mul_7161 + (Unnamed Layer* 5030) [Shuffle], Mul_3408)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3409 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3409 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3409 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3410, Add_3411) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3412 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3413 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7169 + (Unnamed Layer* 5042) [Shuffle], Pow_3415) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3416 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7172 + (Unnamed Layer* 5046) [Shuffle], Add_3418), Sqrt_3419), Div_3420), Mul_3421), Add_3422) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3427 + Reshape_3428 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3429 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.mlp.dense1.bias + (Unnamed Layer* 5139) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.layer_norm_2.bias + (Unnamed Layer* 5133) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.layer_norm_2.weight + (Unnamed Layer* 5130) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.attention.output.dense.bias + (Unnamed Layer* 5115) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.attention.self.value.bias + (Unnamed Layer* 5097) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.attention.self.layer_norm.bias + (Unnamed Layer* 5084) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.attention.self.layer_norm.weight + (Unnamed Layer* 5081) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3430 + Transpose_3431 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3432 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3433 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7222 + (Unnamed Layer* 5072) [Shuffle], Pow_3435) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3436 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7225 + (Unnamed Layer* 5076) [Shuffle], Add_3438), Sqrt_3439), Div_3440), Mul_3441), Add_3442) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3446 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3446 || MatMul_3443 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3446_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3446 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3447 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3448 + Transpose_3449 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.attention.self.query.bias + (Unnamed Layer* 5060) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3423 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3423 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3423 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3424 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3425 + Transpose_3426 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.attention.self.key.bias + (Unnamed Layer* 5090) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3443_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3443 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3444 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3445 + Transpose_3450 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3451 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_7268 + (Unnamed Layer* 5104) [Shuffle], Div_3453) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3454 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3455 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3456 + Reshape_3457 + reshape_before_MatMul_3458 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3458 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3458 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3459, Add_3460) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3461 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3462 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7290 + (Unnamed Layer* 5121) [Shuffle], Pow_3464) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3465 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7293 + (Unnamed Layer* 5125) [Shuffle], Add_3467), Sqrt_3468), Div_3469), Mul_3470), Add_3471) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3472 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3472 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3472 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3473 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3474 + Reshape_3475 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3476 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.layer_norm_1.bias + (Unnamed Layer* 5183) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.layer_norm_1.weight + (Unnamed Layer* 5180) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.25.mlp.dense2.bias + (Unnamed Layer* 5165) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3484 + Transpose_3485 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_7325 + (Unnamed Layer* 5151) [Shuffle], Div_3487), Erf_3488), PWN(onnx::Add_7328 + (Unnamed Layer* 5155) [Shuffle], Add_3490)), Mul_3491), PWN(onnx::Mul_7331 + (Unnamed Layer* 5159) [Shuffle], Mul_3493)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3494 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3494 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3494 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3495, Add_3496) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3497 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3498 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7339 + (Unnamed Layer* 5171) [Shuffle], Pow_3500) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3501 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7342 + (Unnamed Layer* 5175) [Shuffle], Add_3503), Sqrt_3504), Div_3505), Mul_3506), Add_3507) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3512 + Reshape_3513 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3514 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.mlp.dense1.bias + (Unnamed Layer* 5268) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.layer_norm_2.bias + (Unnamed Layer* 5262) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.layer_norm_2.weight + (Unnamed Layer* 5259) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.attention.output.dense.bias + (Unnamed Layer* 5244) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.attention.self.value.bias + (Unnamed Layer* 5226) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.attention.self.layer_norm.bias + (Unnamed Layer* 5213) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.attention.self.layer_norm.weight + (Unnamed Layer* 5210) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3515 + Transpose_3516 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3517 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3518 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7392 + (Unnamed Layer* 5201) [Shuffle], Pow_3520) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3521 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7395 + (Unnamed Layer* 5205) [Shuffle], Add_3523), Sqrt_3524), Div_3525), Mul_3526), Add_3527) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3531 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3531 || MatMul_3528 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3531_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3531 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3532 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3533 + Transpose_3534 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.attention.self.query.bias + (Unnamed Layer* 5189) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3508 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3508 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3508 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3509 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3510 + Transpose_3511 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.attention.self.key.bias + (Unnamed Layer* 5219) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: reshape_after_MatMul_3528_copy_input [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3528 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3529 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3530 + Transpose_3535 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3536 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Div_7438 + (Unnamed Layer* 5233) [Shuffle], Div_3538) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SOFTMAX: Softmax_3539 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MATRIX_MULTIPLY: MatMul_3540 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3541 + Reshape_3542 + reshape_before_MatMul_3543 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3543 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3543 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3544, Add_3545) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3546 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3547 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7460 + (Unnamed Layer* 5250) [Shuffle], Pow_3549) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3550 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7463 + (Unnamed Layer* 5254) [Shuffle], Add_3552), Sqrt_3553), Div_3554), Mul_3555), Add_3556) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3557 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3557 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3557 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3558 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3559 + Reshape_3560 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3561 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.2.bias + (Unnamed Layer* 5312) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.2.weight + (Unnamed Layer* 5309) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.2.26.mlp.dense2.bias + (Unnamed Layer* 5294) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3569 + Transpose_3570 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_7495 + (Unnamed Layer* 5280) [Shuffle], Div_3572), Erf_3573), PWN(onnx::Add_7498 + (Unnamed Layer* 5284) [Shuffle], Add_3575)), Mul_3576), PWN(onnx::Mul_7501 + (Unnamed Layer* 5288) [Shuffle], Mul_3578)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3579 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3579 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3579 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3580, Add_3581) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3582 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3583 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7509 + (Unnamed Layer* 5300) [Shuffle], Pow_3585) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3586 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7512 + (Unnamed Layer* 5304) [Shuffle], Add_3588), Sqrt_3589), Div_3590), Mul_3591), Add_3592) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3593 + Transpose_3594 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3595 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[onnx::MatMul_9671 + (Unnamed Layer* 5373) [Shuffle]...Transpose_3662 + Reshape_3663]} [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3664 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[onnx::MatMul_9701 + (Unnamed Layer* 5480) [Shuffle]...Transpose_3731 + Reshape_3732]} [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3733 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] MYELIN: {ForeignNode[onnx::MatMul_9731 + (Unnamed Layer* 5587) [Shuffle]...Transpose_3800 + Reshape_3801]} [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: decode_head.linear_c.0.proj.bias + (Unnamed Layer* 5690) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3843 + Transpose_3844 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3845 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3845 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3845 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3846 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3847 + Reshape_3848 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: decode_head.linear_c.1.proj.bias + (Unnamed Layer* 5708) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3863 + Transpose_3864 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3865 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3865 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3865 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3866 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3867 + Reshape_3868 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] RESIZE: Resize_3875 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: decode_head.linear_c.2.proj.bias + (Unnamed Layer* 5726) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3883 + Transpose_3884 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3885 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3885 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3885 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3886 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3887 + Reshape_3888 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] RESIZE: Resize_3895 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3802 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: decode_head.linear_c.3.proj.bias + (Unnamed Layer* 5744) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.3.bias + (Unnamed Layer* 5676) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.layer_norm.3.weight + (Unnamed Layer* 5673) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONSTANT: segformer.encoder.block.3.2.mlp.dense2.bias + (Unnamed Layer* 5658) [Shuffle] [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3810 + Transpose_3811 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Div_7946 + (Unnamed Layer* 5644) [Shuffle], Div_3813), Erf_3814), PWN(onnx::Add_7949 + (Unnamed Layer* 5648) [Shuffle], Add_3816)), Mul_3817), PWN(onnx::Mul_7952 + (Unnamed Layer* 5652) [Shuffle], Mul_3819)) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3820 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3820 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3820 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(Add_3821, Add_3822) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3823 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Sub_3824 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(onnx::Pow_7960 + (Unnamed Layer* 5664) [Shuffle], Pow_3826) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] REDUCE: ReduceMean_3827 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] POINTWISE: PWN(PWN(PWN(PWN(PWN(onnx::Add_7963 + (Unnamed Layer* 5668) [Shuffle], Add_3829), Sqrt_3830), Div_3831), Mul_3832), Add_3833) [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3834 + Transpose_3835 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Reshape_3903 + Transpose_3904 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_before_MatMul_3905 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: MatMul_3905 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: reshape_after_MatMul_3905 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] ELEMENTWISE: Add_3906 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] SHUFFLE: Transpose_3907 + Reshape_3908 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] RESIZE: Resize_3915 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: onnx::Concat_8153 copy [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: onnx::Concat_8110 copy [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] COPY: onnx::Concat_8067 copy [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3917 + Relu_3918 [02/07/2023-12:35:34] [I] [TRT] [GpuLayer] CONVOLUTION: Conv_3919 [02/07/2023-12:35:37] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +534, GPU +738, now: CPU 1511, GPU 5830 (MiB) [02/07/2023-12:35:38] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +83, GPU +124, now: CPU 1594, GPU 5954 (MiB) [02/07/2023-12:35:38] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored. [02/07/2023-12:57:58] [W] [TRT] Tactic Device request: 62648MB Available: 21952MB. Device memory is insufficient to use tactic. [02/07/2023-12:57:58] [W] [TRT] Skipping tactic 0 due to insufficient memory on requested size of 62648 detected for tactic 0x0000000000000018. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-12:57:59] [W] [TRT] Tactic Device request: 62648MB Available: 21952MB. Device memory is insufficient to use tactic. [02/07/2023-12:57:59] [W] [TRT] Skipping tactic 1 due to insufficient memory on requested size of 62648 detected for tactic 0x0000000000000019. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-12:57:59] [W] [TRT] Tactic Device request: 62648MB Available: 21952MB. Device memory is insufficient to use tactic. [02/07/2023-12:57:59] [W] [TRT] Skipping tactic 2 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001a. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-12:57:59] [W] [TRT] Tactic Device request: 62648MB Available: 21952MB. Device memory is insufficient to use tactic. [02/07/2023-12:57:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001b. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-12:58:00] [W] [TRT] Tactic Device request: 62648MB Available: 21952MB. Device memory is insufficient to use tactic. [02/07/2023-12:58:00] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001f. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:14:59] [W] [TRT] Tactic Device request: 62648MB Available: 21942MB. Device memory is insufficient to use tactic. [02/07/2023-13:14:59] [W] [TRT] Skipping tactic 0 due to insufficient memory on requested size of 62648 detected for tactic 0x0000000000000018. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:14:59] [W] [TRT] Tactic Device request: 62648MB Available: 21942MB. Device memory is insufficient to use tactic. [02/07/2023-13:14:59] [W] [TRT] Skipping tactic 1 due to insufficient memory on requested size of 62648 detected for tactic 0x0000000000000019. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:14:59] [W] [TRT] Tactic Device request: 62648MB Available: 21942MB. Device memory is insufficient to use tactic. [02/07/2023-13:14:59] [W] [TRT] Skipping tactic 2 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001a. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:14:59] [W] [TRT] Tactic Device request: 62648MB Available: 21942MB. Device memory is insufficient to use tactic. [02/07/2023-13:14:59] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001b. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:14:59] [W] [TRT] Tactic Device request: 62648MB Available: 21942MB. Device memory is insufficient to use tactic. [02/07/2023-13:14:59] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001f. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:15:05] [W] [TRT] Tactic Device request: 62648MB Available: 21940MB. Device memory is insufficient to use tactic. [02/07/2023-13:15:05] [W] [TRT] Skipping tactic 0 due to insufficient memory on requested size of 62648 detected for tactic 0x0000000000000018. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:15:05] [W] [TRT] Tactic Device request: 62648MB Available: 21940MB. Device memory is insufficient to use tactic. [02/07/2023-13:15:05] [W] [TRT] Skipping tactic 1 due to insufficient memory on requested size of 62648 detected for tactic 0x0000000000000019. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:15:05] [W] [TRT] Tactic Device request: 62648MB Available: 21940MB. Device memory is insufficient to use tactic. [02/07/2023-13:15:05] [W] [TRT] Skipping tactic 2 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001a. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:15:05] [W] [TRT] Tactic Device request: 62648MB Available: 21940MB. Device memory is insufficient to use tactic. [02/07/2023-13:15:05] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001b. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:15:05] [W] [TRT] Tactic Device request: 62648MB Available: 21940MB. Device memory is insufficient to use tactic. [02/07/2023-13:15:05] [W] [TRT] Skipping tactic 4 due to insufficient memory on requested size of 62648 detected for tactic 0x000000000000001f. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:31:03] [W] [TRT] Tactic Device request: 23001MB Available: 21920MB. Device memory is insufficient to use tactic. [02/07/2023-13:31:03] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 23001 detected for tactic 0x0000000000000004. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:31:04] [W] [TRT] Tactic Device request: 23001MB Available: 21918MB. Device memory is insufficient to use tactic. [02/07/2023-13:31:04] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 23001 detected for tactic 0x000000000000003c. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:31:06] [W] [TRT] Tactic Device request: 23001MB Available: 21918MB. Device memory is insufficient to use tactic. [02/07/2023-13:31:06] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 23001 detected for tactic 0x0000000000000074. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:35:54] [W] [TRT] Tactic Device request: 23901MB Available: 21917MB. Device memory is insufficient to use tactic. [02/07/2023-13:35:54] [W] [TRT] Skipping tactic 3 due to insufficient memory on requested size of 23901 detected for tactic 0x0000000000000004. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:35:55] [W] [TRT] Tactic Device request: 23901MB Available: 21918MB. Device memory is insufficient to use tactic. [02/07/2023-13:35:55] [W] [TRT] Skipping tactic 8 due to insufficient memory on requested size of 23901 detected for tactic 0x000000000000003c. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:35:57] [W] [TRT] Tactic Device request: 23901MB Available: 21918MB. Device memory is insufficient to use tactic. [02/07/2023-13:35:57] [W] [TRT] Skipping tactic 13 due to insufficient memory on requested size of 23901 detected for tactic 0x0000000000000074. Try decreasing the workspace size with IBuilderConfig::setMemoryPoolLimit(). [02/07/2023-13:55:00] [I] [TRT] [GraphReduction] The approximate region cut reduction algorithm is called. [02/07/2023-13:55:00] [I] [TRT] Total Activation Memory: 107204442112 [02/07/2023-13:55:00] [I] [TRT] Detected 1 inputs and 1 output network tensors. [02/07/2023-13:55:01] [I] [TRT] Total Host Persistent Memory: 1283184 [02/07/2023-13:55:01] [I] [TRT] Total Device Persistent Memory: 777728 [02/07/2023-13:55:01] [I] [TRT] Total Scratch Memory: 398131200 [02/07/2023-13:55:01] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 162 MiB, GPU 15662 MiB [02/07/2023-13:55:01] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 2984 steps to complete. [02/07/2023-13:55:02] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 583.585ms to assign 10 blocks to 2984 nodes requiring 3475799552 bytes. [02/07/2023-13:55:02] [I] [TRT] Total Activation Memory: 3475799552 [02/07/2023-13:55:02] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +5, now: CPU 1959, GPU 10480 (MiB) [02/07/2023-13:55:02] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +9, now: CPU 1960, GPU 10489 (MiB) [02/07/2023-13:55:02] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +141, GPU +256, now: CPU 141, GPU 256 (MiB) [02/07/2023-13:55:02] [I] Engine built in 4865.61 sec. [02/07/2023-13:55:03] [I] [TRT] Loaded engine size: 249 MiB [02/07/2023-13:55:03] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +10, now: CPU 1509, GPU 10474 (MiB) [02/07/2023-13:55:03] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +9, now: CPU 1509, GPU 10483 (MiB) [02/07/2023-13:55:03] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +245, now: CPU 0, GPU 245 (MiB) [02/07/2023-13:55:03] [I] Engine deserialized in 0.134754 sec. [02/07/2023-13:55:03] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +4, now: CPU 1510, GPU 10474 (MiB) [02/07/2023-13:55:03] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +10, now: CPU 1510, GPU 10484 (MiB) [02/07/2023-13:55:03] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +2, GPU +3315, now: CPU 2, GPU 3560 (MiB) [02/07/2023-13:55:03] [I] Setting persistentCacheLimit to 0 bytes. [02/07/2023-13:55:03] [I] Using random values for input input.1 [02/07/2023-13:55:04] [I] Created input binding for input.1 with dimensions 1x3x1920x1080 [02/07/2023-13:55:04] [I] Using random values for output 8158 [02/07/2023-13:55:04] [I] Created output binding for 8158 with dimensions 1x35x480x270 [02/07/2023-13:55:04] [I] Starting inference [02/07/2023-13:55:16] [I] Warmup completed 1 queries over 200 ms [02/07/2023-13:55:16] [I] Timing trace has 10 queries over 11.3154 s [02/07/2023-13:55:16] [I] [02/07/2023-13:55:16] [I] === Trace details === [02/07/2023-13:55:16] [I] Trace averages of 10 runs: [02/07/2023-13:55:16] [I] Average on 10 runs - GPU latency: 1091.47 ms - Host latency: 1093.53 ms (enqueue 1091.33 ms) [02/07/2023-13:55:16] [I] [02/07/2023-13:55:16] [I] === Performance summary === [02/07/2023-13:55:16] [I] Throughput: 0.88375 qps [02/07/2023-13:55:16] [I] Latency: min = 1086.71 ms, max = 1101.74 ms, mean = 1093.53 ms, median = 1094.1 ms, percentile(90%) = 1100.69 ms, percentile(95%) = 1101.74 ms, percentile(99%) = 1101.74 ms [02/07/2023-13:55:16] [I] Enqueue Time: min = 1064.49 ms, max = 1121.93 ms, mean = 1091.33 ms, median = 1097.73 ms, percentile(90%) = 1112.24 ms, percentile(95%) = 1121.93 ms, percentile(99%) = 1121.93 ms [02/07/2023-13:55:16] [I] H2D Latency: min = 1.37402 ms, max = 2.06885 ms, mean = 1.45896 ms, median = 1.39221 ms, percentile(90%) = 1.41406 ms, percentile(95%) = 2.06885 ms, percentile(99%) = 2.06885 ms [02/07/2023-13:55:16] [I] GPU Compute Time: min = 1084.73 ms, max = 1099.76 ms, mean = 1091.47 ms, median = 1092.13 ms, percentile(90%) = 1098.71 ms, percentile(95%) = 1099.76 ms, percentile(99%) = 1099.76 ms [02/07/2023-13:55:16] [I] D2H Latency: min = 0.509766 ms, max = 0.609131 ms, mean = 0.596387 ms, median = 0.605713 ms, percentile(90%) = 0.608398 ms, percentile(95%) = 0.609131 ms, percentile(99%) = 0.609131 ms [02/07/2023-13:55:16] [I] Total Host Walltime: 11.3154 s [02/07/2023-13:55:16] [I] Total GPU Compute Time: 10.9147 s [02/07/2023-13:55:16] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized. [02/07/2023-13:55:16] [W] If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput. [02/07/2023-13:55:16] [I] Explanations of the performance metrics are printed in the verbose logs. [02/07/2023-13:55:16] [I] &&&& PASSED TensorRT.trtexec [TensorRT v8502] # /usr/src/tensorrt/bin/trtexec --onnx=./sidewalk3.onnx